Posted on March 09, 2022 in Security • Tagged with API, Datacenter, Hosting, Cloud-Provider, IP API, Bot-Detection, VPN-Detection, IP-Intelligence, IP-Lookup • 8 min read
It is not entirely trivial to find out if an IP address belongs to a datacenter / cloud provider. In this blog article, I try to find an algorithm that outputs with high confidence if an IPv4 / Ipv6 address belongs to a hosting provider or not.
Posted on November 26, 2021 in Security • Tagged with proxy, proxy-detection, bot-detection, proxy-provider, anti-scraping • 8 min read
I (maybe) found another method to detect browsers that route their traffic through SOCKS/HTTP proxies. What do you think? Is this a valid method to detect Proxies? I need your help!
Posted on October 16, 2021 in Security • Tagged with proxy, proxy-detection, bot-detection, proxy-provider, anti-scraping • 14 min read
In this blog post, I demonstrate 7 different efficient ways how to detect a proxy server when the client is visiting a web server with a browser that has a proxy / VPN configured.
Posted on July 18, 2021 in Security • Tagged with Internet Bots, CAPTCHA, Bot Detection • 15 min read
There are unique challenges when developing a passive bot detecting system. In this blog article, I explain some of the obstacles that need to be overcome in order to detect advanced bots without presenting a CAPTCHA. I also explain how bot programmers can benefit from the architectural challenges that bot detection systems inherently suffer from.
Posted on June 05, 2021 in Security • Tagged with proxy-provider, bot-detection, anti-scraping • 10 min read
In this blog article I demonstrate several bullet-proof ways how to detect Brightdata Data Collector as a bot without any doubt.
Posted on April 11, 2021 in Security • Tagged with Behavioral Analysis, Bot Detection • 4 min read
Behavioral analysis is an interesting approach to detect bots. It surely is not the panacea for bot detection, but it certainly is an useful extension in your bot hunting tool belt.