How to find out if an IP address belongs to a Hosting / Cloud Provider?

Posted on March 09, 2022 in Security • Tagged with API, Datacenter, Hosting, Cloud-Provider, IP API, Bot-Detection, VPN-Detection, IP-Intelligence, IP-Lookup • 8 min read

It is not entirely trivial to find out if an IP address belongs to a datacenter / cloud provider. In this blog article, I try to find an algorithm that outputs with high confidence if an IPv4 / Ipv6 address belongs to a hosting provider or not.


Continue reading

Is this a valid method to detect Proxies?

Posted on November 26, 2021 in Security • Tagged with proxy, proxy-detection, bot-detection, proxy-provider, anti-scraping • 8 min read

I (maybe) found another method to detect browsers that route their traffic through SOCKS/HTTP proxies. What do you think? Is this a valid method to detect Proxies? I need your help!


Continue reading

7 different ways to detect Proxies

Posted on October 16, 2021 in Security • Tagged with proxy, proxy-detection, bot-detection, proxy-provider, anti-scraping • 14 min read

In this blog post, I demonstrate 7 different efficient ways how to detect a proxy server when the client is visiting a web server with a browser that has a proxy / VPN configured.


Continue reading

On the Architecture of Bot Detection Services

Posted on July 18, 2021 in Security • Tagged with Internet Bots, CAPTCHA, Bot Detection • 15 min read

There are unique challenges when developing a passive bot detecting system. In this blog article, I explain some of the obstacles that need to be overcome in order to detect advanced bots without presenting a CAPTCHA. I also explain how bot programmers can benefit from the architectural challenges that bot detection systems inherently suffer from.


Continue reading

Detecting Brightdata's (formerly Luminati Networks) Data Collector as a Bot

Posted on June 05, 2021 in Security • Tagged with proxy-provider, bot-detection, anti-scraping • 10 min read

In this blog article I demonstrate several bullet-proof ways how to detect Brightdata Data Collector as a bot without any doubt.


Continue reading

Behavioral Analysis for Bot Detection

Posted on April 11, 2021 in Security • Tagged with Behavioral Analysis, Bot Detection • 4 min read

Behavioral analysis is an interesting approach to detect bots. It surely is not the panacea for bot detection, but it certainly is an useful extension in your bot hunting tool belt.


Continue reading