Scraping 1 million keywords on the Google Search Engine

Posted on in Scraping • Tagged with puppeteer, web scraping, headless chrome, 1 million, queue, architecture

Scraping one million keywords is not a easy task. There are proxy problems, big data problems and reliability issues. In this blog post, the most valuable insights are shared.


Continue reading

Scraping with puppeteer and headless chrome deployed to AWS Lambda

Posted on in Scraping • Tagged with puppeteer, web scraping, AWS lambda, headless chrome

In this blog post, we demonstrate how a web scraping function is deployed to the AWS cloud with puppeteer and headless chrome.


Continue reading

Fuzzing the WPA3 Dragonfly handshake

Posted on in Security • Tagged with wpa3, SAE, Dragonfly, fuzzing

Implementing possible fuzzing strategies with boofuzz against the WPA3 SAE Dragonfly handshake. Dragonfly is the main ingredient of WPA3 certified routers and 802.11 devices.


Continue reading

Struktur: A completely new approach to web scraping

Posted on in Scraping • Tagged with puppeteer, web scraping, CSS selectors, XPath queries

I will shop an alternative approach to web scraping without using css selectors and XPath queries. We make use of the fact that most web pages visually render the information of interest in a coherent, structured way. This technique requires a remotely controllable web browser such as puppeteer, that is capable of rendering web pages visually.


Continue reading

Breaking Google's Recaptcha

Posted on in Scraping • Tagged with puppeteer, recatpcha, scraping

A captcha is a mechanism to distinguish human users from automated programs (bot). There are many service providers in the Internet that have a major incentive to prevent bots from (ab)using their systems.


Continue reading

Running a WPA3 access point with hostapd 2.7 and SAE/Dragonfly

Posted on in Tutorials, WPA3, 802.11 • Tagged with WPA3, 802.11, hostapd, wpa_supplicant

Tutorial that shows how to run an WPA3 access point with hostapd 2.7 and SAE Dragonfly Handshake.


Continue reading