Posted on July 15, 2019 in Scraping • Tagged with puppeteer, web scraping, CSS selectors, XPath queries • 7 min read
I will shop an alternative approach to web scraping without using css selectors and XPath queries. We make use of the fact that most web pages visually render the information of interest in a coherent, structured way. This technique requires a remotely controllable web browser such as puppeteer, that is capable of rendering web pages visually.
Posted on March 01, 2019 in Scraping • Tagged with puppeteer, recatpcha, scraping • 5 min read
A captcha is a mechanism to distinguish human users from automated programs (bot). There are many service providers in the Internet that have a major incentive to prevent bots from (ab)using their systems.
Posted on February 22, 2019 in WPA3 • Tagged with WPA3, 802.11, hostapd, wpa_supplicant • 10 min read
Tutorial that shows how to run an WPA3 access point with hostapd 2.7 and SAE Dragonfly Handshake.
Posted on February 04, 2019 in Scraping • Tagged with puppeteer, scraping, modern • 4 min read
Modern scraping now is mostly done with real browsers, configured to behave like real humans.
Posted on January 02, 2019 in Tutorials • Tagged with music, tutorials, learning • 4 min read
Posted on December 24, 2018 in GoogleScraper • Tagged with discontinuation, GoogleScraper, scraping • 1 min read
Discontinuation of GoogleScraper in favor of https://www.npmjs.com/package/se-scraper