Back
Similar todos
more playwright dabbling and working on another scraper
🤖 worked on old scraping project and making playwright act like a real person
🚀 figured out how to run Playwright in docker as a worker tasks so that I can schedule smarter page scrapes without being blocked #servers
explored Playwright's devices feature and added model support for a scraping project
used playwright to automate screenshots which was super fast
Moved playwright functions from vercel to a 5$ node.js server so I can sleep better at night
worked on job website tests on one of the scrapers
🤖 upgraded a few bots to the use the latest Playwright version
playing with playwright
worked on how to test/keep a scraping project updated more easily
write first prototype automated web scraper #pagesonpages
watched web scraping node js tuts to improve my crawlers
finished out my day updating scraper-proxy to support css and xpath selectors along with a few features I haven't seen anyone do yet.
⬆️ upgraded the running website and looked at refreshing data scrapers that pull in race info
reimplement core crawler in nodejs and puppetteer for javascript rendering #joopie
late night hacking on a scraper project and mostly getting the UI updated
refactored racing website scraper to feed from the database