Back
Similar todos
more playwright dabbling and working on another scraper
🤖 worked on old scraping project and making playwright act like a real person
rewrote one of the running website scrapers to use playwright so that the JS bits get rendered
🚀 figured out how to run Playwright in docker as a worker tasks so that I can schedule smarter page scrapes without being blocked #servers
playing with playwright
🤖 upgraded a few bots to the use the latest Playwright version
worked on how to test/keep a scraping project updated more easily
working on some scraping for data analysis #linkhandy
models and test for small scraper #work
Created a feature to share scrapers (with others and support) #mrscraper
build more scrapers #pagesonpages
finished out my day updating scraper-proxy to support css and xpath selectors along with a few features I haven't seen anyone do yet.
relaunched the scraping machine #thecompaniesapi
used playwright to automate screenshots which was super fast
make new scraper and test it #plumberjobs
write first prototype automated web scraper #pagesonpages
add several scrapers and content script detectors #pagesonpages
new scrapers for #sportsjobs
dusted off my scraper project and shared it with a few machines