Back
Similar todos
Load previous page…
re-worked one of my job scrapers and trying to decide if I should keep it or keep moving forward on it
continue work on scrapers 
#pagesonpages
Wrote about the difference between Playwright and Puppeteer (puppeteer.guide/posts/puppete…) for 
#puppeteerguide
Rewrote scraper. Second attempt is always significantly better than the first one.
🤖 wrote a few automated bots using Playwright's codegen tool to spit out Python scripts for me. playwright.dev/docs/cli/#gene…
refactor wikipedia scrapper so the script stop at the end
worked on two new 
#jobs scrapers using RSS
overhauled another scraper/processor with much better tests and fixed several non-obvious bugs. I should have written tested upfront.
make new scraper and test it 
#plumberjobs
Make the website to redeploy after the scraper finishes working 
#domainwatchman
wrote a job scraper because why not?
Add basic website scraper as a test 
#foxquery
Successfully moved scraper from reading json from the puppeteer output to getting a POST request after the process is done! 💪 (less problems with messy output :S) 
#bagsoup
✏ more work on new scraper to get more events 
#conf
worked on a scraper service tonight to update it for a few common area layouts and the general collection system
fix scraping script for 
#devopsprojectshq it was giving out some nonsense data