Back
Similar todos
Load previous page…
finally finished scraper and data looks good. a few hard refactors but I have a pretty good handle on spatula now.
updated scraper logic to fix tags and author information along with some easy to update tests to make this much easier to find/fix next time around
Updated scraper and hand-curated jobs to 
#jobsinenglish
more scraper work and I finally figured out how to work around a few issues I couldn't quite wrap my brain around.
Prepare scrapers code for batches and pagination 
#mrscraper
fixed a bug in one of my job scrapers
finished job scraper
working with Pandas (Python) to update a few existing scrapers. It's really, really nice but I ran into a bug trying to pull URLs that I don't want to think about right now.
add a new scraper for 
#devopsprojectshq
overhauled another scraper/processor with much better tests and fixed several non-obvious bugs. I should have written tested upfront.
Wrote down a plan for MrScraper v3 #mrscraper
more scraper-proxy work (up to 31 deploys this month) and worked on selector logic and automation.
add another scraper for the #devopsprojectshq
worked on a bunch of 
#djangocon updates late afternoon/tonight
more scrapper work. I filed a few issues on GH, those were fixed, and now I'm refactoring so that everything meshes together