Back
Similar todos
finally finished scraper and data looks good. a few hard refactors but I have a pretty good handle on spatula now.
overhauled another scraper/processor with much better tests and fixed several non-obvious bugs. I should have written tested upfront.
continue work on scrapers #pagesonpages
more scrapper work. I filed a few issues on GH, those were fixed, and now I'm refactoring so that everything meshes together
make new scraper and test it #plumberjobs
continued automating parts of the scraper. I'm now very close to almost 100% hands off.
re-worked one of my job scrapers and trying to decide if I should keep it or keep moving forward on it
Rewrote scraper. Second attempt is always significantly better than the first one.
Figuring out backup scrapers...
Made progress on second scraper but not finished which is annoying.
finished out my day updating scraper-proxy to support css and xpath selectors along with a few features I haven't seen anyone do yet.
working with Pandas (Python) to update a few existing scrapers. It's really, really nice but I ran into a bug trying to pull URLs that I don't want to think about right now.
fix a few scrapers for #devopsprojectshq
late night hacking on a scraper project and mostly getting the UI updated
worked on how to test/keep a scraping project updated more easily
worked on a scraper service tonight to update it for a few common area layouts and the general collection system