Back
Similar todos
Load previous page…
Start work on first scraper 
#plumberjobs
more scraper-proxy work (up to 31 deploys this month) and worked on selector logic and automation.
Prepare scrapers code for batches and pagination 
#mrscraper
Fixed proxies/database issues for Google serp scraping, benchmarking right now and refining 
#seolabs
late night hacking on a scraper project and mostly getting the UI updated
working with Pandas (Python) to update a few existing scrapers. It's really, really nice but I ran into a bug trying to pull URLs that I don't want to think about right now.
updated scraper logic to fix tags and author information along with some easy to update tests to make this much easier to find/fix next time around
refactored a scraper app to use django-q more effectively
overhauled another scraper/processor with much better tests and fixed several non-obvious bugs. I should have written tested upfront.
🔨 update celery scraper tasks to be Django friendly
Fix some scrapers on 
#vietnamdevs
Fix movies scraper because data format changed overnight 
#life
📝 Updates CFP scraper over lunch 
#conf
fix a few scrapers for 
#devopsprojectshq
refactored a scraping library to clean the bulk arguments that are passed to it
some data scraping and analysis 
#life