Back
Similar todos
Load previous page…
Prepare scrapers code for batches and pagination 
#mrscraper
Fixed proxies/database issues for Google serp scraping, benchmarking right now and refining 
#seolabs
late night hacking on a scraper project and mostly getting the UI updated
working with Pandas (Python) to update a few existing scrapers. It's really, really nice but I ran into a bug trying to pull URLs that I don't want to think about right now.
updated scraper logic to fix tags and author information along with some easy to update tests to make this much easier to find/fix next time around
refactored a scraper app to use django-q more effectively
overhauled another scraper/processor with much better tests and fixed several non-obvious bugs. I should have written tested upfront.
🔨 update celery scraper tasks to be Django friendly
Fix movies scraper because data format changed overnight 
#life
📝 Updates CFP scraper over lunch 
#conf
fix a few scrapers for 
#devopsprojectshq
refactored a scraping library to clean the bulk arguments that are passed to it
pulled in a new csv scraper data for 
#daysuntillatenight
🚜 refactored core events and place scraper to be in its own core app
re-worked one of my job scrapers and trying to decide if I should keep it or keep moving forward on it
🔨 Fixed stayinghomeclub scraper which changed due to growth #conf