Back
Similar todos
Fix movies scraper because it broke overnight
#life
Add ability to resume movies scraping in case it stops because of hard rate-limit
#life
Fix movies scraper after seeing some un-expected data
#life
Fix movies scraper because data format changed overnight
#life
Improve movies scraper to only scrape priority countries
#life
restrict number of concurrent scraping tasks a user can have
#infinityxml
better replication of erroneous scraping tasks
#infinityxml
move all scrapers and robots into cron jobs
deploy scrape cron job
Fix cronjobs that were failing
#ecommerce
Finally added a log of failing scrapings so I can take action and solve recurring problems
#bagsoup
relaunched the scraping machine
#thecompaniesapi