Back
Similar todos
Load previous page…
Started implementing Google searches to a tool 
#shipit
make Google scraper robot to get hotel ratings 
#hotellist
Fix some scrapers on 
#vietnamdevs
build more scrapers 
#pagesonpages
new scrapers for 
#sportsjobs
finished out my day updating scraper-proxy to support css and xpath selectors along with a few features I haven't seen anyone do yet.
Add basic enrichment through scraping SERPs 
#nichewit
Wtf happened at google? My scrapers got like 150 jobs in one day?
hit google programmatic search engine daily limit of 10K queries / day much too quickly while developing
worked on how to test/keep a scraping project updated more easily
Request indexing from google for newly deployed site #pagesonpages
Fix the web scraper for 
#copycopter
more scraper-proxy work (up to 31 deploys this month) and worked on selector logic and automation.
Figuring out backup scrapers...