Back
Similar todos
improve crawler logic to better navigate websites #joopie
setup queue service for crawler and start sending data to it #joopie
get crawler returning accurate results for job boards! #joopie
get crawler working with html based structured data #joopie
get crawler working with iframes #joopie
reimplement core crawler in nodejs and puppetteer for javascript rendering #joopie
setup pipeline for website #joopie
get websites setup and running on new cluster #joopie
added new crawlers, need more jobs on site 
#woodyjobs
fixed workable crawler 
#sportstechjobs
fixed cron job for crawlers
much improvement, much simultanious pages such wow #joopie
built a crawler for workday jobs so i can get all sports jobs from companies using workdays for their job postings #sportstechjobs
make queue worker 
#interiorai
added cron jobs to crawler for 
#teacherjobs
fix multiple workers doing same job #interiorai
learn about webworkers for performance