Back
Mahmoud Swehli
post a blog post and put it on hackernew #blog
setup queue service for crawler and start sending data to it #joopie
get crawler working with html based structured data #joopie
improve crawler logic to better navigate websites #joopie
get websites setup and running on new cluster #joopie
move services to new k8s cluster to take advantage of WIP AWS credits and improve the setup #sod
get crawler returning accurate results for job boards! #joopie
much improvement, much simultanious pages such wow #joopie
create worker pool to improve performence for crawlers #joopie
reimplement core crawler in nodejs and puppetteer for javascript rendering #joopie
get basic trees and nodes and distance calculations setup for career page finder #joopie
get back to working on it and setup the back office client auth and basic geo services #joopie
fix bugs in date time formatting #nowleave
get everything back up on new cluster on gcp #nowleave