Back
Similar todos
Load previous page…
Discover I might have accidentally blocked Google from indexing parts of my site 
#startupjobs h/t @AndreyAzimov
be DDOS by Googlebot, site works unstable 
#vietnamdevs
GA IP anonymization on maketheweb.pl
fixed bug in 
#sportstechjobs crawler
fixed bug in crawler #sportstechjobs
fixed bug in #sportstechjobs crawler
fixed bug in #sportstechjobs crawler
fixed bug in #sportstechjobs crawler
improve crawler logic to better navigate websites #joopie
changed crawler so i can keep css from workdays #sportstechjobs
Add very simple crawling logic 
#foxquery
Block Bright edge bot from hammering my site 
#rubyonremote