fixed bugs in #sportstechjobs crawler for job lever

fix site errors #keylogs

fixed crawler for #teacherjobs

getting crawled at weegee.ch - by aggressive crawlers which brought the site down. Gonna do the simplest thing by blocking the IPs. As a crawler myself I know that this usually causes enough troubles to stop a crawler.

recrawl site #rewardsflights

fix 500 errors #zap

fixed bug in cron crawler job #sportstechjobs

fix remoteok 1,107,634x 404 errors in Google Console

fix search console errors #cappr

check 404 errors in google console

add 504 to error report exceptions beause Goog.io API is full of errors #nomads

fix google search console #makerstories

fix #remoteok sitemap by asking ChatGPT to rewrite sitemap script

bug #162 crawl timeout problem on some sites #apercite

fixed bug in sitemap #sportstechjobs