working on #ofwcrawl

added cd projekt to crawler #sportstechjobs

make a crawler for on-page stats #keylogs

updated crawler and sitemaps #sportstechjobs

added onrunning to #sportstechjobs crawler

updated scraper logic to fix tags and author information along with some easy to update tests to make this much easier to find/fix next time around

added gig-6 to #sportstechjobs crawler

write first prototype automated web scraper #pagesonpages