Back
Similar todos
check that sitemap is working 
#zap
fix problems of bot scraping single page apps www.netlify.com/docs/prerende…
Check the accessibility of individual pages and api when not logged in 
#modelchimp
cleanup edit bot page for bot landing pages
make sure google bot can read faq 
#startupcrowns
validate broken pages on Search Console 
#freelancegig
Tried @philkellr's Noindex Checker tool (backl.io/blog/indexable) and found a few social media accounts for plugins.carrd.co to be not indexed 
#pluginsforcarrd
Add user agent check to filter bots 
#simpleanalytics
check that logged in user can preview unpublished chatbots 
#botreach
fix issue where facebook messenger was not able to access images uploaded on 
#crisp anymore due to robots.txt
check some stuff in ahrefs 
#japandev
ignore 404s from Ahrefs bot 
#wip
make stats page to track if the robots are doing their job 
#hotellist
update robots.txt, restrict stripe connect pages #invitemember
create robots.txt for seo score 
#barberhead
Prevent search engines from indexing #airbot