Back
Similar todos
#thecompaniesapi finalize subpages & sitemap extraction, now our bot can filter out sitemap to only visit pages that contains interesting data for our schema
make sure google bot can read faq #startupcrowns
validate broken pages on Search Console #freelancegig
Tried @philkellr's Noindex Checker tool (backl.io/blog/indexable) and found a few social media accounts for plugins.carrd.co to be not indexed #pluginsforcarrd
check some stuff in ahrefs #japandev
ignore 404s from Ahrefs bot #wip
Some pages on #devopsprojectshq didn't get indexed until I specifically added them? Wondering why????
add robots.txt #freelancegig
#pn add robots.txt
#hw add robots.txt
add robots.txt #blip
Add Google URL Index Checker bot to #seobots