create a sitemap & robots.txt #openalternative

noindex public. with robots.txt

fix #remoteok robots not running due to existence of PID files,, removed PID file check