fix test robot test failing because added reCAPTCHA to #remoteok subscribe box (add exception for the robot now)

fix robot #beincrypto

#td add robots.txt