# Specifications for robots: # A Disallow field with no value indicates, that all URLs # can be retrieved User-agent: * Disallow: User-agent: YoudaoBot Disallow: / User-agent: YodaoBot Disallow: /