# The robots.txt file is used to stop search engines from indexing certain paths. # in our case we allow anything to be indexed User-agent: * Disallow: