Access your robots.txt file
Learn how to view your site’s automatically generated robots.txt file
The robots.txt file tells search engines which pages they can crawl and index on your site.
Framer automatically generates a robots.txt file for every published site. You can access it directly from your browser.
Open your browser.
Enter your site’s domain followed by
/robots.txt(for example,example.com/robots.txt).Press Enter to load the file.
You’ll see the live robots.txt file that search engines use when crawling your site.
If you need a custom robots.txt file, you can upload one using Static Files. This is available on Pro, Scale, and Enterprise plans. When you upload a custom robots.txt, it replaces the automatically generated one.
FAQ
What does the robots.txt file do?
The
robots.txtfile gives instructions to search engine bots about which pages they can or cannot crawl. It helps manage how your site appears in search results and supports your SEO strategy.Does Framer create a robots.txt file automatically?
Yes, Framer generates a
robots.txtfile for every published site. If you upload a customrobots.txtvia Static Files, it will replace the default one.Can I edit the robots.txt file in Framer?
Yes. You can upload a custom
robots.txtfile using Static Files. Go to your project dashboard, select your domain, open the "Files" tab, and upload your file with the path set to/. This is available on Pro, Scale, and Enterprise plans.
Updated