Access your robots.txt file
Learn how to view your site’s automatically generated robots.txt file.
The robots.txt file tells search engines which pages on your site can be crawled and indexed. It plays an important role in search engine optimization by guiding bots on how to interact with your content.
Framer automatically generates a robots.txt file for every published site. To view your file:
Open your browser.
Add
/robots.txtto the end of your site’s domain.
Once loaded, you’ll see the live robots.txt file that search engines use to crawl your site.
What is the purpose of the robots.txt file in Framer?
The robots.txt file serves as a guide for web robots, indicating which web pages are suitable for indexing and which should be excluded. This file is essential for search engine optimization as it directs robots on how to interact with a website’s content.
Does Framer automatically generate a robots.txt file for my site?
Yes, Framer generates a robots.txt file automatically.
How can I view the robots.txt file for my Framer website?
To view this file, simply add /robots.txt to the end of your domain in the URL, such as mydomain.com/robots.txt. This allows search engine crawlers to navigate and index the relevant content on your website efficiently.
Updated