Identify and Fix Crawlability and Indexability Issues
Google and other search engines must be able to crawl and index your webpages in order to rank them. Two important website files—robots.txt and sitemap.xml—that have a huge impact on how search engines discover your site.
Check for and Fix Robots.txt Issues
Robots.txt is a website text file that tells search engines which pages they should or shouldn’t crawl. It can usually be found in the root folder of the site: https://domain.com/robots.txt.
A robots.txt file helps you:
- Point search engine bots away from private folders
- Keep bots from overwhelming server resources
- Specify the location of your sitemap
Spot and Fix XML Sitemap Issues
An XML sitemap is a file that lists all the pages you want search engines to index—and, ideally, rank.
The Site Audit tool can detect common sitemap-related issues, such as:
- Incorrect pages in your sitemap
- Format errors in your sitemap
Audience Identification
Lorem ipsum dolor sit amet, consectetur adipiscing elit. Aliquam vel molestie diam. Duis ultricies vestibulum nisl. Etiam egestas nisi volutpat tellus varius, a congue nibh tempus. Vestibulum dictum, dolor non tincidunt varius, mi diam pretium nulla, vitae faucibus ante nulla id nunc.
Product Requirements
Lorem ipsum dolor sit amet, consectetur adipiscing elit. Aliquam vel molestie diam. Duis ultricies vestibulum nisl. Etiam egestas nisi volutpat tellus varius, a congue nibh tempus. Vestibulum dictum, dolor non tincidunt varius, mi diam pretium nulla, vitae faucibus ante nulla id nunc.
Market Viability
Lorem ipsum dolor sit amet, consectetur adipiscing elit. Aliquam vel molestie diam. Duis ultricies vestibulum nisl. Etiam egestas nisi volutpat tellus varius, a congue nibh tempus. Vestibulum dictum, dolor non tincidunt varius, mi diam pretium nulla, vitae faucibus ante nulla id nunc.
Product Launch
Lorem ipsum dolor sit amet, consectetur adipiscing elit. Aliquam vel molestie diam. Duis ultricies vestibulum nisl. Etiam egestas nisi volutpat tellus varius, a congue nibh tempus. Vestibulum dictum, dolor non tincidunt varius, mi diam pretium nulla, vitae faucibus ante nulla id nunc.
