Share this article
How to analyze your website's crawling on Google Webmasters is a post designed to help you understand this very important feature for the success of your Digital Strategy.
There are several relevant topics on Google Webmasters , which is truly a fantastic tool for those who really want to make money on the Internet . In this article, we list the most important topics to be successful in your online actions. As always, we consider it essential to analyze, interpret and act according to the best tools available.
How to Analyze Crawl – HTML Improvements
The HTML Improvements page shows potential issues that Google has found while crawling and indexing your site . It's a good idea to review this report regularly to identify changes macedonia telemarketing that could potentially improve your ranking in Google's search results pages while providing a better user experience.
These issues won’t prevent your site from being crawled and indexed , but paying attention to this data can improve the user experience and even help drive traffic to your site . For example, your meta description and title text can appear in search results pages (descriptive, helpful text is more likely to get more clicks).
banner-ebook-multimedia-contents
Data included in this analysis include:
– Title issues: Potential issues with the title tag on pages, such as missing or duplicate page titles.
– Meta description issues: Potential issues with missing, duplicate, and/or problematic meta descriptions.
– Non-indexable content: pages with non-indexable content, such as rich media files, videos, or images.
How to Analyze Tracking – Tracking Errors
The Crawl Errors page provides details about the URLs on your website that Google tried to index but couldn't access.
The crawl errors page also shows, in addition to the web tab that relates to the use of computers accessing the internet, errors related to mobile devices, providing details about problems encountered when indexing URLs on the website for mobile devices.
URL errors: This section lists errors that Googlebot encountered while trying to index specific URLs . In most cases, it specifically points out the error with the code 404.
The 404 error is an HTTP response code that indicates that the website was able to communicate with the server, but either the server could not find what was requested, or was configured to not fulfill the request and not reveal the reason, or that the page no longer exists. This 404 error should not be confused with other errors in which a connection to the target server could not be made.
In addition to listing all the URLs that had trouble getting indexed, Crawl Errors indicate the type of issue and, where possible, the page or pages where you encountered the error. The most important URLs appear first.
Once the issue that caused the error on a specific URL has been resolved, we can hide that URL from the list. Simply select the checkbox next to the URL, and then click Mark as resolved .
The URL will be removed from the list. (However, if the issue is not resolved, the URL will reappear in the list the next time Googlebot crawls it.)
RECOMMENDED ACTION: You can also generate an error report using the online optimization tool called GT Metrix – http://gtmetrix.com/ . The report will be available as a PDF file with the Webmasters – Tracking data. You can then use these webmasters and GT Metrix lists to optimize your website’s technical data.
How to Analyze Crawling – Blocked URLs
The “Blocked URLs” page lists URLs that Google is unable to crawl due to restrictions in your robots.txt file. You can generate your website’s robots.txt using a number of online tools, and then upload the same file to the FTP server that supports your website.
How to Analyze Tracking – Tracking Statistics
Crawl statistics provide information about Googlebot activity on your website over the past 90 days. These statistics take into account all types of content downloaded (such as CSS, JavaScript, Flash, PDF files, and images) .
They also include AdSense hits , as well as hits from some Google products , such as Google News and Google Images . Crawl statistics are only available for verified websites.