How Often Is Google Crawling My Website?

How Often Is Google Crawling My Website?

Watch this Booster Seat episode for more updates on this topic!

Having managed SEO for hundreds of websites, I’ve realized there are many reasons to ask: “How often is Google crawling my site?” When deciding how often to make changes, some website owners try to look at how frequently Google visits them. Others wonder whether Google has noticed their site and SEO efforts at all. This blog post resolves all your queries on the issue.

Finding the Crawl Stats for Your Website

You can find out how frequently Google crawls your site in Search Console. (Search Console is a free service available to every  Google account.) Once you’ve logged in, add a property to your account to check out your performance.

You should see something similar to the image below:

You’ll notice that Search Console only stores historical data for up to 90 days, but this should give you all the info you need to discover Google’s crawling habits as they relate to your site.

How Do I Get Google to Crawl My Site More Often?

There are a few ways to encourage Google to pay your website more frequent visits.

Server Connectivity and Page Load Time

If your website has connectivity errors (meaning Google is unable to access your site, either because the site is down or its servers are down), Google will stop coming to your site. Your rankings will plunge and, as a result, your traffic will be near zero.

This makes perfect sense – if Google can’t access your site for a long period of time, why should it keep sending bots? And why would Google want to send users your way?

Errors

You can check for errors by heading to “Sitemaps” in the side bar. In the case of this website, the last read was a success.

Google can also show you if the site has any mobile usability issues. Again, we see zero errors.

Frequent Site Changes

If you’re constantly adding new material to your website, Google won’t want to stay away. Bots will want to see everything new that you post to keep your site fully indexed. Adding fresh content to your site is the easiest way to entice Google to come back often.

Frequently updating a news site makes sense, but small and midsize businesses may have a tougher time coming up with ways to generate new content. The addition of a blog gives you the perfect platform for adding new material as often as you want. You can blog about anything, including replacement parts for hydraulic equipment (speaking from experience).

Sitemaps

Sitemaps do more than show Google what pages you have on your site. They also tell Google how frequently you update your content and, therefore, how frequently Google should come back and crawl your site.

There is a debate about how much influence sitemaps actually have. It is possible that Google ignores sitemaps, paying more attention to your habits than your stated intentions. Nevertheless, Googlebots do read sitemaps, meaning if your habits and intentions aren’t too dissimilar, a sitemap could give you some extra influence. Most sitemap generators will not only let you create a sitemap for free, they also have entry fields for how frequently you plan to change or add content to your site.

Inbound Links

Links from other places leading to your website are great for getting Google to notice you. When Google sees that others are sharing your content, the search engine will take notice. However, you do need to become careful when implementing a link building strategy. If you use black hat tactics, Google may penalize your site.

Read more about Search Console and the importance of content in some of our other blog posts designed to help you rock the SEO world. Need help making sure your website is reaching its full potential? Our online marketing consultants can provide you with the answers for free!

This post was originally published April 2015 and has been updated to reflect current information and processes.

Laura Holton
[email protected]

Utilizing her knowledge of SEO and inbound marketing practices, Laura has gained significant attention for her articles and blog posts. Writing on a range of B2B topics, she helps entrepreneurs take their businesses to the next level, provides inspiration, and solves the most pressing problems small businesses face.