HomeTechnology & Gadgets

Googlebot will crawl and index the first 15MB of content per page

Googlebot will crawl and index the first 15MB of content per page

Google has updated its help document on Googlebot to specify that Googlebot will crawl up to the first 15MB of t

3 Content Marketing Strategies to Support SEO Success
4 steps to content marketing that will help you rank higher on Google
Why does good content cost so much money

This post may contain affiliate links, which means that I may earn a commission if you click on the link & sign-up or make a purchase. You will NOT be charged extra for using the link, but it goes a long way in supporting this blog. I only recommend products or services that I have personally used or believe will add value to my readers.

Google has updated its help document on Googlebot to specify that Googlebot will crawl up to the first 15MB of the page and then stop. So if you want to ensure that Google ranks your page appropriately, make sure Googlebot can crawl and index that part of the page within the first 15MB.

What is new. In the Googlebot help document, Google added this section that reads:

Googlebot can crawl the first 15MB of content in an HTML file or supported text-based file. After the first 15MB of the file, Googlebot stops crawling and only considers the first 15MB of content for indexing.

Why we care. In general, you probably want to keep your pages pretty light for both users and search engine crawlers. But here Google is being very clear about how much Googlebot will consume from your page.

A good way to test this is to use the URL Inspection tool in Google Search Console and see what parts of the page Google renders and sees within the debugging tool.


New on Search Engine Land

About The Author

Barry Schwartz a Contributing Editor to Search Engine Land and a member of the programming team for SMX events. He owns RustyBrick, a NY based web consulting firm. He also runs Search Engine Roundtable, a popular search blog on very advanced SEM topics. Barry can be followed on Twitter here.

COMMENTS

WORDPRESS: 0
    error: Content is protected !!