Saturday, July 4, 2015

Google Crawl Limit Per Page: 10 Megabytes

Google's John Mueller said in a Google Hangout this morning on Google+ at the 31:25 mark that Google will crawl up to about 10 megabytes per page.

So if you have pages larger than 10 megabytes, make sure the content on the page is crawled within the 10 megabytes part.

Note, this number of how much Google crawls on a megabyte level with Google seems to continue to rise and rise over time.
John said:

There is obviously a limit to the size of the page that we can download. I think that is around 10 megabytes. So if you have your content within those 10 megabytes, then we will be able to recognize that and show that in search.

Here is the video:


Forum discussion at Google+.

No comments:

Post a Comment

Facebook Likes, Increase FB Likes Free