Why was only 15MB of content crawled during the May Google Core Algorithm roll-out?

Why was only 15MB of content crawled during the May Google Core Algorithm roll-out?

Originally, Google made an update to their Googlebot Help Document stating that it only “sees” the first 15 megabytes (MB) when looking at certain file types online. However, this is not a new procedure for Google, it has been in place for years, except now it is officially documented. The new documentation states that any content after the first 15 MB is dropped by Googlebot, and only the first 15 MB gets forwarded to indexing. Google has indicated that this likely does not mean anything for most web pages because there are not many pages on the internet bigger than 15 MB. As a rule of thumb, you want to keep your pages as light as possible so it has a faster load time and provides users and the Googlebot with a positive experience. This newly documented measurement will presumably not change. However, this shift alternatively continues to demonstrate the importance of putting your most important content, images, or videos at the top of your webpage to make certain they are crawled.
To read more about the May Google Core Algorithm roll-out, click here.