.Google's Gary Illyes reveals Googlebot gathers hyperlinks instead of "following" all of them, contradicting main documents.Googlebot accumulates hyperlinks instead of observing them in real-time.Gary Illyes discussed this relevant information in Google.com's 'Look Off The File' podcast.Google.com's documentation opposes the actual crawler habits.