The process by which search engines discover and scan content on a website.