Crawling

The process of gathering information, using a crawler, from the billions of public webpages to update, add, and organize webpages in a search engine’s index.