Crawl or Crawling

Using an automated program to index data on web pages so they can be returned in search results. They gather information about each page, such as meta tags and copy, then store the page in an index so search engines can find them later and rank for users.