Web-crawler meaning

The definition of a web crawler is a computer program that systematically scans the Internet to collect copies of websites for a search engine to index, to automatically perform tasks on a website, or to perform a specific task like collecting email addresses for spam.

An example of a web crawler is a program used by Google to view websites and to provide current data for Google to use in keeping their searches updated.

noun
0
0
0
0
(Internet) Synonym of Web spider.
noun
0
0
Advertisement