Web crawler
Software automatically visiting web addresses and inspecting resources. A crawl does not by itself mean indexing or inclusion in results.
Sources and review
Reviewed:
Software automatically visiting web addresses and inspecting resources. A crawl does not by itself mean indexing or inclusion in results.
Reviewed: