Spider

A spideri (also known as a wanderer or boti) is a type of program used to search the internet for new resources that are publicly accessible. Once it has accumulated this information it adds it to a database that can be searched by internet users via a search engine. Spiders are used by many of the popular search sites such as Google or Lycos.