Identification of the Tutorial Crawler Internet robot. These include owner, description, HTTP user agent and whether this robot adheres to the robot exclusion standard.
| Owner |
Tutorgig |
| Country |
USA |
| Description |
The aim of Tutorgig is to provide a search engine which is geared towards students and professionals looking for educational information on the Internet. |
| IP Addresses |
217.160.250.182 |
| HTTP User Agent |
Tutorial Crawler 1.4 (http://www.tutorgig.com/crawler)
TutorGigBot/1.5 ( +http://www.tutorgig.info ) |
| Exclusion |
This robot supports the robots.txt exclusion standard, which is described at http://www.robotstxt.org/wc/exclusion.html#robotstxt. To stop the robot from visiting the /cgi-bin directory:
User-agent:
Disallow: /cgi-bin/ |
| Further Info. |
www.tutorgig.com/crawler/ |
NAT August 2005 (Revised)
| |
This article viewed: 1821 times |
Back |
Copyright © 2004-2009 Janet Systems Ltd.