Identification of the Pompos Internet robot. These include owner, description, HTTP user agent and whether this robot adheres to the robot exclusion standard.
| Owner |
dir.com |
| Country |
France |
| Description |
Pompos is a web crawler. Its job is to collect documents for the dir.com search engine. |
| IP Addresses |
212.27.33.160 212.27.33.161 212.27.33.162 212.27.33.163 212.27.33.164 212.27.33.165 212.27.33.166 212.27.33.167 212.27.33.168 212.27.33.169 212.27.41.11 212.27.41.14 212.27.41.22 212.27.41.26 212.27.41.34
|
| HTTP User Agent |
pompos/1.3 http://dir.com/pompos.html |
| Exclusion |
This robot supports the robots.txt exclusion standard, which is described at http://www.robotstxt.org/wc/exclusion.html#robotstxt. To stop the robot from visiting the /cgi-bin directory:
User-agent: pompos Disallow: /cgi-bin/ |
| Further Info. |
dir.com/pompos.html |
NAT August 2005 (Revised)
| |
This article viewed: 1675 times |
Back |
Copyright © 2004-2009 Janet Systems Ltd.