spacer
Janet Systems DotNetNuke Websites, Hosting, Custom Servers
Tag Words
spacer
Web Robot Articles

Identification of the Pompos Internet robot. These include owner, description, HTTP user agent and whether this robot adheres to the robot exclusion standard.

Owner dir.com
Country France
Description Pompos is a web crawler. Its job is to collect documents for the dir.com search engine.
IP Addresses 212.27.33.160
212.27.33.161
212.27.33.162
212.27.33.163
212.27.33.164
212.27.33.165
212.27.33.166
212.27.33.167
212.27.33.168
212.27.33.169
212.27.41.11
212.27.41.14
212.27.41.22
212.27.41.26
212.27.41.34
HTTP User Agent pompos/1.3 http://dir.com/pompos.html
Exclusion This robot supports the robots.txt exclusion standard, which is described at http://www.robotstxt.org/wc/exclusion.html#robotstxt. To stop the robot from visiting the /cgi-bin directory:

User-agent: pompos
Disallow: /cgi-bin/

Further Info. dir.com/pompos.html

NAT August 2005 (Revised)

  This article viewed: 1675 times Back

Copyright © 2004-2009 Janet Systems Ltd.

    spacer
    Print