Notice to "Twiceler" crawler - Cuill.com

[Worker 11811]

Subject: Cease and Desist

From: [email protected]

Date: Mon, March 17, 2008 11:37 am

To: [email protected]

Priority: High

Read receipt: sent

 

This will serve as your legal notice to cease and desist all further

webcrawling and/or information gathering activities at

http://thefurden.com and all associated subdomains, URLs and IP address.

(68.178.172.67)

 

Your "Twiceler" robot has been disrupting the operation of our website for

several weeks. We have made three different requests via updates to our

"robots.txt" file to stop Twiceler from doing this. Even though you claim

your crawler reads our robots.txt file every 24-48 hours, compliance has

been spotty, at best.

 

Our last contact with you on Friday, March 14, 2008 stated that we would

contact you again if the situation did not improve within 48 hours. There

has been no change.

 

We can no longer tolerate such abuse.

 

Please block Twiceler from crawling any part of our website immediately.

 

We will be monitoring our server's log files for any activity from your

location. If we detect any activity, we will file abuse complaints with

Cogent Communications and XO Communications. If this action does not

produce results we will take further action as we believe necessary to

stop your activities.

 

We are sorry we have to take this action but we believe there is no other

solution.

 

Worker 11811

Administrator

 

http://thefurden.com

[Worker 11811]

Subject: Re: Cease and Desist

From: "James Akers"

Date: Tue, March 18, 2008 4:34 am

To: [email protected]

Priority: Normal

 

Dear Woker11811,

 

Twiceler is the crawler that we are developing for our new search

engine. It is important to us that it obey robots.txt, and that it not

crawl sites that do not wish to be crawled.

 

Recently we have seen a number of crawlers masquerading as Twiceler, so

please check that the IP address of the crawler in question is one of ours.

You can see our IP addresses at http://cuill.com/twiceler/robot.html

 

I believe this is the first email I have received from you. I will

add 68.178.172.67 to our list of IPs to exclude

and I apologize for any inconvenience this has caused you.

 

 

Sincerely,

 

 

James Akers

Operations Engineer

Cuill, Inc.