Project

General

Profile

Actions
Copy link

Support #1447

closed

Google bot

Added by Anonymous about 12 years ago. Updated about 12 years ago.

Status:
Closed
Priority:
Normal
Assignee:
-
Target version:
3.2.3
Start date:
10/02/2012
Due date:
% Done:

0%

Estimated time:

Description

I've developed a number of web services under wt, and have deployed them via apache2/fastcgi. Unfortunately, I find that the main user of these web services is Google. I'm sure I must not be the only user who has encountered this issue. Is there a method in Wt to block Google from repeatedly running these services?

Actions
Copy link
 #1

Updated by Koen Deforche about 12 years ago

  • Status changed from New to Resolved

Hey,

If you want to avoid bots from accessing your web services, you need to deploy a robots.txt file.

See http://www.robotstxt.org/

Regards,

koen

Actions
Copy link
 #2

Updated by Koen Deforche about 12 years ago

  • Status changed from Resolved to Closed
  • Target version set to 3.2.3

Fixed in Wt 3.2.3 RC1.

Actions
Copy link

Also available in: Atom PDF