• Want to receive the latest contracting news and advice straight to your inbox? Sign up to the ContractorUK newsletter here. Every sign up will also be entered into a draw to WIN £100 Amazon vouchers!

robots.txt

NotAllThere

Permie Swiss
Moderator
Joined
Aug 27, 2007
Messages
28,185
Likes received
8,675
Thanks received
2,403
Location
Far away from HMRC
I'm not sure where it's coming from, but robots.txt keeps being downloaded onto my laptop. Currently at robots(14).txt...

It contains:
Code:
# https://www.robotstxt.org/robotstxt.html
User-agent: *
Disallow:

Any ideas what's going on?
 

Advertisers

Back
Top