Bots (the boring Google etc sort)

Visitors can check out the Forum FAQ by clicking this link. You have to register before you can post: click the REGISTER link above to proceed. To start viewing messages, select the forum that you want to visit from the selection below. View our Forum Privacy Policy.
Want to receive the latest contracting news and advice straight to your inbox? Sign up to the ContractorUK newsletter here. Every sign up will also be entered into a draw to WIN £100 Amazon vouchers!

You are not logged in or you do not have permission to access this page. This could be due to one of several reasons:

You are not logged in. If you are already registered, fill in the form below to log in, or follow the "Sign Up" link to register a new account.
You may not have sufficient privileges to access this page. Are you trying to edit someone else's post, access administrative features or some other privileged system?
If you are trying to post, the administrator may have disabled your account, or it may be awaiting activation.

AtW replied

21 December 2013, 19:55
Originally posted by Bunk View Post

The link to the cart on the Wordpress site might have rel="nofollow" on it so that search engines will ignore it.

rel="nofollow" was designed for user-submitted comments with links so that ranking does not pass to those sites.

Use robots.txt to disallow URLs that should not be crawled - The Web Robots Pages

Originally posted by Sockpuppet View Post

You could set a robots.txt to make sure they "good" bots don't index it.

They can still index it (show in searches thanks to anchor text and URL matches), but good bots should not crawl that URL.
Leave a comment:
Sockpuppet replied

21 December 2013, 19:36
You could set a robots.txt to make sure they "good" bots don't index it.
Leave a comment:
Bunk replied

21 December 2013, 14:44
The link to the cart on the Wordpress site might have rel="nofollow" on it so that search engines will ignore it. Or the cart might actually open using JavaScript which the bots won't be using so they can't visit it.
Leave a comment:
xoggoth started a topic Bots (the boring Google etc sort)

21 December 2013, 14:05
Bots (the boring Google etc sort)

At the mo. i've got a flag set in my new shopping cart to log all visitors so I could get a clue if summit not working. Get large number of visits from Google, MSN and lesser known bots, Russia, Germany, China, Ukraine etc.

Got similar on a cart on a Wordpress site set up by somebody else and it all seems to be working correctly if I or other interested parties visit but otherwise it gets no visits at all, not even by those bots. Anyone got a clue why this might be? Cheers.

Last edited by xoggoth; 21 December 2013, 14:14.
Tags: None