search engines and click.php

tango3d posted 2nd of August 2008 in Community Voice. 5 comments.

In google webmaster tools I am getting Url's not followed because of empty redirect, they all look similar this If anyone knows how to fix this problem or what is causing it I would be very grateful for any advice.

Please login to post a comment.
have you tried to call up each of those files that are not redirecting as they should be? copy the url that is presenting the problem and track it down. it could be that you may have to edit your htaccess mod_rewrite, or you could write a robots.txt file and do a no-follow on those files if they are not a part of what needs to be indexed.

Hi DosDawg thanks for your input, I didn't know that you could do a no-follow on a single file, I thought it was just on directories only like Disallow: /cgi-bin/ so as the file "click.php" is in the root directory, how can I just disallow that file without the others. sorry to sound a bit thick but I'm not very familiar with this stuff.

do you have that in the head of the html of the page, have you got a robots.txt file?

User-agent: *
Disallow: /
this in the robots.txt file would also stop pages being indexed, in this case the whole root from all robots

User-agent: *
Disallow: /admin

would only disallow the admin folder

User-agent: *
Disallow: /greet.php

would disallow the greet.php from being indexed
Hey Sammie, thanks for that thats what I needed to know. yes I do have robots.txt so I will edit it, thanks again for your help.
Not all robots follow these rules but at least most of the more popular and legit do. You will still most likely get a few bad hits on it, and about the only other thing you can do is add:
if ( !( $logged['admin'] = member_auth( 1, false ) ) )
if ( !( $logged['member'] = member_auth( 0, true ) ) )
if ( !( $logged['aff'] = member_auth( 2, false )) )
$logged['moderator'] = member_auth( 3, false );

Which prevents a nonmember from using the page, but since it already has:
$logged['member'] see more = member_auth(0, false);

You could try:$logged['member'] = member_auth(0, true);

Which will block non member access too.

Something to play with anyway. And your valid members could still abuse it, but it would most likely cut it down considerably.
Below is the legacy version of the Boonex site, maintained for Dolphin.Pro 7.x support.
The new Dolphin solution is powered by UNA Community Management System.