You are here:  » msn indexing all my jump.php pages


msn indexing all my jump.php pages

Submitted by Julian on Tue, 2006-08-01 09:07 in

at the moment msn seems to be mainly indexing all my jump pages - is there a way to stop this or does it not matter?

Submitted by support on Tue, 2006-08-01 11:11

Hi Julian,

It doesn't really matter; but in any case I would use robots.txt to prevent it from being indexed. You might want to look at my Price Tapestry demo site robots.txt for other ideas...

http://www.webpricecheck.co.uk/robots.txt

Cheers,
David.

Submitted by Julian on Tue, 2006-08-01 15:41

Thanks David - do you think the robot.txt files helps at all getting all your pages indexed or do you use a site map - i see you have thousands of pages indexed ( including jump pages on msn )

also what do you use to password protect your admin pages ?

Submitted by support on Tue, 2006-08-01 16:11

I do have the sitemap registered with Google - you can do the same for your site with the automatically generated sitemap; check here for the documentation...

http://www.pricetapestry.com/node/11

For password protecting the admin page I just use a standard .htaccess file with BASIC authentication.... here's a good tutorial:

http://www.sitedeveloper.ws/tutorials/htaccess.htm

Cheers!
David.