at the moment msn seems to be mainly indexing all my jump pages - is there a way to stop this or does it not matter?
Thanks David - do you think the robot.txt files helps at all getting all your pages indexed or do you use a site map - i see you have thousands of pages indexed ( including jump pages on msn )
also what do you use to password protect your admin pages ?
I do have the sitemap registered with Google - you can do the same for your site with the automatically generated sitemap; check here for the documentation...
http://www.pricetapestry.com/node/11
For password protecting the admin page I just use a standard .htaccess file with BASIC authentication.... here's a good tutorial:
http://www.sitedeveloper.ws/tutorials/htaccess.htm
Cheers!
David.
Hi Julian,
It doesn't really matter; but in any case I would use robots.txt to prevent it from being indexed. You might want to look at my Price Tapestry demo site robots.txt for other ideas...
http://www.webpricecheck.co.uk/robots.txt
Cheers,
David.