 Hi How can I make www.mysite/m/articles/view/ not indexed by Google but www.mysite/m/articles/view/anyarticle to get indexed. Can I use <meta name="robots" content="noindex, follow"> and if so in which file should I add the meta tag.
The link www.mysite/m/articles/view/ gives a 404 error and it also applies to other modules that use /view/ without a subsequent page name. I'm using 7.1.4 Darkbread |
Any??? |
no one?? |
You use the robots.txt file to control how a robot will crawl; and index, your site. Go here to learn; and of course search for others on the net as well: http://www.robotstxt.org/ Now of course only the good bots will follow the robots.txt file but I am guessing you are more concern with Google and Bing. Geeks, making the world a better place |
Hi Thanks for your answer. I all ready use robots.txt to prevent unwanted index. But if I make an Disallow: /m/articles/view/ in robots.txt it means that Google will not index /m/articles/view/ and it's entire content. I want google to not index /m/articles/view/ and index all articles like /m/articles/view/anyarticle I suppose I can't use Disallow: /m/articles/view/ Allow: /m/articles/view/*.* Regards |
Google does allow a * as a wild card, but not *.*
https://www.deanbassett.com |
Hi and thanks Then I'll have to do a meta with noindex and follow. Do you now in which file I can add this. I have your Head injection module but there I have to put in the side titel and not the URL. Something for you to develop perhaps Darkbread |
Yes, url matching is planned fro the next version. https://www.deanbassett.com |
Thank you. I'll try that until next upgrade of your head injection which is an excellent mod by the way.
Regards Darkbread |
