update robots.txt to disallow makepdf.php?

Having issues using the CentOS WebSite? Then describe your problem(s) here. Please include details of your platform (Linux, Mac, Windows) and browser -- not forgetting the versions of each.
Posts: 37
Joined: 2012/05/04 19:31:50
Location: Austin, Tx, Usa

update robots.txt to disallow makepdf.php?

Postby michael_centos » 2012/07/08 21:42:34

Currently web searches return results like this:

http://www.centos.org/modules/newbb/mak ... _id=160061

Which is really annoying, as some searches only return the pdf of a single post and the topic search result will be pages down.

Can someone review the robots.txt and add add in appropriate "Disallow: xxx" lines?