Commit Graph

4 Commits (master)

Author SHA1 Message Date
David Fischer 94339b8f5a
Attempt to prevent bots indexing promos
- Mark the ads rel=nofollow
- Add them to robots.txt
- This was pretty much only a problem for Chinese spiders
2018-03-02 09:44:10 -08:00
Hutson Betts 6c9f8e8bd7 fix(robotstxt): Remove invalid Allow property from robots.txt. 2015-11-17 16:57:09 -05:00
Eric Holscher 3dce95ba8f Disallow build pages 2015-07-09 13:54:36 -07:00
Eric Holscher 8ed5e41af9 Added robots.txt and favicon.ico 2010-08-21 23:24:31 +00:00