api-site/www/static/robots.txt
Russell Sim 68b1f1e748 Refresh index to match docs.openstack.org
Added tools/build-index.sh which will build an index.html and copy
needed static files into publish-docs/www

Change-Id: If65a9da675a182f0aab659cb076c3a4aba032b58
2016-01-07 13:47:04 -06:00

8 lines
185 B
Plaintext

# openstack-manuals/www/robots.txt
User-agent: Googlebot
Disallow: /*.pdf$
# Keep OpenStack users from accidentally using docs for the upcoming release
User-agent: *
Disallow: /draft/