Add robots.txt file to prevent indexing outdated docs

Cherry-picked from 2e37935e73b629fd9ecaabf958943cabc3ac825 and follow-ups.
This commit is contained in:
Rémi Verschelde
2020-03-16 12:21:55 +01:00
parent dbec5c0a37
commit 08168d3afd

7
robots.txt Normal file
View File

@@ -0,0 +1,7 @@
user-agent: *
disallow: /*/3.2
disallow: /*/3.1
disallow: /*/3.0
disallow: /*/2.1
sitemap: https://docs.godotengine.org/sitemap.xml