Appease our great search engine overlords

This hopefully fixes all translated pages showing up in search engine results, and makes the STABLE version of each page canonical.
In turn, this allows us to re-enable indexing of the version-specific pages (see robots.txt changes), as search engines should prefer the canonical (stable) version, and only show the other versions if no canonical (stable) version exists (i.e. because that feature is only in latest, or was removed in stable).

It adds proper canonical links for all generated pages, and fixes the existing links between the various translations of a page by both ensuring the pages links to itself with the proper language tag, and by properly linking to the full path of other translated versions.
This commit is contained in:
Max Hilbrunner
2020-04-20 22:18:48 +02:00
parent b4c20830d1
commit fd5f6f4909
3 changed files with 24 additions and 18 deletions

View File

@@ -1,7 +1,3 @@
user-agent: *
disallow: /*/3.2
disallow: /*/3.1
disallow: /*/3.0
disallow: /*/2.1
sitemap: https://docs.godotengine.org/sitemap.xml