diff options
author | Paweł Dybiec <pawel.to.malpa@gmail.com> | 2020-03-10 18:25:01 +0100 |
---|---|---|
committer | Paweł Dybiec <pawel.to.malpa@gmail.com> | 2020-03-10 18:25:01 +0100 |
commit | 09e74b0b4fecce03ff3a1432fcb5b9ccef4280a7 (patch) | |
tree | 1a1e837f911d20d711d42dae0f406e8308bb867f /compose/nginx/darling/robots.txt | |
parent | Change nginx ciphers (diff) |
Move darling files
Diffstat (limited to 'compose/nginx/darling/robots.txt')
-rw-r--r-- | compose/nginx/darling/robots.txt | 17 |
1 files changed, 17 insertions, 0 deletions
diff --git a/compose/nginx/darling/robots.txt b/compose/nginx/darling/robots.txt new file mode 100644 index 0000000..83b2668 --- /dev/null +++ b/compose/nginx/darling/robots.txt @@ -0,0 +1,17 @@ +############################################################################## +# This is a production robots.txt! Edit with care. +############################################################################## + +User-agent: * +Disallow: /wotd-signup-message +Disallow: /wotd-signup-result +Disallow: /word-of-the-day/manage-subscription +Disallow: /interstitial-ad +Disallow: /my-saved-words/dictionary/starclick/ +Disallow: /lapi +Disallow: /assets/mw/static/old-games/ +Sitemap: https://www.merriam-webster.com/sitemap-ssl/sitemap_index.xml + +############################################################################## +# This is a production robots.txt! Edit with care. +############################################################################## |