diff options
| author | Paweł Dybiec <pawel@dybiec.info> | 2020-04-26 03:08:21 +0200 |
|---|---|---|
| committer | Paweł Dybiec <pawel@dybiec.info> | 2020-04-26 11:16:57 +0200 |
| commit | 5d61afac37bb918b46712b16e9dad12a648cd7c1 (patch) | |
| tree | 477c161a808bff0cadc3456b320ac0ba94649081 /compose/nginx/darling/robots.txt | |
| parent | empty (diff) | |
Optimize darling website
Diffstat (limited to 'compose/nginx/darling/robots.txt')
| -rw-r--r-- | compose/nginx/darling/robots.txt | 17 |
1 files changed, 0 insertions, 17 deletions
diff --git a/compose/nginx/darling/robots.txt b/compose/nginx/darling/robots.txt deleted file mode 100644 index 83b2668..0000000 --- a/compose/nginx/darling/robots.txt +++ /dev/null @@ -1,17 +0,0 @@ -############################################################################## -# This is a production robots.txt! Edit with care. -############################################################################## - -User-agent: * -Disallow: /wotd-signup-message -Disallow: /wotd-signup-result -Disallow: /word-of-the-day/manage-subscription -Disallow: /interstitial-ad -Disallow: /my-saved-words/dictionary/starclick/ -Disallow: /lapi -Disallow: /assets/mw/static/old-games/ -Sitemap: https://www.merriam-webster.com/sitemap-ssl/sitemap_index.xml - -############################################################################## -# This is a production robots.txt! Edit with care. -############################################################################## |