about summary refs log tree commit diff
path: root/robots.txt
diff options
context:
space:
mode:
Diffstat (limited to 'robots.txt')
-rw-r--r--robots.txt5
1 files changed, 5 insertions, 0 deletions
diff --git a/robots.txt b/robots.txt
new file mode 100644
index 0000000..ed8c524
--- /dev/null
+++ b/robots.txt
@@ -0,0 +1,5 @@
+User-agent: GPTBot
+Disallow: /
+
+User-agent: *
+Allow: /
\ No newline at end of file