wowana.me

website source

commit b643fa34606f78f992531ea471176305914cfb3a
parent 4afd44d55fdc717c1386658e2e3e79e45375eded
Author: opal hart <opal@wowana.me>
Date:   Tue,  3 Sep 2019 05:34:48 +0000

add robots.txt

about time I have this

Diffstat:
A
out/robots.txt
 | 
9
+++++++++

1 file changed, 9 insertions(+), 0 deletions(-)
diff --git a/out/robots.txt b/out/robots.txt
@@ -0,0 +1,9 @@
+User-agent: curl
+User-agent: wget
+Disallow: 
+
+User-agent: TurnitinBot
+Disallow: /
+
+User-agent: *
+Disallow: /files/