From 489e70a8fbcf2c50612b13fbfb47ed271ff7a681 Mon Sep 17 00:00:00 2001 From: =?UTF-8?q?B=C3=BCnyamin=20K=C4=B1rm=C4=B1z=C4=B1?= <55808189+bunyaminkirmizi@users.noreply.github.com> Date: Fri, 16 Sep 2022 22:09:50 +0300 Subject: [PATCH] Create robots.txt --- public/robots.txt | 5 +++++ 1 file changed, 5 insertions(+) create mode 100644 public/robots.txt diff --git a/public/robots.txt b/public/robots.txt new file mode 100644 index 00000000..d0e5f1be --- /dev/null +++ b/public/robots.txt @@ -0,0 +1,5 @@ +# www.robotstxt.org/ + +# Allow crawling of all content +User-agent: * +Disallow: