Add robots.txt and sitemap.xml for search engine indexing
This commit is contained in:
1 parent
f2981f2ad8
commit
345ff6fefe
3 files changed
+29
No files matched your search
@@ -0,0 +1,10 @@
|
||||
# robots.txt for https://nx9.in
|
||||
|
||||
User-agent: *
|
||||
Allow: /
|
||||
|
||||
# Sitemap
|
||||
Sitemap: https://nx9.in/sitemap.xml
|
||||
|
||||
# Optional crawl delay (ignored by Google)
|
||||
Crawl-delay: 1
|
||||
Reference in new issue
Block a user