mirror of
https://github.com/rehlds/rehlds.github.io.git
synced 2025-03-04 09:35:29 +03:00
Rework robots.txt
for better SEO (remove extra)
This commit is contained in:
parent
016cee40d1
commit
30f710960a
@ -1,12 +1,4 @@
|
|||||||
User-agent: *
|
User-agent: *
|
||||||
Allow: /
|
Allow: /
|
||||||
|
|
||||||
User-agent: Yandex
|
|
||||||
Allow: /
|
|
||||||
|
|
||||||
User-agent: Googlebot
|
|
||||||
Allow: /
|
|
||||||
|
|
||||||
Host: rehlds.dev
|
|
||||||
|
|
||||||
Sitemap: https://rehlds.dev/sitemap.xml
|
Sitemap: https://rehlds.dev/sitemap.xml
|
Loading…
x
Reference in New Issue
Block a user