mingle-website/robots.txt

14 lines
236 B
Plaintext

User-agent: *
Allow: /
# Specifically allow Naver bot
User-agent: Yeti
Allow: /
# Sitemap
Sitemap: https://minglestudio.co.kr/sitemap.xml
# Disallow specific files and patterns
Disallow: /cgi-bin/
Disallow: /tmp/
Disallow: /private/