mingle/mingle-website
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

Block: ClaudeBot 크롤러 차단

Browse Source 
- robots.txt에 ClaudeBot, anthropic-ai 차단 추가
- 서버 부하 감소 목적 (봇 트래픽 97% 이상 차지)

Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>
This commit is contained in:
서버 2026-02-17 03:36:58 +09:00
parent 7da5ca908b
commit f0e5bdc399
1 changed files with 8 additions and 0 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

8
robots.txt
View File

@ -1,3 +1,11 @@
# AI 크롤러 차단
User-agent: ClaudeBot
Disallow: /
User-agent: anthropic-ai
Disallow: /
# 기타 모든 봇 허용
User-agent: * User-agent: *
Allow: / Allow: /