This website requires JavaScript.
Explore
Help
Sign in
sup39
/
firefish
Watch
1
Star
0
Fork
You've already forked firefish
0
Code
Issues
Pull requests
Activity
52e3595da2
firefish
/
custom
/
assets
/
robots.txt
6 lines
80 B
Text
Raw
Normal View
History
Unescape
Escape
feat: add custom robots.txt to reject crawlers (close #38)
2023-07-20 15:04:36 +09:00
User-agent: *
Disallow: /
fix: allow joinfirefish bot
2023-07-24 13:06:17 +09:00
User-agent: FirefishOrg*
fix: allow FediDB bot
2023-08-02 12:30:30 +09:00
User-agent: FediDB*
fix: allow joinfirefish bot
2023-07-24 13:06:17 +09:00
Allow: /
Copy permalink
