Remove all robots.txt rules; Applebot-Extended is handled by a custom

Anubis rule.
2025-08-19 11:35:01 -04:00
parent b14bf720e9
commit 04a4adb4d4
1 changed files with 1 additions and 3 deletions
--- a/src/robots.txt
+++ b/src/robots.txt
@@ -1,3 +1 @@
-# Explicitly catch Applebot-Extended, as the default regex in Anubis will permit it.
-User-agent: Applebot-Extended
-Disallow: /
+