alice.pds.demo.boltless.dev / core
This repository has no description
0
Fork 0

Configure Feed

Select the types of activity you want to include in your feed.

appview/state: update robots.txt

Signed-off-by: Anirudh Oppiliappan <anirudh@tangled.org>

author
Anirudh Oppiliappan committer did:plc:wshs7t2adsemcrrd4snkeq… date (Feb 11, 2026, 7:09 AM UTC) commit 37a9708f parent f569d2be change-id nmslklvo
+8 -1
+8 -1
appview/state/state.go
··· 207 207 w.Header().Set("Content-Type", "text/plain") 208 208 w.Header().Set("Cache-Control", "public, max-age=86400") // one day 209 209 210 - robotsTxt := `User-agent: * 210 + robotsTxt := `# Hello, Tanglers! 211 + User-agent: * 211 212 Allow: / 213 + Disallow: /*/*/settings 214 + Disallow: /settings 215 + Disallow: /*/*/compare 216 + Disallow: /*/*/fork 217 + 218 + Crawl-delay: 1 212 219 ` 213 220 w.Write([]byte(robotsTxt)) 214 221 }