Serve Hesychia crawler files as static text #43

New Issue

2026-10-17T04:07:08-07:00

westfarn commented

2026-10-17 04:07:08 -07:00

Crawlers requesting /robots.txt, /sitemap.xml, or /llms.txt must get those files, not the SPA index.html.

Scope

For chat_web_app only, nginx exact locations for those three paths.
try_files the real file or return 404. Do not fall through to index.html.
Set text/plain for the txt files and application/xml for the sitemap.
Other static apps keep the current catch-all.

The files themselves ship in chat_web_app public/.

Crawlers requesting `/robots.txt`, `/sitemap.xml`, or `/llms.txt` must get those files, not the SPA `index.html`. ## Scope - For `chat_web_app` only, nginx exact locations for those three paths. - `try_files` the real file or return 404. Do not fall through to `index.html`. - Set `text/plain` for the txt files and `application/xml` for the sitemap. - Other static apps keep the current catch-all. The files themselves ship in chat_web_app `public/`.

westfarn referenced this issue from a commit

2026-10-17 05:19:12 -07:00

Serve Hesychia crawler files as static text instead of the app shell.

westfarn referenced a pull request that will close this issue

2026-10-17 05:19:51 -07:00

Serve Hesychia crawler files as static text #44

westfarn closed this issue

2026-10-19 08:07:47 -07:00

westfarn referenced this issue from a commit

2026-10-19 08:07:47 -07:00

Serve Hesychia crawler files as static text (#44)

Sign in to join this conversation.