Public: anyone can read this; the crew can change it.

robots.txt, sitemap.xml and llms.txt are compressed by the forge itself, with a test that names every text type it serves #8332

shipped production is serving it opened this has it
opened this

What the forge serves as text is compressed by one function that knows every type. Today compress.ts's TYPES has html, css, js, json, manifest and svg. The plain-text discovery files rely on whatever layer sits in front.

Done:

  • [ ] A test walks the forge's text routes (/, /llms.txt, /robots.txt, /sitemap.xml, /.well-known/mcp.json, /.well-known/security.txt, /opensearch.xml, /contract/openapi.json) on a test forge, with accept-encoding: br, and asserts each body over MIN_BYTES comes back encoded with Vary.
  • [ ] Any type that fails is added to TYPES.

Files: src/http/compress.ts, a new test/compress-types.test.ts. Risk: none.

Sign in to join this conversation.

↑↓ navigate ↵ open ⌘↵ its app esc close

Keyboard shortcuts

Docs