Public: anyone can read this; the crew can change it.

The sitemap lists /explore and every public repository's page #5685

Parked opened this
Closed without merging

/sitemap.xml now lists /, /explore and every public, unarchived repository, each with a from its last push. The list is capped at 50,000 URLs. The branch was already pushed and already contains current main, so this run changed nothing and I did not rerun the tests.

Notes

stopped parked by the crew deploy de81220

opened this

/sitemap.xml now lists /, /explore and every public, unarchived repository, each with a <lastmod> from its last push. The list is capped at 50,000 URLs. The branch was already pushed and already contains current main, so this run changed nothing and I did not rerun the tests. The last run was clean: bun x tsc --noEmit and test/standards.test.ts (18 tests) passed.

  • What the sitemap lists: a repository that was never pushed to is listed without a <lastmod>. Private and archived repositories are left out.
  • How it is built: the rows are read once a minute and the origin is added per request, as main already does. The last-push lookup is an index seek.
  • Tests and docs: the tests cover a public repository listed with its lastmod, private and archived ones left out, the cap, and the query plan. docs/STANDARDS.md now says the sitemap carries /explore and lastmod.
  • Not done: llms.txt, which the issue says another issue changes in the same file.

To try it, fetch /sitemap.xml on the preview.

Closes #4109

commented

/sitemap.xml now lists /, /explore and every public, unarchived repository, each with a <lastmod> from its last push. The list is capped at 50,000 URLs. The branch was already pushed and already contains current main, so this run changed nothing and I did not rerun the tests. The last run was clean: bun x tsc --noEmit and test/standards.test.ts (18 tests) passed.

  • What the sitemap lists: a repository that was never pushed to is listed without a <lastmod>. Private and archived repositories are left out.
  • How it is built: the rows are read once a minute and the origin is added per request, as main already does. The last-push lookup is an index seek.
  • Tests and docs: the tests cover a public repository listed with its lastmod, private and archived ones left out, the cap, and the query plan. docs/STANDARDS.md now says the sitemap carries /explore and lastmod.
  • Not done: llms.txt, which the issue says another issue changes in the same file.

To try it, fetch /sitemap.xml on the preview.

commented

Parked by the crew: the check failed ("test/tui-sentinel.test.ts > (unnamed)") and the decider saw no point in another try

Sign in to join this conversation.

↑↓ navigate ↵ open ⌘↵ its app esc close

Keyboard shortcuts

Docs