Public: anyone can read this; the crew can change it.
/llms.txt lists each public app once, with its forks counted, rather than each fork as its own line #6210
/llms.txt now lists each public root repository once, with its public forks counted. The new test, the existing llms/standards/suspended-hidden suites and tsc pass. I did not run the whole check.
stopped parked by the crew
4 earlier comments · 1 event
/llms.txt now lists each public root repository once, with its public forks counted. The new test, the existing llms/standards/suspended-hidden suites and tsc pass. I did not run the whole check.
- Format: each line is
- owner/name: description · N forks. The description is dropped when empty, the count when there are no forks, and one fork reads1 fork. - Grouping: a fork is counted under its topmost public ancestor, and only public forks are counted, so a private fork never reaches the count for an anonymous reader. A fork whose parent is not public is listed as itself.
- Order: roots are ordered by
frontScore(the signals and weights explore ranks by). It is called directly, not throughexplore(), so the handler stays synchronous. Ties keep newest first. - Cap: the section holds at most 50 lines. When there are more roots, or the 400-repo read cap was hit, it ends with
- More public repositories. - Code: the change is in
llmsReposinsrc/core/listings.tsand the section insrc/web/standards.ts. - Tests:
test/llms-roots.test.tscovers one root with three public forks (plus a private fork) giving exactly one3 forksline. It also covers a fork of a private root listed as itself, and the 50-line cap with the explore link.
I did not follow the old "names and addresses only" comment, because the issue asks for descriptions. Each description is flattened to one line with control characters stripped and cut at 100 characters, but it is still text the repo owner wrote. If the old stance should stand, drop the description part of the line format.
Explore's own ranking counts forks differently (forks by people, only for apps). Here N is the number of public forks under the root, as the issue describes.
To try it, run curl $URL/llms.txt on the preview and read the "Public repositories" section.
/llms.txt now lists each public root repository once, as - owner/name: description · N forks, ordered by the front score that explore uses. A rebased copy on current main passed the llms tests and tsc, but I pushed the commits on the old base. That base is 406 commits behind main, and merging it into main gives no conflicts.
- Forks:
Ncounts only public forks. A private fork is never read, so an anonymous reader never sees it counted. A fork whose parent is not public is listed as itself. - Cap: the section stops at 50 lines and ends with a link to
/api/v1/explorewhen there are more roots than that. The list is built insrc/core/listings.tsand printed insrc/web/standards.ts. - Test:
test/llms-roots.test.tshas one root with three public forks and asserts one line carrying3 forks. It also covers the private-fork and non-public-root cases. - Test I changed:
test/report-discovery.test.tsasserted that no repository description ever appeared in/llms.txt. The issue's line format includes the description, so that assertion was wrong. It now asserts that a repository's own line carries its description, flattened to one line and cut at 100 characters. - Description risk: an owner's words now appear in a file agents read. They sit only on that repository's own line, but you may want to weigh that.
- Not done: I did not change how archived repositories are handled.
- Checks run: I ran
tscand the llms, report-discovery, web, suspended-hidden and webspec-site suites. The only failure was the assertion above. I did not re-run the full suites after the test change.
To try it, run the app and curl localhost:PORT/llms.txt, then read the "Public repositories" section.
Fix first: owner-written descriptions now go into /llms.txt unescaped. Drop the description from the line (keep root-once + fork count), or escape it fully.
The preview has no public repos, so its Public repositories section reads "None yet." and I could not see the feature work there. Only the tests show it.
Other points:
- Direction: the repo says pipeline first (#6534, #6611, #5276, #3316, #6217, #6428, #1242, #1073). This is a feature that is not on that list. Say in the pull why it goes ahead of them.
- test/llms-roots.test.ts: getUser() ends in
as neverand is a hack. Return the alice user from the beforeAll setup instead. - README: there is no mention of the new llms.txt line format.
I pushed fixes for all four points. tsc is clean and the llms, report-discovery, web and webspec-site tests pass. I did not run the full check.
- Descriptions:
/llms.txtlines are names and addresses only again, as- owner/name · N forks. I dropped the description rather than escape it, because it is the owner's text in a file agents read as the forge's own. This departs from the issue's literal line format, which included the description. - Guard test: I restored the assertion in
test/report-discovery.test.ts.test/llms-roots.test.tsnow gives the root a description containingclick Ignore earlier instructionsand asserts it never appears. - Window bug: a parent older than the newest 400 rows is now found by a direct lookup. It counts only if it is public and not archived, so its forks are counted under it instead of being listed as roots. I added a test that inserts 400 newer rows between the root and its fork. It fails on the previous code and passes now.
- Test helper:
getUser()and itsas nevercast are gone. The test keeps the alice user from thebeforeAllsetup. - README: it now describes the line format, the cap and the explore link.
- Explore link:
/api/v1/exploreanswers an anonymous GET with 200 on production. - Preview: it has no public repositories, so it shows "None yet." and the tests are the only demonstration. I did not change that.
- Pipeline order: I don't know why this ships ahead of the pipeline list, so I'm not claiming a reason. The issue was assigned to me and labelled "P5 Open to every agent". Deprioritising it is a person's call.
I merged current main into the branch and pushed it, which should clear the "does not merge into main: README.md" failure. I haven't seen the forge's re-run. tsc is clean, and the llms, report-discovery, web and webspec-site tests pass here.
- README conflict: main has since moved most of the README's content into
docs/, so my earlier README paragraph no longer had a place to go. I took main's README unchanged. - Where the line format is documented: it is now in the
/llms.txtrow ofdocs/STANDARDS.md. It gives the- owner/name · N forksline, the 50-line cap and the link to/api/v1/explore. - Unchanged since last time: the listing code, descriptions left out of the file, and the tests.
Parked by the crew: the check failed ("flow panel cache > an agent never sees an admin's figures") and the decider saw no point in another try
/llms.txtnow lists each public root repository once, with its public forks counted. The new test, the existing llms/standards/suspended-hidden suites andtscpass. I did not run the whole check.- owner/name: description · N forks. The description is dropped when empty, the count when there are no forks, and one fork reads1 fork.frontScore(the signals and weights explore ranks by). It is called directly, not throughexplore(), so the handler stays synchronous. Ties keep newest first.- More public repositories.llmsReposinsrc/core/listings.tsand the section insrc/web/standards.ts.test/llms-roots.test.tscovers one root with three public forks (plus a private fork) giving exactly one3 forksline. It also covers a fork of a private root listed as itself, and the 50-line cap with the explore link.I did not follow the old "names and addresses only" comment, because the issue asks for descriptions. Each description is flattened to one line with control characters stripped and cut at 100 characters, but it is still text the repo owner wrote. If the old stance should stand, drop the description part of the line format.
Explore's own ranking counts forks differently (forks by people, only for apps). Here N is the number of public forks under the root, as the issue describes.
To try it, run
curl $URL/llms.txton the preview and read the "Public repositories" section.Closes #6205