ONCE Campfire's own Minitest suite, run against a Roundhouse emit of the same commit. A failure here mostly names a Rails construct not yet modeled; some are answers that came out wrong with nothing raised, and some have not been triaged at all. That makes their tests the worklist generator — so the ranked causes below, not the pass count, are what this page is for.
scripts/campfire-suite and runs on Ruby 3.4.11.
The input is pinned at c8f74a0b0e1e, which is the whole reason this lane
runs in CI on every commit: with campfire held still, every movement in the number belongs to a
Roundhouse change and nothing else. Bumping the pin moves the number deliberately, and the commit
that bumps it owns the delta. (The lobsters conformance lane makes
the opposite call — it tracks upstream HEAD and pins nothing, so it cannot attribute per commit and
runs on a schedule instead.)
The file list is theirs. Every test file campfire's own suite declares, read from the emitted Makefile's SPINEL_TESTS rather than restated here — a `find test -name '*_test.rb'` would also sweep in the scaffold's own tests, which are not campfire's.
Each run stands alone. There is no history here and no comparison to previous runs: a chart of a number that moves for a dozen reasons is not the point of a worklist.
Occurrences churn; causes are the unit of work, so each carries a stable slug you can still refer to forty commits later. Owner says who can act: most of this is Roundhouse's own modeling debt.
Counts are how many tests are currently stopped by each cause, not how many will pass when it lands: a test is attributed to the first thing that stopped it, so clearing one cause routinely reveals another behind it. Each unpassed test carries its own message; a file that never ran contributes its whole count against its load error.
| Blocked | Cause | Owner | |
|---|---|---|---|
| 3 | The emit ran and answered differentlysilent-divergence | untriaged | |
NOT a root cause — the bucket of tests that still need one. Nothing raised: the emitted code ran to completion and produced a different answer, so each of these has to be followed down its own chain. This is the most valuable cluster on the page and the most expensive: a missing method names itself, a wrong answer does not.
3 tests
| |||
| 4 | Not yet triagedunclassified | untriaged | |
No rule in bench/campfire/suite-causes.json matches these. Triage, then add a rule.
4 tests
| |||
A rule at zero is kept, not deleted: it is the tripwire that catches the fix coming undone. What it means depends on why it is at zero.
| Rule | Why it reads zero |
|---|---|
deferred-preload-timing | load_records runs includes unless skip_preloading!. message_test is 10/10 on Campfire 11d3fb9, and the page-preload sibling still leaves unrendered rows unloaded. The rule stays as a regression tripwire. |
mocha-stub-raises | served 2026-09-19 (sessions 9/10 spinel, 10/10 ruby); the rule stays as a regression tripwire. |
mocha-bare-mock | served 2026-09-20 (sessions 10/10 both lanes; a no-op `disconnect` fails the test with `expected 1 time(s), got 0`); the rule stays as a regression tripwire. |
proc-call-lost | spinel#4529 closed by PR #4530 (b93306b6, same day): the fast path's guard is arity-aware; spinel lane 286 -> 290/300 on the merge. The rule stays as the tripwire for the two guards disagreeing again. |
sti-becomes | `becomes!` landed in f2d42854; the rule stays as a regression tripwire. |
actiontext-attachment-from-node | `from_node`, `#attachable` and `MissingAttachable` landed with the generated `ActionText::Attachable.locate` (the includer set is the registry); the rule stays as a regression tripwire. |
sgid-wire-format | the wire format is Rails' and the tolerant list is read off the reopen; the rule stays as a regression tripwire for either end drifting (a salt, digest, padding or `?expires_in` change fails the pinned literal first). |
socket-interception | served 2026-09-17 (sequential Resolv answers + the TcpSocketStub seam); the rule stays as a regression tripwire. |
globalid-sgid | minting served 2026-09-22; the rule stays as the tripwire for a mint whose model the pass cannot name, which is reported rather than guessed. |
turbo-streams-channel | the constant landed in fd1a3259; the rule stays as a regression tripwire. |
belongs-to-autosave | served with #818 tip-compat (FirstRun/grant_to peel); rule stays as a regression tripwire. |
conditional-get | `fresh_when` / `stale?` landed in 7ea262e2; the rule stays as a regression tripwire. |
pagination | landed in 0ef8fb79; the rule stays as a regression tripwire. |
id-zero-sentinel | zero is the intended reading. This is a deliberate divergence rather than a gap, and the rule exists to catch the day it becomes visible again. |
shared-cache-table-lock | the harness opens a per-test file database since 2026-09-17; the rule stays as the tripwire — a reappearance means a shim opened a shared-cache database again. |
render-json-encoder | the monomorphized writer landed for the declared-readers case (campfire's only site); the rule stays as a regression tripwire, and names the shapes that would still reach the encoder. |
nokogiri-css-class | served by loading ruby-vips after boot so Nokogiri keeps the libxml that accepts `*:` and css-class(). messages_helper_test is 17/17, messages_boosts_controller_test is 5/5, and rooms_refreshes_controller_test is 1/1 on Campfire 11d3fb9. The rule stays as a regression tripwire. |
action-view-base-missing | served by the ActionView::Base#form_with peel (b513fa665): fragment_rendering_test is 9/9 on Campfire 11d3fb9. The rule stays as a regression tripwire. |
native-validators-304 | served with #829; rule stays as a regression tripwire. |
fragment-cache-identity | fragment_rendering_test is 9/9 on Campfire 11d3fb9 after ActionView::Base#form_with (b513fa665). The rule stays as a regression tripwire. |
message-creation-tx | served by d5bbeaaaa (transactional saves, deferred commit callbacks, automatic inverses) on 448bfea2e; the three files measure 15/15 (was 10/15, five fails, on 61a8f105f). The rule stays as a regression tripwire. |
room-destroy-batching | served by the room-destroy peel (6e3405f50): a non-joinable fixture transaction opens a savepoint per destroy, and room_test is 11/11. `use_transactional_tests = false` still COMMITs. The rule stays as a regression tripwire. |
messages-caching-fixture-txn | The fixture frame is hidden from `transaction_open?`, and an uncommitted write moves the observer's data_version, so the cached page is dropped when the example edits a message. messages_caching_test is 4/4. The rule stays as a regression tripwire. |
presentation-preload-introspection | served 2026-10-09 (`embeds` modeled and preloaded). associations_load_together is cleared with deferred-preload-timing. The rule stays as a regression tripwire. |
turbo-signed-stream-name | served 2026-09-22 (room_messages_channel_test 6/6 + the stock-channel pair 2/2); the rule stays as a regression tripwire. |
web-push-pinned-delivery | served 2026-09-22 on both lanes (web_push_persistent_request_test 2/2 ruby and spinel, through campfire's own PersistentRequest over the real gem / the port); the rule stays as a regression tripwire. |
cable-test-case | served 2026-09-22 (test/channels 20/20 on the ruby lane); the rule stays as a regression tripwire for a harness method going missing. |
view-test-case | served 2026-09-22 (messages_helper_test 3/3); the rule stays as the tripwire for a `view` call no helper defines, which is ActionView::Base's own surface and still unmodeled. |
uri-parse-conformance | the space case served upstream 2026-09-22 (matz/spinel#4806 + fd49be64); the rule stays as the tripwire for the colon-form divergences still open in the same parser, and for the guard itself being loosened again. |
rails-test-support-classes | served 2026-09-22 (opengraph-embed 8/8, log_scrubbing 6/6); the rule stays as the tripwire for the next Rails test stand-in the corpus reaches for, and names the three it has needed so far. |
kwargs-splat-forwarding | served 2026-09-21 (opengraph-embed 7/8, the eighth is `ActionDispatch::TestRequest`); the rule stays as a regression tripwire. |
actiontext-fragment-mutation | served 2026-09-21 (Node writes, `Fragment#update`/`at_css`/`css`, and Rails' attachable-driven plain text; content_filters 12/14); the rule stays as a regression tripwire. |
activesupport-string-core-ext | `squish` served 2026-09-22; the rule stays as the tripwire, and names the three String core exts (`squish!`, `truncate_words`, `remove`) the corpus has not asked for yet. |
ipaddr-octets-on-stdlib | served 2026-09-21 (guard 24/24 on the ruby lane); the rule stays as the tripwire for a runtime IPAddr method the stdlib facade does not mirror. |
vips-image-construction | served 2026-10-05: spinel-ruby-vips grew Image.black / #add / #cast / write_to_buffer, so the policy file reaches find_load instead of stopping on unknown. Remaining find_load nils on libvips 8.14 are vips-policy-not-applied-in-tests, not this construction wall. |
tempfile-stdlib | served 2026-09-22; the rule stays as the tripwire for the next caller that reaches for a temp file, and for the port's one real difference from Ruby's — it opens by name where Ruby opens O_EXCL and retries. |
vips-policy-not-applied-in-tests | served 2026-10-05: the processor wraps Vips.vips_foreign_find_load through VipsExt so a blocked loader is not selected (8.15+ already skips BLOCKED classes in vips_foreign_map; 8.14 does not). 15/15 on this orb's libvips 8.14.1 after the wrap, two skips for loaders the host never built. |
test-harness-surface | served 2026-09-22; the rule stays as the tripwire for the next harness method the corpus reaches for — `file_fixture`, `fixture_file_upload`, `response`, `parsed_body` and the bare `assert` family are all named in the match because each hides an unknown number of assertions behind it. |
attachable-partials-not-rendered | both halves landed: sgid attachables through the generated `Content.render_attachment` (fe2ce576), content-type attachables through their own `from_node` with the partial's local named `model_name.element` and `caption` delegated back through the node, plus the shared `auto_link` running Rails' body pass so the outer node is stripped around the partial on every lane; ruby 294/300, spinel 292/300. The rule stays as the tripwire for an attachment node reaching the page bare again. |
test-helper-kwarg-defaults | the skipped-slot fill landed 2026-09-19 (unfurl 7/7 both lanes); the rule stays as a regression tripwire. |
direct-uploads-not-served | served 2026-09-20 (4/4 both lanes; with the generated filter reopens deleted the anonymous POST creates a blob and the anonymous PUT is not a 401, so the guard is what the tests see); the rule stays as a regression tripwire. |
No explanation recorded, so these are the open question: either the cause is cleared and nobody wrote that down, or the failure's message changed and it is now being counted as untriaged above. fixture-accessors, params-object-representation, relation-vs-array, object-extend, rails-module-facade, broadcast-assertions, view-helper-in-helper-module, active-storage-attachments, route-helper-takes-a-record, out-of-scope-gems, arity-divergence, allow-browser, params-hash-in-path, ar-database-tasks, sqlite-wal-checkpoint, record-cache-admit, sidebar-cached-direct-sort.
A file that never ran is not the same as a file whose tests failed: it died at load, so its whole count is charged to one error and nothing behind that error has been seen yet.
| File | Tests | Pass | Fail | First error |
|---|---|---|---|---|
test/channels/application_cable_connection_test | 7 | 3 | 4 | FAIL ApplicationCable::ConnectionTest#test_closes_once_its_session_has_ended_without_it_hearing: uninitialized constant ActionCable::Connection::Base::Cable |
test/controllers/users_profiles_controller_test | 21 | 18 | 3 | FAIL Users::ProfilesControllerTest#test_a_new_password_needs_the_current_one_however_the_form_spells_it: assert_equal failed |
test/channels/presence_channel_test | 7 | 7 | 0 | all green |
test/channels/room_messages_channel_test | 6 | 6 | 0 | all green |
test/channels/room_messages_via_stock_turbo_channel_test | 2 | 2 | 0 | all green |
test/channels/unread_rooms_channel_test | 3 | 3 | 0 | all green |
test/controllers/accounts_bots_controller_test | 5 | 5 | 0 | all green |
test/controllers/accounts_bots_keys_controller_test | 1 | 1 | 0 | all green |
test/controllers/accounts_controller_test | 6 | 6 | 0 | all green |
test/controllers/accounts_custom_styles_controller_test | 3 | 3 | 0 | all green |
test/controllers/accounts_join_codes_controller_test | 2 | 2 | 0 | all green |
test/controllers/accounts_logos_controller_test | 6 | 6 | 0 | all green |
test/controllers/accounts_users_controller_test | 3 | 3 | 0 | all green |
test/controllers/autocompletable_users_controller_test | 4 | 4 | 0 | all green |
test/controllers/first_runs_controller_test | 4 | 4 | 0 | all green |
test/controllers/messages_boosts_by_bots_controller_test | 12 | 12 | 0 | all green |
test/controllers/messages_boosts_controller_test | 5 | 5 | 0 | all green |
test/controllers/messages_by_bots_controller_test | 23 | 23 | 0 | all green |
test/controllers/messages_controller_test | 20 | 20 | 0 | all green |
test/controllers/qr_code_controller_test | 3 | 3 | 0 | all green |
test/controllers/rooms_closeds_controller_test | 9 | 9 | 0 | all green |
test/controllers/rooms_controller_test | 10 | 10 | 0 | all green |
test/controllers/rooms_directs_controller_test | 6 | 6 | 0 | all green |
test/controllers/rooms_involvements_controller_test | 5 | 5 | 0 | all green |
test/controllers/rooms_opens_controller_test | 9 | 9 | 0 | all green |
test/controllers/rooms_refreshes_controller_test | 1 | 1 | 0 | all green |
test/controllers/searches_controller_test | 7 | 7 | 0 | all green |
test/controllers/sessions_controller_test | 11 | 11 | 0 | all green |
test/controllers/sessions_transfers_controller_test | 4 | 4 | 0 | all green |
test/controllers/unfurl_links_controller_test | 12 | 12 | 0 | all green |
test/controllers/users_avatars_controller_test | 4 | 4 | 0 | all green |
test/controllers/users_bans_controller_test | 7 | 7 | 0 | all green |
test/controllers/users_controller_test | 6 | 6 | 0 | all green |
test/controllers/users_push_subscriptions_controller_test | 11 | 11 | 0 | all green |
test/controllers/users_sidebars_controller_test | 6 | 6 | 0 | all green |
test/controllers/welcome_controller_test | 2 | 2 | 0 | all green |
test/helpers/content_filters_test | 19 | 19 | 0 | all green |
test/helpers/messages_helper_test | 17 | 17 | 0 | all green |
test/helpers/rich_text_helper_test | 4 | 4 | 0 | all green |
test/models/account_joinable_test | 2 | 2 | 0 | all green |
test/models/account_test | 4 | 4 | 0 | all green |
test/models/action_text__attachment_test | 3 | 3 | 0 | all green |
test/models/action_text_attachment_opengraph_embed_test | 9 | 9 | 0 | all green |
test/models/action_text_attachment_test | 3 | 3 | 0 | all green |
test/models/active_storage_authentication_test | 4 | 4 | 0 | all green |
test/models/block_banned_requests_test | 3 | 3 | 0 | all green |
test/models/cached_responses_test | 14 | 14 | 0 | all green |
test/models/fetch_metadata_test | 7 | 7 | 0 | all green |
test/models/first_run_test | 3 | 3 | 0 | all green |
test/models/fragment_rendering_test | 9 | 9 | 0 | all green |
test/models/log_scrubbing_formatter_test | 6 | 6 | 0 | all green |
test/models/membership_test | 9 | 9 | 0 | all green |
test/models/message_attachment_test | 10 | 10 | 0 | all green |
test/models/message_creation_commit_test | 1 | 1 | 0 | all green |
test/models/message_creation_test | 6 | 6 | 0 | all green |
test/models/message_mentionee_test | 2 | 2 | 0 | all green |
test/models/message_pagination_test | 1 | 1 | 0 | all green |
test/models/message_searchable_test | 8 | 8 | 0 | all green |
test/models/message_test | 10 | 10 | 0 | all green |
test/models/messages_caching_test | 4 | 4 | 0 | all green |
test/models/opengraph_document_test | 3 | 3 | 0 | all green |
test/models/opengraph_fetch_test | 12 | 12 | 0 | all green |
test/models/opengraph_location_test | 7 | 7 | 0 | all green |
test/models/opengraph_metadata_test | 11 | 11 | 0 | all green |
test/models/push_subscription_test | 18 | 18 | 0 | all green |
test/models/record_cache_test | 5 | 5 | 0 | all green |
test/models/response_cache_test | 4 | 4 | 0 | all green |
test/models/restricted_http_private_network_guard_test | 24 | 24 | 0 | all green |
test/models/room_messages_count_lifecycle_test | 7 | 7 | 0 | all green |
test/models/room_messages_count_tasks_test | 4 | 4 | 0 | all green |
test/models/room_messages_count_test | 6 | 6 | 0 | all green |
test/models/room_push_test | 10 | 10 | 0 | all green |
test/models/room_test | 11 | 11 | 0 | all green |
test/models/rooms_direct_test | 5 | 5 | 0 | all green |
test/models/rooms_open_test | 2 | 2 | 0 | all green |
test/models/session_test | 2 | 2 | 0 | all green |
test/models/sqlite_wal_checkpoint_test | 15 | 15 | 0 | all green |
test/models/user_avatar_test | 3 | 3 | 0 | all green |
test/models/user_bannable_test | 1 | 1 | 0 | all green |
test/models/user_bot_test | 4 | 4 | 0 | all green |
test/models/user_role_test | 3 | 3 | 0 | all green |
test/models/user_test | 13 | 13 | 0 | all green |
test/models/user_transferable_test | 5 | 5 | 0 | all green |
test/models/users_push_subscriptions_controller_foreign_write_test | 1 | 1 | 0 | all green |
test/models/vips_loader_policy_test | 15 | 15 | 0 | all green |
test/models/web_push_connections_test | 14 | 14 | 0 | all green |
test/models/web_push_persistent_request_test | 6 | 6 | 0 | all green |
test/models/web_push_pool_test | 2 | 2 | 0 | all green |
test/models/webhook_test | 6 | 6 | 0 | all green |
From the transpile that produced the tree under test: 1,598 files, 0 errors, 51 warnings. Warnings are a modeling-debt ledger rather than a failure — the Ruby target emits through its gaps — so the COUNTS are not comparable to the test failures above.
They are not independent of them either. send_dispatch_failed in particular names a call the analyzer could not resolve, and three of the fixes on this lane came out of those lines before the suite reached them at all — the analyzer had already written the diagnosis. Read the emit log before the fail log.
| Diagnostic | Count |
|---|---|
lower_residue | 51 |