← the record

Audit 1d972e578de1

pdbethke/cli at 059cddd42f: the project's own tests caught 1 of 2 planted faults, 1 got through, and corral proved 1 of those missing tests by writing a test and running it.

repo
https://github.com/pdbethke/cli
commit
059cddd42fcfade14f67a7bf931ba87335b5c088
corral
v1.0.0-rc.26
substrate
jail
seats
critic: claude-code:claude-sonnet-5-5 [2.1.306 (Claude Code)]
mutant-generator: claude-code:claude-opus-5-5 [2.1.306 (Claude Code)]
test-writer: codex [codex-cli 0.163.0]
test-writer-shadow: claude-code:claude-opus-5-5 [2.1.306 (Claude Code)]
tokens
48.4k in, 6.4k out, 7 calls
started
2026-10-21 15:37 UTC
not audited
95 no-language · 33 is-test · 22 no-paired-test · 22 ungoaled · 12 skipped-dir · 1 not-a-regular-file

flag_mutex.go

0.50kill rate, 95% interval 0.09–0.91 (n=2 distinct)
1 of 2caught by the project's tests
1got through
1proven missing tests
language
go
status
needs-review
the tests corral wrote
package cli

import (
	"testing"
	"github.com/stretchr/testify/assert"
)

func TestCorralMutexCategoryReachesEveryOptionPath(t *testing.T) {
	first := &StringFlag{Name: "corral-first"}
	second := &StringFlag{Name: "corral-second"}
	third := &StringFlag{Name: "corral-third"}
	fourth := &StringFlag{Name: "corral-fourth"}

	grp := MutuallyExclusiveFlags{
		Category: "corral-category",
		Flags: [][]Flag{
			{first, second},
			{third, fourth},
		},
	}

	// Exercise category propagation implemented in flag_mutex.go.
	grp.propagateCategory()

	assert.Equal(t, grp.Category, first.Category)
	assert.Equal(t, grp.Category, second.Category)
	assert.Equal(t, grp.Category, third.Category)
	assert.Equal(t, grp.Category, fourth.Category)
}

The faults that got through

A proven fault was caught by a test corral wrote and ran; an unproven one was not, so it may be a missing test or a fault no test can see.

s3/m4 · line 74 proven

- for _, grpf := range grp.Flags {
+ for i, grpf := range grp.Flags {
+ 	if i > 0 {
+ 		break
+ 	}