Three of the findings in this umbrella were invisible until the corresponding benchmark existed, and
one of them stopped a change that would have been made for nothing. A cluster tells you the pipeline
got slower; it does not tell you which stage, and a nineteen-machine baseline moves about 15% between
days, so small effects are only measurable in-process.
This issue tracks the set; each benchmark is a child, independently reviewable.
Shared prerequisite: several test helpers must widen from *testing.T to testing.TB so benchmarks
can reuse them (utils/test.WaitForConnections, mock.StartMockVerifierService, and the coordinator
and sidecar test environments). Precedent exists in mock/test_exports.go, where
StartMockCoordinatorService and NewOrdererTestEnv are already testing.TB.
Three of the findings in this umbrella were invisible until the corresponding benchmark existed, and
one of them stopped a change that would have been made for nothing. A cluster tells you the pipeline
got slower; it does not tell you which stage, and a nineteen-machine baseline moves about 15% between
days, so small effects are only measurable in-process.
This issue tracks the set; each benchmark is a child, independently reviewable.
Shared prerequisite: several test helpers must widen from
*testing.Ttotesting.TBso benchmarkscan reuse them (
utils/test.WaitForConnections,mock.StartMockVerifierService, and the coordinatorand sidecar test environments). Precedent exists in
mock/test_exports.go, whereStartMockCoordinatorServiceandNewOrdererTestEnvare alreadytesting.TB.