02 · Compare the artifacts
Supported work. Visible uncertainty.
This is a fictional, sanitized software-quality case. All systems, users, transactions, and records are fabricated; testing remains authorized and bounded and provides no security, legal, accessibility, or defect-free guarantee.
BlueMesa checkout release
BlueMesa is a fictional business-to-business storefront preparing release 4.8 of its checkout. The approved requirement says authenticated buyers may purchase approved catalog items up to their account credit limit, apply one active contract discount, choose an allowed shipping method, and receive an accessible confirmation. The release candidate is build 4.8.17 in staging. Six browsers and two mobile devices are in scope, but the test plan lists only the latest desktop Chrome. A sample account has a $10,000 credit limit and an existing $9,600 open balance. The cart contains a $700 item, a 10 percent contract discount, $55 shipping, and an 8.25 percent tax rule. The product owner expects the order to be blocked, while the developer says discounts should be considered before the credit check; the requirement does not state calculation order. In preliminary testing, the keyboard focus disappears after the shipping modal closes, the error summary is not announced by the screen reader, and refreshing after payment timeout sometimes creates a second pending order. Logs show the same idempotency key on both requests, but the payment sandbox returns different response identifiers. The tax service was upgraded after the last regression baseline. A defect titled checkout broken includes no build, data, steps, expected result, actual result, or evidence. Marketing already announced Friday availability, and the release manager proposes accepting all medium defects. Learners must define risk and acceptance, control environments, write reproducible tests, explore edge cases within authority, classify defects, and make an evidence-bounded release recommendation. They must not conduct unapproved security testing or claim exhaustive coverage.
Supported example — reference only
- Environment ID
- ENV-01
- Build
- 4.8.17 staging — M02-I01 (F01)
- Browser/version
- Not supplied
- OS/device
- Desktop combination not supplied
- Viewport/input
- Keyboard coverage proposed; viewport not supplied
- Assistive technology
- Not supplied
- Locale/network
- Not supplied
- Dependency version
- Tax service changed after the prior baseline — M02-I03 (F11)
- Risk coverage
- One of at least eight planned slots; exact six-browser/two-mobile combinations remain unspecified — M02-I02 (F02).
- Evidence location
- Pending — test execution is outside this exercise
- Owner
- QA lead
- Status
- Draft — environment details not supplied
A well-handled evidence gap
- Environment ID
- ENV-02
- Build
- 4.8.17 staging — M02-I01 (F01)
- Browser/version
- Not supplied
- OS/device
- Mobile device model and OS not supplied
- Viewport/input
- Touch and responsive viewport details not supplied
- Assistive technology
- Not supplied
- Locale/network
- Not supplied
- Dependency version
- Current tax-service version not supplied
- Risk coverage
- Mobile scope exists, but the approved pairing and expected results are not supplied — M02-I02 (F02).
- Evidence location
- Not supplied
- Owner
- QA lead and accessibility reviewer
- Status
- Blocked — environment definition pending
Flawed approach — do not copy
Marking this cross-environment test-plan matrix “approved and complete” without the required evidence or reviewer is a flawed submission. Stop execution or coverage claims when build, environment, dependency, test data, or evidence-capture state is unknown.
Repair: Rework the cross-environment test-plan matrix as an evidence-backed draft, not an approved result. Freeze build 4.8.17 as the version under design review. Enumerate all six browser and two mobile-device slots instead of collapsing them into one desktop row. Add operating system, viewport/input method, assistive technology, locale, and network-state fields as not supplied where absent. Check the revision against this requirement: Six browser and two mobile-device slots are explicitly represented. If the required evidence is still absent, keep the decision blocked and identify the missing input or authorized reviewer.
Full case record, ambiguities and all assignments →