02 · Compare the artifacts
Supported work. Visible uncertainty.
This is a fictional, sanitized software-quality case. All systems, users, transactions, and records are fabricated; testing remains authorized and bounded and provides no security, legal, accessibility, or defect-free guarantee.
BlueMesa checkout release
BlueMesa is a fictional business-to-business storefront preparing release 4.8 of its checkout. The approved requirement says authenticated buyers may purchase approved catalog items up to their account credit limit, apply one active contract discount, choose an allowed shipping method, and receive an accessible confirmation. The release candidate is build 4.8.17 in staging. Six browsers and two mobile devices are in scope, but the test plan lists only the latest desktop Chrome. A sample account has a $10,000 credit limit and an existing $9,600 open balance. The cart contains a $700 item, a 10 percent contract discount, $55 shipping, and an 8.25 percent tax rule. The product owner expects the order to be blocked, while the developer says discounts should be considered before the credit check; the requirement does not state calculation order. In preliminary testing, the keyboard focus disappears after the shipping modal closes, the error summary is not announced by the screen reader, and refreshing after payment timeout sometimes creates a second pending order. Logs show the same idempotency key on both requests, but the payment sandbox returns different response identifiers. The tax service was upgraded after the last regression baseline. A defect titled checkout broken includes no build, data, steps, expected result, actual result, or evidence. Marketing already announced Friday availability, and the release manager proposes accepting all medium defects. Learners must define risk and acceptance, control environments, write reproducible tests, explore edge cases within authority, classify defects, and make an evidence-bounded release recommendation. They must not conduct unapproved security testing or claim exhaustive coverage.
Supported example — reference only
- Criterion ID
- AC-CREDIT-01
- Given state
- $10,000 limit; $9,600 open balance; cart has a $700 item, ten-percent discount, $55 shipping, and an 8.25-percent tax rule.
- Action
- Learner-proposed check of the credit decision using an approved calculation sequence.
- Expected observable result
- Decision gap — expected approval/decline result cannot be fixed until the calculation order is approved.
- Formula or rounding rule
- Operands are supplied; calculation order and rounding points are not supplied because product/development disagree and the requirement is undefined.
- Environment
- Not supplied
- Source IDs
- M01-I01 (F03); M01-I02 (F04); M01-I03 (F05); M01-I04 (F06)
- Requirement status
- Conflicting / not supplied
- Owner
- Product owner with engineering and QA review
- Test status
- Blocked — requirement decision pending
A well-handled evidence gap
- Criterion ID
- AC-FOCUS-02
- Given state
- Keyboard focus disappears after the shipping modal closes.
- Action
- Close the shipping modal using a keyboard in an approved test environment.
- Expected observable result
- Approved focus-return target and observable focus state are not supplied.
- Formula or rounding rule
- Not applicable
- Environment
- Browser, OS/device, viewport, input method, and build evidence not supplied.
- Source IDs
- M01-I05 (F07)
- Requirement status
- Observed defect; acceptance target incomplete
- Owner
- Accessibility reviewer and frontend engineering owner
- Test status
- Not run — environment and expected target pending
Flawed approach — do not copy
Marking this acceptance-criteria table “approved and complete” without the required evidence or reviewer is a flawed submission. Stop pass/fail or release claims when the requirement, formula, environment, or expected state is disputed or absent.
Repair: Rework the acceptance-criteria table as an evidence-backed draft, not an approved result. Capture account, cart, tax, requirement-conflict, accessibility, and duplicate-order facts with source IDs. Separate supplied observations from proposed acceptance rules. Write each criterion as observable given/when/then behavior with a single pass condition. Check the revision against this requirement: Money, accessibility, duplicate, and recovery criteria are observable and traceable. If the required evidence is still absent, keep the decision blocked and identify the missing input or authorized reviewer.
Full case record, ambiguities and all assignments →