02 · Compare the artifacts
Supported work. Visible uncertainty.
This is a fictional, sanitized software-quality case. All systems, users, transactions, and records are fabricated; testing remains authorized and bounded and provides no security, legal, accessibility, or defect-free guarantee.
BlueMesa checkout release
BlueMesa is a fictional business-to-business storefront preparing release 4.8 of its checkout. The approved requirement says authenticated buyers may purchase approved catalog items up to their account credit limit, apply one active contract discount, choose an allowed shipping method, and receive an accessible confirmation. The release candidate is build 4.8.17 in staging. Six browsers and two mobile devices are in scope, but the test plan lists only the latest desktop Chrome. A sample account has a $10,000 credit limit and an existing $9,600 open balance. The cart contains a $700 item, a 10 percent contract discount, $55 shipping, and an 8.25 percent tax rule. The product owner expects the order to be blocked, while the developer says discounts should be considered before the credit check; the requirement does not state calculation order. In preliminary testing, the keyboard focus disappears after the shipping modal closes, the error summary is not announced by the screen reader, and refreshing after payment timeout sometimes creates a second pending order. Logs show the same idempotency key on both requests, but the payment sandbox returns different response identifiers. The tax service was upgraded after the last regression baseline. A defect titled checkout broken includes no build, data, steps, expected result, actual result, or evidence. Marketing already announced Friday availability, and the release manager proposes accepting all medium defects. Learners must define risk and acceptance, control environments, write reproducible tests, explore edge cases within authority, classify defects, and make an evidence-bounded release recommendation. They must not conduct unapproved security testing or claim exhaustive coverage.
Supported example — reference only
- Test ID
- TEST-01
- Requirement/risk
- Credit-decision arithmetic is disputed — M03-I03 (F05); approved order is absent — M03-I04 (F06).
- Preconditions
- Sample account has $10,000 limit and $9,600 open balance — M03-I01 (F03).
- Test data
- $700 item, ten-percent discount, $55 shipping, 8.25-percent tax rule — M03-I02 (F04).
- Ordered steps
- 1) Load approved safe account; 2) enter supplied cart values; 3) submit only after the calculation rule is approved; 4) capture operands and decision trace.
- Expected result or decision gap
- Blocked — calculation order, rounding points, and expected credit decision are not supplied.
- Environment
- Not supplied
- Evidence to capture
- Calculation trace, displayed totals, decision message, request/response IDs, and timestamp.
- Reviewer
- Product owner, engineering owner, and QA lead
- Result
- Not run
- Status
- Draft — oracle decision pending
A well-handled evidence gap
- Test ID
- TEST-02
- Requirement/risk
- Refresh after payment timeout can create a second pending order — M03-I07 (F09); duplicate requests share a key but sandbox IDs differ — M03-I08 (F10).
- Preconditions
- Approved safe payment sandbox account and timeout setup are not supplied.
- Test data
- Payment payload, idempotency-key generation rule, and expected record state are not supplied.
- Ordered steps
- Learner-proposed sequence: submit, induce approved timeout, refresh once, and compare order/request records.
- Expected result or decision gap
- Expected duplicate-request and order-state behavior requires authorized product/payments decision.
- Environment
- Not supplied
- Evidence to capture
- Request IDs, key, response IDs, order IDs/statuses, timestamps, and logs.
- Reviewer
- Payments engineer, product owner, and QA lead
- Result
- Not run
- Status
- Blocked — safe setup and oracle not supplied
Flawed approach — do not copy
Marking this six test-case designs “approved and complete” without the required evidence or reviewer is a flawed submission. Stop execution or defect conclusions when expected behavior, environment, safe test data, or evidence method is missing.
Repair: Rework the six test-case designs as an evidence-backed draft, not an approved result. Create exactly six stable test-case IDs spanning money boundary, calculation ambiguity, keyboard focus, screen-reader summary, timeout refresh, and idempotency. Write preconditions and test data directly from supplied facts without inventing credentials or records. Express each action sequence as a learner-proposed reproducible method. Check the revision against this requirement: Exactly six distinct risk-based designs are present. If the required evidence is still absent, keep the decision blocked and identify the missing input or authorized reviewer.
Full case record, ambiguities and all assignments →