02 · Compare the artifacts
Supported work. Visible uncertainty.
This is a fictional, sanitized software-quality case. All systems, users, transactions, and records are fabricated; testing remains authorized and bounded and provides no security, legal, accessibility, or defect-free guarantee.
BlueMesa checkout release
BlueMesa is a fictional business-to-business storefront preparing release 4.8 of its checkout. The approved requirement says authenticated buyers may purchase approved catalog items up to their account credit limit, apply one active contract discount, choose an allowed shipping method, and receive an accessible confirmation. The release candidate is build 4.8.17 in staging. Six browsers and two mobile devices are in scope, but the test plan lists only the latest desktop Chrome. A sample account has a $10,000 credit limit and an existing $9,600 open balance. The cart contains a $700 item, a 10 percent contract discount, $55 shipping, and an 8.25 percent tax rule. The product owner expects the order to be blocked, while the developer says discounts should be considered before the credit check; the requirement does not state calculation order. In preliminary testing, the keyboard focus disappears after the shipping modal closes, the error summary is not announced by the screen reader, and refreshing after payment timeout sometimes creates a second pending order. Logs show the same idempotency key on both requests, but the payment sandbox returns different response identifiers. The tax service was upgraded after the last regression baseline. A defect titled checkout broken includes no build, data, steps, expected result, actual result, or evidence. Marketing already announced Friday availability, and the release manager proposes accepting all medium defects. Learners must define risk and acceptance, control environments, write reproducible tests, explore edge cases within authority, classify defects, and make an evidence-bounded release recommendation. They must not conduct unapproved security testing or claim exhaustive coverage.
Supported example — reference only
- Section
- Mission and risk focus
- Supported statement
- Explore how build 4.8.17 handles money boundaries, focus/announcement, timeout refresh, and repeated idempotency using safe staging data.
- Source input ID
- F03, F07, F08, F09, F10
- Assumption or gap
- Exact timebox, environments, safe account, and approved expected results are not supplied.
- Decision requested
- Approve charter scope and evidence method before a session.
- Reviewer
- QA lead with product, payments, and accessibility reviewers
- Status
- Draft - session not run
A well-handled evidence gap
- Section
- Oracle and stopping conditions
- Supported statement
- Product/development disagree and the requirement does not define calculation order.
- Source input ID
- F05, F06
- Assumption or gap
- A pass oracle cannot be created for the credit calculation.
- Decision requested
- Obtain an authorized product/finance decision; explore only observable differences meanwhile.
- Reviewer
- Product and finance/payments owners
- Status
- Blocked for pass/fail conclusion
Flawed approach — do not copy
Marking this exploratory test charter “approved and complete” without the required evidence or reviewer is a flawed submission. Pause for unsafe payment side effects, sensitive data, environment drift, or an absent oracle required for a conclusion.
Repair: Rework the exploratory test charter as an evidence-backed draft, not an approved result. State one bounded mission around checkout money, accessibility, and duplicate-order risk. List supplied starting observations separately from learner-designed hypotheses. Choose tours for boundary arithmetic, modal focus, announced errors, timeout refresh, and repeated idempotency. Check the revision against this requirement: Mission, tours, variables, evidence, timebox gap, and stop conditions are explicit. If the required evidence is still absent, keep the decision blocked and identify the missing input or authorized reviewer.
Full case record, ambiguities and all assignments →