The observation unit is one receipt and its proposed allocation across one or more customer balances; missing and conflicted evidence remain explicit outcomes.
Research question and boundary
Partial Payment Allocation Decision Repeatability protocol note 1: This protocol will measure whether independent reviewers classify the same partial-payment allocation evidence consistently. It evaluates local administrative evidence and does not authorize posting, credit, collection, tax, legal, refund, payment, or customer decisions.
Partial Payment Allocation Decision Repeatability protocol note 2: Register the question, systems, workflow versions, dates, population rules, exclusions, primary outcome, subgroup plan, and stop criteria before viewing results. Preserve dated amendments.
Population and sampling frame
Partial Payment Allocation Decision Repeatability protocol note 3: The observation unit is one receipt and its proposed allocation across one or more customer balances. Build the frame from stable identifiers and retain canceled, superseded, failed, unresolved, corrected, and restricted records.
Partial Payment Allocation Decision Repeatability protocol note 4: If a census is impractical, use a reproducible random sample with predeclared strata and a published seed. Do not replace an incomplete selected record with a cleaner example.
Data dictionary and lineage
Partial Payment Allocation Decision Repeatability protocol note 5: Capture study key, payer, amount, remittance, candidate invoices, proposed split, difference, first code, second code, confidence, and adjudication. Define allowed values, authoritative source, observation time, transformation, missing-state codes, and adjudication for every field.
Partial Payment Allocation Decision Repeatability protocol note 6: Keep absent, inaccessible, disputed, not applicable, overwritten, and indeterminate as distinct states. Link derived values to the read-only extract and transformation log.
Reviewer reliability
Partial Payment Allocation Decision Repeatability protocol note 7: Train reviewers on cases outside the scored sample, lock the dictionary, and independently double-code a blinded overlap set. Retain confidence and initial choices before discussion.
Partial Payment Allocation Decision Repeatability protocol note 8: Publish raw agreement, category-specific disagreement, chance-adjusted agreement where suitable, adjudication counts, and every rubric clarification. Weak agreement is a measurement result.
Primary analysis
Partial Payment Allocation Decision Repeatability protocol note 9: Compare remittance format, split count, difference presence, customer match, reviewer pair, and final code. Report counts, denominators, missingness, and uncertainty with rates; for elapsed time show medians, quartiles, age bands, and unresolved observations.
Partial Payment Allocation Decision Repeatability protocol note 10: The primary outcome is raw and chance-adjusted agreement on supported, conflicted, insufficient-evidence, or not-applicable classification. Keep evidence quality separate from operating performance because missing documentation cannot prove that an event occurred or failed.
Sensitivity checks
Partial Payment Allocation Decision Repeatability protocol note 11: Recalculate under strict source-only evidence and the declared adjudication rule. Bound inaccessible units once as missing and once as adverse, then repeat after removing linked duplicates.
Partial Payment Allocation Decision Repeatability protocol note 12: Preserve the registered result when alternatives look more favorable. Explain the changed assumption, number of units moved, and whether the operational recommendation reverses.
Privacy and limitations
Partial Payment Allocation Decision Repeatability protocol note 13: The central limit is that agreement on evidence status does not authorize posting or prove an accounting treatment. Also assess selection, channel-specific missingness, system clocks, retrospective corrections, workflow changes, correlated accounts, and reviewer learning.
Partial Payment Allocation Decision Repeatability protocol note 14: Replace customer, employee, bank, and transaction identifiers with study keys. Restrict the linkage table, minimize free text, log access, and suppress sensitive small cells.
Evidence quality checks
Partial Payment Allocation Decision Repeatability protocol note 15: Trace a stratified quality sample back to study key, payer, amount, remittance, candidate invoices, proposed split, difference, first code, second code, confidence, and adjudication. Confirm that extraction preserved the source event, actor, version, time zone, and later correction; a derivative spreadsheet is not independent confirmation.
Partial Payment Allocation Decision Repeatability protocol note 16: Record every failed link, inaccessible artifact, conflicting value, and reviewer query in an evidence-quality log. Retain the affected observation in its missing or disputed category.
Governance and replication
Partial Payment Allocation Decision Repeatability protocol note 17: Separate data custody, coding, adjudication, and operational approval where practical. Disclose conflicts and require an authorized owner for any use beyond the registered purpose.
Partial Payment Allocation Decision Repeatability protocol note 18: Give a second analyst the frozen extract, dictionary, and transformation log without private notes. Compare replicated counts and exceptions, explain differences, and version the final package.
Reporting and responsible use
Partial Payment Allocation Decision Repeatability protocol note 19: Publish frame construction, observation count, exclusions, coverage, dictionary, missingness, reliability, primary estimate, groups, sensitivities, counterexamples, and limitations.
Partial Payment Allocation Decision Repeatability protocol note 20: Use findings for a bounded process trial with an owner, duration, review date, rollback condition, and privacy check. Do not use this study alone for discipline, surveillance, or automated consequential decisions.
Sources
Put the protocol into operational context.
Discuss the queue, evidence, ownership, and safeguards that apply to your workflow.
Discuss your workflow