Acquire
Validate
Register Events
Epoch
Preprocess
Extract Features
Analyze
Test Hypotheses
Verify
Report
Run A
Run B
Maximum permitted claim
PASSRun A
L1 · OBSERVEDRun B
L1 · OBSERVEDConfiguration diff
| Key | A | B |
|---|---|---|
| bands | delta,theta,alpha,beta,gamma | delta,theta,alpha,beta,gamma |
| cv | GroupKFold5 | GroupKFold5 |
| model | logistic_regression | logistic_regression |
| multiverse_spec | [object Object] | [object Object] |
| n_permutations | 50 | 100 |
| preregistered | true | false |
| random_seed | 42 | 42 |
| required_permutations | 1000 | 100 |
| run_mode | CONFIRMATORY | SMOKETEST |
| smoketest | true | true |
Primary result diff
| Metric | A | B | Δ |
|---|---|---|---|
| auc | 0.7222 | 0.7222 | 0 |
| balanced_accuracy | 0.6628 | 0.6628 | 0 |
| sensitivity | 0.3662 | 0.3662 | 0 |
| specificity | 0.9594 | 0.9594 | 0 |
| permutation_p | 0.0196 | 0.0099 | -0.0097 |
| cohens_d | 1.0860 | 1.0860 | 0 |
| n | 900.0000 | 900.0000 | 0 |
| n_permutations | 50.0000 | 100.0000 | 50 |
Evidence-gate diff (2 changed)
ALTERNATIVE MODEL A
UNRESOLVED→UNRESOLVED
ALTERNATIVE MODEL B
UNRESOLVED→UNRESOLVED
ALTERNATIVE MODEL C
UNRESOLVED→UNRESOLVED
ALTERNATIVE MODEL D
UNRESOLVED→UNRESOLVED
ALTERNATIVE MODEL E
UNRESOLVED→UNRESOLVED
AROUSAL CONTROL
INSUFFICIENT DATA→INSUFFICIENT DATA
ARTIFACT CONTROL
PASS→PASS
AUTOBIOGRAPHICAL MEMORY CONTROL
INSUFFICIENT DATA→INSUFFICIENT DATA
DATA LEAKAGE AUDIT
PASS→PASS
DEFINITION
PASS→PASS
EFFECT SIZE REQUIREMENT
PASS→PASS
FALSIFICATION CRITERIA
PRESPECIFIED→PRESPECIFIED
FAMILIARITY CONTROL
INSUFFICIENT DATA→INSUFFICIENT DATA
HELD OUT PARTICIPANT VALIDATION
INSUFFICIENT DATA→INSUFFICIENT DATA
HELD OUT SESSION VALIDATION
INSUFFICIENT DATA→INSUFFICIENT DATA
HELD OUT STIMULUS VALIDATION
INSUFFICIENT DATA→INSUFFICIENT DATA
INDEPENDENT REPLICATION
NOT TESTED→NOT TESTED
LIVING ATTACHMENT CONTROL
PASS→PASS
MEASUREMENT VALIDITY
PASS→PASS
MULTIPLE COMPARISON CONTROL
PASS→PASS
NEGATIVE CONTROLS
PASS→PASS
ORDER TIME CONTROL
INSUFFICIENT DATA→INSUFFICIENT DATA
PARTICIPANT ID CONTROL
NOT APPLICABLE→NOT APPLICABLE
PERMUTATION NULL
INSUFFICIENT DATA→PASS
POSITIVE CONTROL
PASS→PASS
PRE REGISTERED PREDICTION
PASS→UNRESOLVED
PROVENANCE
PASS→PASS
RAW DATA INTEGRITY
PASS→PASS
REPRODUCIBILITY
PASS→PASS
ROBUSTNESS ANALYSIS
PASS→PASS
STIMULUS CONTROL
INSUFFICIENT DATA→INSUFFICIENT DATA
TEST RETEST RELIABILITY
INSUFFICIENT DATA→INSUFFICIENT DATA
UNCERTAINTY
PASS→PASS
VALENCE CONTROL
INSUFFICIENT DATA→INSUFFICIENT DATA