Every metric, tested against a baseline.
Here's what survived.
We ran ~173 candidate metrics1 through a rigorous incremental information coefficient gate. 6 passed. The failures are shown too — that's what honest validation looks like.
1 Candidates tested, as the validation API reports them: ~90 across 3 discovery runs + 42 in wave-4 SPY-only batch (2026-07-16) + 41 in wave-8 domain-matched re-run (2026-07-17). The board below shows a representative subset, not every candidate.
What a metric must prove
Method: partial Spearman Information Coefficient (incremental IC)
Controlling for the naive baseline, the metric must add incremental_ic >= 0.05 with p < 0.05. Incremental IC = partial Spearman rank-correlation of the signal vs forward target, residualised on the naive baseline.
Dataset: ~10y daily prices, 8-9 tickers (SPY, QQQ, AAPL, MSFT, NVDA, AMZN, GOOGL, META + others), ~22,793 observations · +42 newly-live products scored 2026-07-16 vs SPY next-day return (FRED SP500 proxy) · +41 domain-matched re-run 2026-07-17 vs BTC/XLE/XLV/XLF/XLK/XLY/IYT/DBA/SPY next-day returns
Latest gate run: 2026-07-17. Results fetched from the ADW validation API when this page was built (2026-11-21).
16 metrics on the board
6 passed · 7 failed · 3 demoted
Passed rows are shown first. Failed rows follow — we publish them because hiding negative results would defeat the purpose of having a gate. Demoted rows passed one run but failed a stricter re-test, so they are not counted as validated.
Passed the gate (6)
| Metric | Target | Baseline IC | Incr. IC | p-value | Result |
|---|---|---|---|---|---|
| Entropy-Weighted CUSUM Volatility Signal (EWC) ADW-101 | forward 5-day realized volatility vs. trailing-20d realized volatility | 0.691 | 0.125 | < 1e-10 | PASS |
| Tail Probability Shift (TPS) ADW-102 | forward 5-day realized volatility vs. trailing-20d realized volatility | 0.691 | -0.095(flip) | < 1e-10 | PASS |
| Local Tail Variance Ratio (LTVR) ADW-105 | forward 5-day realized volatility vs. trailing-20d realized volatility | 0.691 | 0.058 | 7.20e-9 | PASS |
| Tail Mean Difference (TMD) ADW-106 | forward 5-day return vs. 20-day momentum | — | 0.054 | 1.00e-7 | PASS |
| Public Data Source Quality & Freshness Index ADW-010 | next-day SPY return (FRED SP500 proxy) vs. 20d rolling z-score of daily SPY return | 0.018 | -0.084(flip) | 0.0243 | PASS |
| US Bank Stability & Branch Coverage Index ADW-004 | next-day XLF return vs. 20d rolling z-score of daily XLF return | -0.096 | 0.092 | 0.0252 | PASS |
Did not pass (7)
| Metric | Target | Baseline IC | Incr. IC | p-value | Result |
|---|---|---|---|---|---|
| Geometric Autocorrelation (GAC) CAND-GAC | forward 5-day realized volatility vs. trailing-20d realized volatility | 0.691 | 0.023 | 0.0073 | FAIL |
| H-KER (Hurst-Kernel Entropy Ratio) CAND-H-KER | forward 5-day return vs. 20-day momentum | — | — | 0.3040 | FAIL |
| OUV (Ornstein-Uhlenbeck Volatility) CAND-OUV | forward 5-day return vs. 20-day momentum | — | — | 0.2310 | FAIL |
| EHA (Entropy-Hurst Asymmetry) CAND-EHA | forward 5-day return vs. 20-day momentum | — | — | 0.7100 | FAIL |
| Tail Concentration Ratio CAND-R1-TCR | forward 5-day realized volatility vs. trailing-20d realized volatility | 0.691 | 0.019 | 0.0610 | FAIL |
| Median Absolute Deviation Ratio CAND-R2-MADR | forward 5-day realized volatility vs. trailing-20d realized volatility | 0.691 | 0.013 | 0.2100 | FAIL |
| Fractal Hurst CAND-R2-FH | forward 5-day realized volatility vs. trailing-20d realized volatility | 0.691 | 0.004 | 0.7200 | FAIL |
Demoted on re-test (3)
These passed when scored only against the S&P 500 (SPY). A re-run against each product’s own sector benchmark rejected them, which means the first pass was picking up broad-market moves. They stay on the board for the audit trail and are not counted among the 6 validated.
| Metric | Target | Incr. IC | p-value | Result |
|---|---|---|---|---|
| Energy Grid Carbon Intensity Summary ADW-006 | next-day SPY return (FRED SP500 proxy) vs. 20d rolling z-score of daily SPY return | 0.085 | 0.0462 | DEMOTED |
| 3-Ps Mix Index ADW-205 | next-day SPY return (FRED SP500 proxy) vs. 20d rolling z-score of daily SPY return | -0.123 | 0.0068 | DEMOTED |
| Software Dependency Risk ADW-436 | next-day SPY return (FRED SP500 proxy) vs. 20d rolling z-score of daily SPY return | -0.103 | 0.0186 | DEMOTED |
What this means for you
Failures included
Any vendor can cherry-pick winners. We publish every candidate we ran, including the ones that looked good on raw IC but failed the incremental gate.
Not just "significant"
We control for the naive baseline. A metric that correlates with a simple moving average adds no value — it has to add incremental signal beyond what you already have.
API-backed
This page is rebuilt from the live validation API. When new candidates are tested or results are updated, the scoreboard reflects it automatically.