Hermes Confidence Model & Evidence Verification Framework
1. The Epistemological Hierarchy: Fact vs. Inference vs. Prediction
Section titled โ1. The Epistemological Hierarchy: Fact vs. Inference vs. PredictionโIn traditional cybersecurity reporting, analysts frequently blur the boundary between observed ground truth and speculative hypotheses. Hermes formalizes four distinct epistemic tiers:
โโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโ 1. FACT โโ Directly observable, empirically verified, primary-source data. โโ Example: "A commit fixing CVE-2026-41264 was merged to Flowise main." โโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโคโ 2. INFERENCE โโ Logical deduction derived from technical ground facts. โโ Example: "The patch adds AST validation, confirming the sink was โโ un-sandboxed Python execution." โโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโคโ 3. PREDICTION โโ Probabilistic forecast of adversary behavior or exploit spread. โโ Example: "Hermes estimates an 82% probability of automated scanner โโ weaponization within 72 hours." โโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโคโ 4. HYPOTHESIS โโ Working theoretical model subject to ongoing falsification. โโ Example: "The campaign may be affiliated with Storm-1175 based on โโ shared PowerShell stagers." โโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโ2. Mathematical Confidence Scoring Formula
Section titled โ2. Mathematical Confidence Scoring FormulaโEvery score and analytic judgment produced by Hermes Codex is accompanied by a Confidence Value ($C \in [0.0, 1.0]$) derived from technical evidence rather than unconstrained model generation.
The confidence score is computed as:
Confidence (C) = min(1.0, max(0.1, BaseQuality + Sum(SourceBonuses) - ContradictionPenalty - DistancePenalty))Components of the Formula:
Section titled โComponents of the Formula:โ- Source Reliability Weight ($W_s \in [0.1, 0.35]$):
- Official Vendor Advisories, CERTs, CISA KEV:
0.35 - Verified Security Research Lab / PoC Repository:
0.25 - Automated Threat Scanners / Aggregators:
0.15 - Unverified Social Media / Forum Claims:
0.05
- Official Vendor Advisories, CERTs, CISA KEV:
- Multi-Source Corroboration Bonus ($+0.10$ per independent source, up to $+0.30$):
- Agreement across $\ge 3$ independent telemetry sources guarantees high confidence.
- Technical Verification Bonus ($+0.25$):
- Awarded if a functional exploit or sandbox test has been successfully verified in the Hermes isolated lab environment.
- Contradiction Penalty ($-0.35$):
- Applied immediately if primary sources dispute root causes, impact scopes, or active exploitation.
- Inference Distance Penalty ($-0.10$ per deduction hop):
- Penalizes conclusions that require multiple chained assumptions without intermediate telemetry.
3. Confidence Classification Tiers
Section titled โ3. Confidence Classification Tiersโ| Confidence Score | Qualitative Tier | Publishing Threshold | Operational Action |
|---|---|---|---|
| 0.90 โ 1.00 | VERY HIGH | Automated Publication | Direct actionable intelligence; emergency remediation advisory. |
| 0.75 โ 0.89 | HIGH | Automated Publication | Standard intelligence briefing with verified telemetry citations. |
| 0.55 โ 0.74 | MEDIUM | Requires Critic Pass | Published with prominent caveats highlighting pending verification. |
| 0.35 โ 0.54 | LOW | Hold for Evidence | Staged internally; blocked from main threat boards. |
| 0.00 โ 0.34 | VERY LOW | Rejection | Discarded as unverified rumor or hallucination. |
4. Handling Intelligence Disagreements
Section titled โ4. Handling Intelligence DisagreementsโWhen primary sources conflict, Hermes Codex never forces an artificial consensus. The platform explicitly highlights and documents the dispute:
โโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโ โ ๏ธ INTELLIGENCE DISAGREEMENT DETECTED โโ โโ Source A (Vendor Advisory): "CVSS 7.2 โ User Interaction โโ Required; no remote vector without physical terminal." โโ โโ Source B (Pillar Security Research): "CVSS 8.8 / HASS 91 โ โโ Auto-Run mode executes shell built-ins without confirmation.โโ โโ Hermes Resolution: โโ Hermes sides with technical laboratory verification (B) โโ because Auto-Run bypasses user prompts at runtime. โโ Confidence adjusted to 88% due to vendor dispute. โโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโThis ensures full transparency and prevents model hallucinations from masquerading as definitive facts.
5. Live Multi-Model Consensus Dispersion Matrix (Section 11)
Section titled โ5. Live Multi-Model Consensus Dispersion Matrix (Section 11)โMulti-Perspective Consensus & Epistemic Conflict Engine
Objective measurement of divergence between theoretical models (CVSS), in-the-wild probabilities (EPSS), and Hermes operational telemetry (HTS).
Key Divergence Anomalies & Model Conflicts
Vulnerabilities where theoretical CVSS or historical EPSS drastically diverge from observed reality.
CVSS overestimates theoretical severity while real-world EPSS and telemetry confirm absence of wild weaponization.
CVSS overestimates theoretical severity while real-world EPSS and telemetry confirm absence of wild weaponization.
CVSS overestimates theoretical severity while real-world EPSS and telemetry confirm absence of wild weaponization.
CVSS overestimates theoretical severity while real-world EPSS and telemetry confirm absence of wild weaponization.
CVSS overestimates theoretical severity while real-world EPSS and telemetry confirm absence of wild weaponization.
CVSS overestimates theoretical severity while real-world EPSS and telemetry confirm absence of wild weaponization.
CVSS overestimates theoretical severity while real-world EPSS and telemetry confirm absence of wild weaponization.
CVSS overestimates theoretical severity while real-world EPSS and telemetry confirm absence of wild weaponization.
CVSS overestimates theoretical severity while real-world EPSS and telemetry confirm absence of wild weaponization.
CVSS overestimates theoretical severity while real-world EPSS and telemetry confirm absence of wild weaponization.
CVSS overestimates theoretical severity while real-world EPSS and telemetry confirm absence of wild weaponization.
CVSS overestimates theoretical severity while real-world EPSS and telemetry confirm absence of wild weaponization.
CVSS overestimates theoretical severity while real-world EPSS and telemetry confirm absence of wild weaponization.
CVSS overestimates theoretical severity while real-world EPSS and telemetry confirm absence of wild weaponization.
CVSS overestimates theoretical severity while real-world EPSS and telemetry confirm absence of wild weaponization.