If every candidate's loss is measurable and a.e. valued in [a, b] under Q, every training-generated trajectory is admissible for F, and the resulting uniform-deviation failure event is measurable, then on an i.i.d. panel of size n drawn from Q, measured cumulative empirical-loss progress exceeds population-loss progress by more than 2 · deltaFiniteExperts (card ι) n (b - a) δ with probability at most ENNReal.ofReal δ.
∀ {Ωtrain : Type u_1} {Z : Type u_2} {ι : Type u_3} [inst : MeasurableSpace Ωtrain] [inst_1 : MeasurableSpace Z]
[inst_2 : Fintype ι] [Nonempty ι] (μtrain : AuditCP.AuditSampleLaw Ωtrain) [MeasureTheory.IsProbabilityMeasure μtrain]
(Q : AuditCP.AuditSampleLaw Z) [MeasureTheory.IsProbabilityMeasure Q] (n : ℕ),
0 < n →
∀ (a b : ℝ),
a < b →
∀ (δ : ℝ),
0 < δ →
δ ≤ 1 →
∀ (loss : ι → Z → ℝ),
(∀ (i : ι), Measurable (loss i)) →
(∀ (i : ι), ∀ᵐ (z : Z) ∂Q, loss i z ∈ Set.Icc a b) →
∀ (F : Ωtrain → AuditCP.AuditEnvelope ι) (g : Ωtrain → AuditCP.AuditTrajectory ι),
(∀ (t : Ωtrain), AuditCP.Admissible (g t) (F t)) →
MeasurableSet
{p |
¬AuditCP.UniformDev (F p.1) (fun i => AuditCP.empiricalLoss loss i p.2)
(fun i => AuditCP.populationLoss Q loss i)
(AuditCP.deltaFiniteExperts (Fintype.card ι) n (b - a) δ)} →
∀ (T : ℕ),
(MeasureTheory.Measure.prod μtrain (MeasureTheory.Measure.pi fun x => Q))
{p |
AuditCP.cumCP (fun i => AuditCP.empiricalLoss loss i p.2) (g p.1) T >
AuditCP.cumCP (fun i => AuditCP.populationLoss Q loss i) (g p.1) T +
2 * AuditCP.deltaFiniteExperts (Fintype.card ι) n (b - a) δ} ≤
ENNReal.ofReal δ- DeclAuditCP.auditBlind_finiteTrajectory_goodhartDeclaration kindtheorem
∀ {Ωtrain : Type u_1} {Z : Type u_2} {ι : Type u_3} [inst : MeasurableSpace Ωtrain] [inst_1 : MeasurableSpace Z] [inst_2 : Fintype ι] [Nonempty ι] (μtrain : AuditCP.AuditSampleLaw Ωtrain) [MeasureTheory.IsProbabilityMeasure μtrain] (Q : AuditCP.AuditSampleLaw Z) [MeasureTheory.IsProbabilityMeasure Q] (n : ℕ), 0 < n → ∀ (a b : ℝ), a < b → ∀ (δ : ℝ), 0 < δ → δ ≤ 1 → ∀ (loss : ι → Z → ℝ), (∀ (i : ι), Measurable (loss i)) → (∀ (i : ι), ∀ᵐ (z : Z) ∂Q, loss i z ∈ Set.Icc a b) → ∀ (F : Ωtrain → AuditCP.AuditEnvelope ι) (g : Ωtrain → AuditCP.AuditTrajectory ι), (∀ (t : Ωtrain), AuditCP.Admissible (g t) (F t)) → MeasurableSet {p | ¬AuditCP.UniformDev (F p.1) (fun i => AuditCP.empiricalLoss loss i p.2) (fun i => AuditCP.populationLoss Q loss i) (AuditCP.deltaFiniteExperts (Fintype.card ι) n (b - a) δ)} → ∀ (T : ℕ), (MeasureTheory.Measure.prod μtrain (MeasureTheory.Measure.pi fun x => Q)) {p | AuditCP.cumCP (fun i => AuditCP.empiricalLoss loss i p.2) (g p.1) T > AuditCP.cumCP (fun i => AuditCP.populationLoss Q loss i) (g p.1) T + 2 * AuditCP.deltaFiniteExperts (Fintype.card ι) n (b - a) δ} ≤ ENNReal.ofReal δ - DeclAuditCP.finite_experts_iid_badEvent_leDeclaration kindtheorem
Under the hypotheses of
finite_experts_iid_uniformDev, theENNReal-valued probability that the panel fails uniform deviation is at mostENNReal.ofReal δ.∀ {Z : Type u_1} {ι : Type u_2} [inst : MeasurableSpace Z] [inst_1 : Fintype ι] [Nonempty ι] (Q : AuditCP.AuditSampleLaw Z) [MeasureTheory.IsProbabilityMeasure Q] (n : ℕ), 0 < n → ∀ (a b : ℝ), a < b → ∀ (δ : ℝ), 0 < δ → δ ≤ 1 → ∀ (loss : ι → Z → ℝ), (∀ (i : ι), Measurable (loss i)) → (∀ (i : ι), ∀ᵐ (z : Z) ∂Q, loss i z ∈ Set.Icc a b) → (MeasureTheory.Measure.pi fun x => Q) {panel | ¬AuditCP.UniformDev Set.univ (fun i => AuditCP.empiricalLoss loss i panel) (fun i => AuditCP.populationLoss Q loss i) (AuditCP.deltaFiniteExperts (Fintype.card ι) n (b - a) δ)} ≤ ENNReal.ofReal δ - DeclAuditCP.finite_experts_iid_uniformDevDeclaration kindtheorem
If every candidate's loss is measurable and a.e. valued in
[a, b]underQ, then on an i.i.d. panel of sizendrawn fromQ, with probability at least1 − δthe empirical lossempiricalLoss loss i paneland the population losspopulationLoss Q loss iagree withindeltaFiniteExperts (card ι) n (b - a) δfor every candidatei(hoeffding1963; cesabianchi2006).∀ {Z : Type u_1} {ι : Type u_2} [inst : MeasurableSpace Z] [inst_1 : Fintype ι] [Nonempty ι] (Q : AuditCP.AuditSampleLaw Z) [MeasureTheory.IsProbabilityMeasure Q] (n : ℕ), 0 < n → ∀ (a b : ℝ), a < b → ∀ (δ : ℝ), 0 < δ → δ ≤ 1 → ∀ (loss : ι → Z → ℝ), (∀ (i : ι), Measurable (loss i)) → (∀ (i : ι), ∀ᵐ (z : Z) ∂Q, loss i z ∈ Set.Icc a b) → 1 - δ ≤ (MeasureTheory.Measure.pi fun x => Q).real {panel | AuditCP.UniformDev Set.univ (fun i => AuditCP.empiricalLoss loss i panel) (fun i => AuditCP.populationLoss Q loss i) (AuditCP.deltaFiniteExperts (Fintype.card ι) n (b - a) δ)} - DeclAuditCP.finite_experts_subgaussian_uniformDevDeclaration kindtheorem
If each
Y i jisμ-sub-Gaussian with proxy(L/2)²and, for each candidatei, independent across panel positionsj, then with probability at least1 − δthe panel means(∑ⱼ Y i j) / nall lie withindeltaFiniteExperts (card ι) n L δof0(hoeffding1963).∀ {Ω : Type u_1} {ι : Type u_2} [inst : MeasurableSpace Ω] [inst_1 : Fintype ι] [Nonempty ι] (μ : AuditCP.AuditSampleLaw Ω) [MeasureTheory.IsProbabilityMeasure μ] (n : ℕ), 0 < n → ∀ (L : ℝ), 0 < L → ∀ (δ : ℝ), 0 < δ → δ ≤ 1 → ∀ (Y : ι → Fin n → Ω → ℝ), (∀ (i : ι) (j : Fin n), ProbabilityTheory.HasSubgaussianMGF (Y i j) ((‖L‖₊ / 2) ^ 2) μ) → (∀ (i : ι), ProbabilityTheory.iIndepFun (Y i) μ) → 1 - δ ≤ MeasureTheory.Measure.real μ {ω | AuditCP.UniformDev Set.univ (fun i => (∑ j, Y i j ω) / ↑n) (fun x => 0) (AuditCP.deltaFiniteExperts (Fintype.card ι) n L δ)} - DeclAuditCP.auditBlind_randomTrajectory_goodhartDeclaration kindtheorem
If every training-generated trajectory
g tis admissible forF t, the uniform-deviation failure event is measurable, and its audit fiber has probability at mostδforμtrain-almost every training history, then measured cumulative compression progress exceeds true progress by more than2Δwith probability at mostδunderμtrain.prod μaudit.∀ {Ωtrain : Type u_1} {Ωaudit : Type u_2} {ι : Type u_3} [inst : MeasurableSpace Ωtrain] [inst_1 : MeasurableSpace Ωaudit] (μtrain : AuditCP.AuditSampleLaw Ωtrain) [MeasureTheory.IsProbabilityMeasure μtrain] (μaudit : AuditCP.AuditSampleLaw Ωaudit) [MeasureTheory.IsProbabilityMeasure μaudit] (F : Ωtrain → AuditCP.AuditEnvelope ι) (g : Ωtrain → AuditCP.AuditTrajectory ι) (Ehat : Ωaudit → AuditCP.AuditPotential ι) (E : AuditCP.AuditPotential ι) (Δ : ℝ) (δ : ENNReal), (∀ (t : Ωtrain), AuditCP.Admissible (g t) (F t)) → MeasurableSet {p | ¬AuditCP.UniformDev (F p.1) (Ehat p.2) E Δ} → (∀ᵐ (t : Ωtrain) ∂μtrain, μaudit {a | ¬AuditCP.UniformDev (F t) (Ehat a) E Δ} ≤ δ) → ∀ (T : ℕ), (MeasureTheory.Measure.prod μtrain μaudit) {p | AuditCP.cumCP (Ehat p.2) (g p.1) T > AuditCP.cumCP E (g p.1) T + 2 * Δ} ≤ δ - DeclAuditCP.finite_audit_goodhartDeclaration kindtheorem
Under
UniformDev F Ehat E ΔandAdmissible g F, empirical cumulative compression progress is bounded by true cumulative progress plus2Δat every horizonT:cumCP Ehat g T ≤ cumCP E g T + 2Δ.∀ {ι : Type u_1} {F : AuditCP.AuditEnvelope ι} {Ehat E : AuditCP.AuditPotential ι} {Δ : ℝ}, AuditCP.UniformDev F Ehat E Δ → ∀ {g : AuditCP.AuditTrajectory ι}, AuditCP.Admissible g F → ∀ (T : ℕ), AuditCP.cumCP Ehat g T ≤ AuditCP.cumCP E g T + 2 * Δ - DeclAuditCP.cumCP_telescopeDeclaration kindtheorem
Cumulative signed compression progress telescopes:
cumCP E g T = E (g 0) - E (g T).∀ {ι : Type u_1} (E : AuditCP.AuditPotential ι) (g : AuditCP.AuditTrajectory ι) (T : ℕ), AuditCP.cumCP E g T = E (g 0) - E (g T) - DeclAuditCP.auditBlind_randomClass_badEvent_leDeclaration kindtheorem
If the event
{p | Bad (Γ p.1) p.2}is measurable and its audit fiber{a | Bad (Γ t) a}hasμaudit-probability at mostδforμtrain-almost every training historyt, then its probability under the product lawμtrain.prod μauditis at mostδ.∀ {Ωtrain : Type u_1} {Ωaudit : Type u_2} {ι : Type u_3} [inst : MeasurableSpace Ωtrain] [inst_1 : MeasurableSpace Ωaudit] (μtrain : AuditCP.AuditSampleLaw Ωtrain) [MeasureTheory.IsProbabilityMeasure μtrain] (μaudit : AuditCP.AuditSampleLaw Ωaudit) [MeasureTheory.IsProbabilityMeasure μaudit] (Γ : Ωtrain → AuditCP.AuditEnvelope ι) (Bad : AuditCP.AuditEnvelope ι → Ωaudit → Prop) (δ : ENNReal), MeasurableSet {p | Bad (Γ p.1) p.2} → (∀ᵐ (t : Ωtrain) ∂μtrain, μaudit {a | Bad (Γ t) a} ≤ δ) → (MeasureTheory.Measure.prod μtrain μaudit) {p | Bad (Γ p.1) p.2} ≤ δ - Hypothesishn
0 < n
- Hypothesishab
a < b
- Hypothesishδ0
0 < δ
- Hypothesishδ1
δ ≤ 1
- Hypothesishmeas
∀ (i : ι), Measurable (loss i)
- Hypothesishbdd
∀ (i : ι), ∀ᵐ (z : Z) ∂Q, loss i z ∈ Set.Icc a b
- Hypothesishadm
∀ (t : Ωtrain), AuditCP.Admissible (g t) (F t)
- HypothesishBad
MeasurableSet {p | ¬AuditCP.UniformDev (F p.1) (fun i => AuditCP.empiricalLoss loss i p.2) (fun i => AuditCP.populationLoss Q loss i) (AuditCP.deltaFiniteExperts (Fintype.card ι) n (b - a) δ)} - DefinitionAuditCP.Admissibledef
Every stage of the trajectory
glies in the envelopeF.{ι : Type u_1} → AuditCP.AuditTrajectory ι → AuditCP.AuditEnvelope ι → Prop - DefinitionAuditCP.AuditEnvelopedef
B4 —
AuditEnvelope ιis the type of subsetsSet ιof the indexι.AuditCP.AuditIndex → Type u
- DefinitionAuditCP.AuditPotentialdef
B2 —
AuditPotential ιis the type of real-valued readingsι → ℝof the indexι.AuditCP.AuditIndex → Type u
- DefinitionAuditCP.AuditSampleLawdef
B7 —
AuditSampleLaw ΩisMeasureTheory.Measure Ω, a σ-additive probability law on the measurable spaceΩ.(Ω : AuditCP.AuditIndex) → [MeasurableSpace Ω] → Type u
- DefinitionAuditCP.AuditTrajectorydef
B3 —
AuditTrajectory ιis the type of stage-indexed selectionsℕ → ιof the indexι.AuditCP.AuditIndex → Type u
- DefinitionAuditCP.UniformDevdef
The potentials
EhatandEagree to withinΔat every point of the envelopeF.{ι : Type u_1} → AuditCP.AuditEnvelope ι → AuditCP.AuditPotential ι → AuditCP.AuditPotential ι → ℝ → Prop - DefinitionAuditCP.cumCPdef
Cumulative signed compression progress of a potential
Eread along a trajectorygoverTstages, ∑_{t < T} (E(g t) − E(g(t+1))) (schmidhuber1991; schmidhuber2010).{ι : Type u_1} → AuditCP.AuditPotential ι → AuditCP.AuditTrajectory ι → ℕ → ℝ - DefinitionAuditCP.deltaFiniteExpertsdef
The finite-experts uniform-deviation radius,
L·√(log(2N/δ)/(2n)), forNcandidates, panel sizen, loss rangeL, and failure probabilityδ(hoeffding1963).ℕ → ℕ → ℝ → ℝ → ℝ
- DefinitionAuditCP.empiricalLossdef
The empirical mean loss of candidate
ion the panel,(∑ⱼ loss i (panel j)) / n.{Z : Type u_1} → {ι : Type u_2} → {n : ℕ} → (ι → Z → ℝ) → ι → (Fin n → Z) → ℝ - DefinitionAuditCP.populationLossdef
The population loss of candidate
iunder the lawQ,∫ loss i z ∂Q.{Z : Type u_1} → {ι : Type u_2} → [inst : MeasurableSpace Z] → AuditCP.AuditSampleLaw Z → (ι → Z → ℝ) → ι → ℝ
Verification
- Replay
- accepted
- Axioms
- Classical.choiceQuot.soundpropext
- Statement identity
- not-applicable
- Substrate
- Lean 4 kernel v4.31.0
- Dictionary pin
- design-lab@5802df4 · initial
- Frozen export
- 823e9d21e1d7
- Verified
- 2026-09-24T00:00:00Z