Skip to content

Commit 7a651bd

Browse files
papers: honesty + citation follow-up (paper-1 supersession, reverse-import, 2022 priority) (#53)
* papers: honesty + citation follow-up (paper-1 supersession, reverse-import, 2022 priority) Paper 1: dated supersession note retiring the Sections 4-5 likelihood-vs-Schur SELECTION contrast (objective-mismatch artifact, not a likelihood failure; the held-out likelihood does not pick ill-conditioned estimates); flags Section 6 'Schur-LW' as cross-block ENTRY shrinkage, not the structured Schur damping. Two Sides of Schur Damping: separate the (classical) shrinkage intensity from the Schur OPERATION (cite Schaefer & Strimmer 2005); add the reverse-import section (a ridge/robust hedge repairs the structured Schur estimator, shipped as SchurConditionalCovariance, best-on-likelihood); establish the 2022 priority of the allocation gamma-dial (Geek Culture, Nov 21 2022). refs.bib: correct cotton2024 title; add schafer2005, cotton2022. Regenerate docs web edition (pandoc 3.9.0.2). Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com> * docs: regenerate two-sides-of-schur-damping web edition (fixes docs-up-to-date) Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com> --------- Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
1 parent e00dc8c commit 7a651bd

7 files changed

Lines changed: 308 additions & 154 deletions

File tree

docs/papers/schur-likelihood/index.html

Lines changed: 22 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -64,6 +64,25 @@ <h1>Schur Covariance Evaluation</h1><div class="subtitle">A
6464
several-fold lower out-of-sample portfolio variance once the dimension
6565
rivals the sample size.</p></div>
6666

67+
<blockquote>
68+
<p><em>Note (added 2026, retained as a historical record).</em> The
69+
held-out-likelihood-versus-Schur <em>selection</em> contrast of
70+
Sections 4–5 does not survive scrutiny. In controlled follow-up
71+
experiments the full likelihood’s poor showing there is an artifact of
72+
judging by portfolio <em>variance</em> rather than by likelihood
73+
(objective mismatch), not a failure of the likelihood as a criterion:
74+
restricted to well-conditioned candidates and judged on its own terms it
75+
is in fact the better selector, and—contrary to a suspicion we briefly
76+
held—it does not select ill-conditioned estimates (the held-out
77+
likelihood penalises them). Two further corrections: the
78+
Schur–Ledoit–Wolf estimator of Section 6, as implemented, is cross-block
79+
<em>entry</em> shrinkage (a Schäfer–Strimmer-style operation), not the
80+
structured Schur damping it is named for; and that structured damping is
81+
viable only with a regularised hedge. The durable contributions are the
82+
closed-form reliability <span class="math inline">\gamma^\star</span>
83+
(Section 3) and the estimator family. See the companion note <em>Two
84+
Sides of Schur Damping</em> for the corrected and unified account.</p>
85+
</blockquote>
6786
<h2 id="the-high-dimensional-failure-of-the-gaussian-likelihood">The
6887
high-dimensional failure of the Gaussian likelihood</h2>
6988
<p>A correlation matrix is the hard part of a covariance matrix:
@@ -504,8 +523,9 @@ <h2 id="conclusion">Conclusion</h2>
504523
Theory.”</span> <em>Physics Reports</em> 666: 1–109.
505524
</div>
506525
<div id="ref-cotton2024" class="csl-entry" role="listitem">
507-
Cotton, Peter. 2024. <span>“Schur Complementary Portfolios.”</span>
508-
<em>arXiv Preprint arXiv:2411.05807</em>.
526+
Cotton, Peter. 2024. <span>“Schur Complementary Allocation: A
527+
Unification of Hierarchical Risk Parity and Minimum Variance
528+
Portfolios.”</span> <em>arXiv Preprint arXiv:2411.05807</em>.
509529
</div>
510530
<div id="ref-james1961" class="csl-entry" role="listitem">
511531
James, W., and Charles Stein. 1961. <span>“Estimation with Quadratic

docs/papers/two-sides-of-schur-damping/index.html

Lines changed: 184 additions & 107 deletions
Large diffs are not rendered by default.

papers/refs.bib

Lines changed: 20 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -48,7 +48,7 @@ @techreport{antonov2024
4848

4949
@article{cotton2024,
5050
author = {Cotton, Peter},
51-
title = {Schur Complementary Portfolios},
51+
title = {Schur Complementary Allocation: A Unification of Hierarchical Risk Parity and Minimum Variance Portfolios},
5252
journal = {arXiv preprint arXiv:2411.05807},
5353
year = {2024}
5454
}
@@ -235,3 +235,22 @@ @misc{cotton2025psl
235235
year = {2025},
236236
note = {Note, \texttt{microprediction/precise}}
237237
}
238+
239+
@article{schafer2005,
240+
author = {Sch\"afer, Juliane and Strimmer, Korbinian},
241+
title = {A Shrinkage Approach to Large-Scale Covariance Matrix Estimation and Implications for Functional Genomics},
242+
journal = {Statistical Applications in Genetics and Molecular Biology},
243+
volume = {4},
244+
number = {1},
245+
pages = {Article 32},
246+
year = {2005}
247+
}
248+
249+
@misc{cotton2022,
250+
author = {Cotton, Peter},
251+
title = {Schur Complementary Portfolios: A Unification of Machine Learning and Optimization-Based Allocation},
252+
year = {2022},
253+
month = nov,
254+
howpublished = {Geek Culture (Medium)},
255+
note = {\url{https://medium.com/geekculture/schur-complementary-portfolios-fix-hierarchical-risk-parity-28b0efa1f35f}}
256+
}

papers/schur_likelihood_paper.pdf

292 KB
Binary file not shown.

papers/schur_likelihood_paper.tex

Lines changed: 13 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -35,6 +35,19 @@
3535
lower out-of-sample portfolio variance once the dimension rivals the sample size.
3636
\end{abstract}
3737

38+
\begin{quote}\small\emph{Note (added 2026, retained as a historical record).} The held-out-likelihood-versus-Schur
39+
\emph{selection} contrast of Sections~4--5 does not survive scrutiny. In controlled follow-up
40+
experiments the full likelihood's poor showing there is an artifact of judging by portfolio
41+
\emph{variance} rather than by likelihood (objective mismatch), not a failure of the likelihood as a
42+
criterion: restricted to well-conditioned candidates and judged on its own terms it is in fact the
43+
better selector, and---contrary to a suspicion we briefly held---it does not select ill-conditioned
44+
estimates (the held-out likelihood penalises them). Two further corrections: the Schur--Ledoit--Wolf
45+
estimator of Section~6, as implemented, is cross-block \emph{entry} shrinkage (a Sch\"afer--Strimmer-style
46+
operation), not the structured Schur damping it is named for; and that structured damping is viable only
47+
with a regularised hedge. The durable contributions are the closed-form reliability $\gamma^\star$
48+
(Section~3) and the estimator family. See the companion note \emph{Two Sides of Schur Damping} for the
49+
corrected and unified account.\end{quote}
50+
3851
\section{The high-dimensional failure of the Gaussian likelihood}
3952
A correlation matrix is the hard part of a covariance matrix: variances are a one-dimensional,
4053
per-series problem, while the high-dimensional difficulty---the near-singular spectrum and the unstable
-117 KB
Binary file not shown.

0 commit comments

Comments
 (0)