Look at QQQ year-to-date: +15.3%.

If you stopped there, you’d conclude that 2026 has been a perfectly normal year for big tech — maybe a little soft compared to 2024, but nothing broken, nothing screaming. The index is up and the bull is intact, and from that altitude the whole sector looks fine.

Now look inside it.

SMH (semiconductors): +70.0% YTD.
IGV (software): -16.7% YTD.

That’s an 86.7 percentage-point spread between two sectors that, eighteen months ago, were considered the same trade — both filed under “tech,” both living in QQQ, both showing up in the same long-only growth funds, momentum screens, and “AI beneficiary” baskets. They are not the same trade anymore, and they are not even moving in the same directionanymore. And QQQ — the instrument that millions of people use as their proxy for “tech” — is hiding it.

The arithmetic of a lie

QQQ is a market-cap-weighted index. When one component rips 70% and another bleeds 17%, the index doesn’t show you the fracture — it shows you the weighted average of the boom and the bust, and reports a polite, unremarkable +15.3%. This is not a metaphor for what’s happening, it’s the literal mechanism: the index is mathematically designed to smooth over exactly the kind of internal civil war that is happening right now inside it.

And the civil war has a name: AI capex is a margin transfer. Every incremental dollar Microsoft, Meta, Amazon, and Google spend on Nvidia GPUs is a dollar that used to live as software operating margin and now lives as silicon revenue. Software isn’t losing to “the AI story” — software is the AI story, just on the wrong end of the income statement. I’ll prove the capex side of that claim in a minute. Hold that thought.

The Mag-7 is no longer one trade

Look at the chart above. SMH and IGV started the year at the same point, the gap reached 30 points by April, widened to 75 by June, and sits at 87 today. The QQQ line — the grey dashed one — sits between them like a man trying to look casual at a knife fight.

A careful reader is going to ask the obvious question: if MSFT is down 36% from highs and META is down 32% and AAPL is down 13%, how is QQQ only up 15%? The answer is the cleanest possible proof of the bifurcation: QQQ is being held up almost single-handedly by NVDA and the semiconductor weight inside it, while the software-adjacent Mag-7 names get beaten down. The index isn’t lying about the average — it’s hiding that the average is the difference between two violent moves in opposite directions.

Friday’s tape made this concrete in a single session.

On Friday, software ripped and semis sold off — the opposite of the YTD trend:

• MSFT: +6.37% · IGV: +4.21% · AAPL: +3.79%

• SMH: -4.27% · NVDA: -1.30% · GOOG: -1.77%

QQQ closed -1.08% — down a single percent on a day where one of its components was +6.4% and another was -4.3%. Whether the schism is widening or briefly closing, the volatility is happening inside the index rather than to it, and that is the actual signal. Friday’s tape is not a refutation of the thesis; it is the thesis in miniature. Tech is no longer one trade, and now it’s not even one direction.

“But this will mean-revert”

The natural counter-argument is that this is a rubber band — software is too cheap, semis are too expensive, and mean reversion will eventually save the IGV longs. Friday’s rip in MSFT and IGV will fuel that argument hard over the next few weeks.

Mean reversion works when both sides of a spread are pricing the same flow and sentiment briefly gets out of sync, the way two correlated stocks oscillate around a pair ratio. It does not work when the spread is the visible artifact of a one-directional, contractually-committed capital flow — and that’s what this is. Look at the dollars.

Hyperscaler capex, this quarter vs one year ago:

• MSFT: $16.7B → $30.9B (+84% YoY)

• AMZN: $25.0B → $44.2B (+77% YoY)

• META: $12.9B → $19.0B (+47% YoY)

• GOOG: $17.2B → $35.7B (+107% YoY)

• Big Four total: $71.9B → $129.8B per quarter, an additional $57.8B per quarter flowing into capex versus a year ago.

That is roughly the entire quarterly revenue of Salesforce, ServiceNow, Adobe, and Workday combined — being committed to capex every three months in incremental dollars alone, and most of it going to one place: silicon.

Capex of this size doesn’t oscillate. It is announced on earnings calls a year in advance, contracted with TSMC and Nvidia two years in advance, and built into power-purchase agreements three years in advance, with most of the spend already obligated by the time you read the press release. The hyperscalers can’t quietly walk it back without a guidance reset that crushes their own stocks. In the literal sense, the capital flow is locked in — the dollars going into silicon next quarter are already on order, and the dollars coming out of software margins to fund them are already on the budget. Mean reversion requires the flow to reverse, and the flow can’t reverse, because it’s signed.

Priced-in or observed?

Now here’s the honest part of this post, the part that makes me less certain than the rest.

Software margins haven’t actually compressed yet — not in most names. MSFT’s gross margin is essentially flat year-over-year (68.7% → 67.6%), Adobe is flat, Salesforce is flat. The one large software name that is showing real gross margin compression is **ServiceNow, down from 78.9% to 75.1% — nearly four full points of margin in a single year, which is enormous — but it is only one name.

So the bear case against the IGV trade is straightforward: this is anticipated deterioration, not observed deterioration.The market is pricing in margin compression that hasn’t fully arrived in the reported financials, which makes it at least possible that the market is wrong and the rubber band snaps back when next quarter’s software earnings come in fine.

I don’t think that’s what happens, but I want to lay out why honestly. The capex is being spent right now, every quarter, in real dollars; depreciation on $130 billion per quarter of GPU and datacenter capex is going to start hitting income statements as those assets get placed in service, and that is not a forecast but an accounting identity. Once it hits, gross margins compress mechanically rather than at management’s discretion. But that sequence — capex first, depreciation second, margin compression third — is still a thesis, not a fact. The fact is the capex; the thesis is what the capex will eventually do to software margins. If you’re going to short IGV on the back of this, you should know which is which.

Who is getting hurt

The people getting hurt by the QQQ lie are not the index investors — the index is doing exactly what it was designed to do, which is to average things. The people getting hurt are the active managers, the long-only growth funds, the “AI thematic” ETFs, and the retail investors who own software names because they believed in the AI story, and they are getting hurt because every dollar the AI story raised in capital, attention, and capex went into the silicon side of the trade and is being extracted out of the software side.

If you own IGV — or if you own a basket of “AI software” names because somebody told you AI would expand software TAM — you have been on the wrong side of the largest sector rotation in modern tech history, and your QQQ benchmark has been quietly telling you that you’re “only a little behind.” You are not a little behind; you are catastrophically behind, and the index is camouflaging the magnitude of your underperformance. Friday’s rip in MSFT and IGV may have closed the gap by a couple of points, but it does not close 87.

This is the most dangerous kind of bear market: the one that doesn’t look like a bear market on the chart everyone is watching.

What to do with this post

If you take one thing from this piece, take this: stop using QQQ as your proxy for “tech.” It hasn’t been a single sector for at least six months — it is two sectors stapled together, moving in opposite directions, and the index is hiding the divergence from you.

If you are long “tech” and underperforming, the question isn’t whether you’re right or wrong but which half of QQQ you actually own. If it’s the silicon half, you’re winning and you don’t know it. If it’s the software half, you’re losing and your benchmark is lying to you about how badly. So pull up your portfolio, look at the tech sleeve, and ask which half of the schism it lives on. The answer matters more than your YTD number.

Next Saturday: “Software Is Dead. Long Live Silicon.” A closer look at the margin transfer — when the depreciation actually hits, which names get crushed first, and why the coal-to-natural-gas analogy is more literal than you think.

If this reframed how you look at your tech book, restack it. Someone in your feed is benchmarking themselves to QQQ tonight and doesn’t know what it’s hiding.

As always, the material presented in Math & Markets is for informational purposes only. It does not constitute investment or financial advice.

Alpha is never guaranteed and the backtest is a liar until proven otherwise.

What the readers caught

The original backtester used Yahoo’s daily crypto bars to construct an “overnight” crypto return:

crypto_overnight_d = ln( Close_d / Close_(d-1) )

The problem: Yahoo’s daily crypto bar closes at 00:00 UTC, which is roughly 20:00 ET on the same calendar day. So Close_d is recorded after the VIX trading session of day d has already ended. The “overnight” variable I was using to predict the VIX trading-hour return contained the VIX trading-hour move itself.

That is the textbook definition of lookahead bias. It is exactly the kind of thing that turns a ~0.5 Sharpe signal into a ~2.4 Sharpe phantom.

I confirmed it directly. Once you align the “overnight” bar one day forward — so it is genuinely information available before the NY open — the same-day correlation of the proxy with the VIX trading return collapses from −0.24 to +0.001. The signal as I had it was almost entirely the contamination.

It sucks. But I’m grateful to Eric and Per because understanding and fixing the mistakes in the strategies we discuss is what makes M&M better!

Original numbers vs corrected numbers

Step 1: Rebuild the data, three ways

I scrapped Yahoo for crypto and rebuilt the dataset from cryptodatadownload.com, pulling hourly BTC and ETH bars from three exchanges that don’t share an order book: Binance (USDT pairs, Aug 2017–present), Bitstamp (USD pairs, May 2018–present), and Gemini (USD pairs, Oct 2015–present).

Three exchanges is overkill for the headline number, but it answers the obvious second question: is the signal a Binance artifact, or is it really there? The clean overnight return is now constructed from hourly bars at the exact NYSE-relevant times:

crypto_overnight_d = ln( price@09:30 ET on d  /  price@16:00 ET on d-1 )

NYSE sessions come from pandas_market_calendars. Matching hourly bar timestamps to ET clock times uses a 75-minute tolerance to absorb exchange downtime and DST. Sample: 2018-01-02 to 2025-12-30, 2,010 NYSE trading days.

Headline regression — clean, three exchanges

All BTC t-stats clear |t|>3.8. All ETH t-stats clear |t|>3.3. Standard errors are HAC (Newey-West) with 5 lags. The signal is real, robust across exchanges with no shared price source, and more statistically significant on clean data than it was on contaminated data. In-sample R² is roughly 3.0% for the crypto-only specifications, versus the 6.16% I originally reported. The original number was inflated; the sign and significance were not.

Strategy — VIXY long/short, 25bp round-trip cost

This is the corrected verdict, and it is much, much weaker than the headline I originally published. Gross Sharpe of ~1.2 looks fine. Net of realistic round-trip costs of 25 bps, Sharpe drops to ~0.6, drawdowns exceed 60%, and a 57% hit rate is well short of what would justify the position swings the strategy demands. This is not a tradable standalone strategy — it is a research finding about predictability, not a P&L engine.

Step 2: Can we save it with another variable?

Once the clean numbers were in, the natural next move was to ask whether the Sharpe could be repaired by adding additional, theoretically-motivated predictors. I picked three from the literature, all strictly available before the NY 09:30 open on each trading day:

• Nikkei 225 close-to-close return. NY Fed “Overnight Drift” work documents large Asian-session content in US open vol. Tokyo closes at 01:00 ET — fully pre-NY-open.

• Lagged VIX trading-hour return (d-1). Bevilacqua et al, “Breaking VIX at Open” — strong cross-autocorrelation between successive VIX trading-hour moves; VAR specifications dominate AR(1) and HAR.

• Log VIX level (d-1). Vol is mean-reverting at horizons ≤ 5 days. Cheap to add.

I deliberately did not test day-of-week dummies (data-mined to death), FOMC-day dummies beyond what’s already in the model (8 events/year overfit OOS), or VVIX (collinear with VIX level).

Extended-model coefficients

There is a more important and uncomfortable finding here. When we add log VIX level lagged, the BTC overnight coefficients lose significance. BTC t-stats collapse from −3.85/−3.93/−3.89 to roughly −0.6 to −1.1 across the three exchanges. ETH retains marginal significance (t ≈ −2.1 to −2.3).

That’s pretty interesting because it tells me a chunk of what the BTC overnight signal was capturing was VIX mean-reversion — high vol days tend to be days with sharp overnight crypto moves and days where VIX is about to revert. Once you control for the VIX level directly, BTC stops adding much.

Out-of-sample lift

In-sample R² rises from ~3.0% to ~5.5%. Out-of-sample R² rises modestly: from 5.8–6.5% to 6.5–7.5%. But the Diebold-Mariano test comparing clean vs extended yields p-values of 0.46 to 0.78 — i.e., the OOS R² improvement is not statistically significant. The model fits better in-sample, but we cannot reject that the OOS improvement is luck.

And, crucially, what happens to the Sharpe

The extended model is more informationally accurate — Spearman IC of forecast vs realized VIXY return rises from 0.071 to 0.091, a ~30% lift. But the extended model flips position roughly 60% more often. Once you charge round-trip cost on every flip, the gain in IC is more than wiped out by the gain in turnover. The two lines cross at about 4 bps — i.e., the extended model is only better than the clean model in a friction-free world that doesn’t exist.

What I actually learned

1. The headline Sharpe of 2.36 was a bug. The real Sharpe net of 25bp costs is about 0.5–0.6 on clean, cross-validated data.

2. The crypto → VIX signal is real but weak. It is statistically significant on three independent exchanges, contributes ~3.3pp of OOS R², but does not, on its own, support a tradable strategy at realistic costs.

3. Most of the BTC signal seems to be a proxy for VIX mean-reversion. Once you include the lagged VIX level, BTC coefficients lose significance. ETH retains marginal significance.

4. Adding three theoretically-motivated predictors improved in-sample fit and information coefficient but reduced net Sharpe because the extended model trades much more. This is one of the cleaner examples of the gap between forecasting accuracy and strategy performance.

5. Nikkei is not predictive of next-day VIX trading-hour moves, at least once we control for VIX dynamics directly. This contradicts the natural intuition from the overnight-drift literature.

The honest synthesis: the crypto-VIX relationship is best understood as a small piece of the larger fact that volatility is mean-reverting, and crypto markets — being open 24/7 — happen to register that mean-reversion ahead of when the NYSE does. That’s interesting. It’s not a new strategy. It’s a noisier way of betting on something we already know.

What I’m changing on this site

• This post replaces the original Sharpe-2.36 post (I’ll still leave the old one up for a minute).

• All numbers here reflect the clean values.

• Full corrected data and code —

  • clean_replication.py

  • extended_replication.py

  • Data bundle with derived panels, model outputs, strategy P&L, and readme.md

  • I have not included the raw hourly OHLCV bars from Binance/Bitstamp/Gemini — you can download them directly from CryptoDataDownload.com

Method appendix

Crypto data: Hourly BTC and ETH from cryptodatadownload.com (Binance USDT, Bitstamp USD, Gemini USD). All timestamps UTC. Hourly bars matched to ET clock times via UTC lookup with 75-min tolerance.

Reference data: Daily VIX, ES futures, VIXY, and ^N225 from Yahoo Finance. Daily series are only used for instruments whose close is unambiguously before the NY open on the prediction date, so there is no equivalent lookahead.

Target: vix_trading_d = ln(VIX_close_d / VIX_open_d) — the NYSE-session VIX return.

Standard errors: HAC (Newey-West), 5 lags. OOS: rolling 666-trading-day window, walk-forward one-step-ahead. Strategy: VIXY long if forecast > 0, short if < 0; round-trip cost 25 bps applied to each position change. Diebold-Mariano: squared-loss differential, Newey-West variance, two-sided.

Remember: Alpha is never guaranteed. And the backtest is a liar until proven otherwise.

As you can see, my math can have errors — please let me know if you find any.

The material presented in Math & Markets is for informational purposes only. It does not constitute investment or financial advice.

The VIX is a forecast of the next 30 days of S&P 500 volatility, and it only trades during the 6.5 hours U.S. equities are open. The other 17.5 hours of every day, the world keeps happening — and there is exactly one freely-traded, leverage-funded, globally accessible risk asset that doesn’t stop: cryptocurrency. Whatever happens to it overnight tells you something about global risk appetite that flows into the next VIX print.

A 1% positive overnight return in Bitcoin or Ethereum — the hours when U.S. equity markets are closed — predicts a roughly 0.4% drop in the VIX during the next U.S. trading session. The signal is large by predictive-regression standards (t ≈ −5), and a single-signal VIXY long/short strategy built on it produces an out-of-sample Sharpe of 3.05 gross, 2.36 net of 25 bps.

had recently posted a paper on VIX Forecasting Using Crypto Overnight Returns. He was kind enough to help me with the methodology, which I was able to successfully replicate.

The replication target is Gu, Lin & Liu (2026), “Beyond Conventional Sentiment Indicators: Cryptocurrency’s Hidden Potential in VIX Forecasting” (Economic Modelling). Their paper uses 5-minute CoinDesk data; this version uses only what’s publicly accessible on Yahoo Finance, January 2018 through December 2025. The headline findings replicate cleanly.

The decile sort makes it unmissable

Sort every trading day into ten buckets by overnight crypto return, then plot the mean VIX trading-hour change in each bucket. The gradient is monotone: +2.4% to +2.6% in the bottom decile (big crypto sell-off), down to −2.7% in the top decile (big crypto rally). No nonlinearity to hide behind. No subset of the data carrying the result. A clean, monotone, economically interpretable signal.

Regression coefficients with HAC standard errors

Four nested OLS specifications, all with Newey-West (5 lags) standard errors. The baseline controls for VIX overnight, SPX futures overnight, FOMC dummies, and post-holiday dummies — and reaches an R² of just 0.43%. Adding BTC alone takes R² to 5.51%; adding ETH alone, 5.73%; both together, 6.16%. SPX futures overnight, the conventional sentiment proxy, never loads significantly.

The signal is small in absolute magnitude — but stable in sign, significant in every regime, and untainted by the conventional sentiment proxies you’d expect to dominate.

Out-of-sample: a rolling-window forecast

Forecasts are produced with a 666-day rolling window — re-estimated every day, used to forecast the next day’s VIX trading-hour log change. Baseline is an AR(1); the augmented model adds BTC overnight, ETH overnight, and SPX futures overnight. The Diebold-Mariano test rejects equal predictive accuracy at the 1% level.

METRICAR(1) BASELINECRYPTO-AUGMENTEDΔn (OOS observations)1,3421,342—MSE0.0049160.004653−5.3%MAE0.048360.04728−2.2%OOS R² (vs zero)2.19%7.43%+5.2 ppDiebold-Mariano stat—2.70p = 0.0069

From forecast to position.

The forecast is converted into a daily position on VIXY, the ProShares VIX short-term futures ETF. Long if predicted ΔVIX is positive, short if negative. Position taken at 09:30 ET, held to 16:00 ET. (VXX was delisted in January 2022, so VIXY is the live instrument throughout.)

Cost sensitivity.

Charging realistic round-trip costs per position flip:

A WORD ON THE 213% HEADLINE RETURN

That number deserves three caveats. (1) Realized vol is also 70% — the Sharpe is the defensible figure. (2) Max drawdown is −40%, with a particularly ugly 2024 stretch. (3) Short-borrow costs and financing on VIXY are not modeled and become meaningful at scale. The realistic takeaway is Sharpe ≈ 2.4 after costs, max drawdown ≈ 40%, and a clean economic story.

Crypto signals roughly triple in high-volatility regimes

Split the sample at the 80th percentile of the VIX level (threshold: 24.11). In low-volatility regimes (n = 1,606 days), the crypto–VIX correlation is a modest −0.13 to −0.14. In high-volatility regimes (n = 403 days), it roughly triples to −0.36 and −0.33. SPX futures overnight stays glued to zero across both.

The interpretation is straightforward. In a quiet regime, the marginal U.S. desk opens, scans the overnight tape, and prices it efficiently. In a high-stress regime, the overnight tape is itself the information event — and crypto is the cleanest read of that tape because it’s the asset that actually traded.

The bottom line.

All four findings of Gu, Lin & Liu (2026) replicate cleanly on Yahoo Finance data:

• Crypto overnight returns significantly predict next-session VIX changes (t ≈ −5).

• Adding crypto triples OOS R²; the improvement is significant at p < 0.01.

• A VIXY long/short strategy on the augmented forecast generates a Sharpe of 3.05 gross, 2.36 net of 25 bps.

• The crypto signal strengthens in high-vol regimes, where SPX-based sentiment is noise.

Methodology footnote: Yahoo-only data & what changed

The original study uses 5-minute CoinDesk bars from 2018 to 2025. Yahoo’s intraday data is capped at ~730 days, so a true 5-minute history wasn’t retrievable. The replication uses a hybrid construction:

• Hourly-precise window for 2024–2026, where Yahoo serves hourly bars. The 16:00 ET → 09:30 ET overnight return is computed from actual hourly prints.

• Daily-proxy window for 2018–2024. Crypto’s UTC daily close sits roughly four hours after U.S. equity close, so 24/7 daily close-to-close is a reasonable approximation for the overnight return.

The signal is qualitatively unchanged by the granularity choice.

Other deviations

• No Google Trends / on-chain attention proxies. Those weren’t accessible from Yahoo; the paper’s attention-decile analysis is omitted.

• AR(1) rolling OOS forecast in place of the paper’s VAR(p). For a single-target ΔVIX problem, essentially equivalent.

• Diebold-Mariano only, no Model Confidence Set. DM is sufficient for the pairwise baseline-vs-augmented comparison.

• VIXY only. The paper uses both VXX and VIXY; VXX was delisted in January 2022.

• FOMC dates are the 66 release-day dates from the Federal Reserve’s official 2018–2025 calendar, hardcoded.

• Standard errors on all regressions are Newey-West HAC with 5 lags.

Tickers used: BTC-USD, ETH-USD,^VIX, ES=F, VIXY. All from Yahoo Finance via yfinance.

Remember: Alpha is never guaranteed. And the backtest is a liar until proven otherwise.

My math may have errors — please let me know if you find any.

The material presented in Math & Markets is for informational purposes only. It does not constitute investment or financial advice.

This is part of my series — Building & Scaling Algorithmic Trading Strategies

Fifth post in the 0DTE series. Previous: Two-Engine, V2, V3, Three-Engine, $25K Trades, What the pros are doing, 0DTE Engine 4: When Not to Trade (I)

Last Saturday, I introduced Engine 4: the regime classifier that decides which of the three 0DTE engines (income, convexity, VIX governor) gets to fire on any given day. The framework showed 7 of 9 regime cells beat a no-filter baseline on illustrative data.

This post validates that framework on real market regimes (2018-2024) with realistic engine mechanics. The question it answers is does the regime filter still work when you model how the engines actually behave?

The answer is yes — but with a caveat about GEX.

Methodology: Real Data, Realistic Models

This backtest runs on:

Real market data: SPX and VIX history from June 2018 to August 2024. The 1,329 trading days cover three distinct regimes: calm (most of 2019, most of 2024), elevated (March-April 2021, scattered 2022), and spike (March 2020, August 2024).

Realistic engine mechanics:

• Engine 1 (income): 65-72% win rate depending on VIX level. Not perfect — reflects slippage, execution variance, and the reality that premium capture degrades as vol rises. Average win ~35 bps, average loss ~75 bps.

• Engine 2 (convexity): Daily theta bleed (~0.8 bps), plus rare but large spike payoffs (~5% of days generate 300-800 bps). Models the long-hedge behavior: slow decay, occasional paychecks.

• Engine 3 (VIX governor): Position sizing scales from 1.0x (VIX < 20) to 0.4x (VIX > 25). Not a separate P&L engine — it’s a multiplier on the other two.

Three versions compared:

1. Baseline: All engines always on, sized by VIX level only

2. Engine 4 (VIX+time): Regime classifier using VIX level + term-structure signal, no GEX

3. Engine 4 (VIX+time+GEX): Same as above, plus z-score GEX overlay

The Results

TL;DR: Baseline wins on raw P&L. It’s an always-on strategy that outperforms the filtered versions by 2.3x on total cumulative return.

But that’s misleading. Here’s why the filter matters anyway.

The chart above shows why. The baseline grows steadily until spikes hit. Then it gets hurt. Engine 4 versions sit out those spikes entirely (0% trades in high-VIX regimes). The filtered versions give up total P&L but preserve capital when it matters.

Why This Comparison Matters

The baseline number (67% win rate, 19.8 bps/day) is theoretical. It assumes you trade every single day, every single regime, regardless of whether the market is paying you to take the risk.

The filtered versions (60% win rate, 8.7 bps/day) trade fewer days. They sit out bad regimes.

The question isn’t “which version makes more money?” It’s “which version takes intelligent risk?” Part 1 made the argument that the edge is in disqualification, not discovery. This backtest shows what that actually looks like.

When you break it down by regime cell, you see where that disqualification matters.

The Three-Version Grid Breakdown

The key insight here is that in low and mid regimes, all three versions perform similarly. The filter’s value is in the high-VIX rows — where it stops trading entirely (0% because engines are off). Baseline keeps running and loses.

The two heatmaps are nearly identical. The GEX overlay is supposed to improve the filter by separating good dealer conditions from bad. Instead, it makes one cell worse (low + negative GEX, -2.5pp) and leaves eight unchanged. The z-score normalization works mathematically. The signal doesn’t exist. This is what $3k/month gets you: one worse cell and eight unchanged ones.

But here’s the critical finding: GEX actually hurts win rates by 0.28 percentage points on average (60.6% → 60.5%). In one cell (low + negative GEX), it underperforms by 2.5pp. There’s no regime where GEX improves the filter. It’s not worth the $3k/month feed. VIX + time is strictly better.

The Individual Grids

Here are the three versions broken down cell-by-cell:

Version 1: Baseline (VIX gate only)

The baseline filters on VIX level only (skip if VIX > 25, half-size if 20-25). It’s still running both engines in every VIX regime. In calm and mid regimes, this works fine. But notice the high-VIX cells: 48-60% win rate. You’re trading in a panic, engines are sized down, and you’re still taking losses. This is the cost of not having a regime classifier — you’re not quitting when you should.

Version 2: Engine 4 (VIX + Time)

Introducing term-structure signal (VIX1D momentum). This does two things:

• In low VIX: income engine stays full size (same as baseline). Convexity hedge is suppressed (0.3x) because tail insurance is expensive.

• In mid VIX with backwardation signal: convexity engine fires at full size, income is reduced to 0.3x. This is the transition regime where dealers are short gamma.

• In high VIX: both engines shut off entirely. Only VIX governor (sizing reduction) applies. No premium selling, pure defense.

The result: Win rates in high-VIX cells drop to 0% because we’re barely trading them. That’s intentional.

Version 3: Engine 4 (VIX + Time + GEX)

Adding GEX overlay. Same grid, same win rates. The GEX column adds marginal signal in the low-VIX cells (separating positive-GEX from flat-GEX dealer states), but the overall pattern is identical to Version 2.

Live Example

What the filter did: It shut down completely during high-VIX days and underperformed during strong rally weeks (May 2024: 760 baseline vs 148 filtered). The trade: you give up 60% of peak P&L but avoid 70% of downside in crash weeks.

What the filter prevented: Look at November 2023: baseline lost -90 bps, filtered lost less. But more importantly, in weeks where the market crashed (any high-VIX period), the filter sat in cash instead of trying to trade volatility.

The drawdown chart shows the difference starkly. Baseline’s cumulative loss is roughly 50-70% deeper than filtered versions at the worst points. The filter’s job isn’t to outperform in good markets — it’s to lose less in bad ones.

What Changed from Part 1

Part 1 showed the framework on illustrative data. Part 2 shows it on real market regimes with realistic engine mechanics. The framework held:

• 7 of 9 cells show intelligent behavior (sized appropriately for the regime)

• The failure mode (mid + negative) is identifiable

• GEX adds noise, not signal

But the win rates are lower (60% vs 65% in Part 1). That’s because real engines have higher variance than illustrative ones. The edge is still there — it’s just more modest and requires patience in filtering.

The GEX Problem — Diagnosed

A reader commented this — “If you’re going to use GEX, it needs to be systematic and backtestable, not hand-waving.” Totally fair, so I ran the numbers.

Z-score GEX subtracts 0.28 percentage points from win rate. In one cell (low + negative GEX), it underperforms by 2.5pp. For a $3k/month feed, that’s a negative cost-benefit.

But here’s the thing: GEX itself isn’t broken. My implementation was. I was z-scoring GEX on SPX in isolation. By the time GEX flips negative, dealers are already in pain and the cascade is underway. You’re 24-48 hours too late.

who caught this explained the real failure mode: it’s not a statistical anomaly. It’s the mathematical result of Vanna cascades and dealer delta-hedging forcing the vol surface to invert. The 17.6% collapse (mid + negative GEX) happens because I’m watching a reactive, lagging metric on a single asset.

Real edge comes from seeing it before it breaks. Cross-asset synthesis — SPX + SPY + NDX + QQQ options flows together — maps the institutional liquidity clusters that dealers must hedge against. When those assets synchronize into a gamma flip, you get variance expansion 24-48 hours early. That’s anticipation, not reaction.

So here’s the takeaway: You get 100% of the edge from free VIX data (level + term structure). Z-score GEX on SPX alone adds nothing but noise. If you have a GEX feed and you’re using it the way I was, drop it. If you don’t have one, don’t chase it.

But the structural signal — cross-asset liquidity mapping — that’s Engine 5. Not reactive metrics. Predictive early-warning.

In Closing…

The regime classifier works on real data. It doesn’t beat an always-on strategy on raw P&L. It beats it on risk-adjusted returns by knowing when not to trade.

The failure mode is real: mid VIX + negative GEX. If you see this regime forming, close positions.

GEX doesn’t improve the edge enough to justify the cost. VIX + time is your core.

If your backtest shows different results, I want to see it. Show me where I’m wrong!!

What’s Next

Engine 5 is about execution friction. Right now I’ve modeled slippage as uniform across regimes but it really isn’t. Low-VIX environments have tight spreads but wide market moves. High-VIX environments have looser spreads but options pin to strikes. Building a friction layer that scales by regime should improve the filter another 10-15%.

Engine 6 — if we get there — is about IV surface complexity. One reader suggested 0DTE vs 1DTE backwardation as a transition signal. Another suggested put/call skew by delta. Both of those are candidates for the next upgrade, but only after we validate the current framework on live trading data.

Until then, I’ll keep experimenting, one variable at a time!

As always, thank you for reading Math & Markets.

Footnote On This Backtest

I use synthetic engines but real market regimes. The engine mechanics are modeled based on typical behavior (70% income win rates in calm vol, theta decay on long hedges), not calibrated to specific strategies. Your actual engines might perform differently.

The framework itself — the regime classification logic, the failure mode identification, the GEX impact assessment — should transfer to real trading. But validate it on your own data before you size capital to it.

As always, this post is about methodology, not recommendations. Options and derivatives are complex instruments and this analysis probably contains errors. If you find them, let me know.

The information presented in Math & Markets is not investment or financial advice and should not be construed as such.

This is part of my series — Building & Scaling Algorithmic Trading Strategies

Fifth post in the 0DTE series. Previous: Two-Engine, V2, V3, Three-Engine, $25K Trades, What the pros are doing.

Over the last four posts, I’ve built three separate engines for 0DTE premium selling — Engine 1 (income), Engine 2 (convexity), and Engine 3 (VIX governor). Each one is a bet and each one assumes something about the market on the day you’re trading it. And alas, each one stops working the moment that assumption breaks.

Engine 4 is not another engine. It’s the rule that sits above the other three and decides which one gets to fire.

The core thesis: Engines 1-3 are bets. Engine 4 is the regime classifier that decides which bet the market is currently paying you to make — and the honest answer, most days, is “none of them.”

Methodology Note: This is Part 1 of 2

This post introduces the framework and validates it on illustrative (synthetic) data. The backtest shows proof-of-concept: a regime classifier beats a no-filter baseline in 7 of 9 cells, and identifies a failure mode. But it’s not yet validated against actual Engine 1-3 mechanics.

Part 2 (next week) rebuilds this backtest on real engine mechanics:

• Engine 1 as an intraday credit spread model (individual spread win rates, delta decay, gamma bleed)

• Engine 2 as a long-dated hedge model (theta decay + spike payoff)

• Engine 3 as a VIX-indexed sizing rule

The framework itself — the 3×3 grid, the regime classification logic, the identification of mid + negative as a failure mode — should transfer to real data. But you’ll want the validation before you size capital to it.

Correction: Engine 3 Sizing at High VIX

I want to credit and for pointing out a few gaps and errors in my methodology.

There was a gap in the Engine 3 sizing logic in Thursday’s post. I had it backwards.

The error: I wrote “widen to 15-delta at high VIX” for risk management. But 15-delta is closer to ATM, not wider — that’s the opposite of what you want when volatility rises.

The correct logic: A 10-delta put always has ~10% probability of expiring ITM, regardless of VIX. But the dollar distance from spot changes with vol. At VIX 15, a 10-delta put might be $130 OTM (~1.8%). At VIX 30, the same 10-delta put is $200 OTM (~1.3%). Same delta, less percentage cushion.

To maintain the same percentage distance OTM at high VIX, you should move to a lower delta — 5-7 delta — which pushes the short strike further from spot. This collects less premium per spread, which is why you’d also reduce contract count.

The corrected sizing rule:

• VIX < 20: Short 10-delta put

• VIX 20-25: Short 7-delta put

• VIX > 25: Short 5-delta put

Part 2’s backtest will use these correct thresholds. Thank you for catching this — you were right, and I should have stress tested my own logic harder.

Why Engines 1-3 Aren’t Enough

I’d say the first three engines are strategies. They assume a regime and trade inside it.

Engine 1 (income) assumes the market stays in a profitable zone for intraday credit spreads. Engine 2 (convexity) assumes tail-risk premiums stay stable enough that long puts bleed predictably. Engine 3 (VIX governor) assumes position sizing scales inversely with volatility risk.

Each one has a failure mode. Each one stops making money when its assumption no longer holds.

Every backtest I’ve shown you in this series ran on the same six-year window. That window had three distinct regimes: calm (most of 2019, most of 2024), elevated (March-April 2021, scattered 2022), and spike (March 2020, August 2024). The strategies don’t know which one they’re in. Engine 4 is the part that does.

When I ran all three engines without regime classification — sizing them identically across all regimes — the aggregate win rate was 40.5%. That’s worse than random. It’s the cost of indiscriminate trading — trying to capture premium in regimes where it shouldn’t be captured, running convexity hedges at fixed cost when tail insurance is about to spike in value, keeping position sizes constant when volatility risk is climbing.

The question wasn’t “are these three engines broken?” The question was “which engine should I turn off today, and which should I turn up?”

Engine 4’s job is to disqualify days, not to discover trades.

The Two Inputs, and the One I’m Less Sure About

Engine 4 takes two inputs. I trust one of them. The other one is — well, maybe.

Input 1 — VIX + time (the trusted one):

VIX absolute level + VIX term-structure slope (front month vs 3-month).

Why this works: it captures both the level of forward-implied vol and whether the market is pricing the front or back of the curve. When VIX1D moves three times as fast as VIX on a flat-tape day, the surface is telling you something the index isn’t. It’s a transition signal — the term structure is decoupling because dealers are repricing faster than spot.

Reference the tape at the time of writing this as a live example: VIX at 16.10 while VIX1D ripped +29.9% to 11.54 in a single session. That’s the exact decoupling Engine 4 is built to flag. It says “the short-dated curve is moving faster than the index. The surface expects front-month vol to move materially.” That changes which engine you run.

Input 2 — GEX overlay (the one on probation):

GEX is dealer-positioning-derived. The inputs are noisy. The calibration drifts. Historical data is expensive ($3-5k/month for a clean feed). Most retail traders don’t have access to real-time GEX.

Here’s my honest take: If you took GEX out of Engine 4 entirely, you’d lose roughly 15% of the edge and roughly 40% of the false signals. That trade is worth making in some regimes and not worth making in others. This post will tell you which.

The framework I’m about to show you runs on VIX + time as the primary input. GEX is a secondary filter — optional, not required. If you don’t have a live GEX feed, the VIX-and-time classifier gets you 85% of the way there. If you do have it, you get incrementally better at identifying which sub-regimes (positive/flat/negative dealer gamma) are safest for each VIX level.

I don’t have a real-time GEX feed either. That’s part of the limitation I’m trying to address and work around.

Note on Part 2: pushed back last week that “check GEX” isn’t a systematic signal — it needs backtestable rules or it’s hand-waving. He was right. This post sets up the framework. Monday’s post validates it on real market regimes and runs the exact three-way comparison: Baseline vs. Engine 4 (VIX+time) vs. Engine 4 (full GEX with z-score normalization). You’ll get the answer that matters most: does GEX improve Sharpe and drawdown enough to justify the $3k/month feed, or do you get 85% of the edge from free VIX data alone? I’m running this to answer it for myself. You get the results for free!!

The 3×3 Grid — Where Regime Meets Engine Mix

Engine 4 classifies every trading day into one of nine cells: 3 VIX levels × 3 GEX states.

Each cell has a specific job: which engines fire at what size, and what move in VIX shuts the whole thing down.

Here’s the grid with backtest results from six years of data:

What the grid is telling you:

Low VIX + positive GEX (top-left): Calm market, dealers accumulating long gamma. Engine 1 (intraday income) fires at full size — the premium is reliable and the spread deltas are stable. Engine 2 (long tail hedge) is suppressed to a light 0.3x because tail insurance costs more relative to the risk. This is most of 2024. Win rate 39.6% — barely beats baseline. The puzzle here is worth noting for Part 2: dealers being long gamma in calm markets theoretically de-risks short premium, but the data shows only marginal outperformance. Possible explanations: slippage dominates, sample size (53 days) is too small, or the signal is weaker than expected.

Mid VIX + negative GEX (the red cell): This is the catastrophic regime. Mid VIX (15-25) means you’re past the calm threshold — volatility is elevated. Negative GEX means dealers are short gamma — they’re being forced to buy back options in a rising vol market. You’re trying to run Engine 2 (long tail hedge) at full size, thinking “dealers are in pain, protection is expensive.” But that’s exactly backwards. Dealers are short gamma because the vol surface is about to invert. Your long puts haven’t spiked yet, but they’re about to. Your short spreads (Engine 1) are about to blow up. This is when the filter should be stopping you from trading entirely, not optimizing engine mix. Win rate 17.6% — the worst cell by far. This regime occurs roughly 1-2 times per month but defines drawdown months. The honest application: mid + negative is a kill-switch. Close positions. Go to cash until the regime clarifies.

High VIX + any GEX (bottom row): Market in crisis. Engine 3 (VIX governor / sizing reduction) takes over completely. Engines 1 and 2 are off. You’re running pure defense: reduced position sizes, full hedge ratios, minimal new premium selling. All three cells beat baseline by 16-26 percentage points. Win rates are 57-67%. The absolute P&L is barely positive (+2.8, +0.8, +0.2 bps) — which is exactly right. The job isn’t alpha generation. The job is “preserve what you made in calm months and don’t give it back in panic months.”

Mid VIX + flat (the sweet spot): 49.8% win rate, +9.3 pp outperformance. Moderate volatility, neutral dealer positioning. You get a balanced allocation: Engine 1 at 0.8x (intraday income still profitable but margins are tighter), Engine 2 at 0.5x (hedging costs are moderate, worth the protection), Engine 3 off (no need for emergency sizing cuts yet). This is the standard allocation most trading days fall into.

Engine 4 Regime Grid: Win Rate Heatmap. Green = beats 40.5% baseline, Red = underperforms. The mid + negative cell (bottom row, left) is where the filter fails catastrophically at 17.6% win rate.

Engine Sizing by Regime: How much of each engine (Income, Convexity, VIX Gov) fires in each regime cell. The shaded area marks the failure mode, where Engine 2 (Convexity) is at full size precisely when the surface is about to invert.

Live Example — What Engine 4 Says Right Now

At the time of writing this post, VIX is 16.10 (mid-low boundary). SPX -0.70% (essentially flat). But VIX1D +29.9% to 11.54 in one session.

Where does the grid put you?

Base classification: Mid VIX (16.10 is just above the 15 threshold). Term structure signal: VIX1D up +29.9% in one day while spot tape is flat = front-month repricing faster than the index = early warning of backwardation. This is the signature of dealers being forced to reduce short exposure.

GEX position: You don’t have a live GEX feed. (I don’t either.) So you’d default to the “flat” cell or wait for EOD positioning data. If you’re using a data co-op or the BMLL feed, you could check dealer positioning explicitly. But if you’re flying on VIX + time alone, you’re in mid/flat.

What the filter says:

Engine 1 (income) at 0.8x size. Engine 2 (convexity) at 0.5x. Engine 3 off. Expected win rate: 49.8%. Mean daily expected: -39.8 bps.

Interpreting this:

I’m telling you what the filter says. I’m not telling you to take the trade (or not). As I always say, the backtest is a liar until proven otherwise, and that includes this one. The fact that this cell beat baseline by 9.3 percentage points in backtest doesn’t mean it will beat baseline today.

What this means is that if you’re running a systematic strategy, this is the regime cell you’ve sorted into, and these are the engine weights your rules say to run. Whether you take it is your call. Whether it works is between you and Mr. Market.

Section 5: What’s Actually New Here

Most retail filter-stacks are AND gates: VIX low AND GEX positive AND trend up = trade. If one input flips, the whole system shuts down. They’re binary.

Engine 4 is a regime classifier, not an AND gate.

The difference: AND gates fail catastrophically at boundaries. One input flips, and the whole strategy disappears from the universe. You go from full deployment to zero deployment in a single 0.5% move in VIX. Regime classifiers degrade smoothly. You move from one cell to another. The engine mix shifts, not the entire framework.

In backtest, the AND-gate version of this strategy (all engines fire only if all three conditions pass) was unfunded 73% of trading days. Engine 4 was unfunded roughly 30% of trading days. Same Sharpe target. Three times the deployment.

That’s the edge: not finding more alpha. Finding which days to deploy the alpha you already have.

AND-Gate vs. Regime Classifier: An AND-gate filter (all conditions must be true) sits empty 73% of trading days. Engine 4 sits empty only 30% of days — 3x more deployment with the same Sharpe target.

Outperformance vs. No-Filter Baseline. Engine 4 beats an always-on strategy in 7 of 9 regime cells. Mid + negative (bottom bar) underperforms by 22.8 percentage points — the failure mode.

What Else?

Three things I’m still working on:

The failure mode. There is one specific regime where this filter gets worse than no filter at all. I found it in backtest: mid VIX + negative GEX, 17.6% win rate, underperforms baseline by 22.8 percentage points. But I haven’t fully understood why it fails in that specific way — is it because the filter is trying to run convexity at maximum exactly when the surface is about to invert? Is it because 85 days is too small a sample? I’m figuring this out — but let me know if you spot the pattern before I do! :)

The GEX data problem. Where the historical data actually comes from (CBOE OTM volume, BMLL proprietary flow, dealer-facing APIs), why retail feeds are unreliable (EOD OI is a terrible proxy for intraday dealer positioning), and whether a reader co-op solves it (consider this — 20 readers willing to split a $3k/month BMLL subscription). This is the next technical problem to solve.

Engine 5. The next one isn’t a filter. It’s about execution friction. Right now I’m assuming slippage is uniform across regimes. It isn’t. Low VIX regimes have tighter spreads but wider market moves. High VIX regimes have looser spreads but the position pins. I’m building a friction model that adjusts for this. More in a few weeks.

The Failure Mode (Mid VIX + Negative GEX): 17.6% win rate, average wins of 41.7 bps against average losses of 138.5 bps. This is the transition regime where dealers are short gamma and the surface is repricing. 85 days in sample over 6 years.

Closing

Engine 4 doesn’t tell you what to trade. It tells you when to and when not to.

Obviously, I’ve only shown you the cells I’m most confident in. The cell that breaks worst (mid + negative GEX) is worth watching because you need to know where the filter fails.

As always, comments are open. I’ve probably made a mistake somewhere or the 3×3 may have gaps. Tell me where!

What’s Next

Part 2 (Monday) validates this framework on actual Engine 1-3 mechanics:

• Engine 1 modeled as intraday credit spreads (individual spread win rates, delta decay, fill slippage)

• Engine 2 modeled as a rotating long-option hedge (daily theta bleed, spike payoff on panic days)

• Engine 3 modeled as a VIX-indexed sizing rule (position count scales inversely with volatility risk)

The question Part 2 answers: Do the regime cells that beat baseline in this illustrative backtest also beat baseline when we model the engines’ actual mechanics? And does the mid + negative failure mode hold up empirically, or was it an artifact of simplified assumptions?

Comments are open here. But if you want to see the real validation, subscribe for Part 2 — Monday.

This post is about methodology, not recommendations. Options and derivatives are complex instruments and this analysis probably contains errors. If you find them, let me know.

The information presented in Math & Markets is not investment or financial advice and should not be construed as such.

This is part of my series — Building & Scaling Algorithmic Trading Strategies

Fourth post in the 0DTE series. Previous: Two-Engine, V2, V3, Three-Engine, $25K Trades.

The Question Nobody Asks

Every day, roughly 45% of all SPX options volume is 0DTE.

Let that number land. Nearly half of all options activity on the most liquid equity index in the world expires the same day it’s traded. This didn’t exist five years ago. CBOE started listing daily SPX expirations in 2022. By 2024, 0DTE was the market.

The Reddit version of this story: retail traders discovered they could sell iron condors for $1.50 and collect theta. /r/thetagang, passive income, and 72% win rate.

But here is the version nobody tells you: when retail sells those iron condors, someone is buying them. And the buyers are not random strangers. They’re desks at Citadel, Millennium, and Jump Trading — and they’re not buying your iron condor because they think SPX is going to blow through your strikes. They’re buying it because your flow is one component of a completely different trade.

This post is about what that trade actually looks like.

Two Different Games on the Same Board

Left: what retail does — sell iron condors, collect theta, smooth upward curve with violent drawdowns on blow-up days (red arrows). Right: what institutions do — trade dispersion and correlation, smoother curve, and they actually make money on the days retail blows up (green arrows). Same market. Completely different strategy.

Notice the arrows. On the days when retail’s equity curve drops — the VIX spike days, the gap-down days, the “I lost three months of premium in one session” days — the institutional curve steps up. Their green arrows point upward where retail’s red arrows point down.

This isn’t coincidence. The institutional trade is structurally designed to profit from the same volatility events that destroy the retail trade. Not because they’re betting against you. Because they’re playing a different game entirely.

The Dispersion Trade: The Institutional 0DTE Strategy

When a multi-strat fund trades 0DTE, they’re not selling premium for income. They’re trading the gap between two numbers: implied correlation and realized correlation.

Here’s the idea in plain English:

SPX index options price in an assumption about how correlated the 500 stocks in the index will be. If the index trades at 20% implied vol, and the average single stock trades at 25% implied vol, the market is pricing in high correlation — the index is almost as volatile as its components, meaning stocks are all moving together.

But stocks don’t always move together. On most days, Apple goes up, Microsoft goes down, energy rallies, tech sells off. The realized correlation is lower than what index options price in.

The trade: sell SPX vol (overpriced because of high implied correlation) and buy single-stock vol (cheaper per unit of risk). If stocks move independently — which they usually do — you profit.

Top: implied correlation (orange, from index options) vs. realized correlation (blue, from actual stock moves). The green-shaded zone is where dispersion makes money — most of the time. The red zone is during stress, when correlation spikes and dispersion temporarily loses. Bottom: cumulative dispersion P&L. Steady grind upward with brief dips during correlation spikes.

Why does this work with 0DTE specifically?

Because 0DTE SPX options are where retail concentrates its selling. All that iron condor flow pushes SPX implied vol lower relative to single-stock vol — widening the dispersion spread. The institutional desk is effectively buying the vol that retail is selling, but they’re doing it as part of a hedged correlation trade, not as a naked directional bet.

The retail trader thinks: “I’m selling premium for income.”

The institutional trader thinks: “Retail just made the short leg of my dispersion trade cheaper.”

The Flow That Moves SPX

This is the part that should change how you think about your 0DTE entries.

Top: SPX intraday price action on a day with heavy 0DTE open interest at 7,400. Price gravitates toward the strike all morning — the GEX magnet effect. At 2:30pm, dealer hedging flips and the magnet becomes a launcher. Bottom: the 0DTE contribution to total GEX (orange) builds throughout the day and collapses into the close. When it collapses, dealers stop dampening moves and volatility spikes.

When you sell a 0DTE put credit spread, a market maker buys it from you. That market maker is now long your put — which means they’re long gamma. To hedge, they sell SPX futures. If SPX drops, their put gains delta, so they sell more futures. If SPX rises, they buy back futures.

At scale — with 45% of all SPX volume in 0DTE — this hedging flow moves the actual index.

The effect depends on the time of day:

9:30am-2:00pm: 0DTE GEX is positive and building. Market makers are long gamma from the puts and calls they bought from retail. Their hedging dampens moves — if SPX dips, they buy; if it rips, they sell. Price tends to mean-revert toward heavy open interest strikes. This is the “magnet” effect.

2:00pm-2:30pm: The transition zone. As 0DTE options approach expiry, their gamma explodes (gamma is proportional to 1/sqrt(time)). Dealers’ hedging activity becomes increasingly frantic. The price gets pinned to the nearest large OI strike.

2:30pm-4:00pm: The GEX collapses. Options are expiring, dealers are unwinding their hedges, and the dampening effect disappears. SPX is free to move — and the accumulated hedging pressure can release in either direction. This is why the last 90 minutes of trading are the most volatile.

What institutional desks do with this: They know the GEX schedule because they can see the open interest. Their stat arb desks trade the mean-reversion in the morning (when GEX is dampening moves) and the momentum in the afternoon (when GEX is releasing). The 0DTE flow that retail creates is the signal they’re trading on.

The Food Chain

The 0DTE ecosystem. The multi-strat fund sits on top with three desks: vol arb (dispersion trades using the vol retail sells), market making (capturing the bid-ask on every retail transaction), and stat arb (using the GEX signal that retail flow creates). Retail flow feeds all three.

Three ways institutions extract value from retail 0DTE flow:

1. The Vol Arb Desk buys the cheap vol that retail sells. Not as a standalone trade — as the short leg of a dispersion or skew trade. Your iron condor premium is their cost basis for a hedged correlation position.

2. The Market Making Desk captures the bid-ask spread on every trade. When you sell a put spread and collect $0.75, you probably crossed at $0.73-0.74. That $0.01-0.02 per contract, multiplied by millions of contracts per day, is the market maker’s revenue. The more retail volume, the more they make.

3. The Stat Arb Desk uses the GEX exposure that retail creates as an intraday trading signal. Positive GEX = mean reversion plays. Negative GEX = momentum plays. The open interest data — which reflects where retail has positioned — is visible and exploitable.

None of this means retail is “being scammed.” The market is providing a service: retail gets exposure to the VRP (which is a real, documented edge) and the institutions get exposure to dispersion, flow, and microstructure (which are different, often uncorrelated edges). Both sides can make money.

But only one side understands the full picture.

What You Can Actually Learn From This

Knowing how institutions trade 0DTE doesn’t mean you should try to trade like them. Dispersion requires capital, infrastructure, and cross-asset execution that retail can’t replicate.

But there are two practical takeaways:

Left: GEX-aware entry timing. Skipping trades on negative GEX days (when dealer hedging amplifies moves instead of dampening them) improves the Sharpe. Right: average P&L by entry time. Entries before noon are significantly more profitable than entries after 2:30pm, when GEX collapses and gamma accelerates.

Lesson 1: Check GEX Before You Trade

When aggregate GEX is positive, market makers are dampening moves. Your short premium position benefits — prices mean-revert, your strikes stay safe, and the grind-to-expiry works in your favor.

When GEX is negative, market makers are amplifying moves. Your short premium position is exposed — prices trend, stops get hit, and the gamma you’re short is working against you.

Skipping trades on negative GEX days — roughly 20% of all sessions — reduces your trade count but meaningfully improves your Sharpe. Fewer trades, better trades.

Lesson 2: Respect the 2:30pm Line

After 2:30pm, the 0DTE GEX contribution collapses to zero. The dampening effect disappears. If you enter a credit spread at 3pm, you’re selling premium into the most volatile 60 minutes of the trading day, without the institutional hedging flow that was protecting you all morning.

The data is consistent: average P&L per spread is positive for entries before noon, roughly breakeven for 12:00-2:00pm entries, and negative for entries after 2:30pm. The premium looks the same at 3pm as at 10:30am. The gamma does not.

The Uncomfortable Chart

Each dot is one day. X-axis: total retail 0DTE premium sold. Y-axis: market maker profit. The correlation is 0.85. More retail volume, more institutional revenue. This is the business model: retail provides predictable, one-directional flow, and institutions monetize it through superior infrastructure and hedging.

This chart isn’t an argument against selling 0DTE premium. The VRP is real and retail can make good money selling options. The Two-Engine and Three-Engine frameworks I’ve published in this series are designed to capture that edge responsibly.

But it is an argument for understanding where you sit in the ecosystem. When you sell an iron condor, you’re not trading against a faceless market. You’re selling cheap vol to a dispersion desk, paying the bid-ask to a market maker, and creating GEX exposure that a stat arb desk trades on.

The edge you capture — the VRP, roughly 0.05-0.10 per spread after costs — is what’s left after these participants have taken their cut. It’s real. It’s just smaller than you think.

What to Do With This

If you’re selling 0DTE premium: Keep doing it. The VRP is real and your edge is real. But add two things: a GEX check (skip negative GEX days) and a time cutoff (no new entries after 2:00pm). These two filters alone will improve your Sharpe by reducing exposure to the environments where institutional flow works against you.

If you’re thinking about 0DTE premium selling: Read the Two-Engine and Three-Engine posts first. The framework matters more than any individual trade. Understand the VIX regime sizing before you enter your first spread.

If you’re an aspiring institutional trader: The dispersion trade is the starting point. Study implied vs. realized correlation, learn to decompose index vol into single-stock vol plus correlation, and understand how GEX creates tradeable intraday patterns. The opportunities are real — but they require infrastructure that a Schwab account can’t provide.

The Honest Caveat

I wrote this post from the retail side of the table. I have not run an institutional dispersion book. The descriptions of institutional strategies are based on published research (Derman, Bossu, Carr), industry commentary, and conversations — not personal P&L. The flow data is estimated from public sources and academic analysis, not proprietary order flow.

However, my co-author and quant trading partner is a former quant, and he’s run an option book at a major fund.

But here’s what I am confident about: the GEX feedback loop is well-documented and the entry timing implications are real. What I’m less confident about: the exact percentage splits in the flow hierarchy. Those are informed estimates, not precise measurements.

As always, the goal is to understand the game you’re playing — including who else is at the table.

Remember: Alpha is never guaranteed. And the backtest is a liar until proven otherwise.

The material presented in Math & Markets is for informational purposes only. It does not constitute investment or financial advice.

This is part 100 of my series — Building & Scaling Algorithmic Trading Strategies

The Trades

Every other week there’s a variation of this on various Reddit trading subs: “I have $25K. What 0DTE trades should I actually be making?”

Not “it depends on your risk tolerance.” Not “paper trade first.” The actual trades. Strikes, dollars, what you’re risking, what you’re making.

Well, here are the four I’d run — with SPX at 7,400 — and what each one looks like at expiry.

Four trades, four payoff profiles. Top left: the put credit spread — your daily workhorse, collect $75, risk $425, win if SPX stays above 7,250. Top right: the iron condor — higher premium ($130), tighter range (7,250-7,550), win if SPX goes nowhere. Bottom left: the butterfly — only $250 at risk, but if SPX pins near 7,400 you make $750. Bottom right: the call credit spread — same structure as the put spread but on the upside, slightly less premium because of skew.

Trade 1: The Put Credit Spread

This is the one you do every day. The one that compounds your account while you’re eating lunch.

10:30am. Not at open — the bid-ask spread at 9:30 is 30-50% wider than it will be an hour later. You’re paying $20-40 in invisible friction for the privilege of being early. Just wait.

Sell the 10-delta put. With SPX at 7,400 and VIX at 18, that’s roughly the 7,250 strike — about 1.5% below spot. Buy the put $5 below it (7,245). Collect $0.65-0.85 in premium per spread.

You just bet that SPX won’t fall 1.5% by 4pm. Historically, SPX stays above its 10-delta put about 72% of the time. On the 72% of days you’re right, you keep $65-85. On the 28% you’re wrong, you lose $425-435.

Expected value per spread: roughly +$5. Not exciting per trade. But 3 spreads a day, 252 days a year — that’s the math behind a 19% annual return on a $25K account. We’ll get to the growth path.

When to skip: VIX below 14 (premium is $0.15 — not worth the execution cost) or VIX above 25 (widen to 15-delta strikes per the Three-Engine framework).

Trade 2: The Iron Condor

Same concept, both sides. You’re selling the put credit spread AND a call credit spread. Betting SPX stays in a box.

Sell the 10-delta put spread (7,250/7,245) AND the 10-delta call spread (7,550/7,555). Collect $1.10-1.40 combined.

More premium than a standalone spread — $130 vs. $75. But the win rate drops to about 65% because the market only needs to break ONE side to hurt you. On big directional days, you give back the extra premium and then some.

Use it when: You have zero directional view and VIX is in the 16-22 sweet spot. This is a pure vol trade — you’re selling the market’s expectation of movement.

Don’t use it when: There’s a Fed meeting, CPI print, or any catalyst that could send SPX 1%+ in either direction. On catalyst days, sell one side — the side you think won’t get hit.

Trade 3: The Butterfly

This is the underrated one. The trade nobody on Reddit talks about because the win rate is ugly — roughly 30%. But the risk/reward is inverted.

Buy the 7,390 call. Sell two 7,400 calls. Buy the 7,410 call. Cost: $2.00-3.00 per fly ($200-300).

If SPX closes anywhere near 7,400, you make $400-750. If it doesn’t, you lose your $250. That’s it.

The math doesn’t work on any single day. It works across 30 days. You put on 3-4 butterflies a day at $250 each, risk $750-1,000 (3-4% of account), and the 30% that hit near the center strike cover the 70% that don’t.

The secret: Low-VIX days when the market is grinding sideways. SPX tends to pin near round numbers and heavy open interest strikes on quiet days. The butterfly is a pinning bet — and on days when the market cooperates, the payoff is 3:1.

Why it’s perfect for small accounts: $250 at risk. Not $500. You can take four shots per day and your worst-case daily loss is $1,000. Compare that to the iron condor where one bad day costs $500.

Trade 4: The Call Credit Spread

Mirror image of Trade 1, on the upside.

Sell the 10-delta call (~6000 strike) and buy the call $5 above it. Collect $0.55-0.75.

Less premium than the put spread. Always. That’s skew — the market charges more for downside protection than upside protection because crashes happen more violently than rallies. At the same 10-delta, the put is always more expensive than the call.

Use it when: You’re bearish or neutral. After a large rally (SPX rarely does back-to-back 1%+ up days). Or to balance a put credit spread into a piecemeal iron condor — sell the put spread in the morning, add the call spread after lunch if the market’s been flat.

Two Trades That Will Blow Up Your Account

People run these on $25K accounts all the time. They shouldn’t.

Trade 5: The Naked Short Put

“But the win rate is 80%!”

Look at the left panel. A naked put averages $95 per day. Beautiful equity curve going up and to the right — until it isn’t. Three blowup days: -$3,200, -$1,800, -$5,500. That $5,500 loss is 22% of a $25K account in a single session.

And that’s a good outcome. The naked put has no defined maximum loss. A flash crash, a gap down, an August 5th VIX spike — your $25K account could go negative. Not to zero. Negative. You can owe your broker money.

The margin requirement alone is disqualifying: $5,000+ for a single naked SPX put. That’s 20% of your account on one position with unlimited downside.

If you want to sell puts, sell put spreads. The $5-wide spread costs you $10 in premium but caps your loss at $500. That cap is what lets you trade every day and still be here next month.

Trade 6: The Long ATM Straddle

This is the “something big is about to happen” trade. At 0DTE, it’s a theta incinerator.

An ATM straddle costs $20-30 at 0DTE. SPX needs to move 0.5%+ AFTER you enter just to break even. On most days, SPX’s total daily range is less than 0.5%.

Right panel: 12% win rate. Steady bleed of $25/day. After a year: -$4,149. The straddle works at 30 DTE where theta is gentle and you have time for a move to develop. At 0DTE, theta is a chainsaw. It cuts through your position minute by minute, and unless SPX makes a violent intraday move, you’re paying premium to watch your trade decay to zero.

How Many Spreads Can You Actually Run?

At 2% risk per trade ($500), you run 1 spread per entry. At 3% risk ($750), still 1 spread but with room for wider wings. The sweet spot is 2-3%. At 5%+ you’re one bad streak from a blown account.

The rule that keeps you alive: max 2-3% of your account per trade. On $25K, that’s $500-750 at risk per entry.

A $5-wide SPX spread has a $500 max loss. So you run one spread per entry. Three entries across the day (10:30, 12:30, 2:30) = three spreads, $1,500 max daily risk, 6% of account.

“One spread? That only makes $75!” Yes. Three of them make $225 on a good day. That’s $1,125 per good week. The compounding does the rest.

What a Real Week Looks Like

This is the part nobody posts on social media.

Left: four wins, one loss, net +$345 (+1.4%). This is a good week. Right: two wins, three losses, net -$1,090 (-4.4%). This is a bad week. Both happen regularly. The bad week will happen roughly once a month.

The bad week is the test. Not whether the strategy works — the math says it does. Whether you can sit through three losing days in a row without changing your approach, increasing your size, or abandoning the system entirely.

If looking at -$1,090 on a Friday makes you want to double your contracts on Monday, this isn’t for you. The strategy needs 200+ trades to express its edge. You need to let it.

The 12-Month Reality Check

$25K to $29,811 in 12 months. +19.2%. Eight winning months out of twelve. Max drawdown $3,291. This is what “realistic” looks like.

Nobody’s screenshotting +19% for Reddit. There’s no 10-bagger, no “turned $500 into $50K” story. Just a $25K account that grew to almost $30K through 756 small trades, each one risking $500 to make $75.

Year 2 at the same rate on $30K: $5,700 in profit. Year 3: $6,800. By year 5 you’re north of $50K and running 5-6 spreads per day.

The path to $1.5M isn’t one trade. It’s 3,000 of them.

Five Rules, Non-Negotiable

1. Max 2% of account per trade. Survive losing streaks. Five losses in a row = -10%, not -50%. Break it and you blow up on the first bad week.

2. No trades in the first 15 minutes. Spreads are widest at open — you pay 30-50% more in friction. Death by a thousand cuts.

3. Close at 50% profit or let expire. Taking profits at 50% frees capital and avoids late-day gamma spikes. Otherwise you hold a winner that reverses at 3:30pm and goes from +$60 to -$400.

4. Daily stop: 2× your target. One bad day should cost two good days, not ten. A VIX spike catches you at full size and you lose a month of premium.

5. Check VIX before your first trade. VIX > 25 = widen strikes, reduce size. Sell 10-delta into VIX 30 without adjusting and wonder why your “safe” spread lost $500.

The hardest one for me is the daily stop. Two losing trades by 1pm and every instinct screams “one more to get back to even.” That’s how a $500 loss becomes a $1,500 loss. The stop exists for the days when your judgment is worst — which are always the days you’re losing.

I don’t care who you are — all of us are human, and it’s important to have a degree of self awareness.

The VIX Check

Before your first trade, check VIX. Every day. If you’ve read the Three-Engine 0DTE post, you know the full framework. The short version:

VIX < 14: Run 1-2 spreads instead of 3. Premium is thin. Don’t force it.

VIX 14-22: Full speed. This is your money zone.

VIX 22-30: Widen to 15-delta. Run 2 spreads. Tighten stops.

VIX > 30: One spread max, or sit out entirely. The best 0DTE trade on a VIX-35 day is no trade at all.

Where to Start

If this is your first 0DTE post:

1. Two-Engine 0DTE — the original framework

2. Three-Engine 0DTE — adding VIX regime sizing

3. This post — the specific trades for a $25K account

Paper trade for two weeks. Track every entry, every exit, every P&L. Then decide if you can stomach the bad weeks for the sake of the compounding.

Remember: Alpha is never guaranteed. And the backtest is a liar until proven otherwise.

The material presented in Math & Markets is for informational purposes only. It does not constitute investment or financial advice.

This is post 99 of my series — Building & Scaling Algorithmic Trading Strategies

Sequel to Two-Engine 0DTE Strategy, my most-read post. If you haven’t read it, start there.

August 5, 2024

VIX opened at 23. By noon it was 38. By 2pm it touched 65 — the highest intraday reading since March 2020. SPX dropped 3% in a single session.

If you were running the Two-Engine 0DTE strategy that day at full size — 150 spreads, 10-delta strikes, standard hedge ratio — every spread was underwater by late morning. Your 10-delta puts, which started 1.2% out of the money, were now deep in the money. Your convexity hedge helped, but it was sized for a VIX-25 event, not a VIX-65 event. The long puts you bought at VIX 16 the previous month had tripled in value, but they couldn’t offset 150 short spreads exploding simultaneously.

One day. Potentially months of premium erased.

This post is about the layer that would have cut that loss in half — or more.

Quick Recap: The Two-Engine Framework

In November, I reconstructed a strategy used by a trader who reportedly scaled a small account to $1.5M selling 0DTE SPX premium. The Two-Engine framework separated the strategy into its essential components:

Engine 1: Short 0DTE Premium. Sell 150-200 credit spreads per day on SPX same-day expiration options. Each spread collects a small premium ($0.30-0.80). Most expire worthless. The law of large numbers turns a 60-70% win rate into steady daily income.

Engine 2: Long-Dated Convexity. Buy 30-90 DTE out-of-the-money puts on SPX. These are your crash insurance. They bleed a small amount daily (the hedge cost) but explode in value on days like August 5. The two engines together create a risk-balanced system: Engine 1 makes money most days, Engine 2 saves you on the days that would otherwise end your account.

The Two-Engine framework works. Thousands of people read that post and many started exploring 0DTE premium selling.

But it has a blind spot that I didn't address.

The Blind Spot: Same Speed Through Every Neighborhood

The Two-Engine runs at the same speed regardless of the environment.

Same 150 contracts when VIX is 12 (calm, premium is paper-thin, barely worth the execution cost) as when VIX is 32 (stressed, premium is fat, but the tail will eat you alive).

Same 10-delta strikes in a market that’s been flat for three weeks as in a market that just dropped 2% overnight.

Same hedge ratio when OTM puts cost $0.50 as when they cost $4.00.

This is like driving 60 mph through a school zone and 60 mph on the highway. You’ll get away with it most days. The day you don’t is the day that defines your year.

The data makes the problem concrete:

Left: as VIX rises, the premium you collect per spread (green) grows roughly linearly — twice the vol, twice the premium. But the expected loss from tail events (red) grows as approximately VIX^1.8. Above VIX 28, the lines cross. You’re collecting premium that doesn’t compensate for the risk you’re taking. Right: expected daily P&L with constant sizing (orange, Two-Engine) vs. regime-scaled sizing (green, Three-Engine). The Two-Engine goes negative above VIX 28. The Three-Engine stays positive by scaling down.

That crossover point — around VIX 28-30 — is where the Two-Engine breaks. Not because the strategy is wrong, but because the sizing is wrong for the environment.

The Fix: Engine 3

The third engine is the simplest of the three. It’s a lookup table. Check VIX at market open. Set your parameters. Don’t deviate.

Engine 3 (yellow) sits on top and modulates both Engine 1 (how many contracts, what strikes) and Engine 2 (how much hedge). It’s the risk governor — the piece that keeps the other two engines from running off a cliff.

Engine 3 does four things:

1. Scales contract count. Fewer contracts when premium is thin (why trade 150 spreads at $0.15 each when bid-ask eats half of it?) and fewer when tail risk is elevated (why run full size into a VIX 35 environment?).

2. Widens strikes. A 10-delta put at VIX 15 is about 1.8% out of the money. At VIX 30, the same 10-delta put is only about 1.2% OTM — dangerously close. Engine 3 pushes to 15-delta and 20-delta strikes at high VIX to maintain the same effective distance from spot.

3. Adjusts frequency. At VIX < 14, premium per spread is so thin that the bid-ask spread absorbs 30-40% of it. Trading 150 spreads at those levels means paying $50+ in friction for $120 of premium. Engine 3 drops to 100-120 trades and skips any spread where friction exceeds 40%.

4. Scales the hedge. Engine 2’s convexity position runs at base when VIX is normal. At VIX > 22, it scales to 1.5×. At VIX > 30, it doubles to 2.5×. This is the piece that would have saved you on August 5 — twice the hedge when it matters most.

The Four Zones

VIX over two simulated years with four zones. Each has specific rules for everything: contract count, strike selection, spread width, hedge ratio, trade frequency, and stop levels. The Sweet Spot (green) is where you make your money. The Danger zone (red) is where you protect it.

Zone 1: Thin Premium (VIX < 14)

The market is dead calm. SPX is grinding higher on low volume. Premium per 0DTE spread: $0.15-0.30. After bid-ask, you’re collecting maybe $0.10-0.15 of real edge per trade.

The Two-Engine mistake: Running 150 spreads here and paying proportionally more in friction than you’re earning in premium.

Engine 3 rule: Drop to 60% of max contracts. Tighten entry criteria — skip any spread where the bid-ask exceeds 40% of premium. You’re trading less, but every trade you do take has a real edge.

Zone 2: Sweet Spot (VIX 14-22)

This is where you make your money. Premium is $0.50-0.85 per spread. Gamma is elevated but manageable at 10-delta. The hedge is cheap. The law of large numbers is working hard for you.

Engine 3 rule: Full speed. 150-200 spreads, 10-delta strikes, $5-wide spreads, standard stops. This is approximately 65% of trading days in a normal year.

Zone 3: Elevated (VIX 22-30)

Premium looks incredible. Your instinct says sell more. Your instinct is wrong.

At VIX 25, a 10-delta put is only about 1.2% out of the money. That felt like a comfortable distance at VIX 15 when it was 1.8%. The math has shifted underneath you.

Engine 3 rule: Drop to 70% of contracts. Widen to 15-delta strikes (restoring the ~1.8% buffer). Increase spread width to $7-10. Bump hedge ratio to 1.5×. Tighten stops to 1.5× daily target.

Zone 4: Danger (VIX > 30)

Every forum is posting screenshots of 0DTE premium. “Look at these spreads paying $2.50!” They’re paying $2.50 because there’s a meaningful chance they go to $10.

Engine 3 rule: 30% of max contracts. 20-delta strikes. $10-15 spread width. 2.5× hedge ratio. Stop at 1× daily target. You are here to survive, not to get rich.

What Happens When You Add the Third Engine

Two years of simulated 0DTE. Top: the Two-Engine (orange) has higher peaks in calm periods but deeper valleys during stress. The Three-Engine (green) compresses both — smaller peaks, much smaller valleys. Bottom: drawdown comparison. The worst Two-Engine drawdown is roughly twice the Three-Engine’s worst.

The Three-Engine gives up return in calm markets. It’s running at 60% size when VIX is below 14, so you’re leaving money on the table during the quiet grind-higher periods. That’s the cost.

The benefit: when VIX spikes — and it always spikes eventually — the Three-Engine is already at reduced size with wider strikes and a bigger hedge. The drawdown that takes the Two-Engine down 6% only takes the Three-Engine down 3%.

Over a full cycle of calm → spike → calm, the Three-Engine compounds better because it doesn’t dig as deep a hole to climb out of.

The Tail Gets Fatter Than You Think

This is the chart that should change how you think about high-VIX 0DTE — it should terrify you:

Daily P&L distributions by VIX regime. In the Sweet Spot (VIX 14-22): 73% win rate, average loss about 2× the average win. Manageable. In the Danger zone (VIX > 30): the win rate drops to 62% and the average loss explodes to nearly 6× the average win. The distribution isn’t just shifted — it’s a different shape. The left tail gets 5× fatter.

At VIX 15, when you lose, you lose about $0.65 per spread. At VIX 32, when you lose, you lose about $3.50 per spread. The premium went from $0.35 to $0.60 — not even a 2× increase. The loss went from $0.65 to $3.50 — a 5× increase.

Premium doubles. Risk quintuples. That’s the asymmetry Engine 3 is designed to manage.

The Adjustments Under the Hood

Left: the Two-Engine uses 10-delta strikes all the time (orange dashed). The Three-Engine widens to 15-delta above VIX 22 and 20-delta above VIX 30 (green). Wider strikes give you more room — the spread stays further from the money. Right: the Two-Engine runs a constant 1.0× hedge (orange dashed). The Three-Engine scales to 2.5× in the Danger zone (blue). You buy more crash insurance exactly when crashes become most likely.

The Cheat Sheet

Print this. Pin it. Don’t trade 0DTE without checking it.

Four zones, seven parameters. Check VIX at open, set your numbers, execute. The stop column is the most important — in the Danger zone, your daily stop is equal to your daily target. One losing day, you’re done for the session. That discipline is what keeps a bad day from becoming a catastrophic day.

The Uncomfortable Truth About 0DTE

The Two-Engine post got 86 subscribers — more than any other post I’ve written. That means a lot of people are interested in selling 0DTE premium. I want to be direct about the risks and caveats.

Even with three engines, 0DTE premium selling requires intraday monitoring, fast execution, deep understanding of gamma risk, and the ability to watch 30+ losing days per year without abandoning the system. The third engine doesn’t make it safe — it makes it less dangerous. Those are different things.

If you’re paper-trading the Two-Engine and it’s working, add the third engine before going live. The regime sizing is the difference between a strategy that survives its first VIX spike and one that doesn’t.

If you’re already live with the Two-Engine, the most important thing you can do today is check your current VIX zone and ask: am I sized correctly for this environment?

Remember: Alpha is never guaranteed. And the backtest is a liar until proven otherwise.

My math may have errors — please let me know if you find any.

And you should not be doing this unless you understand the risk.

The material presented in Math & Markets is for informational purposes only. It does not constitute investment or financial advice.

This is part 98 of my series — Building & Scaling Algorithmic Trading Strategies

Final part of the ML for Trading series. Part 1: Features. Part 2: XGBoost. Part 3: Validation.

The Race

Four posts ago, I asked: can a model do better than my hand-tuned rules? The answer required building a feature pipeline (Post 95), training and interpreting an XGBoost model (Post 96), and then subjecting it to honest validation that stripped away the overfitting (Post 97).

Now, let’s get to it.

Four approaches, same simulated data, same stress periods, same evaluation criteria:

Five years of simulated data with four stress periods (red shading). Gray: V6 base with no regime protection. Orange: 50 lines of if-else rules from Post 86. Blue: validated XGBoost from Post 97. Green: the hybrid (ML in calm markets, rules in spikes). The hybrid edges out XGBoost on total return while matching it on Sharpe and drawdown.

The numbers:

                  Sharpe    Max DD    Ann. Return
V6 base:          0.98      -40%       ~21%
If-else rules:    1.27      -23%       ~24%
XGBoost:          1.35      -20%       ~24%
Hybrid:           1.35      -20%       ~25%

The XGBoost beats the if-else rules. The hybrid matches the XGBoost on risk metrics and slightly improves total return. But the gap between if-else and XGBoost is smaller than the gap between V6 base and if-else.

The first 50 lines of protection code did most of the work.

Where Each Approach Wins

The aggregate numbers hide regime-specific performance that matters for deployment:

OOS Sharpe by VIX regime for each approach. The XGBoost wins in Calm and Elevated regimes (where it has abundant training data). The if-else rules win in Spike regimes (where the model has too few examples). The hybrid takes the best of both: ML performance in normal markets, rules-based safety in tail events.

This is the key finding of the entire series: ML and rules are complements, not substitutes. The XGBoost discovers non-linear patterns in normal markets (the VIX reversal from Post 96, the GEX × spread interaction) that if-else rules can’t express. But in rare events — VIX > 35, which happens roughly 5% of the time — the model doesn’t have enough training examples to generalize. The simple rule (”go to minimum allocation”) outperforms the model’s confused prediction.

The hybrid captures this insight by routing decisions through a regime check: if VIX > 30, use rules; otherwise, use the model.

The Full Cost

Sharpe isn’t the only metric. Every approach has operational costs that don’t show up in the backtest:

The if-else rules cost essentially nothing to maintain. They’re 50 lines of Python that I wrote once and haven’t touched. The XGBoost requires a feature pipeline (11 data feeds), quarterly retraining, SHAP drift monitoring, and 10-30 minutes of investigation per unusual trade. The hybrid sits between — it needs the ML pipeline but uses rules as a safety net, which reduces the monitoring burden.

I can’t highlight this enough — ML sounds tempting but the reality is that the overhead and complexity of ongoing maintenance and pipeline is difficult to manage.

The Complexity-Adjusted View

Here’s the chart that made the decision for me:

Sharpe ratio (bars) vs. hours per month to maintain (yellow line). The XGBoost Raw bar is struck through — that was the 0.71 that Post 97 proved wasn’t real. The validated XGBoost and hybrid have similar Sharpe, but the hybrid requires half the maintenance hours because the rules portion needs no monitoring.

The if-else rules deliver 0.50 Sharpe for 0.5 hours per month of effort. The hybrid delivers 0.56 Sharpe for 4 hours per month. That’s +0.06 Sharpe for 3.5 additional hours.

At a $500K portfolio, 0.06 Sharpe is roughly $3,000 per year of additional risk-adjusted return. For 42 hours of annual work, that’s $71/hour. Not nothing — but not obviously worth it either.

At a $2M portfolio, the same 0.06 Sharpe is $12,000/year, or $286/hour. Now it’s clearly worth it. Scale determines the answer for you!

What Actually Gets Deployed

The final V6 architecture has four layers:

Layer 1: Data + Features. Eleven features computed daily from six data feeds (VIX, price, spreads, GEX, yield curve, credit spreads). All features are stationary (z-scored or binary). This is the pipeline from Post 95.

Layer 2: Regime Router. A simple VIX threshold check. If VIX > 30, route to the rules path. If VIX ≤ 30, route to the ML path. This is the hybrid insight from Post 97’s regime stability analysis.

Layer 3a: ML Allocation (calm/elevated regimes). The XGBoost model outputs a continuous allocation between 0.1× and 1.0×. This captures the non-linear patterns — the VIX reversal, the interaction effects, the gradual re-entry after stress — that rules can’t express.

Layer 3b: Rules Allocation (spike regimes). The if-else rules from Post 86 output a binary allocation: 0.2× (crisis) or 1.0× (all clear). Simple, robust, doesn’t need training data for rare events.

Layer 4: Monitoring. SHAP drift detection (are the feature importances shifting?), OOS Sharpe tracking (is the model still working?), CUSUM on residuals (has the relationship changed?), and a quarterly retrain trigger.

The 18-Post Journey

The honest Sharpe progression across 18 posts and 5 series. The green line (validated Sharpe) rises gradually from 0.33 to 0.56. The orange line shows the reported Sharpe, which spiked to 0.71 at Post 96 before validation crashed it to 0.41 at Post 97. The red-shaded zone between the lines is the overfitting — the part that wasn’t real.

This chart is the most important one in the series. Every series across Posts 80-98 made V6 better — but the improvements were smaller and harder to achieve with each layer:

Posts 80-82 (Strategy Decay): +0.05 Sharpe from CUSUM monitoring. Almost free.

Posts 83-86 (Microstructure): +0.12 Sharpe from GEX and spread conditioning. The biggest single improvement. Worth every line of code.

Posts 87-89 (Carry Trade): +0.03 Sharpe from carry optimization. Real but small.

Posts 90-93 (Synthetic Replication): +0.00 Sharpe. The options overlay was theoretically sound but added complexity without improving the validated result. I implemented the tail hedge in paper mode only.

Posts 95-98 (ML for Trading): +0.06 Sharpe from the hybrid approach — but only after honest validation stripped 0.30 of apparent Sharpe away as overfitting.

The total improvement: 0.33 → 0.56, or +0.23 Sharpe across 18 posts. The microstructure layer (4 posts) contributed more than half of that.

The Decision Matrix

The question everyone asks: should I add ML to my strategy?

The last row is the one I care about most. If you’re reading this series to learn quantitative methods, build everything. Train the XGBoost, run the SHAP analysis, implement the walk-forward validation, and compute the deflated Sharpe. The understanding you develop from building and breaking these tools is worth more than any Sharpe improvement.

But if you’re deploying real capital, the honest answer is that 50 lines of if-else rules, carefully chosen and rigorously monitored, get you 90% of the way there. The ML layer adds the last 10% — at 4× the operational cost and 10x the complexity.

What I Learned

Four posts, four lessons:

The model doesn’t matter — the inputs do (Post 95). I spent 80% of the ML work on feature engineering and 20% on the model. That ratio was correct. The model amplifies signal; it can’t create it.

Trees beat neural nets for this problem (Post 96). Not because trees are better in general — because financial data is regime-based, sample-limited, noisy, and needs to be interpretable. Trees match all four constraints. Neural nets match one.

Honest validation destroys most backtests (Post 97). Our XGBoost went from 0.71 to 0.41 after walk-forward validation, purged CV, and deflated Sharpe adjustment. If that haircut surprises you, you haven’t validated enough strategies yet.

The hybrid is better than either extreme (Post 98). ML where it has data, rules where it doesn’t. The model that admits its limitations outperforms the one that pretends it doesn’t have any.

This concludes the ML for Trading series (Posts 95-98) and the full arc that began at Post 80. Nineteen posts, five series, one strategy: V6 went from a simple TQQQ/TLT allocator to a layered system with regime detection, microstructure conditioning, carry optimization, and a validated ML overlay.

The Sharpe went from 0.33 to 0.56. Not through one clever insight, but through the accumulation of small, honest improvements — each one tested, validated, and documented in public.

Remember: Alpha is never guaranteed. And the backtest is a liar until proven otherwise.

The material presented in Math & Markets is for informational purposes only. It does not constitute investment or financial advice.

This is part 97 of my series — Building & Scaling Algorithmic Trading Strategies

Part 3 of the ML for Trading series. Part 1: Feature engineering. Part 2: XGBoost and SHAP.

Every Good Backtest Starts as a Lie

In Part 96, I reported an XGBoost model with a 0.71 Sharpe ratio. That number is a lie — well, not completely true anyway.

You see, the calculation is correct on the data I used. But it’s a lie because I tested 20 features, 4 model types, multiple hyperparameter configurations, and two interaction engineering approaches before arriving at that number. So conservatively, I evaluated ~80 strategy variations on the same dataset.

This is the multiple testing problem, and it is the most expensive bug in quantitative finance. Every blown account, every fund that looked great on paper and lost money live, every strategy that “worked in the backtest” — almost all of them trace back to this single error: mistaking a lucky variation for a real edge.

This post is about how to not make that mistake.

Problem 1: We Test 80 Things and Reported the Best One

Left: 80 strategy variations, all with ZERO true alpha, simulated under the null hypothesis. Six of them show Sharpe > 0.5 by pure chance. If you pick the best one and report it, you have a “great” backtest. Right: the probability of finding at least one “significant” result. At 80 tests with a 5% threshold, there’s a 98.3% chance of discovering something “significant” — even when nothing is real.

The math is simple and brutal. If you test one strategy and it has a p-value of 0.05, there’s a 5% chance it’s noise. If you test 80 strategies and report the best one, the probability that your best result is noise is:

P(at least one false positive) = 1 - (1 - 0.05)^80 = 98.3%

You are almost certain to find something “significant.” That doesn’t mean it works.

What This Means for Our XGBoost

I tested 20 features (Post 95). I tried 4 model types (Post 96). I tuned hyperparameters across maybe 10 configurations. That’s roughly 20 × 4 × 10 = 800 implicit tests, not 80. I was conservative earlier.

The observed 0.71 Sharpe needs to survive scrutiny that accounts for all of these trials. If it doesn’t, it’s noise — regardless of how good the SHAP plots look.

Test 1: Walk-Forward Validation

The first and most important test: does the model work on data it has never seen, in temporal order?

Top: the WRONG way — random train/test splits. Test data is scattered between training data, so the model has seen future information. Bottom: the RIGHT way — walk-forward validation. Train on the first year, test on the next quarter. Slide forward, retrain, test again. The model never sees the future.

Random train/test splits are the default in scikit-learn. They are wrong for time series.

Why, you ask? Well let me tell you!

Your features include 63-day rolling z-scores. If day 300 is in the test set and day 337 is in the training set, the model has effectively seen information from the test period — because the z-score on day 337 was computed using days 274-337, which overlaps with the test set.

I have myself failed with exactly this. My model returned an 1080% RoI with a Sharpe of 4.0! Was I the next Jim Simmons? Hell no. I was simply an enthusiastic… moron.

Walk-forward validation eliminates this. The train set is always before the test set. No overlap, no leakage, no cheating.

Our Results

I ran 12 walk-forward windows (1-year train, 3-month test) on the XGBoost model:

Top: Sharpe ratio for each walk-forward window. Mean OOS Sharpe is 0.48 — down from the reported 0.71. Two windows (W3 and W7) are negative. Bottom: cumulative OOS P&L. The edge is real but lumpy — two of 12 quarters lost money.

The reported Sharpe of 0.71 just became 0.48. That’s a 32% haircut from walk-forward alone. But it’s still positive and consistent across most windows — the model is learning something real, just less than the in-sample number suggested.

The two negative windows (W3 and W7) are important. They correspond to periods where the market regime shifted in ways the model hadn’t seen in its training window. W3 was a sharp VIX spike followed by an immediate recovery — the model reduced allocation and missed the bounce. W7 was an extended low-vol period where the model kept partial allocation when it should have been fully invested.

These are the failure modes you need to know about before deploying, not after.

Test 2: Purged Cross-Validation

Walk-forward is necessary but not sufficient. Standard k-fold cross-validation has a subtler problem:

Left: standard k-fold. Fold boundaries create leakage zones (red) where features computed from one fold’s data bleed into the adjacent fold. Right: purged CV with embargo. A 21-day purge window removes data before each test fold, and a 10-day embargo removes data after. No feature computation spans the boundary.

The purge window (21 days in our case) must be at least as long as the longest lookback in your features. Our features include a 63-day z-score, so technically the purge should be 63 days. I used 21 as a compromise — the z-score’s sensitivity to any single day is small after the first few days, so a 21-day purge captures most of the leakage.

The embargo (10 days) prevents the model from learning the immediate post-test-fold dynamics, which would give it an unfair advantage on the test fold’s final days.

Our Results

Purged CV Sharpe: 0.44 — an additional -0.04 from the walk-forward result. The leakage in standard CV was inflating our result by about 4 basis points of Sharpe. Small but not zero.

Test 3: The Deflated Sharpe Ratio

The deflated Sharpe ratio (Bailey and de Prado, 2014) answers the question: “Given that I tested N variations and observed this Sharpe, what’s the probability it’s real?”

The intuition: if you flip 80 coins and report the one with the most heads, you haven’t found a biased coin — you’ve found the luckiest fair coin. The deflated Sharpe adjusts for this by subtracting the expected maximum Sharpe from N trials under the null hypothesis.

Left: the deflated Sharpe as a function of trials. The observed Sharpe (0.71, dashed orange) stays constant. The deflated Sharpe (green) drops as you account for more trials. At 80 trials, the DSR is 0.41 — real, but barely half of the reported number. Right: the waterfall from reported to reality. Each validation step strips away more noise: 0.71 → 0.56 (walk-forward) → 0.48 (purged CV) → 0.41 (deflated SR).

The formula:

# Deflated Sharpe Ratio (simplified)
import numpy as np
from scipy.stats import norm

def deflated_sharpe(observed_sr, n_trials, n_observations, sr_std=None):
    """
    observed_sr: the Sharpe you measured
    n_trials: how many strategies/variations you tested
    n_observations: number of data points (days)
    """
    if sr_std is None:
        sr_std = np.sqrt((1 + 0.5 * observed_sr**2) / (n_observations / 252))
    
    # Expected max Sharpe from n_trials under null
    expected_max = sr_std * np.sqrt(2 * np.log(n_trials))
    
    # Deflated = observed minus expected noise contribution
    dsr = observed_sr - expected_max
    
    return dsr

# Our case
dsr = deflated_sharpe(0.71, n_trials=80, n_observations=756)

The Uncomfortable Number

Our XGBoost’s deflated Sharpe, accounting for 80 trials on 756 observations, is approximately 0.41. That’s the honest number — the one that accounts for all the strategies we tested and didn’t report.

A DSR of 0.41 is still positive, which means the edge is likely real. But it’s a long way from the 0.71 we started with.

Test 4: Regime Stability

The final test: does the model work in all market regimes, or did it only learn one environment?

I stratified the OOS results by VIX regime:

VIX Regime      | OOS Sharpe | N Windows | Verdict
────────────────|────────────|───────────|────────
Calm (< 15)     |    0.35    |     4     | ✓ Positive
Elevated (15-25)|    0.62    |     5     | ✓ Strong
Stressed (25-35)|    0.28    |     2     | ✓ Marginal
Spike (> 35)    |   -0.15    |     1     | ✗ Negative

Three of four regimes are positive — acceptable. The model fails in the Spike regime, which makes sense: VIX > 35 events are rare in the training data (roughly 5% of days), so the model has too few examples to learn the dynamics. In the Spike regime, the simple if-else rule (”go to minimum allocation”) actually outperforms the ML model.

This is the most actionable finding: use the ML model for Calm and Elevated regimes, fall back to if-else rules for Spike regimes. The hybrid approach — ML where it has enough data to learn, rules where it doesn’t — is likely better than either approach alone.

The 4-Test Framework

Every strategy must pass all four tests. Failing any single test is disqualifying — not because the strategy is definitely worthless, but because you can’t distinguish it from noise.

Our XGBoost passed all four, but just barely on the deflated Sharpe. The honest reported Sharpe for this model is not 0.71. It’s somewhere between 0.41 (DSR-adjusted) and 0.48 (walk-forward), depending on how conservative you want to be.

What This Looks Like in Practice

Left: the in-sample backtest. Sharpe 1.84, smooth upward trajectory, -11% max drawdown. “This strategy is amazing.” Right: the walk-forward OOS reality. Sharpe 1.06, choppy with deep drawdowns, -26% max DD. “This strategy is real — barely.” The gap between these two curves is the cost of overfitting.

This is what honest validation does to every strategy. In my experience, rightfully or not, if it doesn’t look painful, you probably haven’t done it right.

The Takeaways (sounds like a movie…)

1. Track your trials. Every feature you test, every model you evaluate, every hyperparameter you tune is a trial. Write them down. The deflated Sharpe requires this number, and most people wildly undercount it.

2. Walk-forward is mandatory. If you haven’t run walk-forward validation with proper temporal ordering, your Sharpe ratio is meaningless. Not “probably inflated” — meaningless. You can’t know if it’s signal or noise.

3. Report the DSR, not the Sharpe. When someone tells you their strategy has a 1.5 Sharpe, the correct response is: “Over how many observations, after how many trials?” A 1.5 Sharpe after 5 trials on 5,000 days is real. A 1.5 Sharpe after 500 trials on 500 days is noise.

4. Expect a 30-50% haircut. If your in-sample Sharpe is 1.0, your honest OOS Sharpe will be 0.5-0.7 after proper validation. If you can’t accept that haircut, you’re in the wrong business. The alternative — deploying the in-sample number — is how you lose money.

5. The hybrid is better than either extreme. Use ML where it has enough data (normal markets). Use rules where it doesn’t (tail events). The model that admits its own limitations outperforms the one that doesn’t.

The Running Score

Our XGBoost, honestly:
  Reported Sharpe:       0.71
  After walk-forward:    0.56  (-21%)
  After purged CV:       0.48  (-32%)
  After deflated SR:     0.41  (-42%)
  
Verdict: real, but modest. +0.08 over the if-else rules
after accounting for everything.

Is +0.08 Sharpe worth the complexity?
Post 98 will answer.

Up Next

Post 98: The V6 ML Layer — The final verdict. This is where we go head-to-head: 50 lines of if-else vs. the validated XGBoost model. Who will win?

Accounting for implementation cost, operational complexity, and the failure modes we identified here. The honest answer on whether ML belongs in V6 or not.

Remember: Alpha is never guaranteed. And the backtest is a liar until proven otherwise.

These posts are about methodology, not recommendations. If you find errors in my math, let me know — I’ve built an entire series around discovering my own mistakes, so one more won’t hurt.

The material presented in Math & Markets is for informational purposes only. It does not constitute investment or financial advice.

Tool 1: Feature Engineering Explorer

ml-feature-explorer.mathandmarkets.com

This is the companion to Post 95. It lets you do what I did in that post — test 20 candidate features and figure out which ones are signal and which ones are noise — but interactively.

The Feature Explorer tab shows all 20 features ranked by Information Coefficient. Click any feature to select or deselect it. The scoreboard at the top updates in real-time: how many features you’ve selected, how many are above the noise floor (IC > 0.03), your portfolio’s combined IC, and how many redundancy warnings you’ve triggered. Hover over any feature to see what it measures and why it matters.

The thing to watch: redundancy warnings. If you select VIX z-score, Realized vol z, AND VIX term structure, you’ll get a warning that you have three volatility features with high inter-correlation. The model can’t distinguish their individual contributions. Drop one.

The Stationarity Lab tab shows one feature (VIX) rendered four different ways: raw level, z-score, percentile rank, and rate of change. Toggle between them and notice that the raw level drifts — its mean shifts over time. The other three are stationary. The Python code for each transformation is shown alongside so you can apply the same logic to your own features.

If you take one thing from this tab: never feed a raw level into a model.

The IC Decay tab shows your selected features losing predictive power over time. Each feature decays at a different rate — VIX z-score holds its IC for roughly 8 years, while OFI proxy drops to the noise floor in about 3. This tab tells you how often your model needs retraining based on the features you’ve chosen.

The Model Playground tab is where you feel overfitting with your hands. Three sliders: number of trees, max depth, and learning rate. As you increase any of them, the in-sample Sharpe climbs — it can hit 1.0, 1.5, even 2.0+. The out-of-sample Sharpe peaks around 200 trees / depth 4 / learning rate 0.05, then collapses. The bar chart shows the gap at every tree count. The verdict text changes from green (”healthy”) to yellow (”moderate overfit”) to red (”your model has memorized the training data”).

Crank the depth to 15 and watch the IS Sharpe hit 2.0+ while OOS drops below 0.3. That’s the chart that should be tattooed on every ML practitioner’s forearm.

Tool 2: SHAP Explorer

ml-shap-explorer.mathandmarkets.com

This is the companion to Post 96. It shows what the XGBoost model actually learned — not just which features are important (the bar chart) but how each feature affects the model’s output (the dependence plots).

The sidebar ranks all 11 features by mean |SHAP value|. Click any feature to load its dependence plot in the main panel.

The dependence scatter shows the feature’s value on the x-axis and its SHAP contribution on the y-axis. Each dot is one day. The shape of the cloud tells you the relationship — and the key discovery is that many relationships are non-linear.

Start with VIX z-score. You’ll see a shape that isn’t a straight line. Below zero, SHAP is mildly positive (buy the calm). Between 0 and 2.5, it’s strongly negative (reduce allocation). But above 2.5 — the extreme tail — it bends back up. The model discovered that extreme VIX readings predict mean-reversion, not continuation. That’s the signal my if-else rules missed for 94 posts.

Toggle the GEX split button in the top right. This colors each dot by whether GEX was positive (green) or negative (red) on that day. The two populations separate — negative GEX makes every VIX level worse. The model treats VIX = 2.0 with negative GEX the same as VIX = 2.5 with positive GEX. That’s an interaction effect that linear IC analysis from Post 95 couldn’t detect.

The Spread z-score dependence plot is another one worth examining with GEX split on. Wide spreads with positive GEX have almost no effect — dealer hedging absorbs the microstructure stress. Wide spreads with negative GEX are strongly negative. The interaction is the signal, not the individual feature.

Tool 3: Decision Tree Builder

ml-tree-builder.mathandmarkets.com

This one is a game. Can you build a hand-tuned decision tree that beats XGBoost?

The left panel is your rule builder. Click “+ Add Rule” to create a split. Each rule has four components: a feature (VIX z-score, GEX regime, momentum, etc.), a direction (greater than or less than/equal), a threshold, and an allocation (0-100%). Rules are evaluated top to bottom — the first matching rule wins. Days that don’t match any rule get full allocation.

The right panel updates live. You’ll see a heatmap strip showing your allocation over time (green = full, red = minimum), an equity curve comparing your tree to the V6 base, and a results table benchmarking you against XGBoost (Sharpe 0.56) and the if-else rules from Post 86 (Sharpe 0.50).

To get started: try adding one rule — VIX z-score > 1.5, allocation 20%. This single rule captures the three stress periods and should push your Sharpe from the base level up toward 0.4-0.5. Then add a second rule for GEX regime <= 0, allocation 50%. This catches days where dealer positioning amplifies moves even when VIX isn’t extreme.

The verdict bar at the bottom tells you where you stand. If you beat XGBoost with fewer rules than it has trees, the verdict will say so — and that’s the point. Sometimes domain expertise in 3 rules beats 200 trees and 240,000 splits.

The hint if you get stuck: the stress periods are around days 130-170, 370-405, and 570-615. The model catches them by combining VIX z-score, momentum direction, and spread width. Try adding a rule that captures negative momentum during high VIX — that’s the regime the model weights most heavily.

What’s Coming Next

These three tools cover Posts 95-96. The next two posts — Post 97 (The Overfitting Minefield) and Post 98 (The V6 ML Layer) — will bring additional interactive components. The walk-forward validation visualizer is in development, and the final post will include a head-to-head simulator where you can compare the ML layer, the if-else rules, and the V6 base across different market regimes.

All tools are at ml-tools-hub.mathandmarkets.com.

Not investment advice. These are simply tools to experiment and play with. Do your own due diligence.

This is part 96 of my series — Building & Scaling Algorithmic Trading Strategies

Part 2 of the ML for Trading series. Part 1: Feature engineering — 20 features, only 7 survive.

The Problem a Linear Model Can’t Solve

In Part 95, I built an 11-feature input matrix: VIX z-score, VIX term structure, GEX regime, spread z-score, and seven others — all stationary, non-redundant, with domain-driven interactions.

Now: what model should consume these features?

The instinct is to reach for the deepest tool in the box. Transformers. LSTMs. Attention mechanisms. But this problem doesn’t need depth. It needs non-linearity at the split level — the ability to discover that VIX > 25 with negative momentum means something completely different from VIX > 25 with positive momentum.

Left: the actual regime structure in simulated data. Returns depend on VIX × momentum interactions — high VIX with negative momentum crashes, high VIX with positive momentum bounces. The yellow dashed lines are the decision boundaries a tree finds automatically. Right: a linear regression draws a straight line through this mess and misses the regime structure entirely. Trees capture the step-function reality.

This is the core argument for tree models in trading: markets have regimes, not gradients. The relationship between VIX and returns isn’t “higher VIX → proportionally lower returns.” It’s “VIX below 18 = one regime, VIX 18-25 = another, VIX above 25 = a third.” Trees find these thresholds automatically.

What the Tree Learns

Here’s a simplified decision tree trained on V6’s feature matrix:

A single tree from the ensemble, pruned to depth 3 for readability. The root split is on VIX z-score (the strongest feature from Part 95). The left branch handles calm markets, splitting on GEX regime and spread z-score to determine allocation between 0.6× and 1.0×. The right branch handles stress, splitting on momentum direction to distinguish recovery bounces (0.5×) from active crashes (0.2×).

Compare this to the if-else rules I wrote by hand in Post 86 (the microstructure layer):

# My hand-tuned rules (50 lines)
if gex_positive and spread_z < 1.0:
    allocation = 1.0
elif vix > 25 and momentum < 0:
    allocation = 0.3
elif vix > 25 and momentum > 0:
    allocation = 0.5
else:
    allocation = 0.7

The tree discovers approximately the same structure — but with two advantages:

1. The thresholds are optimized. I picked VIX > 25 and spread_z < 1.0 based on intuition. The tree picks VIX z-score > 1.5 (which corresponds to different absolute VIX levels depending on the recent regime) and spread z > 1.0. The tree’s thresholds are fit to the data; mine were fit to my gut.

2. The interactions are automatic. I manually coded the VIX × momentum interaction because I knew it mattered. The tree finds GEX × spread as an additional interaction that I never tested. It also discovers that extreme VIX (z > 3) actually reverses — something I missed entirely.

SHAP: What the Model Actually Uses

The tree has 1,200 estimators, each with up to 200 splits. That’s 240,000 decision points. What is all that complexity doing?

SHAP (SHapley Additive exPlanations) decomposes each prediction into the contribution of each feature. Instead of a black box that says “allocate 0.3×”, SHAP says “VIX z-score pushes the allocation down by 0.15, GEX pushes it down by 0.08, but momentum pushes it up by 0.05, net = 0.3×.”

Mean absolute SHAP values across the test set. VIX z-score dominates (no surprise — it’s the strongest univariate predictor). But the VIX×Momentum interaction ranks third, ahead of most base features. This is the ML model discovering a non-linear relationship that IC analysis from Part 95 couldn’t detect. Top 5 features account for ~80% of the model’s output.

The standout finding: interaction features rank higher than most base features. The VIX×Momentum interaction (which I engineered manually in Part 95) is the third most important feature. The GEX×Spread interaction is sixth. The model confirms that these interactions carry real signal — not just artifacts of my feature engineering choices.

The Non-Linear Discoveries

SHAP dependence plots reveal what the model learned that my if-else rules didn’t:

Left: VIX z-score dependence, colored by GEX regime. The relationship is NOT monotonic. Below z = 0 (calm), the effect is mildly positive (buy the dip). Between 0 and 2.5 (stress), it’s strongly negative (reduce allocation). Above 2.5 (extreme stress)... the model discovers that extreme VIX readings actually reverse. The curve bends back up. This is a mean-reversion signal in the tails that a linear model or a simple if-else threshold would never find. Right: the Spread × GEX interaction. When GEX is negative (red) AND spreads are wide, the model aggressively reduces. When GEX is positive (green), wide spreads have almost no effect — dealer hedging absorbs the microstructure stress.

The extreme-VIX reversal is the most interesting discovery. My hand-tuned rules treated VIX > 25 as uniformly bad. The tree says: “VIX at 25-35 is bad. VIX at 40+ means the crash is almost over — start buying back in.” This matches the empirical research on VIX mean-reversion from Post 80 (strategy decay half-lives), but I never incorporated it into V6’s rules because I didn’t trust myself to time the reversal. The model doesn’t trust itself either — it only gives a partial increase, from 0.2× to maybe 0.35× — but it’s an edge I was leaving on the table.

Model Selection: Why XGBoost Wins

I tested four models on the same feature matrix with the same walk-forward validation:

Left: four models compared on OOS Sharpe, direction accuracy, overfit gap, and training time. XGBoost wins on Sharpe (0.71) with a moderate overfit gap (0.08). Random Forest is close behind (0.62) with a larger overfit gap (0.12). Logistic regression is simplest but misses the non-linearity. The neural net overfits badly (0.25 overfit gap) and is 10× slower. Right: radar chart showing why trees dominate for this problem — adequate training samples, moderate feature count, non-linear relationships, high noise, and critical need for interpretability.

Why neural nets fail here:

Too few samples. V6 has roughly 2,500 days of data. After walk-forward splits, each training window is 500-800 days. Neural nets need 10,000+ samples to generalize. Trees are sample-efficient — they can find meaningful splits with hundreds of observations.

Too much noise. Financial returns have a signal-to-noise ratio of roughly 0.05 (the IC from Part 95). Neural nets overfit noise at low SNR because they have too many parameters. Trees with depth constraints can’t overfit as easily because the number of possible splits is bounded.

Interpretability. When the model says “reduce to 0.2×”, I need to know why. SHAP on a tree ensemble is computationally exact. SHAP on a neural net is approximate and expensive. If I can’t explain the model’s decision, I won’t trade on it.

The Regime Map

Putting it all together: the XGBoost model generates a daily allocation prediction based on the 11 features, and V6 uses that prediction instead of the hand-tuned rules:

Three panels. Top: price action with stress periods shaded. Middle: the XGBoost’s allocation prediction as a heatmap — green = full allocation, red = minimum. The model goes red 5-8 days before the worst of each drawdown and gradually re-enters (yellow → green) after the stress subsides. Bottom: cumulative P&L. XGBoost improves the Sharpe from 0.33 to 0.56 and cuts max drawdown from -34% to -17%.

The heatmap in the middle panel is the key visualization. It shows the model’s regime classification in real-time — not as a binary on/off but as a continuous allocation between 0.1× and 1.0×. The gradual re-entry after stress (the yellow-to-green transition) is something my hand-tuned rules didn’t do well — I used binary switches (in or out) rather than continuous scaling.

The Hyperparameter Trap

Before you get excited: most of the Sharpe improvement is fragile. It depends heavily on hyperparameter choices that I made after looking at the out-of-sample results.

Left: number of trees vs. Sharpe. In-sample Sharpe climbs to 1.95 with 5,000 trees. Out-of-sample peaks at 200 trees (0.71) then declines to 0.42 with 5,000 trees. The widening gap is pure overfitting. Right: max tree depth shows the same pattern. Depth 4 is optimal OOS (0.71). Depth 15 gives an IS Sharpe of 2.20 and an OOS Sharpe of 0.15.

This is the central problem of ML for trading: the model that looks best in-sample is the worst out-of-sample.

A researcher who only reported the depth-15 IS Sharpe of 2.20 would have a “stunning” result. The actual OOS Sharpe of 0.15 tells you it’s garbage. The only honest approach is walk-forward validation with strict separation between parameter tuning and performance evaluation — which is what Part 97 (the overfitting minefield) will cover in depth.

For now, the practical takeaway: shallow trees, few estimators, heavy regularization. My final XGBoost configuration:

model = XGBRegressor(
    n_estimators=200,     # not 1,200 — OOS peaks here
    max_depth=4,          # shallow trees generalize better
    learning_rate=0.05,   # slow learning prevents overfitting
    subsample=0.7,        # row sampling (bagging)
    colsample_bytree=0.7, # column sampling (feature bagging)
    reg_alpha=1.0,        # L1 regularization
    reg_lambda=5.0,       # L2 regularization (heavy)
    min_child_weight=50,  # minimum samples per leaf
)

Every parameter choice limits the model’s ability to memorize the training data. The resulting model is weaker in-sample but more honest out-of-sample.

The Uncomfortable Question

The XGBoost improves V6’s Sharpe from 0.33 to 0.56. That’s meaningful. But the 50-line microstructure layer from Post 86 improved it from roughly 0.33 to roughly 0.50 (varying by simulation).

The marginal improvement of ML over hand-tuned rules is about +0.06 Sharpe. For that, you get:

Additional complexity:
  - Model training pipeline (data prep, validation, tuning)
  - Feature maintenance (11 features, daily updates)
  - Periodic retraining (quarterly, per Part 95's IC decay)
  - Monitoring for model drift
  - SHAP analysis for each trade decision

versus:

50 lines of if-else that anyone can read, modify, and debug

Is +0.06 Sharpe worth that operational burden? Part 98 will give the definitive answer. But I’ll preview my current thinking: it depends on your scale. At $100K, the if-else rules win on simplicity. At $10M+, the ML layer starts to justify its overhead.

Up Next

Part 97: The Overfitting Minefield — Walk-forward validation, combinatorial purged cross-validation, the deflated Sharpe ratio, and a rigorous framework for answering “is this result real or noise?”

Remember: Alpha is never guaranteed. And the backtest is a liar until proven otherwise.

These posts are about methodology, not recommendations. If you find errors in my math, let me know — I’ve built an entire series around discovering my own mistakes, so one more won’t hurt.

The material presented in Math & Markets is for informational purposes only. It does not constitute investment or financial advice.

This is part 95 of my series — Building & Scaling Algorithmic Trading Strategies

This begins a 4-part series on machine learning for trading. Part 1: feature engineering. Part 2: tree models for regime classification. Part 3: the overfitting minefield. Part 4: does the ML layer actually help V6?

🔧 Interactive tool: ML Feature Engineering Explorer — select from all 20 candidate features, check which ones beat the noise floor, watch their predictive power decay over time, and see the Python transforms for making raw data ML-safe.

The Dirty Secret of ML for Trading

Here’s what nobody tells you in the scikit-learn tutorials: the model doesn’t matter.

Not at first. Not until you’ve spent 80% of your time on the input. A random forest trained on good features will crush a transformer trained on garbage. A logistic regression with the right 8 features will beat a neural network with 200 noisy ones. The model learns patterns in whatever you feed it. If you feed it noise, it learns noise.

This post is about the 80% — feature engineering. Specifically: how to convert 93 posts of trading signals, macroeconomic indicators, and microstructure data into a clean, stationary, non-redundant feature set that a model can actually learn from.

The Feature Taxonomy

Over the last 15 posts (Parts 80-94), we built signals across five categories. Here they all are:

Twenty candidate features organized by category. Momentum/trend features capture directional persistence. Volatility/regime features capture market stress. Microstructure features capture order flow and dealer positioning. Carry/macro features capture the yield environment. Cross-asset features capture inter-market relationships.

Each of these features was developed and discussed in a specific post. They’re not random — they have theoretical grounding and empirical motivation. But that doesn’t mean they all belong in an ML model. Many are redundant, some are non-stationary, and a few might be pure noise in a multivariate context.

The job of feature engineering is to separate the signal from the noise, the unique from the redundant, and the stationary from the drifting.

Problem 1: Redundancy

The first thing you notice when you stack these features into a correlation matrix:

Pairwise correlations across 12 features. VIX and 21-day realized vol are 70% correlated — they’re measuring the same thing. 50-day and 200-day momentum have 50% overlap. Credit spreads and VIX are 40% correlated. Feeding all of these into a model gives you multicollinearity — the model can’t separate the contribution of each feature.

The fix is straightforward: for each pair with |r| > 0.7, drop one. The decision of which to drop is domain-driven:

Between VIX and realized vol, keep VIX — it’s forward-looking (implied) while RV is backward-looking (realized). The forward-looking version is more useful for predicting future returns.

Between Mom(50) and Mom(200), keep the ratio (50/200) rather than either level — the crossover signal carries the information of both in a single feature.

Between credit spreads and VIX, keep both — the correlation is moderate (0.4) and they capture different aspects of risk (credit vs. equity volatility). But if forced to choose, credit spreads add incremental information that VIX doesn’t capture.

After the correlation filter: 20 candidates → ~14 features.

Problem 2: Stationarity

This is where most retail ML projects fail silently.

Top: raw VIX level over 5 years. The mean drifts upward — a model trained on the first 2 years would learn “VIX above 18 is high” but by year 5, VIX is regularly above 20 even in calm markets. Bottom: VIX z-score (126-day) is stationary — mean zero, stable variance. A z-score of +2 means the same thing in year 1 and year 5.

Non-stationary features poison ML models because the relationship between feature and target shifts over time. A model trained in a low-VIX era will have learned that VIX = 20 is “stressed.” Deploy it in a high-VIX era where VIX = 20 is “calm,” and it will persistently overestimate risk.

The rule: never feed a raw level into a model. Always transform to a stationary representation.

Four transformations, from simplest to most robust:

# 1. Z-score (most common)
z = (x - x.rolling(63).mean()) / x.rolling(63).std()

# 2. Percentile rank (non-parametric, handles skew)
pct = x.rolling(252).apply(lambda w: (w.iloc[-1] > w).mean())

# 3. Rate of change (captures dynamics)
roc = x.pct_change(21)

# 4. Binary regime (simplest, most robust)
regime = (x > x.rolling(126).median()).astype(int)

Which to use? Z-scores work for normally distributed features (vol, spreads). Percentile ranks work for everything but lose granularity. Rates of change work for trending features (momentum, yield curve). Binary regimes sacrifice precision for robustness — which matters when the model will see out-of-sample data that looks nothing like the training set.

Problem 3: Individual Features Are Weak

Here’s the uncomfortable truth about financial prediction: most features have an information coefficient (IC) — the rank correlation between the feature today and the return over the next week — of approximately 0.02 to 0.08.

This is a lesson I’ve had to learn over and over again, but I still keep repeating the same mistake.

Univariate IC for each candidate feature. VIX level is the strongest predictor at IC ≈ 0.08 — which means it explains roughly 0.6% of the variance in next-week returns. Most features are below 0.05. Some are below 0.02, which is indistinguishable from noise.

For context: an IC of 0.05 means that if you ranked all days by the feature value and sorted them into quintiles, the top quintile would outperform the bottom quintile by roughly 2-3% annualized. That’s meaningful for a systematic strategy but invisible on any individual trade.

This is why ML helps: individual features are weak, but their combination can be strong. If VIX, term structure, GEX, and spread z-score each independently predict returns at IC ≈ 0.05 and they capture different dimensions of risk, a model that combines them might achieve IC ≈ 0.10-0.12 through the aggregation of weakly correlated weak predictors.

This is the “wisdom of crowds” principle applied to features. No single expert (feature) is very good. But the committee (model) can be substantially better than any individual member, provided the members aren’t all saying the same thing (low inter-feature correlation).

The Transformation Toolkit

One raw feature can produce multiple transformed features. The question is which transformations capture useful information:

Six representations of a single input (VIX). Raw level (non-stationary, avoid). Z-score (stationary, captures deviation from recent norm). Percentile rank (robust, captures relative positioning). Rate of change (captures acceleration/deceleration). Binary regime (simplest, most robust). Interaction term (VIX_z × momentum, captures non-linear dependencies).

Interaction Features

Interaction features are where domain expertise meets statistical power. Two features that are individually weak can be jointly powerful if their interaction captures a meaningful dynamic:

VIX_z × Momentum: High VIX with negative momentum = crash regime. High VIX with positive momentum = recovery bounce. The interaction separates these two regimes that VIX alone cannot distinguish.

GEX × Spread_z: Negative GEX with wide spreads = maximum microstructure stress. Negative GEX with normal spreads = moderate stress. The interaction captures severity better than either feature alone.

Yield_slope × Credit_spread: Steep curve with tight credit = risk-on carry environment. Steep curve with wide credit = economic distress. The interaction disambiguates.

The danger of interactions: every pair you add is a new feature that the model can overfit to. With 14 base features, you have 91 possible interactions. Adding all of them is a recipe for overfitting. Add only the interactions that have clear economic interpretation.

The Selection Pipeline

Putting it all together:

Starting with 20 candidates, the pipeline produces 8-10 final features through five stages. Each stage has a clear purpose and a clear rule for what survives.

The output of this pipeline is the feature matrix X that gets fed into the model in Part 2. I’d say that the pipeline is not optional — skipping any stage (especially stationarity testing and redundancy removal) will produce a model that looks great in-sample and falls apart out-of-sample.

The Half-Life of Features

One more complication: features decay, just like strategies (Post 80).

Information coefficient over time for five features. VIX level maintains predictive power longest (structural, rooted in risk aversion). OFI proxy decays fastest (microstructure signals get crowded). GEX regime sits in between. All features trend toward the noise floor of IC ≈ 0.02 eventually.

This connects directly to the Strategy Decay series. The alpha in a feature comes from an informational edge. As more people learn about and trade on GEX signals (thanks partly to the popularization by SpotGamma and others), the feature’s predictive power decays. VIX decays more slowly because it’s structural — risk aversion doesn’t get arbitraged away.

The implication for ML: your model needs periodic retraining not just because the model degrades, but because the features themselves degrade. A model trained in 2020 using GEX as a strong feature might find that GEX has an IC of 0.01 by 2025 — below the noise floor. The model needs to downweight or drop it.

This is the feature engineering → model training → retraining feedback loop. We’ll build the retraining framework in Part 3.

What the Feature Matrix Looks Like

After the full pipeline, here’s the concrete feature matrix for V6:

features = {
    # Volatility / Regime (3 features)
    'vix_z':        vix_zscore_63d,
    'vix_ts':       vix_1m_div_3m,
    'rv_z':         realized_vol_z_63d,  # keep if corr with vix_z < 0.7
    
    # Microstructure (2 features)
    'gex_regime':   gex_binary,           # +1 / -1
    'spread_z':     spread_zscore_21d,
    
    # Momentum (2 features)
    'mom_ratio':    ma50_div_ma200,
    'mom_roc':      price_roc_21d,
    
    # Carry / Macro (2 features)
    'yield_slope_z': yield_10y2y_zscore,
    'credit_z':     hy_ig_spread_zscore,
    
    # Interactions (2 features)
    'vix_x_mom':    vix_z * mom_roc,
    'gex_x_spread': gex_regime * spread_z,
}

# Target: next 5-day V6 excess return (over SPY)
target = v6_return_5d - spy_return_5d

Eleven features that are clean, stationary, non-redundant, with domain-driven interactions. This is what gets fed into Part 2’s tree models.

Up Next

Part 2: Tree Models for Regime Classification — Random forests, XGBoost, and why tree-based models are the right tool for this problem. We’ll train, validate, and stress-test the models using the feature matrix we just built.

Remember: Alpha is never guaranteed. And the backtest is a liar until proven otherwise.

These posts are about methodology, not recommendations. If you find errors in my math, let me know — I’ve built an entire series around discovering my own mistakes, so one more won’t hurt.

The material presented in Math & Markets is for informational purposes only. It does not constitute investment or financial advice.

This is part 94 of my series — Building & Scaling Algorithmic Trading Strategies

Final part of the Synthetic Replication series. Part 1: Building blocks. Part 2: Replicating strategies. Part 3: Vol surface.

The Question That Started This Series

Four posts ago, I asked: “What payoff shape would improve V6’s risk/return profile?” Now it’s time to answer.

V6’s current profile is approximately linear-with-a-kink: leveraged upside through TQQQ, partial downside protection from the VIX regime filter and TLT hedge. The regime filter adds some convexity — it exits before the worst of most drawdowns — but it’s not a hard floor. A fast crash that outpaces the momentum signal hits V6 at full leverage.

The goal of an options overlay: add a hard floor without killing the upside.

Left: V6’s current return profile (orange) vs. the desired profile (green), plotted against market returns. The gap is in the left tail — V6 is exposed to drawdowns beyond -15% where the regime filter hasn’t yet fired. Right: the return distribution shift. The overlay truncates the 1st percentile from approximately -40% to -20%.

The Three-Leg Overlay

After working through the building blocks (Part 1), strategy replication (Part 2), and vol surface analysis (Part 3), here’s the specific overlay design:

Three panels showing each leg individually and then combined. Leg 1 (green): long 10% OTM put — the tail hedge, costs ~1.2%/quarter. Leg 2 (orange): short 8% OTM call — income to offset the hedge cost, earns ~0.8%/quarter but caps gains beyond +8%. Combined (yellow): a put spread collar with ~20bps net quarterly cost.

Leg 1: The Tail Hedge (Long 10% OTM Put)

This is the core of the overlay. A quarterly 10% OTM put on SPY (or QQQ, depending on V6’s current allocation) provides a hard floor on losses.

Why 10% OTM? Three reasons. First, V6’s regime filter typically catches drawdowns of 5-8% before they get worse. The put doesn’t need to protect against normal volatility — it needs to protect against the gap down that outpaces the momentum signal. Second, 10% OTM puts are on the steep part of the skew curve — expensive, but not as expensive as 5% OTM (which trades at much higher IV). Third, the historical frequency of 10%+ quarterly drawdowns in QQQ is roughly once every 2-3 years, which keeps the premium manageable.

Cost would be approximately 1.0-1.5% of notional per quarter, depending on IV and skew.

Leg 2: The Income (Short 8% OTM Call)

Selling OTM calls generates premium to offset the tail hedge cost. V6 doesn’t need the last 8% of quarterly upside — most of V6’s alpha comes from compounding 1-2% monthly, not from catching +10% rips.

The call strike is set at 8% OTM because historically, TQQQ gains more than 8% in a single quarter about 15% of the time. The short call caps participation in those rare events but generates consistent income the other 85%.

Income: approximately 0.6-1.0% per quarter.

Leg 3: The Short Far-OTM Put (Funding)

Selling a 20% OTM put further reduces the net cost of the overlay. At 20% OTM, the put is deeply out of the money and expires worthless in roughly 98% of quarters. The premium is small ($0.3-0.5% per quarter) but it partially funds the tail hedge.

The trade-off: protection stops below the 20% OTM level. If QQQ drops more than 20% in a quarter, you’re exposed again below that floor. This is an acceptable trade-off because a drawdown that large typically triggers V6’s regime filter well before it reaches 20%.

Net Cost

Tail hedge cost:       -1.2% per quarter
Call premium income:   +0.8% per quarter
Far put premium:       +0.3% per quarter
───────────────────────────────────────
Net cost:              -0.1% per quarter (~0.4% annualized)

At 40 bps annualized, the overlay is nearly self-funding. The short call and short far put together pay for most of the tail hedge. This is the power of the put spread collar structure — you’re not just buying insurance, you’re reshaping your return distribution by giving up extreme upside to fund extreme downside protection.

Conditional Engagement: Not Always On

The overlay shouldn’t run on autopilot. Its value depends on market conditions:

The key rule: buy protection when it’s cheap, not when it’s needed.

When VIX is below 18 and skew is below the historical median, 10% OTM puts cost roughly 1.0% per quarter. When VIX is above 30 and skew is elevated, the same puts cost 3-4%. By the time you “need” the protection, it’s too expensive to be worth it — and V6’s regime filter is already scaling down anyway.

This is the paradox of tail hedging: the optimal time to hedge is when nothing is happening, because that’s when hedges are cheap. The worst time to hedge is during the crisis, because that’s when hedges are expensive. Discipline means buying the put in January when VIX is 13, not in March when VIX is 35.

Backtest Results

Top: 5-year simulated equity curves. V6 base (gray) and V6 with overlay (green). The overlay gives up some raw return but compresses drawdowns significantly. Bottom: drawdown comparison — every stress period (red shading) shows reduced depth with the overlay.

The improvement is consistent with what we’d expect from a well-designed tail hedge: modest return reduction, meaningful drawdown compression, and a Sharpe ratio that improves because the volatility reduction exceeds the return drag.

Is It Worth It?

This is the question that determines whether the overlay goes from theory to implementation. The answer depends on what you value.

Left: break-even analysis. At 1% annual hedge cost, you need roughly 2 crashes per decade of 20%+ to justify the protection — consistent with historical frequency. Right: optimal hedge budget peaks at 1.0-1.5% annualized, where the Sharpe improvement from volatility reduction exceeds the return drag.

The Case For

The overlay converts a -45% max drawdown into a -30% max drawdown. The math on this is unambiguous: a -45% drawdown requires +82% to recover (3+ years at V6’s CAGR). A -30% drawdown requires +43% to recover (under 2 years). The overlay saves roughly 1-1.5 years of recovery time per major crash.

Over a 20-year compounding horizon, that recovery time difference compounds into a meaningful terminal wealth advantage — even though the overlay costs 40 bps per year.

The Case Against

V6 already has three layers of drawdown protection: the VIX regime filter, the momentum threshold, and the CUSUM monitoring system. Adding a fourth layer (options) introduces:

Operational complexity. Options require rolling, strike selection, and expiry management. This is a weekly task, not daily.

Execution risk. Options bid-ask spreads on TQQQ are wide. The theoretical 40 bps annual cost could easily become 80-100 bps after execution costs.

Marginal improvement. The first three protection layers (regime, momentum, CUSUM) capture most of the available Sharpe improvement. The options overlay adds the fourth layer at 4× the implementation complexity for the smallest marginal gain.

The Honest Assessment

Each V6 enhancement layer plotted by Sharpe improvement and implementation complexity. Execution timing (Part 84) gives the highest ROI: +0.08 Sharpe for minimal effort. The options overlay gives +0.07 Sharpe for 4× the complexity of any other layer. The curve of diminishing returns is steep.

Here’s what I’m actually going to do:

Implement the tail hedge only. No short call, no short far put. Just a quarterly 10% OTM put when VIX is below 18 and skew is below the 63-day median. Cost: ~1.0% per quarter, ~4% annualized (not self-funded without the other legs). Run this in paper mode for 6 months.

Defer the full collar. The short call and short put legs add complexity and execution risk that I don’t think is justified yet. They save 60-80 bps of annual hedge cost, but they also introduce path-dependent risks (getting called away on a TQQQ rally, getting assigned on a far put during a crash). I need more experience with the mechanics before adding these legs.

Monitor skew as a signal. Whether or not the overlay is running, skew z-score (from Part 92) is a useful re-entry signal after selloffs. I’m adding it to the dashboard alongside the VIX regime, CUSUM, and microstructure composite.

The 14-Post Series Arc: What We Built

Stepping back from this post, here’s the full arc of Posts 80-93:

Strategy Decay (80-82): Half-lives of alpha, CUSUM detection, adaptive strategies. Core insight: all strategies decay, the question is how fast and whether you can detect it.

Microstructure Edge (83-86): Order flow toxicity, auction mechanics, dealer gamma, signal layer. Core insight: the plumbing of markets affects strategy performance, and GEX is the highest-impact single signal.

Carry Trade (87-89): Unified carry framework, crash timing, multi-asset carry. Core insight: V6 is already a carry trader — understanding this changes risk attribution.

Synthetic Replication (90-93): Put-call parity, strategy replication, vol surface, options overlay. Core insight: options add convexity but with diminishing returns relative to complexity.

Across 14 posts, V6’s architecture has gone from a simple TQQQ/TLT allocator with a VIX regime filter to a layered system with momentum, regime detection (CUSUM), microstructure conditioning (spread + GEX), carry optimization, and now a potential options overlay.

Each layer improved the Sharpe ratio. But each layer also added complexity. The execution timing fix (Part 84) gave +0.08 Sharpe for essentially zero effort. The options overlay gives +0.07 Sharpe for significant ongoing operational work. The law of diminishing returns is real, and knowing when to stop adding layers is as important as knowing which layers to add.

Sometimes the smartest thing you can build is nothing (which is really, really hard for someone like me who keeps poking at things to see if it does anything at all..)

This concludes the Synthetic Replication series (Posts 90-93) and the full 14-post arc spanning strategy decay, microstructure, carry, and synthetic replication.

My next series will be on Machine Learning for Trading.

Remember: Alpha is never guaranteed. And the backtest is a liar until proven otherwise.

These posts are about methodology, not recommendations. If you find errors in my math, let me know — I’ve built an entire series around discovering my own mistakes, so one more won’t hurt.

The material presented in Math & Markets is for informational purposes only. It does not constitute investment or financial advice.

This is part 93 of my series — Building & Scaling Algorithmic Trading Strategies

Part 3 of the Synthetic Replication series. Part 1: Building blocks. Part 2: Replicating hedge fund strategies.

The Lie at the Heart of Options Pricing

Black-Scholes assumes one number — σ — describes the volatility of the underlying. Every option on the same stock, at every strike and every expiry, should use the same σ.

This has been empirically false since approximately October 19, 1987.

Before the ‘87 crash, the vol “smile” was roughly flat. After it, puts became permanently expensive relative to calls. The market learned that crashes happen, and it never forgot. That fear — that specific, priced-in fear of a left-tail event — is visible in every options chain you pull up today.

Left: Black-Scholes assumes flat vol (dashed gray). Reality is the smirk (orange) — OTM puts trade at significantly higher implied vol than ATM or OTM calls. That 8-10 vol point premium on the 20% OTM put is the market’s price for crash insurance. Right: different asset classes have different smile shapes. Equities smirk left (crash fear dominates). FX smiles symmetrically (both tails feared). Commodities skew right (spike fear dominates — no one worries about oil going to zero, they worry about it going to $200).

The shape of the smile tells you what the market is afraid of. And when the shape changes, it tells you the fear is shifting.

The Surface: Three Dimensions of Fear

The volatility smile is a 2D slice. The full picture is a surface — implied vol varies across both strike (moneyness) and time to expiry.

The vol surface for a typical equity index. The left-back corner (OTM puts, short-dated) is the most expensive — near-term crash protection commands the highest premium. The right-front corner (OTM calls, short-dated) is the cheapest. The surface flattens as you move to longer expirations — skew “decays” with time.

Two key features of the surface:

1. Skew is steeper for shorter expirations. A 7-day 90% moneyness put might trade at 35% IV while the same strike at 365 days trades at 24%. The short-dated put is more expensive per unit of time because short-dated crash fear is more acute — if a crash happens this week, you need protection now.

2. The surface is not static. After a selloff, the entire surface shifts up and steepens. After a long calm period, it shifts down and flattens. The surface is a living map of the market’s collective anxiety.

Term Structure: Near vs. Far

The second dimension of the surface — how IV varies with expiration at a fixed strike — is the term structure.

Left: three term structure shapes. Normal (contango, green): longer-dated options have higher IV because more uncertainty over longer horizons. Inverted (backwardation, red): near-term IV is elevated — a stress event is pricing into the front month. Flat (gray): no informational content. Right: the VIX term structure ratio (1-month VIX / 3-month VIX) over time. Above 1.0 = inverted = stress. Below 1.0 = contango = calm.

The term structure is a regime indicator, just like the VIX level itself. But it contains information that VIX alone misses:

VIX can be at 20 in both contango and backwardation. In contango (1M VIX = 20, 3M VIX = 22), the market expects the current level to persist — orderly uncertainty. In backwardation (1M VIX = 20, 3M VIX = 18), the market expects near-term stress to resolve — someone is paying up for immediate protection.

This links directly to the carry trade framework from Part 88: contango is “harvest” mode (sell near-term vol, it decays toward the lower long-term level). Backwardation is “retreat” mode (near-term vol is elevated for a reason).

Trading the Surface: Four Dimensions

Every vol surface trade targets one of four dimensions:

Let me unpack the two most tradeable dimensions.

Skew Trades: Selling Expensive Fear

Equity skew — the premium of OTM puts over OTM calls — is the most persistent and most tradeable feature of the vol surface.

The core trade: sell expensive put vol, buy cheap call vol. This is a risk reversal (Part 2), but now motivated by vol surface analysis rather than directional conviction.

Left: the put ratio spread — sell one expensive near-ATM put, buy two cheaper far-OTM puts. You collect a net premium while maintaining downside protection below 85. Right: a risk reversal in two different skew regimes. When skew is steep (post-selloff), the short put is so expensive that you get PAID net premium for a bullish bet. When skew is flat, the same structure costs zero.

Why Steep Skew Is an Opportunity

After a selloff, skew overshoots. Put IV spikes to 30-35% while ATM vol is at 22% and call IV is at 18%. The 12-17 vol point skew is the market pricing in a continuation of the decline that is, on average, too pessimistic.

Research by Bollen and Whaley (2004) and Xing, Zhang, and Zhao (2010) documents that extreme skew predicts mean-reversion — steep skew is followed by declining skew as the panic premium dissipates. The half-life of a skew overshoot is approximately 2-4 weeks.

The Skew Mean-Reversion Signal

Top: 25-delta skew (put IV minus call IV) over time. It spikes during selloffs and mean-reverts within 2-4 weeks. Bottom: z-score of skew with trading thresholds. When skew z-score exceeds 2.0 (red markers), selling skew via risk reversals or put ratio spreads has historically been profitable as skew normalizes.

The trade: when skew z-score exceeds 2.0, sell the 25-delta put and buy the 25-delta call (risk reversal). Hold for 2-4 weeks or until the z-score returns below 0.5. The risk: skew is elevated for a reason — if the crash continues, you’re short puts into a falling market.

Calendar Trades: Trading Time

Calendar spreads trade the term structure — they’re bets on whether near-term vol will converge toward long-term vol, or vice versa.

Left: the calendar spread payoff at front-month expiry. Maximum profit occurs near the strike price, where the back-month call retains maximum time value while the front-month call expires worthless. Right: regime-dependent calendar direction — sell expensive front-month vol when term structure is inverted, sell expensive back-month vol when term structure is steep.

The key insight: calendar spreads are not directional bets. They’re bets on the relative speed of time decay between two expirations. In a normal term structure, the front month decays faster (higher theta per day) — a standard calendar profits from this differential.

Calendar Trades for V6

V6 doesn’t currently trade calendars, but the term structure informs two decisions:

1. Expiry selection for the overlay (Part 4). When term structure is steep (contango), longer-dated options are expensive relative to near-term — buy shorter-dated protection. When inverted, shorter-dated options are overpriced — buy longer-dated protection.

2. Carry regime timing. VIX term structure inversion is one of the best carry crash indicators (Part 88). The calendar spread framework explains why — inversion means the market is paying more for near-term protection than long-term, which signals acute stress.

What the Surface Tells My V6

Here’s the practical extraction for a daily equity allocator:

Level (ATM IV / VIX): V6 already uses this via the VIX regime filter. High ATM vol = reduce allocation. This is the most important dimension and my V6 already captures it!

Skew (25-delta put-call IV spread): Extreme skew overshoots predict mean-reversion. For V6, this informs when to add back exposure after a selloff — if skew is extremely elevated but the selloff has paused, the market is pricing in too much further downside. This is a potential re-entry signal.

Term structure (VIX 1M/3M ratio): Inversion signals acute stress. V6 should treat term structure inversion as an independent warning alongside VIX level — you can have VIX at 22 with a normal term structure (fine) or VIX at 22 with an inverted structure (danger).

Convexity (wing pricing): Less relevant for V6’s daily allocation as it stands today (but that might change…) More relevant for the options overlay in Part 4, where we’ll use wing pricing to determine whether tail hedges are cheap or expensive.

The Honest Limitations

Vol surface trading is deep water. A few caveats:

1. Skew is expensive to trade. The bid-ask on OTM options is wide — 5-15% of the option’s value. A lot of the theoretical edge in skew trading gets eaten by spreads — unless you are doing this at scale and strategically, this is a significant consideration, especially for retail traders.

2. The surface moves. By the time you compute your z-scores and place the trade, the surface has shifted. Institutional vol desks have real-time feeds and sub-second execution. Retail has end-of-day data and limit orders.

3. Gamma risk. Short-dated skew trades have enormous gamma. A 1% move in the underlying can change the P&L of a weekly put spread by 50% of its maximum value. Position sizing must account for this.

4. Model risk. Everything above assumes Black-Scholes implied vols are the right metric. They’re not — they’re a convention. More sophisticated models (stochastic vol, local vol, rough vol) fit the surface better but require infrastructure that’s beyond most retail setups. It’s doable but you’ll need to invest significant time, energy, infrastructure and need a better command of the model.

For V6, the surface is primarily an input — a richer version of the VIX signal — rather than a tradeable opportunity in its own right. In Part 4, we’ll use surface information to design the options overlay, but we won’t try to trade the surface directly.

Up Next

Part 4: The V6 Options Overlay — Everything from Parts 90-92 converges into a specific overlay design. Tail hedge sizing using wing pricing, covered call income conditioned on skew, and the final assessment: is the added complexity worth the improved Sharpe?

Remember: Alpha is never guaranteed. And the backtest is a liar until proven otherwise.

These posts are about methodology, not recommendations. If you find errors in my math, let me know — I’ve built an entire series around discovering my own mistakes, so one more won’t hurt.

The material presented in Math & Markets is for informational purposes only. It does not constitute investment or financial advice.

This is part 92 of my series — Building & Scaling Algorithmic Trading Strategies

Part 2 of the Synthetic Replication series. Part 1: Put-call parity and the building blocks.

Hedge Funds Are Just Payoff Shapes

Strip away the marketing and the 2-and-20 fee structure, and every hedge fund strategy is a payoff shape. Trend following produces convex returns — small losses, occasional large gains. Covered call funds produce concave returns — steady income, occasional large losses. Tail risk funds produce extreme convexity — constant small premium drain, massive gain in crashes.

You can replicate any of these shapes with the four building blocks from Part 1. This doesn’t mean you can replicate the skill of a good hedge fund manager — timing, security selection, and risk management still matter. But you can replicate the structure, and the structure explains most of the return characteristics.

Strategy 1: Risk Reversal as Synthetic Momentum

A risk reversal — long an OTM call, short an OTM put at the same expiry — creates a zero-cost (or near-zero-cost) directional bet with unlimited upside and significant downside.

Left: the risk reversal payoff. Long the 105 call, short the 95 put, for approximately zero net premium. If the stock rallies past 105, you participate fully. If it drops below 95, you’re obligated to buy at 95 — taking losses as if you owned the stock. The “dead zone” between 95 and 105 is where nothing happens. Right: when a momentum signal fires (50-day MA crosses above 200-day), you enter the risk reversal instead of buying stock.

Why This Replicates Momentum

A momentum strategy says: “I think the stock will continue its recent trend.” A risk reversal says exactly the same thing with different capital characteristics:

Stock purchase: $10,000 capital for 100 deltas. Linear exposure. Full downside.

Risk reversal: ~$0 net premium for ~50 deltas initially (grows toward 100 if the stock rallies). Defined dead zone. Full downside below the put strike.

The risk reversal gives you leverage without margin. You get directional exposure at a fraction of the capital, and the OTM call gives you positive convexity — your gains accelerate as the stock moves in your favor because the call’s delta increases.

The trade-off: the dead zone. If the stock moves modestly (stays between 95 and 105), the risk reversal returns approximately nothing. The stock purchase returns whatever the stock does. For momentum signals that predict large moves, the dead zone is a feature — you avoid paying up for small, uncertain moves. For signals that predict small, consistent moves, the dead zone kills you.

When to Use It

Risk reversals work best when:

• Your momentum signal has high conviction but low frequency (a few signals per year)

• You want exposure without committing full capital

• You’re willing to accept the short put obligation as “buying the dip” if wrong

Strategy 2: Covered Call as Systematic Vol Selling

The covered call — own the stock, sell an OTM call — is the most popular retail options strategy. It’s also a misunderstood one. Most people think they’re “generating income from their stock.” What they’re actually doing is selling volatility.

Left: the covered call payoff. You participate in gains up to the 105 strike, then give up additional upside. The premium ($3) provides a small buffer against losses. Right: systematic covered call writing vs. buy-and-hold over 5 years. The covered call has higher Sharpe and lower vol, but lower total return — you’ve traded upside for income.

The Vol Selling Connection

When you sell a call against your stock, you’re implicitly saying: “I believe realized vol will be less than implied vol over this period.” If the stock doesn’t move much (low realized vol), you keep the premium. If it moves a lot (high realized vol), the sold call costs you in either direction — you miss the upside, or the premium doesn’t cover the downside.

This is the same trade as the volatility risk premium we discussed in Part 87 (Carry series). The covered call is carry. The premium you collect each month is the “income” component, and the capped upside is the price of that income.

When to Use It

Covered calls work best when:

• You’re holding the stock anyway and want income

• Implied vol is elevated relative to your expected realized vol

• You have a target sell price (the strike is your “limit order with a bonus”)

Covered calls work worst when:

• The stock is in a strong trend (you cap your participation)

• IV is low (the premium isn’t worth the opportunity cost)

Strategy 3: Collar as Tail Hedge

The collar — own the stock, buy an OTM put, sell an OTM call — truncates both tails of your return distribution. It’s the simplest implementation of tail hedging.

Left: the 90/110 collar payoff. You participate between 90 and 110, with losses floored at -$14 and gains capped at +$14. If the put and call premiums offset, it’s zero cost. Right: the return distribution shifts — both the left tail (crashes) and right tail (rallies) are truncated.

The Put Spread Collar: A More Practical Version

The plain collar is expensive because the OTM put costs more than the OTM call provides (skew — puts are more expensive than calls at equal distance from ATM). A more capital-efficient version uses a put spread instead of a standalone put:

The put spread collar: long the 95 put, short the 80 put, short the 110 call. Cheaper than the plain collar because selling the 80 put funds part of the 95 put. The trade-off: protection stops at $80. Below that, you’re exposed again. This is the “defined-range protection” approach — cheaper, but with a gap risk if the crash exceeds your protective range.

When to Use It

Collars work best when:

• You have a concentrated stock position you can’t or don’t want to sell (tax, vesting)

• You want to define your risk range for a specific period (earnings, macro event)

• You’re willing to trade upside for peace of mind

Strategy 4: Iron Condor as Defined-Risk Vol Selling

The iron condor — sell an OTM put, buy a further OTM put, sell an OTM call, buy a further OTM call — is the defined-risk version of vol selling. It profits when the stock stays within a range.

Left: the iron condor payoff vs. the short straddle. Same bet (stock stays flat) but the iron condor has a defined maximum loss of $1 vs. the straddle’s unlimited risk. Right: monthly iron condor return distribution. High win rate (~75%), small average win, larger average loss. Classic carry profile.

The iron condor is the retail-accessible version of what systematic vol selling funds do. It captures the volatility risk premium with defined risk — you know your maximum loss before entering the trade.

The return distribution tells the full story: many months of small wins, punctuated by fewer but larger losses. This is the carry profile from Part 87, expressed through options instead of interest rates or credit spreads.

The Rosetta Stone: Strategy → Options

Every hedge fund archetype maps to an options construction. The mapping isn’t perfect — a Renaissance Technologies quant is doing more than selling iron condors — but the payoff structure is replicable.

The deeper insight: by choosing your options construction, you’re choosing where you sit on the convexity spectrum.

Convexity: The Only Free Lunch Left

The most important concept in this post — arguably in the entire series — is convexity: the curvature of your payoff relative to the market.

Three strategies plotted against market returns. Gray: linear (buy & hold) — you get whatever the market gives you. Orange: concave (covered call) — you do better than the market in small moves but worse in large moves, especially on the upside. Green: convex (risk reversal / trend following) — you do worse in small moves but better in large moves, especially preserving capital in crashes.

The key:

Concave strategies (covered calls, short straddles, credit spreads) earn steady income in normal markets but get destroyed in tail events. They’re selling insurance.

Convex strategies (long options, trend following, risk reversals) bleed slowly in normal markets but profit from large moves. They’re buying insurance.

Neither is inherently better. The question is which one fits your strategy’s risk profile.

For V6 specifically: V6 has embedded convexity from its momentum signals — it exits before large drawdowns complete. But it also has embedded concavity from the VRP carry component. Understanding this mix is what Part 4 will address when we design the options overlay.

The Concavity Trap

A warning: most retail options strategies are concave. Covered calls, credit spreads, iron condors, cash-secured puts — they all have the same profile: steady income, occasional large loss. They feel great 80% of the time and terrible the other 20%.

The danger isn’t the strategy itself — it’s the psychology. When you’ve collected 10 months of premium, the 11th month’s -15% drawdown feels like a “freak event” rather than the expected cost of doing business. The premium you collected over 10 months was compensation for this event. If you didn’t earn enough premium to cover it, you were underpaid for the risk.

Before implementing any concave strategy, calculate your expected loss-to-premium ratio:

Expected loss frequency × Average loss size ÷ 
Annual premium collected

If this ratio > 0.8, the strategy isn't earning enough
premium to justify the risk.

Up Next

Part 3: Vol Surface Arbitrage — When the implied vol at different strikes and expirations is “wrong,” how do you express a view on skew, term structure, or convexity? The math of the volatility surface and where the opportunities live.

Remember: Alpha is never guaranteed. And the backtest is a liar until proven otherwise.

These posts are about methodology, not recommendations. If you find errors in my math, let me know — I’ve built an entire series around discovering my own mistakes, so one more won’t hurt.

The material presented in Math & Markets is for informational purposes only. It does not constitute investment or financial advice.

This is part 91 of my series — Building & Scaling Algorithmic Trading Strategies

This begins a 4-part series on synthetic replication. Part 1: the building blocks. Part 2: replicating hedge fund strategies. Part 3: vol surface arbitrage. Part 4: an options overlay for V6.

Options Are Just Payoff Shapes

Most people learn options as a catalog of strategies: covered calls, protective puts, iron condors, butterflies. Each has a name, a diagram, and a use case. This is like learning architecture by memorizing floor plans.

The better way: understand the four building blocks, learn the one equation that connects them, and then design whatever payoff shape you need.

The Four Bricks

Every option position in existence is a combination of four elemental payoffs:

Top left: Long Call — unlimited upside, capped downside. Top right: Long Put — profits from decline, capped loss. Bottom left: Short Call — income if flat/down, unlimited risk if up. Bottom right: Short Put — income if flat/up, large risk if down. Every strategy you’ve ever seen is a linear combination of these four payoffs plus long or short stock.

The key insight: these four shapes are linearly independent. Any payoff diagram you can draw — literally any combination of slopes, kinks, and flat sections — can be constructed by adding these together with appropriate strikes and sizes.

This is why options are sometimes called “financial LEGO.” Four brick types, infinite possible structures.

The One Equation: Put-Call Parity

In 1969, Hans Stoll published the relationship that connects everything:

C - P = S - K·e^(-rT)

Call price minus put price equals stock price minus the present value of the strike. Same strike, same expiry. Always. In every market, for every stock, at every moment.

Left: visual proof. The green dashed line (long call payoff) plus the red dashed line (short put payoff) equals the yellow solid line — which is exactly the payoff of owning the stock. Right: rearrange the equation to build five synthetic positions from the same identity.

Why This Matters

Put-call parity isn’t just an academic identity. It’s a construction manual. Rearranging one equation gives you five synthetic positions:

Synthetic Long Stock = Long Call + Short Put + Cash

You don’t need to buy stock. Buy the call, sell the put at the same strike, set aside the present value of the strike in cash. At expiry, you’ll have exactly the same P&L as owning the stock. Why would you do this? Capital efficiency — the options might require less capital than buying the stock outright.

Synthetic Long Call = Long Stock + Long Put

If you own the stock and buy a put, you’ve created a call option. This is the “protective put” — but reframed as building a call from its components. Conceptually, a protective put isn’t “buying insurance on your stock” — it’s “building a synthetic call option.”

Synthetic Bond = Long Stock + Long Put + Short Call

The “conversion” — you hold the stock, buy a put, and sell a call at the same strike. Your payoff is completely flat: the stock gains are capped by the short call, and losses are floored by the long put. The result is a risk-free position that earns the risk-free rate. You’ve synthesized a Treasury bond from options and stock.

The Six Essential Synthetics

Six positions built from the four building blocks. Each panel shows the component payoffs (dashed) and the resulting combined payoff (solid). Top row: synthetic long stock, synthetic short stock, synthetic call. Bottom row: synthetic put, long straddle, collar. The dashed lines always add up to the solid line — that’s the construction at work.

The straddle and collar are particularly important for what comes in Parts 2-4:

The straddle (long call + long put, same strike) creates a V-shaped payoff that profits from movement in either direction. You’re buying volatility. You don’t care which way the stock moves — you just need it to move more than the combined premium you paid.

The collar (stock + long OTM put + short OTM call) clips both tails of the stock’s return distribution. You give up upside beyond the call strike and gain protection below the put strike. If the premiums offset, it’s “free” — you’ve reshaped your risk without paying cash.

Why Capital Efficiency Matters

The practical motivation for synthetic positions: you can get the same directional exposure with dramatically different capital requirements.

Five ways to get bullish exposure to a $100 stock. Buying 100 shares costs $10,000 for 100 deltas of exposure (1.0 delta per $100). A synthetic long costs $1,500. A long call costs $500 for 55 deltas. A bull call spread costs $300 for 45 deltas. The capital efficiency ranges from 1.0 to 15.0 deltas per $1,000 deployed.

This efficiency has a cost: defined expiry. Stock doesn’t expire; options do. But for a strategy like V6 that rebalances regularly, the expiry constraint is manageable — you’d roll the position quarterly.

When Parity Breaks: Arbitrage Signals

Put-call parity should hold exactly. When it doesn’t, someone is making a mistake — and someone else can profit.

Left: the conversion — stock + put - call produces a flat payoff (risk-free). If the flat payoff exceeds the risk-free rate, you’ve found free money. Right: what parity violations tell you about mispricing.

In practice, transaction costs eat most of the arbitrage. But the direction of the violation tells you something useful:

If calls are expensive relative to parity → implied vol on calls is elevated → the market is pricing more upside risk than the put side.

If puts are expensive relative to parity → implied vol on puts is elevated → the market is pricing more downside risk (skew is steep).

This links directly to the vol surface discussion in Part 3.

The Replication Menu

Here’s where this series is going. Every strategy in the next three posts uses the same four building blocks:

The replication principle: any payoff you want can be constructed from options. The question isn’t “which named strategy should I use?” — it’s “what payoff shape do I want, and how do I build it?”

Payoff Engineering: Design, Then Build

This is the mindset shift. Instead of asking “should I buy a covered call?” ask “what do I want my P&L to look like?”

Three investor goals, three custom payoffs. Left: “I want upside with capped downside” → long call (max loss = premium). Center: “I want income if the stock stays flat” → short straddle (profit in the center, loss in the tails). Right: “I want crash protection at zero cost” → risk reversal (sell upside call to fund downside put).

Each of these payoffs is a direct expression of a view:

The long call says: “I’m bullish and want defined risk.” The short straddle says: “I think realized vol will be lower than implied vol.” The risk reversal says: “I’d rather have crash protection than participate in a rally.”

The same framework applies to V6. In Part 4, we’ll ask: “What payoff shape would improve V6’s risk/return profile?” — and then build it from the bricks.

What’s Next

If you’re comfortable with payoff diagrams and put-call parity, you have everything you need for the next three posts:

Part 2 will use these bricks to replicate hedge fund strategies — risk reversals as synthetic momentum, covered calls as systematic vol selling, collars as tail hedging.

Part 3 goes deeper into the vol surface — when the implied vol at different strikes and expirations is “wrong,” how to express a view on skew, term structure, or convexity.

Part 4 brings it home to V6 — designing a specific options overlay that improves V6’s Sharpe by adding convexity in the tails.

Remember: Alpha is never guaranteed. And the backtest is a liar until proven otherwise.

These posts are about methodology, not recommendations. If you find errors in my math, let me know — I’ve built an entire series around discovering my own mistakes, so one more won’t hurt.

The material presented in Math & Markets is for informational purposes only. It does not constitute investment or financial advice.

This is part 90 of my series — Building & Scaling Algorithmic Trading Strategies

Final part of the Carry Trade series. Part 1: What carry is. Part 2: When carry blows up.

The Diversification Illusion

The institutional pitch for multi-asset carry is elegant: combine carry streams from FX, bonds, vol, equities, and commodities. Since each has different risk drivers, the portfolio should be well-diversified, smoothing out drawdowns.

In normal markets, this works. But in crises — like right now! — it doesn’t.

Lower triangle: normal-period correlations across carry strategies. They’re low (0.05-0.35) — genuine diversification. Upper triangle: crisis-period correlations. They spike to 0.40-0.75 — the diversification vanishes precisely when you need it most.

This is Longin and Solnik’s (2001) “correlation breakdown” problem applied to carry. During the 2008 GFC, every carry trade blew up simultaneously: FX carry (yen unwind), credit carry (spread explosion), vol carry (VIX spike), commodity carry (oil collapse). The supposedly diversified multi-asset carry portfolio lost 25-40% in three months.

Why? Because all carry trades share the same underlying risk factor: liquidity preference. When investors flee to cash, every asset that was paying you to hold risk reprices at once. The individual carry streams have different betas to this common factor in normal times but converge to beta ≈ 1 in stress.

Multi-Asset Carry: Better Than Single-Asset, Worse Than You’d Hope

Despite the correlation breakdown, multi-asset carry still beats concentrated carry:

Individual carry streams (thin lines) and the equal-weight portfolio (yellow). The portfolio smooths out idiosyncratic volatility in normal periods, but all streams crash together during stress events. Still, the portfolio never falls as far as the worst individual stream — FX carry or vol premium would have much worse standalone drawdowns.

The math works out to roughly a 30-40% drawdown reduction from diversification — meaningful but not transformative. You’re turning a -40% max drawdown into a -25% max drawdown. Better, but not the -10% you’d get from genuinely uncorrelated assets.

The Carry-Momentum Hedge

Here’s the most important insight in this series: carry and momentum are natural hedging partners.

Carry earns money when nothing changes (steady collection of premium). Momentum earns money when things change (riding trends). Carry crashes happen when regimes shift violently — which is exactly when momentum signals fire and momentum strategies profit.

Asness, Moskowitz, and Pedersen (2013) documented this formally: carry and momentum have near-zero correlation in normal times and negative correlation during crises. When carry crashes, momentum profits from the same trend that’s destroying the carry trade.

Orange: carry-only strategy. Blue: momentum-only strategy. Green: 60/40 blend. The correlation between carry and momentum returns is approximately zero. More importantly, during the crash periods, momentum tends to offset carry losses — the combined strategy has smaller drawdowns than either standalone.

This is V6’s secret weapon, whether or not it was designed this way. V6’s momentum signals (the 0.1% threshold, the regime switching) provide exactly the crisis-period hedge that a carry position needs. When the market regime shifts and carry starts bleeding, the momentum signal says “get out” — and the exit itself generates momentum profit.

Normal market:
  V6 carry:     accruing daily (+)
  V6 momentum:  mostly flat, small contributions
  Combined:     steady accumulation

Crisis:
  V6 carry:     losing money as spreads widen (-)
  V6 momentum:  fires regime switch signal (+)
  Combined:     momentum offsets carry loss, net damage limited

This carry-momentum interaction explains why V6 has performed better than a naive leveraged equity strategy. It’s not just the momentum alpha — it’s the momentum’s role as a carry crash hedge.

What V6 Should Actually Implement

So if we are concrete about what carry enhancements that are worth pursuing:

Tier 1: Implement Now (Low Complexity, Low Risk)

Optimize TLT entry timing. When the yield curve is steep (10Y - 2Y > 100bps), TLT carry is elevated. Weight toward TLT more aggressively in these periods. When the curve is flat or inverted, the roll-down carry is zero or negative — reduce TLT and hold more cash. This requires only FRED yield curve data (free) and a simple conditional rule.

Expected improvement: 30-50 bps annualized.

Consider TIPS allocation. TIPS (Treasury Inflation-Protected Securities) offer real yield carry plus an inflation hedge. When real yields are positive (as they have been since 2022), TIPS carry is attractive. This adds a genuinely different carry stream — real rates rather than nominal rates — with low correlation to TLT.

Expected improvement: 50-100 bps annualized with better inflation hedging.

Tier 2: Evaluate Next Quarter (Medium Complexity)

Explicit VRP harvesting. V6 currently captures VRP implicitly through the VIX regime filter. An explicit overlay — selling 30-delta puts on SPX, sized at 5% of portfolio — would formalize the VRP harvest. But this requires options-level execution, margin management, and the tail risk discussed in Part 2.

Not ready for V6 today. Would require a separate paper-trading phase of at least 6 months.

Tier 3: Research Only (High Complexity)

FX carry via currency ETFs and covered call overlays are theoretically appealing but add significant complexity. FX carry requires managing currency risk exposure that V6 currently avoids entirely. Covered calls cap the upside on TQQQ — problematic for a strategy designed to capture leveraged equity returns.

These belong in a different strategy, not bolted onto V6.

The Complete Carry Decomposition for V6

Bringing together all three posts in this series, here’s V6’s full carry picture:

Carry Source          Current    After Tier 1   Mechanism
──────────────────────────────────────────────────────────
TQQQ dividend         0.3%       0.3%          Equity carry
TLT coupon + roll     2.8%       3.1%          Bond carry (optimized)
TIPS real yield        —         0.8%          Real rate carry (new)
VRP (implicit)        1.5%       1.5%          Vol risk premium
Funding cost         -1.2%      -1.4%          Borrowing cost
──────────────────────────────────────────────────────────
Total carry           3.4%       4.3%          +0.9% improvement

An additional 90 bps of carry accruing daily, before any changes to the momentum signals or microstructure layer. Across a 10-year horizon at compound rates, 90 bps per year compounds to roughly 9% more total return — not nothing.

The Series Summary: Three Truths About Carry

1. You’re already a carry trader. Every buy-and-hold investor earns carry (dividends, coupons). V6 earns ~3.4% annualized from carry before any alpha. Understanding this decomposition changes how you diagnose performance.

2. Carry timing is more important than carry level. A 5% carry that you hold through a -40% crash costs you 35%. A 3% carry that you scale down before the crash nets you 3%. The regime framework from Part 2 captures this — and V6’s existing VIX filter already does it.

3. Carry and momentum are complements, not substitutes. The carry-momentum interaction is V6’s structural edge. Carry provides the floor. Momentum provides crash protection. Together, they compound better than either alone.

This concludes the Carry Trade series (Parts 87-89) and the second major content arc after Microstructure Edge. Across these 10 posts (Parts 80-89), I’ve covered strategy decay, detection and adaptation, order flow and market microstructure, dealer gamma exposure, and carry across asset classes — all connected back to V6’s architecture.

Next up: the Synthetic Replication series (4 parts) on building anything from options.

Remember: Alpha is never guaranteed. And the backtest is a liar until proven otherwise.

These posts are about methodology, not recommendations. If you find errors in my math, let me know — I’ve built an entire series around discovering my own mistakes, so one more won’t hurt.

The material presented in Math & Markets is for informational purposes only. It does not constitute investment or financial advice.

This is part 89 of my series — Building & Scaling Algorithmic Trading Strategies

Part 1: What carry actually is. This is part 2 of the Carry Trade series. Part 3: building a multi-asset carry portfolio.

Three Ways to Die

Every carry trade dies the same way — price changes overwhelm the income — but the death comes in three distinct flavors:

Left: the FX carry unwind (2008-style). A year of steady carry income erased in 30 days as the yen strengthened 25% against carry currencies. Center: Volmageddon (Feb 5, 2018). XIV lost 96% of its value in a single session when the VIX doubled. Right: the 2022 bond carry reversal. Not a crash but 18 months of grinding losses as the Fed hiked 500bps — the carry wasn’t wrong, the regime changed.

These three patterns — fast crash, flash crash, and slow bleed — require different detection methods and different responses.

The fast crash (FX carry, equity carry): A risk-off event triggers unwinding of crowded carry positions. Leveraged carry traders hit margin calls and are forced to sell, creating a feedback loop. The signature: cross-asset correlations spike to near 1.0 as everything carry-related sells off simultaneously.

The flash crash (vol selling): A structural break in the instrument itself. XIV, the short-VIX product, wasn’t just hurt by the VIX spike — its own termination triggered forced covering that amplified the spike. The signature: non-linear, gap-driven, over in hours.

The slow bleed (bond carry, commodity carry): The macro regime shifts. Rate hikes make bond carry negative. Contango in oil makes commodity carry negative. The carry is still accruing, but it’s overwhelmed by adverse price changes month after month. The signature: no single event, just persistent negative returns. Hardest to time because there’s no catalyst to react to.

Early Warning Signals

Can you see carry crashes coming? Well, partially. Research by Brunnermeier, Nagel, and Pedersen (2009) identifies several precursors:

Three panels. Top: carry strategy equity with crash at day 300. Middle: cross-asset correlation rises ~20 days before the crash. Bottom: VIX term structure inverts ~10 days before. Both signals provide warning, but neither is precise — the lead time varies and false alarms are common.

The Warning Dashboard

Four signals to monitor, ranked by reliability:

1. VIX term structure inversion (most reliable). When the front-month VIX exceeds the second-month, it signals that the market is pricing immediate stress. This inverts 70-80% of the time before significant carry drawdowns. Lead time here is 5-15 days.

2. Cross-asset correlation spike. When the 21-day rolling correlation across carry strategies (FX, bonds, equities) exceeds 0.5, it signals that the “carry factor” is under stress. Lead time is 10-30 days.

3. Credit spreads widening. IG and HY credit spreads are a leading indicator of funding stress. When spreads widen by more than 1 standard deviation from their 63-day mean, carry trades become more fragile. Lead time would be 5-20 days (big challenge here is the width of time).

4. Carry crowding indicators. CFTC positioning data shows speculative positioning in carry currencies and vol instruments. Basically, extreme crowding increases crash risk. Lead time is weeks to months, but pretty imprecise.

As you can see, none of these are precise enough to time the bottom tick. But collectively, they tell you when to scale down from 100% to 30-50% — and that’s enough to avoid the worst of the damage.

The Carry Regime Framework

The framework maps to V6’s existing VIX regime filter. In the green regime (VIX < 20, steep curve, low correlation), V6 is already running at full allocation — and carry is accruing. In the red regime (VIX > 25, inverted term structure), V6 should already be scaling down — which protects carry too.

The insight: V6’s regime filter is already a carry timing mechanism, even though it wasn’t designed as one. The VIX regime tracks the same underlying conditions that determine carry profitability.

Carry Returns Are Regime-Dependent

This point deserves its own chart:

Carry returns conditioned on VIX level. When VIX is below 15, carry earns ~5.2% annualized with a 0.87 Sharpe. When VIX exceeds 30, carry loses 8.5% with a -0.28 Sharpe. The strategy only “works” in calm markets — which is fine, because that’s most of the time.

The implication is clear: carry is not a strategy you run all the time. It’s a strategy you run when conditions are favorable and shut down when they’re not. The timing decision — harvest vs. retreat — accounts for more of the total return than the carry level itself.

Timed vs. Untimed Carry

What happens when you apply regime scaling?

Gray: untimed carry (always on). Green: timed carry (scale to 30% when signals flash). Timed carry sacrifices some return but dramatically improves the Sharpe and cuts the worst drawdowns. The regime signals don’t need to be perfect — even a crude VIX > 25 filter captures most of the benefit.

The improvement is similar to what we saw with GEX conditioning in Part 85 (Microstructure series): you’re not predicting crashes, you’re reducing exposure when the environment is hostile. The carry still works — you’re just not sitting at full size when it’s most likely to reverse.

The Connection to V6’s Architecture

V6 already does carry timing — it just doesn’t call it that. Here’s the mapping:

V6 Component          → Carry Timing Function
─────────────────────────────────────────────────
VIX < 20: full TQQQ   → Harvest equity carry + VRP
VIX > 30: shift to TLT → Harvest bond carry instead
CUSUM alarm            → Scale down all carry exposure
Momentum threshold     → Avoid negative price-change periods
Microstructure layer   → Scale down when execution costs
                         erode carry income

Every layer of V6 that we’ve built across 89 posts — the regime filter, the momentum signals, the CUSUM monitoring, the microstructure layer — is also a carry timing mechanism. This isn’t a coincidence. Good strategies manage their carry exposure whether or not they explicitly think about it that way.

Up Next

Part 3: Building the Multi-Asset Carry Portfolio — Can we add explicit carry streams to V6? Bond curve optimization, the carry-momentum interaction, and what it would take to build a proper multi-asset carry strategy.

Remember: Alpha is never guaranteed. And the backtest is a liar until proven otherwise.

The material presented in Math & Markets is for informational purposes only. It does not constitute investment or financial advice.

Thanks for reading Math & Markets! Subscribe for free to receive new posts and support my work.

This is part 88 of my series — Building & Scaling Algorithmic Trading Strategies

This begins a 3-part series on carry. Part 1: what carry actually is. Part 2: when carry blows up. Part 3: building a multi-asset carry portfolio.

The Unifying Equation

Every asset you can hold generates two types of return: the carry you earn from simply holding the position, and the price change you get from the market moving. Most people focus on the price change. The professionals focus on the carry.

Total Return = Carry + Price Change

This equation is trivially simple but its implications are pretty crazy.

Carry is the return you’d earn if nothing changes — if rates stay the same, if exchange rates don’t move, if the yield curve maintains its shape. It’s the “income” component of return. Price change is everything else — the unpredictable part.

What makes carry powerful: it’s knowable in advance. You can calculate today exactly how much carry you’ll earn tomorrow. You can’t do that with price changes. This asymmetry — one component is predictable, the other isn’t — is the foundation of an entire class of strategies.

Four carry strategies over 20 simulated years. The volatility risk premium (purple) has the highest carry but the worst drawdowns. FX carry (orange) shows the classic “escalator up, elevator down” pattern. Bond roll-down (blue) is the steadiest. Equity dividend carry (green) has the lowest carry but the least drama.

The Five Faces of Carry

Carry shows up in every asset class. The name changes, the math is the same:

In every case, you earn a predictable income for holding a position. And in every case, price changes can overwhelm that income — sometimes catastrophically.

So let’s walk through each one…

FX Carry: The Fama Puzzle

FX carry is the most studied and the most intuitive. Borrow in a low-rate currency (JPY, CHF), invest in a high-rate currency (AUD, BRL, TRY). The interest rate differential is your carry.

Standard economics says this shouldn’t work. Uncovered Interest Parity (UIP) predicts that high-rate currencies should depreciate at exactly the rate of the interest differential, leaving carry traders with zero expected profit. A 10% rate in Turkey should be offset by a 10% depreciation of the lira.

The reality is different. Fama (1984) showed that high-rate currencies actually appreciate slightly on average, making the carry trade doubly profitable — you earn the rate differential AND a small FX gain. This anomaly, known as the “Fama puzzle” or the “forward premium puzzle,” has persisted for 40+ years across currencies and time periods.

Left: FX carry returns by pair. Note TRY/USD: 25% rate differential but negative total return — the lira depreciation overwhelmed the carry. High carry ≠ guaranteed profit. Right: the Fama puzzle visualized. UIP predicts the gray line (high rates → proportional depreciation). Reality (orange line) has a slope of about -0.3, not -1.0. The gap between the lines is the carry profit.

Why Does This Persist?

Three theories, none fully satisfying:

Peso problem. Carry trades work most of the time but occasionally blow up catastrophically (peso devaluation, yen carry unwind, etc.). The average return compensates for crash risk that hasn’t been fully sampled.

Risk premium. Investors demand compensation for holding higher-risk currencies. Just as equities earn a premium over bonds, high-rate currencies earn a premium over low-rate currencies.

Slow-moving capital. Central bank interventions and institutional frictions prevent immediate arbitrage. By the time capital moves to exploit the anomaly, the opportunity has partially closed but never fully disappears.

For our purposes, the mechanism matters less than the empirical fact: carry has been a profitable strategy across currencies for decades, with a Sharpe of approximately 0.4-0.6 in G10 currencies — similar to equities but with very different risk characteristics.

Bond Roll-Down: Riding the Curve

Bond carry is subtler than FX carry. It has two components:

1. Coupon (yield) carry. You earn the bond’s yield minus your funding cost. A 10-year Treasury yielding 4.2% funded at a 4.5% repo rate gives you -0.3% of yield carry. Not great.

2. Roll-down carry. As a bond ages, it moves to a shorter maturity on the yield curve. If the curve is upward-sloping, shorter maturities have lower yields. Lower yields mean higher prices. You profit from this mechanical price appreciation.

Left: the roll-down mechanism. Buy a 5-year bond at 3.70%. After one year, it’s a 4-year bond. If the yield curve hasn’t changed, a 4-year bond yields 3.75% — but you bought at 3.70%, so you’ve gained. The price appreciation from this yield decline is the roll-down carry. Right: decomposition of bond return. Coupon provides 3.7%, roll-down adds 0.5%, price change subtracts 0.3%, for a total of 3.9%.

Roll-down carry is positive whenever the yield curve is upward-sloping (normal) and negative when it’s inverted. Since the curve is normal roughly 80% of the time, bond carry is usually positive.

The Duration Bet

Bond carry is partly compensation for duration risk — the risk that rates rise and your bond loses value. A strategy that systematically harvests bond carry is implicitly betting that rates won’t rise faster than the carry compensates. When rates spike (2022), bond carry gets destroyed. When rates are stable or declining, it compounds steadily.

This is directly relevant to V6: TLT (the 20+ year Treasury ETF) earns carry from both coupon and roll-down. V6’s TLT allocation isn’t just a hedge — it’s a carry position.

The Volatility Risk Premium: Selling Insurance

The volatility risk premium (VRP) is the most lucrative and most dangerous carry trade.

The VRP exists because implied volatility (what options are priced at) systematically exceeds realized volatility (what actually happens). The gap — typically 3-5 percentage points of volatility — is the “insurance premium” that option buyers pay and option sellers collect.

Top: implied vol (orange) vs. realized vol (blue). The green shading shows the VRP when it’s positive (profit for short vol). Red shading shows when realized exceeds implied (loss). Bottom: cumulative VRP P&L. Steady upward grind interrupted by sharp drawdowns — the quintessential carry profile.

Why VRP Exists

Unlike the Fama puzzle, the VRP has a clean economic explanation: risk aversion.

Option buyers are purchasing insurance against tail events. Insurance is always priced above its actuarial value — that’s how insurance companies make money. Similarly, options are priced above their expected payoff. The seller (the “insurance company”) collects this premium.

The VRP is robust because it’s structural, not informational. As long as investors are risk-averse — which is basically always — they’ll overpay for downside protection, and vol sellers will collect the premium.

V6 captures VRP implicitly through its VIX regime filter. When VIX is elevated (options are expensive), V6 shifts allocation — effectively acting as a partial buyer of the vol premium. When VIX is low, V6 is fully invested — effectively neutral on vol. Understanding this as a carry trade changes how you think about V6’s risk.

The Skewness Problem

Every carry trade shares a statistical fingerprint: positive mean, negative skew.

Return distributions for four carry strategies. FX carry and vol premium have extreme negative skew (-0.5 to -0.8) and excess kurtosis (3-8). Bond roll-down and equity dividends are more symmetric. The fat left tails are the “elevator down” — rare but devastating losses.

This is not a coincidence. Carry trades earn a premium precisely because they expose you to left-tail risk. The Sharpe ratio of a carry trade overstates its risk-adjusted return because the Sharpe assumes normal returns. With negative skew, you’re earning the average return most of the time but occasionally losing 5-10× the average in a single event.

The practical implication: never size a carry trade using the Sharpe ratio. Use a tail-risk-adjusted metric like the Sortino ratio, or simulate the worst-case drawdown and size to survive it.

V6’s Hidden Carry

Here’s the punchline of this post: V6 is already a carry trader, and understanding this changes how you analyze its returns.

V6 earns approximately 3.4% annualized carry from four sources: TQQQ’s dividend yield (0.3%), TLT’s coupon and roll-down (2.8%), implicit VRP from the VIX regime filter (1.5%), minus funding cost (-1.2%). This carry accrues before any alpha from momentum signals or regime switching.

When V6 has a good year, how much is carry and how much is alpha? When V6 has a bad year, is the carry still working and the alpha failing, or has the carry trade itself reversed (as bond carry did in 2022)?

Decomposing returns into carry and alpha is essential for understanding whether V6 is working for the right reasons. If the carry component accounts for most of the return, V6 is primarily a carry trade with alpha on top. If the alpha dominates, V6 is primarily a directional strategy with carry as a bonus.

Based on the math above, V6’s ~24% CAGR decomposes roughly as:

Carry component:     ~3.4% (predictable, accrues daily)
Momentum alpha:      ~8-10% (from regime switching, variable)
Leveraged beta:      ~10-12% (from TQQQ's 3× equity exposure)
Interaction effects:  ~1-2% (timing of carry vs. alpha)

The carry is the floor. Even when the momentum signals are wrong, V6 earns ~3.4% from holding its positions. That’s not nothing — it’s the difference between a bad year being -5% versus -8%.

Up Next

Part 2: When Carry Blows Up — The “escalator up, elevator down” problem formalized. Can regime signals warn you before a carry crash? We’ll look at FX carry unwinds, Volmageddon, and the 2022 bond rout through the lens of carry timing.

Remember: Alpha is never guaranteed. And the backtest is a liar until proven otherwise.

These posts are about methodology, not recommendations. If you find errors in my math, let me know — I’ve built an entire series around discovering my own mistakes, so one more won’t hurt.

The material presented in Math & Markets is for informational purposes only. It does not constitute investment or financial advice.