BlackMind
Research
Machine learning on financial time seriesOn-chain data engineeringSurvival analysisHonest validation and leakage control

Learnability of pump.fun Meme Tokens

Leakage-free, regime-aware modeling of whether a meme token graduates — and what happens after it does.

Jovonni L. PharrGeorgia Cyber Warfare Range / BlackMindAugust 4, 2026v0.0.1

In brief

A rigorous, leakage-free study of pump.fun meme tokens that corrects a severe sampling bias (~52% -> 4.2% -> 0.95% graduation rate), maps the frontier between cheap-and-scalable versus expensive-and-strong features for predicting graduation (the L6 experiment yields metadata ROC ~0.66 vs on-chain microstructure ROC ~0.91), and follows tokens past graduation to show that median survival is ~1.2 minutes and upside is a power law — all validated out-of-time with survival analysis and audited against the leaks that sink most meme-coin models.

Key results

  • Correcting a selection bias drops the apparent graduation rate from a market-cap-sorted census's ~52% to an honest early-features-plus-outcome cohort's 4.2%, and to 0.95% (11,920 of 1,254,540) across a 13-month, 1.25M-token population.
  • A learnability map from the L6 experiment quantifies the real design trade-off: cheap metadata features (creator history, socials, timing) available for all 1.25M tokens reach only an out-of-time ROC-AUC of roughly 0.66, while expensive on-chain microstructure (holders, bots, churn) available for the ~2,000-token supervised frame reach roughly 0.91.
  • Near-launch holder count separates future graduates at AUC 0.85 and survives age-stratification (0.79-0.90 within every snapshot-age quartile), while early transaction frequency is a strong inverse tell (AUC 0.26) — bot spam without holders.
  • Resolving graduation by reading the bonding-curve account's byte-48 complete flag via getMultipleAccounts hit ~220 mints/sec on a keyless public RPC, resolving 98,175 mints in 7.5 minutes and verifying 100% (300/300) against the /coins ground truth.
  • After graduation, median lifetime is ~1.2 minutes; hand-rolled Kaplan-Meier puts 88.1% of graduates dead within 1 hour and 97.3% within a week, with only ~8% 'sustained' survivors trading for hours to days.
  • Post-graduation upside is a power law (Hill alpha ~2.31; p50 1.35x, p99 14.9x) yet predictable out-of-time from reserve-free behavioral features alone: >=2x reaches ROC ~0.92 with ~4.9x top-decile lift, and the rarer >=5x reaches ROC ~0.94 with ~10x lift in the top 5%.

The Question

Pump.fun launches tens of thousands of meme tokens; the natural question is whether anything observable early in a token's life predicts its fate. The project poses this as several distinct learning problems on one feature store rather than the ill-posed 'will it moon': P1 graduation (does the bonding curve complete and migrate to an AMM), P2 magnitude (peak return, a heavy-tailed regression), P3 rug/manipulation (weakly-supervised anomaly detection), and P4 archetypes (unsupervised clustering). Graduation is chosen as the clean, unambiguous, on-chain milestone to anchor everything else.

The stated bar is deliberately high: correct causal-time discipline, survival framing, regime-aware validation, calibrated probabilities, effect sizes with uncertainty, and interpretable models — explicitly not accuracy theater. Two prior attempts (a market-cap heuristic and a supervised rug classifier) are demoted to baselines, and one of them is shown to have a leaky label that partly re-learned itself.

The sampling illusion: a market-cap-sorted census implies a ~52% graduation rate, but the honest cohort (early features plus realized outcome, no selection on outcome) shows 4.2%. Of 1,969 tokens with both early features and a realized outcome, 82 graduate (4.2%).
Fig.The sampling illusion: a market-cap-sorted census implies a ~52% graduation rate, but the honest cohort (early features plus realized outcome, no selection on outcome) shows 4.2%. Of 1,969 tokens with both early features and a realized outcome, 82 graduate (4.2%).

Method As Built

Every model answers one question: given only what was observable in the window [0, T] after launch, predict something about (T, end]. Features come strictly from [0, T], labels strictly from after T, and a leakage linter checks this per feature. Splits are time-based walk-forward only — train on earlier launch cohorts, test on strictly later ones — because random splits leak the regime. Because graduation is a single-digit-percent event, the reported metrics are PR-AUC, lift, precision@k, and calibration, since precision@k mirrors the real decision of aping into only k tokens.

The data engineering unlocks scale. Rather than grind the rate-limited /coins API (~3/sec), the pipeline reads the on-chain bonding-curve account directly: getMultipleAccounts fetches 100 accounts per call and the graduation complete flag is byte 48 of the 81-byte layout. This resolved 98,175 mints in 7.5 minutes on a keyless public RPC (~220/sec, ~50x faster) and verified 100% (300/300) against /coins ground truth. The approach then scales to a 1.25M-token, 13-month population from a free Kaggle dataset, with 96% of graduations resolved via batched RPC.

Honest labels replace the discarded leaky one: graduated (bonding-curve migration), dud (never moved past the launch floor, 81%), and honest_rug (moved past floor then collapsed >=70% off a real peak), with the explicit caveat that honest_rug is a collapse label, not proof of malicious intent, because that needs trade/LP-level data deliberately not collected.

The Learnability Map

The headline modeling result is not a single best model but a frontier, produced by the L6 map experiment. Cheap metadata — creator prior-launch history, social links, launch timing — is available for every one of the 1.25M tokens but caps at an out-of-time ROC-AUC of roughly 0.66. Expensive on-chain microstructure — holder counts, bot scores, churn — is available only for the ~2,000-token supervised frame (the 1,969 tokens with both early features and a realized outcome) but reaches roughly 0.91. This is the real design choice: you trade sample size and coverage against signal strength.

Feature-family ablation shows creator history dominates the metadata regime while launch timing is nearly noise. On the strong side, near-launch holder count alone hits AUC 0.85 and survives age-stratification (0.79-0.90 within every snapshot-age quartile), confirming it is genuine early traction and not a snapshot-timing artifact; early transaction frequency is a strong inverse tell at AUC 0.26, flagging bot spam that churns without accreting holders. A separate 'constructing the right problem' experiment (L2) narrows the population — for instance to creators with a prior graduate — and its uncaptured runtime output indicates this simultaneously raises the base rate, the out-of-time ROC-AUC, and the top-5% lift; the population report's comparable cut shows a prior-graduate rate of 1.32% vs 0.91% (a ~1.5x lift).

The learnability map (L6 experiment): metadata-only features (blue) scale to ~1.25M tokens but reach an out-of-time ROC-AUC of roughly 0.66; on-chain microstructure (green) reaches roughly 0.91 but only for the ~2,000-token supervised frame. The dotted line is the frontier the designer trades along.
Fig.The learnability map (L6 experiment): metadata-only features (blue) scale to ~1.25M tokens but reach an out-of-time ROC-AUC of roughly 0.66; on-chain microstructure (green) reaches roughly 0.91 but only for the ~2,000-token supervised frame. The dotted line is the frontier the designer trades along.

Life After Graduation

Treating graduation as success turns out to be a mistake, and the second half of the project says so directly. Studying tens of thousands of graduated mints from Dune's base_trades table — with the AMM phase cleanly isolated because pool sol_reserves exceed the ~115-SOL bonding-curve completion cap — a hand-implemented, censoring-aware Kaplan-Meier estimator (product-limit, Greenwood variance bands) finds median post-graduation lifetime of about 1.2 minutes. 88.1% of graduates are dead within an hour and 97.3% within a week; only ~8% 'sustained' tokens trade for hours to days. The dominant failure mode is death by silence at a modest drawdown, not a dramatic LP pull — a strict rug flag (>=90% drawdown and dead) fires on only 2.3%.

The magnitude story is a power law. Post-graduation peak-reserve multiple has a Hill-estimator exponent of alpha ~2.31, with median 1.35x, p99 14.9x, and 89% of peaks arriving within the first hour of migrating. Yet the run is predictable out-of-time from reserve-free behavioral features: a >=2x classifier reaches ROC ~0.92 with ~4.9x top-decile lift, and the rarer >=5x reaches ROC ~0.94 with ~10x lift in the top 5%. Counter-intuitively, the narrower and more concentrated the graduation, the bigger the post-grad run — the same 'concentrated beats organic' pattern the graduation half surfaced.

Regime shift: monthly graduation rate collapsed from ~7% (Feb 2024) to ~0.4-0.5% in late 2024 as pump.fun saturated, before the Feb 2025 bulk at 1.03%. A large, real shift that random splits would leak — which is why validation is walk-forward.
Fig.Regime shift: monthly graduation rate collapsed from ~7% (Feb 2024) to ~0.4-0.5% in late 2024 as pump.fun saturated, before the Feb 2025 bulk at 1.03%. A large, real shift that random splits would leak — which is why validation is walk-forward.

How It Was Verified

The honesty checks are the backbone of the work, not an afterthought. The on-chain graduation decoder was verified 300/300 against the API ground truth before being trusted at scale, and independently cross-checked against a mined prior codebase that decodes the identical bonding-curve layout and confirms the same byte-48 complete flag. The prior work also independently flags the old is_rug label as leaky — it thresholded zero-balance ratio, which was simultaneously a model input — validating the decision to discard it.

In the post-graduation return study, a specific leak is caught and disclosed: reserve-level early features like max SOL can mechanically read the target for fast-graduating tokens whose first-5-minute window overlaps the post-grad peak (that single feature scores AUC 0.95 for >=5x, a mechanical leak). The reported models therefore use only reserve-free behavioral features. Calibration is checked out-of-time on decile bins to confirm the predicted probabilities are honestly ordered, and every headline caveat — reserve semantics as a liquidity proxy rather than price, survivorship conditioning on graduation, right-censoring of recent cohorts — is stated plainly.

Why It Matters

The contribution is methodological as much as empirical. It demonstrates that the single discipline where most meme-coin models die — temporal leakage and regime leakage — can be enforced end to end, and that doing so overturns a headline 'success rate' by more than an order of magnitude (~52% to under 1%). The learnability map reframes the modeling question from 'what is the best model' to 'what feature-cost point can you afford,' which is the decision an actual operator faces.

The limits are owned rather than hidden. The honest_rug and reserve-based magnitude measures are collapse and liquidity proxies, not proof of intent or tradeable returns; the strong-feature regime rests on only ~2,000 tokens; the population is one-month-dominated; and the P&L model is explicit that only its win rate is real (out-of-time model precision) while the payoff multiples are documented assumptions. The through-line is that honest negative results are results: an early signal that cannot beat base rate at a given horizon is reported as such, and the frontier is quantified rather than papered over.

Constructing the right problem (L2 experiment): narrowing the population from all tokens to creators with a prior graduate raises the base rate, out-of-time ROC-AUC, and top-5% lift together — trading sample size for a more actionable problem. The comparable population-report cut shows a prior-graduate graduation rate of 1.32% vs 0.91%.
Fig.Constructing the right problem (L2 experiment): narrowing the population from all tokens to creators with a prior graduate raises the base rate, out-of-time ROC-AUC, and top-5% lift together — trading sample size for a more actionable problem. The comparable population-report cut shows a prior-graduate graduation rate of 1.32% vs 0.91%.

Abstract

This project asks whether the fate of a pump.fun meme token is learnable from data observable early in its life, under strict causal-time discipline. It first dismantles a sampling illusion: a market-cap-sorted census implies a ~52% graduation rate, but an honest cohort selected on early features plus realized outcome — never on outcome — shows the true rate is 4.2%, falling to 0.95% across a 1.25M-token, 13-month population as pump.fun saturated. Graduation is rare, heavy-tailed, and regime-shifting, so every model is validated out-of-time (train earlier launch cohorts, test strictly later) with PR-AUC, precision@k, and calibration rather than accuracy. The central result is a learnability map produced by the L6 experiment: cheap metadata (creator history, socials, launch timing) available for every token reaches an out-of-time ROC-AUC of roughly 0.66, while expensive on-chain microstructure (holders, bots, churn) available for the ~2,000-token supervised frame reaches roughly 0.91 — a frontier the designer trades along, not a single best model. A second half studies what happens after graduation, using hand-rolled Kaplan-Meier survival and leakage-audited return models on tens of thousands of graduated mints from Dune trade data. The finding is stark: median post-graduation lifetime is about 1.2 minutes, 88% of graduates are dead within an hour, and post-graduation upside is a power law (Hill exponent alpha ~2.31). Throughout, the work treats honest negative results and disclosed leakage traps as first-class deliverables.

More figures

  • Head-to-head model bake-off across the deployable, population, and unsupervised-anomaly problems — logistic, tree ensembles, MLP, and anomaly detectors judged on out-of-time ROC-AUC, lift, and fit time; on this problem the signal does the work and model choice is secondary.
    Fig. 1Head-to-head model bake-off across the deployable, population, and unsupervised-anomaly problems — logistic, tree ensembles, MLP, and anomaly detectors judged on out-of-time ROC-AUC, lift, and fit time; on this problem the signal does the work and model choice is secondary.
  • Per-feature AUC for graduation with bootstrap 95% confidence intervals, ranking early on-chain signals by effect size — holder count leads at 0.85, transaction frequency is a strong inverse tell.
    Fig. 2Per-feature AUC for graduation with bootstrap 95% confidence intervals, ranking early on-chain signals by effect size — holder count leads at 0.85, transaction frequency is a strong inverse tell.