What Rally Radar can and cannot do

Rally Radar has not demonstrated a profitable trading strategy. It does appear to concentrate short-horizon movers better than random selection, and about half of that advantage remains after controlling for volatility, momentum and liquidity in the exploratory data. The first pre-registered matched holdout kept a positive estimate, but its interval spanned zero, so it could not settle the question. That makes the score useful as a candidate-ranking tool, and not evidence for mechanically trading it.

The strongest number here: of 1,327 signals at a net score of 85 or above, 18.5% went on to reach +10% within 24 hours, against 8.4% of random entries — and flagged coins still came out ahead of unflagged coins picked to look almost identical at the same hour — though the one pre-registered test of that was too small to confirm it. The weakest: traded mechanically with fees and slippage deducted, none of that turned into a positive expectancy anyone could rely on. Both are worked through below, with the method that produced them.

We publish this because the alternative — a large green win rate with no baseline next to it — is what every scanner shows, and it is not evidence. These figures come from two analysis scripts in the codebase, and the site's test suite fails if the numbers on this page drift from what those scripts last produced.

"Does it work?" is two questions

They get mixed together constantly, and they have different answers:

1. Is it tradeable? If you bought every signal mechanically and exited at a fixed target or stop, would you come out ahead after fees and slippage?
2. Does it find movers? Do the coins it flags go on to move more than the coins it did not flag?

The first decides whether the score is worth trading. The answer is no. The second decides whether the tool is worth opening. The answer is a qualified yes, and the qualification is most of the story.

1. Is the score tradeable? No.

The method is the ordinary one, and what matters is the order it happened in. A grid of configurations — score threshold, profit target, stop, time limit — was scored on an earlier training period. The single best training performer was then run once on later data that the selection had never seen. Choosing after seeing the later data is how almost every published backtest flatters itself, so the choice was locked first.

Every test uses 315 Binance USDC pairs on hourly candles. Each signal is a barrier trade: from the signal bar, does price reach the profit target or the stop first, within the time limit? Costs of 0.30% per round trip are deducted from every trade — 0.20% in fees, 0.10% in slippage. The configuration that won the training period was a net score of 85 or above, a +10% target, a −5% stop and a 48-hour limit.

The training period is where this really ends. Of the 75 configurations that had enough trades to evaluate, 0 had positive expectancy. The best of them lost −0.117% per trade. Taking the highest expectancy from a set of losers selects the least-bad loser, not an edge — so the out-of-sample run that followed had no hypothesis to confirm.

The test period does show +1.605% per trade, and it is tempting to stop reading there. Two things stop us. Its 95% interval runs from −0.140% to +3.500% — it includes zero, so the result is consistent with the score being worth nothing. And entering at random over the same weeks returned +0.508%: much of what the signals earned, an arbitrary coin also earned, because the market was rising.

Those intervals are wider than the ones a backtest usually reports, deliberately. They are computed by resampling whole entry days rather than individual trades. Hundreds of altcoins moving together on one afternoon is a single event, not hundreds of independent confirmations, and an interval that pretends otherwise looks far more convincing than the evidence deserves. Across the test period, 522 trades happened on just 51 days, and the random-entry comparison's 6,621 trades on 44.

2. Does it find movers? Partly — and about half of it is explained.

This section is exploratory. Except for the pre-registered holdout at the end, it is measured on the same data that generated the hypothesis, so it can suggest an effect but cannot confirm one.

Finding movers is a different and easier claim than trading them. Here the outcome is a touch: within the next 24 hours, does the price reach +10% above where it was when the signal fired? Of 1,327 separate signal episodes at a net score of 85 or above, 18.5% reached that target, against 8.4% for random entries. Better than double.

That raw gap is not the finding, because the score's own ingredients are volatility, momentum, volume and distance to a breakout. A tool built from those will naturally pick volatile coins on busy days, and volatile coins reach any target more often. If that is the whole story, the model is an expensive volatility filter. So each flagged coin was compared against unflagged coins priced in the same hour whose volatility, 24-hour momentum and liquidity ranked within a narrow band of its own — as close to the same coin on the same day as the data allows. Every row below is measured on the stretch running up to the 2026-07-17 cutoff described in the next section.

So a meaningful part of the apparent skill is the radar firing on days when everything was running, and on the kind of coin that moves anyway — but not all of it. Holding volatility, momentum and liquidity equal still leaves between +4.5 and +5.2 percentage points, on intervals that stay above zero. That is the closest thing to a positive result this project has.

The last row is not simply the row above it plus one more control. Adding liquidity leaves 133 of the 911 episodes with no comparable unflagged coin at all, so it is averaged over a smaller and easier set — which is why it sits slightly higher, and why it should not be read as liquidity handing part of the effect back. The +4.5 pp row, on almost every episode, is the more conservative reading.

To check it was not an artifact of designing the comparison after seeing the answer, one cell was pre-registered — the matched comparison above, at +10% within 24 hours — with the cutoff date 2026-07-17 written into a design document before it was run, and the code refuses to compute any other. On that held-out stretch: 411 episodes over 34 entry days, 319 of them with a comparable unflagged twin, giving +2.5 percentage points with an interval of −2.0 to +6.9.

That interval spans zero, so the holdout is inconclusive. It is worth being precise about what that means: 34 days is not enough resolution to separate a few percentage points from noise. It is not a finding that the flagged coins and their twins performed alike. The honest summary is that the effect survived the first serious attempt to explain it away, and the confirming test was too small to settle it.

What these numbers do not say

• Nothing above is a profitability claim. A touch means the price reached the target at some point in the window — no stop, no exit rule, no costs. A coin that touched +10% may have first fallen 30%, and nothing here tells you when to sell. The tradeability question has exactly one answer on this site, and it is the one in section 1.
• One market, about five months. With a seven-day hole in the middle where no data was collected. A stretch that short can carry an apparent effect that is really one rally.
• Longer horizons look worse, not better. At 48 hours, three score bands show the pattern in reverse: they fire on days a random coin would also have hit the target, and conditional on the day, their picks did worse than an arbitrary coin. The short horizons are where the evidence lives.
• The score is not ranked by profitability. Setup-type weighting in the scoring model sits at zero on purpose. An earlier version weighted setups by their win rate, which turned out to be inverted against measured outcomes, and it was neutralised rather than guessed at again.

So what is it good for?

Narrowing the field. There are more than 200 USDC pairs on Binance, and a person checking them by hand gets through a fraction of that before the setups have moved on. The evidence says a high score is a reasonable reason to look at a chart, and no reason at all to place an order without one. Treat the ranking as a shortlist, not as a recommendation — the score cannot see the news, the unlock schedule, or your exit plan.

Why publish a negative result?

Because the alternative was a large green number. The scanner tracks how its own signals resolve, and the "hit rate" that comes out of that is genuinely flattering — it is also the statistic that produced the inverted weighting mentioned above. A high hit rate with a worse-than-random payoff is not an edge, and any tool can show you one. The live counters on the scanner page are there because watching signals resolve is interesting, not because they are evidence, and they are labelled that way.

How we report

These are the rules everything published on this site follows. They are here so that the next number we publish can be judged before you read it, not after — and because a rule stated in public is harder to quietly drop than one held privately.

• Figures are generated, not typed. Every number on this page is produced by an analysis script in the codebase, and the site's test suite fails if the prose here drifts from what those scripts last produced.
• Signals are judged by expectancy after costs, against a baseline. Never by win rate alone — a high win rate with a worse-than-random payoff is not an edge, and it is the mistake that already cost us once.
• Comparisons control for the day. A scanner that fires when the whole market is running would otherwise take credit for the market.
• Uncertainty is computed across days, not signals. Hundreds of altcoins moving together are one event. Intervals that ignore this look far more convincing than the evidence allows.
• Holdout tests are pre-registered and run once. The question, the threshold and the cutoff date are fixed in a design document before the test runs, and the code refuses to compute a different one. A test you can repeat until it agrees with you is not a test.
• Negative results are published here, in the same place and the same size as positive ones.

The next holdout run is scheduled rather than continuous, and that is deliberate. Re-running a test every time fresh data arrives means asking the same question until an answer finally flatters you, which is how a coin flip becomes a strategy. So it runs once more when the held-out stretch reaches roughly three times its current length — around November 2026 — and this page changes with whatever comes back, including if it comes back worse.

If you want the mechanics rather than the measurement, how a scanner's score is put together breaks down the points and penalties, and screening 200+ pairs without checking charts manually covers the workflow this is meant to fit into.

← Back to the scanner