From this research, NAGA's experts draw three questions to put to any backtest, whoever or whatever produced it.
The first is how many versions were tested. If nobody can say, the safe assumption is many.
The second is whether any data was held back. A result checked only against the data used to build it cannot tell a real pattern from a coincidence that happened to fit.
AI tools add a subtler version of this problem, and researchers have now measured it. In a recent study, Zhenyu Gao, Wenxi Jiang and Yutong Yan of CUHK Business School gave a language model only Kodak's name, ticker and a date in July 2020. It put the probability of the share price rising at about 0.9999, because the event sat inside its training data. For dates after the training cut-off, the effect all but vanished. A backtest that asks a model to "decide" on past dates can quietly benefit from knowing the answer.
The third is whether the strategy has run forward, on prices that did not exist when it was built. NAGA's backtesting guide names the trap directly as optimisation bias, "also popular as curve-fitting", warns about look-ahead bias in the data, and says traders also need to forward test a strategy in the real-time market.
On NAGA, that step can be taken on a demo account with virtual funds, letting a strategy run on live prices for weeks before any real money is involved. For a retail trader, it is the closest equivalent to a held-out test set.


