How Do I Evaluate a Trading Strategy Vendor Selling an Indicator?

1. Common marketing tactics used for paid indicators

Paid indicator vendors sometimes use visually striking demonstration charts showing the indicator's signals appearing to predict significant moves perfectly, similar to the broader marketing concerns around course and mentor promotion generally, without necessarily providing genuinely independent, verified performance evidence behind these selected examples.

It's worth watching specifically for arrows or highlighted signals appearing exactly at chart turning points, that kind of visual is easy to produce with hindsight by simply choosing which signals to display after already knowing what price did next, worth recognising this specific presentation pattern as a red flag rather than genuine evidence of predictive value.

2. Why impressive demo videos prove relatively little

A demonstration video showing only carefully selected, historically successful signal examples doesn't represent the indicator's genuine overall statistical performance across a complete, representative historical sample, making this kind of cherry-picked demonstration considerably less informative than it might initially appear.

It's worth asking yourself explicitly whether you're seeing a representative sample or a curated highlight reel, an indicator vendor showing five perfect signals says nothing about how many imperfect or losing signals occurred during that same period that simply weren't included in the demonstration.

3. The curve-fitting risk specific to custom indicators

A custom indicator's specific parameters might have been deliberately tuned to perform impressively on the particular historical period used for marketing purposes, the same overfitting risk that affects any backtesting exercise, without genuine robustness to perform similarly well on new, future, unseen market conditions.

It's worth being specifically sceptical of indicators with numerous adjustable parameters, each additional tunable setting increases the statistical risk that the version being marketed was optimised specifically to look impressive on the particular historical data used for that promotional demonstration.

4. Requesting genuine, verifiable track record evidence

As with evaluating trading mentors and EA marketplaces, requesting complete, independently verifiable historical performance data, covering a complete period rather than only selectively impressive examples, provides more genuinely useful evidence than marketing materials alone.

It's worth being persistent but polite in this request, and treating a vendor's reluctance or inability to provide this kind of complete, unfiltered performance data as meaningful information in itself, a genuinely confident vendor with a real track record generally has little reason to withhold it.

5. Testing the indicator yourself before committing fully

Independently testing any purchased indicator yourself, ideally on demo first, across your own chosen historical period and instruments, provides your own genuine, current verification beyond whatever the vendor's own marketing materials claim.

It's worth budgeting genuine time for this independent testing before forming a final opinion, rather than making a purchase decision based purely on marketing material and rushing the verification afterward, testing first protects you from sunk-cost pressure to justify a purchase you've already made.

South African traders who backtest their strategies should use historical data that includes periods of rand volatility and SA-specific events such as budget speeches, credit rating decisions, and periods of high load shedding. A strategy that performs well on global historical data but was not tested against SA-specific market conditions may behave differently when applied to ZAR instruments. Including at least one cycle of SARB rate changes and one period of political uncertainty in your historical test set provides a more realistic assessment of performance.

6. A practical evaluation checklist before purchasing

Before purchasing any indicator, checking for a free trial period allowing your own independent testing, seeking independent reviews beyond the vendor's own marketing, and applying healthy scepticism toward guaranteed-result claims, supports a more informed purchasing decision.

The most common mistake when evaluating a trading strategy is judging it on too short a sample. A strategy with a 55% win rate and a 1.5:1 reward-to-risk ratio will produce losing months even under ideal conditions. Over 100 trades, natural variance means any given run of 30 trades could show results ranging from highly profitable to significantly negative, even if the strategy is working exactly as designed. This statistical reality explains why most retail traders abandon strategies prematurely. Meaningful strategy evaluation requires a minimum of 100 trades under consistent market conditions with consistent position sizing and consistent rule-following. Only after this minimum sample is complete can any objective assessment of the strategy's edge begin. South African traders should document each trade against the strategy's specific entry and exit rules, not just the monetary outcome, to build a genuinely useful performance record.

The most common mistake when evaluating a trading strategy is judging it on too short a sample. A strategy with a 55% win rate and a 1.5:1 reward-to-risk ratio will produce losing months even under ideal conditions. Over 100 trades, natural variance means any given run of 30 trades could show results ranging from highly profitable to significantly negative, even if the strategy is working exactly as designed. This statistical reality explains why most retail traders abandon strategies prematurely. Meaningful strategy evaluation requires a minimum of 100 trades under consistent market conditions with consistent position sizing and consistent rule-following. Only after this minimum sample is complete can any objective assessment of the strategy's edge begin. South African traders should document each trade against the strategy's specific entry and exit rules, not just the monetary outcome, to build a genuinely useful performance record.