← All essays
Creative Velocity 5 min

Volume Testing Changes Everything

By Manuel Zamora · 2026-04-16

The biggest lie in advertising is the creative brief. Not because briefs are bad. Because briefs assume you know what will work before you make it. You sit in a room, you brainstorm angles, you write a brief, you produce 3 variants of the winning concept, and you launch. The process is optimized for efficiency. It minimizes production cost by narrowing the field before any creative is produced. The problem is that narrowing the field before testing is how you miss the angle that would have outperformed everything else.

Volume testing inverts the process. Instead of narrowing first and producing second, you produce first and narrow second. Generate 30 variants across 10 angles. Run them all. Let the data tell you which angles resonate. Then double down on the winners with more variants. The creative brief becomes a creative debrief, written after the data is in, not before.

This sounds wasteful until you do the math. Under the old model, producing 30 ad variants costs $3,000-$10,000 (agency) or 2-3 weeks (in-house). The cost forces you to pre-filter, which means you launch with 3 variants and hope one works. Under the AI model, producing 30 variants costs $30-$50 and takes an afternoon. The cost of not testing 30 variants is higher than the cost of testing them. The economics have flipped, and most marketers have not updated their process to match.

The data from volume testing is categorically different from the data you get testing 3 variants. With 3 variants, you learn which of your three ideas performed best. With 30 variants across 10 angles, you learn which angles your audience responds to. That is a deeper insight. You are not just optimizing within your assumptions. You are discovering assumptions you did not know to make.

I ran this experiment with Rivalize last year. Our traditional approach was to brainstorm 4-5 ad concepts in a meeting, produce the top 3, and test them. Win rates ranged from 1.2% to 2.1% CTR. Then we switched to volume testing: we generated 40 variants across 12 angles, including several angles that nobody in the meeting would have suggested. The winning angle, a direct challenge format ("Your competitor just launched X. What is your move?"), came from angle number 9. It hit 4.7% CTR. Nobody in the brainstorm would have proposed it because it felt too aggressive. The data disagreed.

The psychological barrier to volume testing is ego. When you produce 3 ads, each one represents a significant investment of creative energy. You have opinions about which one is best. You are emotionally attached. When one underperforms, it feels personal. Volume testing removes ego from the equation. You do not have opinions about 30 variants. You have hypotheses about 10 angles, and you let the data validate or invalidate them. The emotional temperature drops and the decision quality rises.

There is a practical concern about quality. If you generate 30 variants, are not most of them garbage? Surprisingly, no. When the generation engine has strong Brand DNA, the quality floor rises significantly. You might not use all 30, but 20-25 are typically publishable. The variation is in angle and emphasis, not in quality. And the 5-10 you do not use are still informative because they show you which directions your brand does not stretch to cover.

Another concern is audience fatigue. If you run 30 ads simultaneously, will your audience see too many variants? In practice, this is rarely a problem. Platform algorithms do their own selection, showing each user the variant most likely to resonate with them. Running 30 variants does not mean each person sees 30 ads. It means the algorithm has 30 options to choose from when deciding what to show each person. More options, better matching, higher performance.

The cadence that works best is weekly batches. Generate a new batch of 20-30 variants every Monday. Launch them Tuesday. Review performance Friday. Kill underperformers, note winning angles, feed those insights into next Monday's generation. After a month, you have a clear map of which angles, formats, and messages your audience responds to. That map is worth more than any creative brief ever written.

Volume testing also changes your relationship with failure. When you produce 3 ads and all 3 underperform, it feels like a crisis. When you produce 30 ads and 10 underperform, it feels like data. The emotional weight per unit of creative drops as volume increases, which means you make better decisions because you are not protecting your ego.

Mani makes volume testing the default workflow. Your daily queue serves up fresh variants every morning. You swipe right on the ones you want to publish, left on the ones you do not. The engine learns from your swipes and adjusts. Over time, the hit rate climbs because the engine gets better at generating within your brand and angle preferences. But the volume stays high because volume is how you find the angles you would never have thought to test.

volume-testing creative-testing ad-performance

Start volume testing with mani

Paste your URL. Get brand-matched creative in 90 seconds.

Get started free