The Testing Pyramid Shows ROI


The testing pyramid can point out the greatest ROI for our tests.

Traditional Testing Pyramid

The testing pyramid is traditionally used to show where we should focus our testing time and effort. According to it, we should do mostly unit tests because they're cheap, stable and fast.

testing pyramid

[Testing pyramid graphic credit to Automation Panda]

But what if the pyramid is telling us something else?

The Opposite Interpretation

If we go big on the bottom part of the pyramid, we're writing a ton of tests. And has it every felt like it can take a ton of unit tests to really verify your code? No test is free. There will be a cost that eats at our profit margins. Those piles of unit tests have their own cost in understanding, maintenance, or even initial investment.

What if the testing pyramid could also really tell us where our best ROI, or return on investment could be?

For instance, to verify something in unit tests requires writing a lot of unit tests. But to verify something in integration tests takes fewer. It's possible that higher-order tests, like functional tests, might take even fewer total tests to get the verification we seek.

I'm talking about tests that really test something. Not just tests that make noise and make us happy because we have 400 of them.

The pyramid is pointing us to the pointy part -- the part that's thin and not fat. The message sounds worthy:

We can spend more time writing source code and less time plumbing tests if we focus on that part of the pyramid.

Is the pyramid sending you a similar message?