What happens when something gets fast and 1,000 times less expensive? The history of photography has the answer.
Photos used to be precious. Each one was expensive, took time to develop, and often turned out poorly. Now digital photos, snaps, and instagrams are taken trillions of times a year.
As photography got fast, cheap, and built into your phone, the volume exploded and its job changed.
That's Jevons Paradox in action. As technology makes something more efficient, consumption goes up, often in new and unexpected ways. Photos are one example, but the same pattern ran through spreadsheets, word processing, coding, and more. Making got cheap, output soared, and the work shifted to producing output that made a difference.
That paradox is about to hit every creative medium: copy, code, designs, videos, websites, apps, and more. As outputs get cheap, volume explodes and the approach to work must change.
We see this firsthand in how people create and optimize online experiences. An online experience has a job to do. With AI the challenge shifts from making something to making something good that gets results. AI can generate almost infinite options. Traditional approaches to testing and iterating cannot keep up.
Old school experiments (aka split tests, AB testing) are like old school photos.
→ Slow: 4 weeks to get results
→ Expensive: tools, a team, and lots of website traffic
→ Failure prone: 89% of what people believe will work actually fails (ouch!)
The world needs a way to validate as fast as AI can build. My venture,
DoWhatWorks, is solving that problem.
We're about to launch "Instant Split Tests." These are simulated tests trained on 1 million data points from real tests across all top brands. We have patented tech that's been capturing tests for years.
You give it ideas, designs, copy, or live sites, and it pressure-tests them as you go. It then helps you validate and generate better options based on what's proven to work, as needed.
Our engine is trained on real split tests across brands, not guesses or conventional wisdom, and keeps learning from every new one. That's why the methodology wins 7X more often than traditional testing. It's also what sets Instant Split Tests apart from LLMs and synthetic data.
If you want early access, sign up using the link below. We are onboarding new customers in waves.
Our aim is to change how people iterate by making testing fast, affordable, effective, and available to brands of all sizes. We're excited to see what people reinvent with it.
#jevonsparadox #ABtesting #experiments #growth #plg
Hat tip to
Scott Heiferman for showing me this graph a decade ago.