How to Win at Building AI Products
2025.22 - Your success is not about getting there first or fast. It is getting there in one piece, ready to take on everything. How do you do that? Two things that will make all the difference.
You are reading a paid post from my newsletter — The Art of Doing Technical Program Management. I write with an aim to demystify the art of technical program management and deliver proven real-world strategies, practical advise and tips, and actionable frameworks to help you level up as a Technical Program Manager.
If you already are a subscriber and found this essay helpful, please share it with your colleagues and network. I am sure others might find it useful as well.
Velocity > Speed
Every company racing to build AI products is repeating the same mantra: speed is everything. Move fast, launch quickly, and iterate later.
But speed alone isn’t enough. What really wins is velocity; the equation for velocity in my mind is speed plus direction, intent, and clarity.
After observing the industry, helping build AI products myself for the past few years, I have come to the conclusion that companies that want to win at the AI Race need to excel at two critical practices:
Running a robust beta testing program before launch
Committing to red-teaming and penetration testing as non-negotiable
If you’re a TPM tasked with planning the next AI product launch, these two phases need to sit firmly on your critical path. Treat them either as phases or milestones but do not skip them.
Why this matters
In traditional software launches, manual regression testing and automation were enough. Beta testing was optional. Red-teaming? Too costly or time-consuming or sometimes not considered necessary.
AI changes that.
A single failure isn’t just a bug, it’s a trust breaker. Hallucinations, unsafe responses, exploitable vulnerabilities… all of these can erode confidence in your product and brand.
That’s why beta testing and red-teaming aren’t “nice to haves” anymore. They’re essentials.
Beta testing: your first line of truth
Beta testing provides real-world feedback that labs and internal QA can’t replicate. For AI products, it answers three key questions:
Keep reading with a 7-day free trial
Subscribe to The Art of Doing Technical Program Management to keep reading this post and get 7 days of free access to the full post archives.