End-to-End Testing for Voice Agents: Inside Faraz Siddiqi and Rohan Vasishth's journey building Bluejay
“Voice AI is being adopted very very fast. We’re seeing voice AI is having the ChatGPT moment of 2022, but in 2025. At Bluejay, we want to make sure that the solutions companies are building actually work and can properly represent their brands.” - Faraz Siddiqi, CTO & co-founder of Bluejay.
Businesses across sectors are rushing to implement Voice AI, with founders developing solutions specialized for everything from restaurants to auto-part sales, and everything in between. But end-to-end testing of agents has become a critical bottleneck. To meet customer expectations, agents must be able to support a seemingly infinite number of scenarios, communication styles, and queries.
Most voice AI developers have been forced to test their agents manually, spending hours running numerous customer scenarios themselves to see how their agents react. Co-founders Faraz Siddiqi and Rohan Vasishth were no exception. While building a voice AI for restaurants, they found themselves calling the agent directly to expose it to new orders, requests, and communication styles. That meant half a day of testing every time they wanted to push an update.
Recognizing many others were encountering the same problem, Faraz and Rohan decided to pivot to building a solution that would enable teams to automate testing and ship faster with simulated customer engagements.
Introducing Bluejay: End-to-end Testing for Voice Agents Powered by Real-World Simulations
Today Faraz and Rohan are leading Bluejay, a simulation, evaluation, and production observability platform for AI voice and text agents. By simulating customer interactions across 500+ variables, such as voices, environments, and behaviors, Bluejay enables businesses to run months of customer interactions in 5-6 minutes–a task that currently takes 10-person QA teams two weeks to complete. The product helps teams eliminate guesswork and improve launch confidence while also improving efficiency.
The platform’s key features include:
- Auto-generated scenario testing based on agent goals
- A/B testing and red teaming to compare performance and find hidden vulnerabilities
- System observability with real-time metrics on success rates, hallucinations, latency, and duration
- Replays, an exciting new feature where Bluejay takes instances where your agent fails in production and simulates those scenarios in a testing environment until your agent succeeds.
As voice agents become the primary means through which customers engage with businesses, Faraz and Rohan aim for Bluejay to become “the trust layer between corporations and their customers, making sure that a company’s agents provide customers with a helpful, consistent, on-brand experience."
The Pivot That Changed Everything
Landing a position at Microsoft after college, Faraz moved to New York and began working on Copilot. But it wasn’t long before he felt a compelling urge to build something of his own.
Excited by the developments in voice AI, he started tinkering with various voice agent solutions alongside future co-founder Rohan. Before long, they’d developed a voice agent that could help restaurants automate customer calls related to ordering, reservations, and menu questions.
But they soon ran into a limiting factor—testing was painful. Every time they wanted to push an update, they’d have to call the agent pretending to be hungry customers and test 50-70 menu items and capabilities.
After building digital humans to automate their own testing, they recognized that the solution could be helpful for other founders building in the voice AI space. So they decided to pivot and develop the first end-to-end testing platform for voice agents.
Since going through YC in Spring 2025, Faraz and Rohan have raised a $4M seed round from Floodgate and are working with Fortune 50 companies, multi-national corporations, and high-growth startups, helping teams go "from shipping every 2 weeks to almost daily." For one of their enterprise clients, Bluejay became the only way to hit their QA deadlines.
In the long run, Faraz and Rohan aim for Bluejay to expand beyond voice to multimodal QA across email, text, web browsers, and all customer interaction channels.
The Importance of Persistence
In Faraz’s experience, one of the greatest determinants of success for a founder, particularly those selling to large companies, is persistence. The importance of persistence at the macro level—never giving up, keep going—is a known prerequisite for founding a company. But Faraz has found that persistence at the micro level is especially critical.
“Sales cycles can take two, three months, and there can be periods when you send three follow-up emails and get no response. That doesn't mean they're not interested, it probably just means they're busy. What pushes it forward is the founder making sure that deal gets closed. So as a founder, you have to stay doggedly persistent.”
To learn more about Faraz’s journey, you can follow him on LinkedIn and visit getbluejay.ai/
Up to 3,500 bonus and 3% cash-back on all card spend [3], 6 months off payroll, and 50% off bookkeeping for 6 months, free R&D credit.
Frequently Asked Questions
- How do I sign up for Every?
You can get started right away—just click “Get Started” and follow a short onboarding flow. Prefer a little help? One of our specialists can walk you through incorporation, banking, payroll, accounting, or whatever you need.
- What features does Every offer?
Every gives startups a complete back office in one platform. From incorporation and banking to payroll, bookkeeping, and tax filings, we take care of the operational heavy lifting—so you can spend more time building, less time managing.
- How is Every different from other tools?
Most competitors give you software. Every gives you a full-stack finance and HR team—plus smart financial tools that actually benefit founders. Earn up to 4.3% interest on idle cash and get cash back on every purchase made with your Every debit cards, routed straight back to you.
Every is not a bank. Banking services provided by Thread Bank, Member FDIC. Your deposits qualify for up to $3,000,000 in FDIC insurance coverage when Thread Bank places them at program banks in its deposit sweep program. Pass-through insurance coverage is subject to conditions. The Every Visa Business Debit Card is issued by Thread Bank, Member FDIC, pursuant to a license from Visa U.S.A. Inc. and may be used anywhere Visa cards are accepted.
- Is my data secure with Every?
We use end-to-end encryption, SOC 2-compliant infrastructure, and rigorous access controls to ensure your data is safe. Security isn’t a feature—it’s foundational.
Can I switch to Every if my company is already set up?Yes—you can switch to Every at any time, even if your company is already incorporated and running. Whether you're using separate tools for banking, payroll, bookkeeping, or taxes, we’ll help you bring everything into one place. Our onboarding specialists will guide you through the process, make sure your data is transferred cleanly, and get you set up quickly—without disrupting your operations. Most founders are fully transitioned within a week.
- What stage of startup is Every best for?
Every is designed for startups from day zero through Series A and beyond. Whether you're just incorporating or already running payroll and managing expenses, we meet you where you are. Early-stage founders use Every to get up and running fast—with banking, payroll, bookkeeping, and taxes all handled from day one. Growing teams love how Every scales with them, replacing patchwork tools and manual work with a clean, unified system.
We’re especially valuable for teams who want to move fast without hiring a full finance or HR team—giving founders more time to build, and fewer distractions from admin and compliance
- How long does onboarding take?
Onboarding with Every is fast and efficient. For most startups, the process typically takes between 3 to 7 days, depending on your specific needs and how much setup you already have in place.
If you're a new company, you'll be up and running quickly—getting your banking, payroll, and bookkeeping set up without hassle. If you’re transitioning from another system, our specialists will help you migrate your data, ensuring a smooth switch with no gaps or errors in your operations.
We guide you every step of the way, from incorporation to setting up automated payroll to handling your taxes—so you can focus on growing your business. Our goal is to make sure you're fully operational and confident in your back office in under a week.
Practical Questions to Ask to Ensure Your Bank is Well Managed
How much liquidity does the bank have on hand to cover unexpected withdrawals or shortfalls?
What percentage of the bank's deposits are invested in longer-term securities and loans, and what percentage is kept as cash reserves?
How does the bank diversify its investment portfolio to minimize potential losses and reduce risks?
