View profile for Shreya Rajpal

CEO and Cofounder, Guardrails AI

Today we’re announcing ❄️ Snowglobe - the simulation engine for AI chatbots! Snowglobe makes it easy to simulate realistic user conversations at scale so you can reveal the blind spots where your chatbots fail, and generate labeled datasets for finetuning them. We built Snowglobe to solve a problem that we ran into again and again through our journey building Guardrails for the last two years — evaluating AI agents is very challenging. If you spend days and weeks manually creating test scenarios for your chatbots, Snowglobe generates hundreds of realistic user conversations in minutes. How do you even formulate a test plan for evaluating something that can take infinite inputs? How do you deal with the many edge cases that break AI chatbots in prod all the time? Interestingly, self driving cars had the exact same problem. They built high fidelity simulation environments to systematically test cars under a wide range of scenarios. Waymo had 20+ million miles on real roads, but 20+ BILLION miles in sim so they had the confidence needed to ship. Today, we’re excited to bring that same tooling to AI agents with the general availability of Snowglobe!

Sergey Sviridov

AI/ML | NEXT AI, CDL Alumni

1mo

Amazing work Shreya Rajpal and the team! 🎉

Prithvi Raj Nair

Career break - AI projects | Ex PM @Meesho, Associate @BCG, SWE @[Nutanix, Microsoft] | CS @ BITS Pilani ’20

4w

Shreya Rajpal this is amazing! Can I use snowglobe to run such a simulation in the design phase itself so that I can design the system with much more knowledge of the edge cases ?

Like
Reply
Jayme Hoffman

Working on Consumer AI | YC alum

1mo

I hate having to manually test and break chatbots. This makes so much sense. Congrats on the launch Shreya Rajpal !!!

Joe Heitzeberg

Working to Expand AI Tinkerers Globally

1mo

Such a great direction.. compelling, needed and not something most teams will build themselves (regardless of which of the 29 ai agent frameworks they are using, they need this and it’s hard to build!)

Ghita Houir Alami

Co-Founder and CEO at ZeroEntropy (YC W25) - We're Hiring!

1mo

This is super cool congrats Shreya Rajpal I think the challenging part is also to figure out _why_ there was a failure It could come from pure LLM hallucination, wrong tool use, wrong context

Rachel Nguyen

🍏→🍺 AI & Blockchain Full-Stack Dev | Co-Founder @IntelliGrowthAI + @GazeFiAI | UC Berkeley CS 🐻

1mo

Congrats Shreya! 🎉

Manikandan Krishnamurthy

Technology Director|Artificial Intelligence|Machine Learning|Data Analysis | Product Owner| Program Management| Cloud Architect |Digital Transformation|Fintech Payments| Clinical Research | HealthCare | MBA| PMP | ITIL

1mo

Impressive Shreya. How do I test Snowglobe?

Neel Shah

Senior Technology Lead | AI & Compliance Solutions | Product & Engineering Strategy | Oracle APEX & Data Science

1mo

Congrats Shreya! 🎉

Giovanni Beggiato

I build AI systems that automate lead generation | Founder, LoopifyAI | Amazon, ex-P&G, ex-PwC

1mo

Addressing edge cases is important for chatbot success. Snowglobe helps uncover those tricky situations.

Mahesh Ram

3X Founder/CEO | former Head of AI at Zoom | Founding CEO at Solvvy (Conversational AI) | Advisor

1mo
See more comments

To view or add a comment, sign in

Explore content categories