Should You Use gRPC in Your AI Tooling Stack?

Jennifer Amah from Ostrom walks us through her experience building MergeWhisperer, an AI-powered code review assistant, and why she considered gRPC to speed up communication between services. She reflects on the real-world performance boosts, developer-experience trade-offs and the scenarios where gRPC truly shines in a modern, AI-heavy pipeline.

Rather than a deep technical dive, this talk offers practical takeaways: a list of questions to ask, red flags to watch for, and whether gRPC might be the missing piece (or an overkill) in your own AI tooling stack.

Watch on YouTube