Vivek Yadav, an engineering manager at Stripe, walks through how he built a multi-year regression testing and simulation framework on Apache Spark. He chose Spark for its distributed processing power, letting him crunch vast historical datasets efficiently and slot tests into familiar versioned workflows.
Along the way, Yadav shares practical tips on structuring data pipelines, tackling edge cases in years of records, and keeping performance humming as your test suite scales. If you’re curious about marrying big-data horsepower with “traditional” engineering practices, his Spark-powered approach is a great blueprint.
Watch on YouTube
Top comments (0)