Partnerships

Get your ticket

Call to action
Your text goes here. Insert your content, thoughts, or information in this space.
Button

Back to speakers

Tarunjit
Singh
Director, Software Engineering
Mastercard
Tarunjit is a Director of Software Engineering at Mastercard, leading teams responsible for building scalable, secure technology solutions. With experience across software architecture, engineering leadership and delivery, Tarunjit focuses on translating complex business requirements into reliable products and platforms that support Mastercard’s global payments ecosystem.
Button
12 November 2026 13:30 - 14:00
Taming non-determinism: A framework for evaluation and observability in autonomous agent trajectories
Deploying agentic AI in production introduces a unique engineering challenge: debugging non-deterministic execution paths. Unlike traditional software, an agent's "code" is a dynamic interplay of prompt context, model weights, and external tool outputs. This talk presents a rigorous engineering methodology for agents, focusing on quantifying agent performance and analyzing trajectories. Key takeways: →Trajectory evaluations: Analyzing the "Reasoning Trace" using a secondary judge model to detect hallucinated logic steps or tool misuse. → Cost-latency trade-offs: Optimizing token usage via dynamic context compression and speculative execution of tool calls. → Sandboxing & side-effects: Technical implementation of ephemeral execution environments to safely contain agentic code execution.