Partnership opportunities

Tickets

Call to action
Your text goes here. Insert your content, thoughts, or information in this space.
Button

Back to speakers

Jeff
Singer
VP, Engineering
DraftKings
Jeff is a Vice President of Engineering at DraftKings, he leads engineering teams building highly scalable, customer-facing platforms that power millions of users in one of the world's largest digital sports entertainment and gaming companies. With a background in engineering leadership across large-scale consumer technology, he specializes in building resilient, high-performance products, leading distributed teams, and driving engineering excellence. Jeff is passionate about modern software architecture, AI-enabled development, and creating technology organizations that can innovate rapidly while operating reliably at enterprise scale.
Button
29 October 2026 11:00 - 11:30
Taming non-determinism: A framework for evaluation and observability in autonomous agent trajectories
Deploying agentic AI in production introduces a unique engineering challenge: debugging non-deterministic execution paths. Unlike traditional software, an agent's "code" is a dynamic interplay of prompt context, model weights, and external tool outputs. This talk presents a rigorous engineering methodology for agents, focusing on quantifying agent performance and analyzing trajectories. Key takeways: →Trajectory evaluations: Analyzing the "Reasoning Trace" using a secondary judge model to detect hallucinated logic steps or tool misuse. → Cost-latency trade-offs: Optimizing token usage via dynamic context compression and speculative execution of tool calls. → Sandboxing & side-effects: Technical implementation of ephemeral execution environments to safely contain agentic code execution.