Scaling AI With Guardrails: Agentic Systems, Evals, And FinTech Innovation, Justin Stottlemyer (Intuit)

Featured

Discover Dialogues

Overview

In this episode of TechDogs Discover Dialogues, Justin Stottlemyer of Intuit discusses what it really takes to scale AI in enterprise and FinTech environments. Drawing on decades of experience across eBay, PayPal, Facebook, Shutterfly, and Intuit, Justin explains why AI transformation is not just a tooling shift—it is an operating model shift.

The conversation explores how organizations can prepare data for AI, why coordination overhead often matters more than the technology itself, and how leaders should think about integrating LLMs, agentic systems, and multimodal architectures into production environments. Justin also shares his perspective on human-in-the-loop design, evaluation strategies for non-deterministic systems, and the build-vs-buy decisions enterprises face in the AI era.

This episode is especially relevant for technology leaders, product teams, architects, and innovation decision-makers navigating AI adoption in regulated industries such as FinTech. Key themes include AI readiness, enterprise architecture, developer productivity, eval engineering, governance, and leadership with guardrails.

In This Episode, We Cover:

Justin’s journey across early internet and commerce platforms and what it taught him about availability and scaling
Why thinking in 1000x forces better architectural decisions than 10x planning
What changes when LLMs, agents, and multimodal systems enter the production stack
Data readiness for AI and why access, security, and structure matter more than ever
The real architectural challenge: coordination overhead across teams, not just tools
FinTech AI: combining non deterministic reasoning with deterministic APIs for accuracy and trust
Human in the loop and validation strategies to reduce risk in AI powered workflows
Build vs buy in AI: what to develop internally and what to leverage externally
Evals and the Agentic Development Lifecycle, and why evaluation strategy is now a core competency
Leadership for AI first organizations: gateway mindset with guardrails

Key takeaways:

AI changes the pace of delivery, so leaders must measure where the next bottleneck is.
Data must be AI ready to unlock real value, without compromising security.
Non deterministic systems still need rigor, testing, and evaluation loops across the lifecycle.
The winners are teams that democratize access safely and invest in education and adoption.

The episode also dives into one of the most practical topics in enterprise AI today: the build vs buy decision. Justin explains why leaders need a balanced strategy—building internal skills, judgment, and business-specific capabilities while also leveraging external tools, models, and platforms where it makes sense. Instead of overinvesting in recreating what the frontier model ecosystem is already advancing quickly, organizations should focus on the areas where they can create durable value, such as domain knowledge, guardrails, workflows, and internal adoption strategies.

A particularly valuable part of the discussion centers on evals and what Justin describes as the emerging agentic development lifecycle. He explains why non-deterministic AI systems cannot be managed with traditional software testing alone, and why online evals, offline evals, and human evals are becoming critical capabilities for any team deploying AI in production. For leaders, builders, and architects, this episode offers a practical framework for thinking about trust, measurement, iteration, and accountability in AI-first environments.

The conversation also explores how AI is reshaping FinTech products and customer experiences. Justin shares his perspective on combining non-deterministic AI reasoning with deterministic APIs and workflows to create systems that are both intelligent and dependable. He discusses how AI can support more personalized and proactive financial experiences, while still keeping humans in the loop for higher-stakes decisions. The episode also touches on the future role of blockchain, stablecoins, and smart contracts in enabling more automated and trusted financial workflows.

Overall, this conversation is highly relevant for CIOs, CTOs, engineering leaders, product teams, architects, and innovation decision-makers looking to understand how AI is changing enterprise systems, development culture, FinTech experiences, and leadership itself. It is a thoughtful discussion on scaling AI with guardrails, enabling teams without losing control, and building organizations that are ready not just to adopt AI, but to evolve with it.

About Justin Stottlemyer

Justin Stottlemyer is a Distinguished Engineer at Intuit and part of the FinTech AI Center of Excellence, where he focuses on AI transformation, developer productivity, and building scalable foundations for agentic experiences.

Thu, Apr 23, 2026

Nikhil Sonawane

Lead, Media Relations And Partnerships TechDogs

Nikhil Sonawane is an experienced content writer and media strategist with a strong focus on tech storytelling and brand amplification. His expertise spans B2B narratives, cross-channel messaging, and thought leadership development across enterprise ecosystems. Whether writing or managing partnerships, Nikhil bridges technical concepts with storytelling that drives visibility, engagement, and clarity. He brings a grounded, purpose-driven approach to every project he leads.

Liked what you read? That’s only the tip of the tech iceberg!

Explore our vast collection of tech articles including introductory guides, product reviews, trends and more, stay up to date with the latest news, relish thought-provoking interviews and the hottest AI blogs, and tickle your funny bone with hilarious tech memes!

Plus, get access to branded insights from industry-leading global brands through informative white papers, engaging case studies, in-depth reports, enlightening videos and exciting events and webinars.

Dive into TechDogs' treasure trove today and Know Your World of technology like never before!

Disclaimer - Reference to any specific product, software or entity does not constitute an endorsement or recommendation by TechDogs nor should any data or content published be relied upon. The views expressed by TechDogs' members and guests are their own and their appearance on our site does not imply an endorsement of them or any entity they represent. Views and opinions expressed by TechDogs' Authors are those of the Authors and do not necessarily reflect the view of TechDogs or any of its officials. While we aim to provide valuable and helpful information, some content on TechDogs' site may not have been thoroughly reviewed for every detail or aspect. We encourage users to verify any information independently where necessary.

Tags:

Agentic AI AI Infrastructure LLM Agents AI Readiness Enterprise Data For AI Eval Engineering Offline Evals Online Evals Human Evals Agent Development Lifecycle AI Transformation Build Vs Buy AI Fintech AI Developer Productivity AI Governance

Join The Discussion