High Signal: Data Science | Career | AI - Episodes Tagged with “Ai”

Episode 40: The Economic Reality of AI: Friction, Talent, and the Future of the Firm

Delphina — Mon, 25 May 2026 23:00:00 -0400

Steve Tadelis, Professor of Economics at UC Berkeley and former senior economist at eBay and Amazon, joins High Signal to bridge the gap between economic theory and the high-stakes reality of data science and AI. Drawing on his experience at the forefront of the world’s largest marketplaces, Steve discusses the "invisible friction" that prevents organizations from acting on data: a combination of misaligned incentives, organizational inertia, and the "Upton Sinclair problem," where leaders are effectively paid not to understand new paradigms.

The conversation moves from the "frustratingly obvious" opportunities left on the floor during eBay’s early years to the relentlessly scientific culture of Amazon. Steve explains why surface-level metrics like conversion rates often mask underlying rot in user retention and how rigorous experimentation, such as his famous $20 million search-ad experiment, can expose the difference between genuine growth and mere navigational intent. We also explore the structural shifts of the AI era, where Steve offers an important counter-narrative: rather than leveling the playing field, AI may act as an "unequalizer" that exponentially rewards those with the deepest critical thinking skills.

LINKS

Episode 38: Why AI Won’t Fix Your Data Culture, It Will Only Amplify It (And What To Do About It)

Delphina — Thu, 16 Apr 2026 18:00:00 -0400

Noah Bruegmann, President of Data CRT, joins High Signal to discuss how to move your data function from a cost center to a strategic "value center". He explains how AI amplifies your existing data culture, the importance of "no-assistance" reporting, and how rebranding documentation as "Context" can finally secure executive buy-in. Drawing on 15 years of experience spanning trading floors and Silicon Valley startups, Noah argues that for too long, data teams have been submerged under an "iceberg" of invisible data preparation. He details how the arrival of LLMs and agentic tools is fundamentally shifting this landscape, automating technical drudgery and allowing data professionals to transition into what he calls "Jack Ryan" mode: acting as high-level intelligence analysts rather than mere number crunchers.

We dig into the architectural and psychological shifts required to navigate this new era and why the most valuable skill in an AI-augmented world is no longer mastering SQL syntax, but "problem framing": the ability to reduce business ambiguity into high-leverage insights. Noah cautions that while AI offers a dopamine hit of instant answers, it demands a new discipline of rigorous verification to avoid automated hallucinations. The conversation provides a clear directive for executives: move past the "ticket-taker" model and start treating the data team as the essential "left-side brain" for organizational decision-making.

LINKS

Episode 37: Engineered Intelligence and The Data Science Problem in AI

Delphina — Thu, 02 Apr 2026 01:00:00 -0400

Jordan Morrow, SVP of Data & AI Transformation at AgileOne and the "Godfather of Data Literacy," joins High Signal to discuss the shift from being "data-driven" to becoming "AI-enabled." Jordan warns that many organizations are walking into the same traps that derailed the data science era a decade ago: prioritizing expensive tooling and hype over the cultural change and literacy required to actually move the needle. The pattern is already visible: enterprise AI projects are failing at around 90%, while individuals doing shadow AI are quietly thriving. The catch is that shadow AI brings its own risks, with people feeding sensitive data into public models without governance. He argues that because AI is probabilistic rather than deterministic, the bottleneck for success has shifted from technical coding ability to a user’s ability to apply "Engineered Intelligence," a blend of machine capability and human emotional intelligence.

LINKS

Episode 36: AI and the Judgment Problem in Data Science

Delphina — Thu, 19 Mar 2026 02:00:00 -0400

Dawn Woodard (Distinguished Engineer, LinkedIn), Andrés Bucchi (LATAM Airlines), and Jeremy Hermann (CEO & Co-Founder, Delphina) join High Signal for a deep dive into the shifting architecture of data science & analytics in the era of AI. As the industry moves from static dashboards to vibe coding and conversational querying, this panel of industry veterans explores why traditional data fundamentals—strict cataloging, verifiable outputs, and a single source of truth—are suddenly the most critical bottlenecks in the AI era.

We dig into the sobering reality of the "source of truth" problem, where the speed of AI-generated code far outpaces our ability to define what "correct" actually looks like in a complex enterprise. The conversation reveals how AI is breaking legacy experimentation platforms, the transition of the data analyst into a "verifier" of AI-generated workflows, and why "headless" security architectures are essential for the next generation of autonomous agents. From the limitations of LLMs in causal reasoning to the challenges of integrating AI into "brownfield" enterprise codebases, this discussion provides a grounded framework for leaders navigating the gap between AI hype and operational reality.

LINKS

Episode 35: Beyond Online Experimentation: Generative Software That Optimizes Itself

Delphina — Wed, 04 Mar 2026 20:00:00 -0500

Martin Tingley, Head of Windows Experimentation at Microsoft and former Head of the Experimentation Platform Analysis Team at Netflix, talks about why humans are the bottleneck in experimentation, and how a five-level maturity framework points the way toward self-optimizing software.

Our conversation traces the path from basic hypothesis testing to a frontier where Generative AI creates, evaluates, and refines product variants in a closed loop. We explore the architectural shift required to move from testing single variants to optimizing entire parameter spaces, and how startups are already using AI to generate production-ready landing pages for Fortune 500 companies in hours rather than weeks. Tingley also shares a strategic lens on "experimentation programs," explaining how plotting the distribution of treatment effects across different product areas can serve as a powerful tool for capital allocation and high-level strategy.

LINKS

Episode 31: Why Data Governance In Your Org is Broken (And How to Fix It)

Delphina — Mon, 29 Dec 2025 19:00:00 -0500

Cara Dailey, VP and Head of Data Strategy at Early Warning (the parent company of Zelle), joins High Signal to discuss the evolution of high-stakes data leadership and governance. From her early work in online advertising at DoubleClick to shaping data strategy at Nike and holding Chief Data Officer roles at Bank of the West and T. Rowe Price, Cara has seen every iteration of the data leader’s role. Now, she’s navigating her 'product era'—shaping the data strategy for Early Warning's Decisions Intelligence business, where she leverages rich financial data and data science to drive fraud monitoring and modeling.

In this episode, Cara shares her pragmatic 'progress over perfection' approach to governance, why she’s abandoning monolithic platforms in favor of incremental data products, and her 80/20 rule for balancing operational rigor with innovation. We also discuss why 'loving' data isn't enough—you have to actually 'take care' of it—and why AI is finally shining a spotlight on the often-neglected fundamentals of data stewardship and conversational BI.

LINKS

Episode 29: Why AI Adoption Fails: A Behavioral Framework for AI Implementation

Delphina — Thu, 27 Nov 2025 20:00:00 -0500

Liz Costa of the Behavioral Insights Team returns to High Signal to deliver a critical behavioral science playbook for the AI era focused on human and business impact. We discuss why the potential of AI can only be fulfilled by understanding a single bottleneck: human behavior. The conversation reveals why leaders must intervene now to prevent temporary adoption patterns from calcifying into permanent organizational norms, the QWERTY Effect, and how to move organizations past simply automating drudgery to achieving deep integration.

We dig into why AI adoption is fundamentally a behavioral challenge, providing a diagnostic framework for leaders to identify stalled progress using the Motivation-Capability-Trust triad. Liz explains how to reframe AI deployment by leveraging Loss Aversion to bypass employee skepticism, and how to design workflows that improve human reasoning rather than replace it. The conversation provides clear guidance on intentional task offloading, the power of using AI to stress-test decisions, and why sanctioning employee experimentation is essential to discovering high-value use cases.

LINKS

Episode 28: From Context Engineering to AI Agent Harnesses: The New Software Discipline

Delphina — Thu, 13 Nov 2025 00:15:00 -0500

Lance Martin of LangChain joins High Signal to outline a new playbook for engineering in the AI era, where the ground is constantly shifting under the feet of builders. He explains how the exponential improvement of foundation models is forcing a complete rethink of how software is built, revealing why top products from Claude Code to Manus are in a constant state of re-architecture simply to keep up.

We dig into why the old rules of ML engineering no longer apply, and how Rich Sutton's "bitter lesson" dictates that simple, adaptable systems are the only ones that will survive. The conversation provides a clear framework for leaders on the critical new disciplines of context engineering to manage cost and reliability, the architectural power of the "agent harness" to expand capabilities without adding complexity, and why the most effective evaluation of these new systems is shifting away from static benchmarks and towards a dynamic model of in-app user feedback.

LINKS

Episode 26: Gen AI's True Cost: Why Today's Wins Are Tomorrow's Debts

Delphina — Thu, 16 Oct 2025 01:00:00 -0400

Vishnu Ram Venkataraman (Generative AI Executive & Entrepreneur; former AI Leader at Credit Karma and Intuit) joins High Signal to unpack the true cost of generative AI. Having scaled AI solutions impacting over 140 million users, Vishnu reveals why the ease of shipping Gen AI prototypes often masks significant operational and engineering debts, challenging the conventional wisdom of rapid deployment.

We dive deep into the strategic shift from traditional ML to Gen AI, discussing why the shelf value of code is dramatically falling, how to design new organizational triads for continuous iteration, and the critical differences in testing probabilistic AI systems. The conversation also explores how to manage risk with sensitive data, the power of synthetic data in early development, and which mature ML practices remain indispensable in the new AI era.

LINKS

Episode 25: How Data-Driven Growth Redefined a Media Giant

Delphina — Thu, 02 Oct 2025 00:00:00 -0400

Sergey Fogelson (VP of Data Science, Televisa Univision) joins High Signal to reveal how the world’s largest Spanish-language media company built a sophisticated data engine from the ground up. This transformation fueled a tenfold expansion of its digital streaming business by redefining how the company connects with 300 million viewers worldwide. At the heart of this success is a proprietary household graph that creates a single, privacy-first view of a massive and culturally diverse audience.

We dig into the journey from basic data unification to building production-ready recommendation engines, how his team uses embeddings on user behavior to uncover surprising connections in content consumption, and the trade-offs between investing in internal data tools versus direct revenue-driving products. The conversation also explores a pragmatic framework for AI adoption, showing how foundational machine learning often outperforms chasing the latest trends and where LLMs can deliver real, measurable value.

LINKS

Episode 24: Rebuilding an Airline for the 21st Century: LATAM's Data-Driven Transformation

Delphina — Mon, 15 Sep 2025 06:00:00 -0400

Andrés Bucchi (Chief Data Officer, LATAM Airlines) joins High Signal to unpack how a century-old airline reinvented itself with data and AI—and how that transformation is unlocking value from fuel efficiency to fraud detection. LATAM has built a massive data operation, experimenting across everything from pricing to operations, while customers benefit from a more reliable and secure travel experience.

We dig into how LATAM fostered an experimentation culture, why existing data infrastructure is a critical asset, and how the biggest bottleneck in AI adoption isn't the technology itself, but human decision-making. The conversation also looks ahead to the future of generative AI as a software engineering problem, and the organizational changes needed to unlock its full potential.

LINKS

Episode 23: Why Most AI Agents Fail (and What It Takes to Reach Production)

Delphina — Tue, 02 Sep 2025 06:00:00 -0400

Anu Bharadwaj (President, Atlassian) joins High Signal to unpack how humans and AI agents will work together across the enterprise, and how that shift could change the very nature of teamwork. Atlassian employees have already built thousands of agents across product, marketing, engineering, and HR teams, while customers like HarperCollins are cutting manual work by 4x as industries from publishing to finance rethink their workflows.

We dig into how Atlassian’s culture enables bottom-up experimentation, why grounding and reliability are critical for adoption, and how non-technical teams are often the ones creating the most useful agents. The conversation also looks ahead to the frontiers of multiplayer agent collaboration, proactive and ambient workflows, and the governance and compliance challenges enterprises will face as agents move from tools to teammates.

LINKS

Episode 22: Why a Trillion Dollars of Market Cap Is Up for Grabs (and How AI Teams Will Win It)

Delphina — Tue, 19 Aug 2025 03:00:00 -0400

Tomasz Tunguz (Theory Ventures) joins High Signal to unpack why a trillion dollars of market cap is up for grabs as AI reshapes enterprise software. He explains why workflows are now changing faster than packaged software can keep up, how “liquid software” is redefining CRM and marketing automation, and why background agents will require a new kind of “agent inbox.” We discuss the compounding errors that arise when tools are chained too finely, the hidden AI technical debt accumulating in today’s systems, and why modular stacks—mixing local and cloud models—will beat monolithic apps. The conversation also surfaces early memory architectures, what breaks when one IC manages 100 agents, and how these shifts change the real bottlenecks in scaling AI.

LINKS

Episode 19: Defaults, Decisions, and Dynamic Systems: Behavioral Science Meets AI

Delphina — Thu, 03 Jul 2025 09:45:00 -0400

Lis Costa, Chief of Innovation and Partnerships at the Behavioural Insights Team, joins High Signal to explore how behavioral science is reshaping public policy, digital platforms, and machine learning.

She explains how defaults influence behavior at scale, why personalization and chatbots are unlocking new kinds of interventions, and what happens when AI systems meet real-world complexity. We also discuss the limits of nudging, the promise of boosting, and why building for human decision-making requires more than just good models.

We dig into why AI adoption is fundamentally a behavioral challenge, providing a diagnostic framework for leaders to identify stalled progress using the Motivation-Capability-Trust triad. Lis explains how to reframe AI deployment by leveraging Loss Aversion to bypass employee skepticism, and how to design workflows that improve human reasoning rather than replace it. The conversation provides clear guidance on intentional task offloading, the power of using AI to stress-test decisions, and why sanctioning employee experimentation is essential to discovering high-value use cases.

LINKS

Episode 18: High-Stakes AI Systems and the Cost of Getting It Wrong

Delphina — Thu, 19 Jun 2025 05:15:00 -0400

Sudarshan Seshadri—VP of AI, Data Science, and Foundations Engineering at Alto Pharmacy—joins us to explore what it takes to build high-stakes AI systems that people can actually trust. He shares lessons from deploying machine learning and LLMs in healthcare, where speed, safety, and uncertainty must be carefully balanced. We talk about designing AI to support pharmacist judgment, the shift from bottlenecks to decision backbones, and why great data leaders are really architects of how irreversible decisions get made.

LINKS

Episode 17: The Incentive Problem in Shipping AI Products — and How to Change It

Delphina — Thu, 29 May 2025 11:00:00 -0400

Roberto Medri, VP of Data Science at Instagram, explains why most experiments fail, how misaligned incentives warp product development, and what it takes to drive real impact with data science. He shares what teams get wrong about launches, why ego gets in the way of learning, and how Instagram turned Reels from a struggling product into a global success. A candid look at product, data, and decision-making inside one of the world’s most influential platforms.

LINKS

Episode 13: The End of Programming As We Know It

Delphina — Thu, 27 Mar 2025 01:00:00 -0400

Tim O’Reilly—founder of O’Reilly Media and one of the most influential voices in tech—argues we’re not witnessing the end of programming, but the beginning of something far bigger. He draws on past computing revolutions to explore how AI is reshaping what it means to build software, why real breakthroughs come from the edge—not incumbents—and what it takes to learn, teach, and build responsibly in the age of AI.

LINKS

Episode 10: AI Won't Save You But Data Intelligence Will

Delphina — Wed, 12 Feb 2025 18:15:00 -0500

Ari Kaplan—Global Head of Evangelism at Databricks and a pioneer in sports analytics—explains why businesses fixated on AI often overlook the real advantage: making better decisions with their own data. He shares lessons from his work building analytics teams for Major League Baseball, advising McLaren’s F1 strategy, and helping companies apply AI where it actually works—without falling into hype-driven traps.

SHOW NOTES

Episode 9: Why 90% of Data Science Fails—And How to Fix It -- With Eric Colson

Delphina — Thu, 30 Jan 2025 15:00:00 -0500

In this episode of High Signal, Eric Colson—former Chief Algorithms Officer at Stitch Fix and VP of Data Science and Machine Learning at Netflix—breaks down why most companies fail to unlock the full potential of their data science teams. Drawing from years of experience leading data functions at top tech companies, Eric shares how organizations can shift from treating data scientists as a service function to empowering them as strategic drivers of business impact.

Key topics from the conversation include:

Data Science as a Strategic Function: Why many companies limit their data teams to answering business requests instead of leveraging their ideas for competitive advantage.
Beyond Skills—The Power of Cognitive Repertoires: How data scientists' unique ways of framing problems can lead to breakthrough innovations.
Trial and Error as a Competitive Advantage: Why most experiments fail—but scaling experimentation is the key to big wins.
Decoupling Algorithms from Applications: How separating data science from engineering enables rapid iteration and direct business impact.
Shifting from Cost Center to Revenue Generator: Practical steps for structuring data teams to drive measurable value and long-term success.

💡 Tune in to learn how leading companies structure their data teams for impact, why experimentation beats rigid planning, and how treating data science as a strategic function can unlock new business opportunities.

You can find more on our website: https://high-signal.delphina.ai/

SHOW NOTES

Episode 8: From Zero to Scale: Lessons from Airbnb and Beyond

Delphina — Thu, 09 Jan 2025 00:00:00 -0500

In this episode of High Signal, Elena Grewal—former Head of Data Science at Airbnb, political consultant, professor at Yale, and ice cream shop owner—shares her journey of building data teams that scale across vastly different contexts. Drawing on her experiences in tech, consulting, and brick-and-mortar, Elena offers practical lessons on leadership, trust, and experimentation.

Key topics from the conversation include:

From Zero to Scale: How Elena built Airbnb’s data science function from the ground up, scaling it to a 200-person team while driving impact across the organization.
Trust and Team Culture: Why trust is foundational for building effective teams, fostering creativity, and empowering data scientists to drive results.
Applying Data Science Across Contexts: Lessons learned from using data to inform decisions in politics, academia, and even running an ice cream shop.
Experimentation and Iteration: Insights into tailoring experimentation methods to fit different scales, from small businesses to tech giants.
Critical Thinking and Data: How Elena equips the next generation of leaders at Yale to ask better questions, assess data quality, and think critically about evidence.

💡 Tune in to explore how data science principles can scale across industries, the leadership skills required to build impactful teams, and why experimentation is as relevant to ice cream as it is to AI systems.

You can find more on our website: https://high-signal.delphina.ai/

SHOW NOTES

Episode 7: What Lies Beyond Machine Learning and AI: Decision Systems and the Future of Data Teams

Delphina — Wed, 18 Dec 2024 22:00:00 -0500

In this episode of High Signal, Chris Wiggins—Chief Data Scientist at The New York Times, Professor at Columbia University, and co-author of How Data Happened—shares how organizations can move beyond prediction to actionable decision systems. Drawing on his work at The New York Times and in academia, Chris explains how to scale data teams, optimize systems, and align data science with organizational impact.

Key topics from the conversation include:
• From Prediction to Prescription: Why organizations need to focus on interventions that drive outcomes, illustrated with insights like, “Imagine a hospital prescribing treatments instead of just diagnosing conditions.”
• The AI Hierarchy of Needs: Foundational practices, such as data logging and engineering, that enable advanced machine learning and AI.
• Personalization and Optimization: How reinforcement learning and exploration-exploitation methods help optimize KPIs and adapt to user context.
• Scaling Data Teams: Strategies for attracting and retaining talent by emphasizing autonomy, mastery, and purpose.
• Empathy as a Data Science Skill: The importance of collaborating with other teams and understanding their goals to drive adoption and success.

🎧 Tune in to learn how to build decision systems, integrate causality into workflows, and develop scalable data science teams for real-world impact.

You can find more on our website: https://high-signal.delphina.ai/

LINKS

Episode 5: The Hard Truth About Building AI Systems and What Most Leaders Miss About AI

Delphina — Wed, 20 Nov 2024 16:00:00 -0500

In this episode of High Signal, Gabriel Weintraub (the Amman Professor of Operations, Information, and Technology at Stanford Graduate School of Business), brings his expertise in market design, data science, and operations, enriched by his experience with global platforms like Uber and Mercado Libre, to a conversation that spans practical strategies, cultural insights, and global perspectives on data and AI.

Highlights from the discussion include:

Bridging the C-Level and Technical Divide: Gabriel emphasizes the importance of aligning leadership with on-the-ground teams to build effective, data-driven organizations.
Starting with the Basics: From building pipelines to identifying high-ROI projects, Gabriel outlines foundational steps for companies adopting data science and AI.
Cultural Transformation for Experimentation: He explains why fostering an experimentation culture, where negative results are valued for learning, is essential for success.
Opportunities in Latin America: Gabriel shares insights on the unique challenges and immense potential of the Latin American tech ecosystem, including the critical role of startups and the need for local innovation systems.
Generative AI’s Role in Driving Impact: Discussing generative AI’s transformative potential, Gabriel highlights its capacity to lower barriers for smaller teams while emphasizing the importance of problem-first approaches.

The conversation concludes with a forward-looking exploration of opportunities in government, education, and healthcare, and Gabriel’s optimism about building ecosystems where startups and local talent thrive.

🎧 Tune in to learn from Gabriel’s thoughtful perspectives on navigating the complexities of building data-driven cultures, the global AI landscape, and how to leverage data for impactful change.

You can find more on our website: https://high-signal.delphina.ai/