The balance between metrics and intuition becomes more critical in a world increasingly driven by data. Businesses that excel integrate the power of quantitative insights with a qualitative understanding of their customers—an understanding that powers intuition and ensures that decisions are not only data-driven but also customer-centric.
An example of this balance comes from Airbnb. The company observed that hosts were sending 1.5 million photo messages to guests each week, primarily to explain check-in procedures. This insight, drawn from a combination of telemetry and direct host feedback, led to the creation of a global check-in tool. This tool allowed hosts to create step-by-step visual guides, simplifying the process for guests and reducing friction for hosts. By leveraging both data and empathy, Airbnb was able to redesign a key aspect of its interface, enhancing user satisfaction and retention (3 real-world UX research case studies from Airbnb, Google, and Spotify—and what we can learn from them, UX Design institute, 2023).
This story underscores a point we often forget: numbers tell us what is happening but not always why.
During a recent conversation about the limitations of data collection, our team grappled with the challenge many startups face: balancing data-driven decisions with the instinct and empathy that only direct human interaction can provide. One of our coaches, a veteran founder with multiple exits, put it simply: "Data gives you the map, but talking to your customers helps you understand the terrain." It's a metaphor that stuck with us.
One of the key risks in relying on data alone is that most of the data we collect is inherently backward-looking. Telemetry, in particular, tells us what people are doing with our products—but do we really know why? Startups often use extensive telemetry, tracking user actions and interactions to understand behavior. While this provides valuable insights, telemetry alone lacks the context to fully understand motivations and emotions.
Take a scenario where your data shows high usage of a particular feature. Telemetry can tell you how often it’s used, but it can't reveal if users are enjoying it or simply tolerating it because there are no better alternatives. Metrics show usage patterns but often miss the why behind these behaviors. The why gives depth to decision-making and helps uncover whether users are truly satisfied or if there are unmet needs beneath the surface.
This is why conversations with customers are critical—they fill in the gaps that telemetry cannot. Direct customer feedback helps refine your instincts, allowing you to understand what users are doing and why they are doing it. Without this deeper understanding, data-driven decisions risk being misinformed or missing key elements of user experience.
Relying solely on data to make decisions can be like trying to navigate a city with just a list of street names and no map. One of the challenges is that past behavior doesn't always predict the future. Take, for instance, Netflix's attempt to split its DVD rental service from streaming—a decision backed by data on distinct customer segments but disconnected from an understanding of how customers emotionally perceived the brand (“How Netflix Lost 800,000 Members, and Good Will,” The New York Times, 2011). The backlash was swift, forcing the company to back peddle.
Data provides essential foundations for understanding trends and behaviors, but it falls short when faced with the human elements of experience—emotions, motivations, and pain points. That's why the most successful founders blend data with gut instinct, honed through firsthand experiences. Your instinct isn’t just a vague feeling; it’s the culmination of countless customer conversations, observations, and qualitative insights that have shaped your understanding of your market.
There's a growing tendency to analyze customer behavior solely through numbers, but metrics can't replace the invaluable insights gained through customer conversations. For example, the metric that shows declining product usage might only scratch the surface. Companies often uncover the deeper why through qualitative feedback (customer support calls, one-on-one interviews, and casual interactions). It’s these nuances that provide the fertile ground for true innovation.
Consider how Slack improved its product experience by relying heavily on qualitative customer insights. Stewart Butterfield and his team talked directly to early users, understanding their workflows and challenges. Through these conversations, they identified bugs and emotional sticking points that could be addressed, turning Slack into one of the fastest-growing enterprise tools of the last decade (“Why Slack Is One Of The Most Innovative Companies Of 2017,” Fast Company, 2017).
Qualitative data provides something that numbers alone cannot: context. If a product has high subscription numbers yet an increasing rate of complaints, qualitative insights can help bridge the gap between what is happening and why. This reminds us of Amazon’s “Customer Obsession” principle, where leaders are encouraged to listen attentively to the voice of the customer, using these insights alongside data to improve their offerings (“Amazon Leadership Principles,” Amazon, 2023).
Data comes in many forms. It could be what somebody said at a conference, an insight gained from watching a user struggle to complete a task, or feedback that surfaces a glaring problem not captured in metrics. In a recent workshop with a fintech startup, one of their founders realized that most of their user drop-off was happening because customers couldn't understand their jargon—something they only uncovered by watching users interact with the product. These real-world interactions sharpen instincts, providing context that numbers alone cannot.
In an age where data is abundant, it's easy to become fixated on it and miss the subtler nuances of human experience. Leaders say, "Follow the data," but perhaps the more accurate guidance is, "Follow the customer." When you lean into the stories behind the numbers, you start seeing the whole picture.
Take the case of Apple’s development of the Apple Watch. At its launch, Apple emphasized that it was the most personal device ever - and led with communication, messaging, and smart information before getting to health. Since then, Apple has followed customer interest in health tracking and insights to make those the consistent lead features on any new launch.
Data should empower decisions but not at the cost of ignoring instincts built from real experiences. Your intuition as a founder or decision-maker is not a magical gift—it's something you develop over time through immersion in customer needs, observing behavior, and understanding pain points. A key takeaway is to look for alignment: when data contradicts intuition, it’s often a signal to dig deeper. Ask questions such as, "Is this data telling the full story, or am I missing something that my direct experience with customers hints at?"
Today's advances in AI provide a significant opportunity to blend qualitative and quantitative data in a meaningful way. Companies like Gong and Qualtrics use AI to analyze sales calls and customer conversations, capturing nuances of sentiment and experience that would otherwise go unnoticed. By leveraging these tools, companies can systematically capture and analyze unstructured data, uncovering insights that lead to richer, more customer-centric strategies (“Customer Experience in the Age of AI,” HBR, 2022).
Ultimately, the best leaders learn to blend the numbers with the narrative—using data and human stories to craft strategies that resonate with their teams and customers. High-quality decision-making doesn’t come from spreadsheets alone; it comes from listening, observing, empathizing, and yes, even taking a leap of faith now and then. Just like Slack and Apple have shown us, understanding the human behind the data is what transforms good companies into great ones.
_______________________________________________________________________________________
Alchemist connects a global network of enterprise founders, investors, corporations, and mentors to the Silicon Valley community.
Alchemist Accelerator is a global venture-backed accelerator focused on accelerating seed-stage ventures that monetize from enterprises (not consumers). The accelerator invests in enterprise companies with distinctive technical founders and provides founders a structured path to traction, fundraising, mentorship, and community during the 6-month program.
AlchemistX partners with forward-thinking corporations and governments to deliver innovation programs worldwide. These specialized programs leverage the expertise and tools that have fueled Alchemist startups’ success since 2012. Our mission is to transform innovation challenges into opportunities.
Join our community of founders, mentors, and investors.