A New Era of Market Research

AI and Specialists — The Qual Research Dream Team

It’s an interesting moment in our industry, and market researchers seem to agree that we’re at a crossroads. Down one path, we see a potential (and, frankly, dystopian) future where artificial intelligence (AI) does all the work — from developing screeners and discussion guides to moderating and even simulating respondents to generating the reports — making humans obsolete. That’s a bleak road indeed, one that leads our industry away from meaningful, difference-making insight.

Down the other path, we see a different future — a much more appealing one in which AI takes over the routine tasks of research while human research specialists focus on providing truly impactful strategic insight. Call us optimists, but we’re betting on this second path and firmly believe that AI will never replace human insight — as long as that human insight comes from a place of expertise.

Clearly, AI isn’t going away. But if we can figure out how to create a harmonious partnership between AI and human research specialist, our industry and clients will benefit from efficient, cost-effective, and agile research that yields deeper insights and better results. So, the question becomes: how do we go about doing that? We have some ideas.

Expertise First for Human Insights

We believe that an expertise-first approach is the best way to ensure human insight remains at the heart of qual market research even as AI reshapes the landscape, now and for the foreseeable future. Unlike the traditional qual research model that embraces a one-researcher-fits-all-studies approach, an expertise-first methodology focuses on delivering specialized and highly targeted insight from researchers who bring in-depth industry-specific experience and subject-matter expertise.

There are significant advantages to this approach. Researchers who bring specialized knowledge in the industry, subject, or niche they’re researching are able to ramp up quickly and dive right into even the most complex studies. They also know how to talk to sophisticated and high-level respondents with peer-to-peer confidence, as well as how to ask the right follow-up questions. An expertise-first research approach means that clients get nuanced, relevant, and actionable insights that secure stakeholder buy-in and lead to faster, smarter business decisions.

Great, so how does AI fit into this model?

AI: the Best Intern You’ll Ever Have

At Thinkpiece, we’ve been closely watching AI and its impact on market research for years. Our lead tech researcher even earned his bachelor’s in computer science with an emphasis AI many decades ago. As software engineers who became tech researchers, we bring a slightly different perspective than many of our colleagues when it comes AI, and how it should be used to liberate, rather than replace, human researchers.

Before the recent AI frenzy, our team had already been using AI as an assistant to help us with the more mundane tasks of research. Our technologist researchers even wrote an AI Reference Box Set — a practical, jargon-free guide on foundational AI concepts and safe usage. It’s designed to be as evergreen as possible in a field that changes by the hour, a resource you can turn to in years to come. Reach out to us and we’ll be happy to send you a copy, no strings attached.

But despite — or perhaps because of — our familiarity with AI, we’re taking a cautious and controlled approach to incorporating it in our own research model. That’s largely because, while full of exciting potential, we also know that AI can be highly disruptive — and not in a good way. So until AI stops hallucinating and making stuff up, we don’t think it’s ready to do the actual research.

We absolutely recognize that AI has a role in expertise-driven qual market research — but not as the primary generator of insight. Rather, we see AI as a super-efficient intern who takes over the tasks that suck up valuable time we humans would rather be spending on, you know, the research.

So, what can and should this AI intern do? For starters, AI can automate vast amounts of data collection, perform detailed analyses, and identify patterns the human eye and brain might miss — all within seconds. AI-powered platforms can shift through months of social media conversations and extract relevant customer feedback; detect trends across thousands of survey responses; and run predictive models that can help forecast customer behavior — all of which are invaluable to researchers and their clients. What’s more, AI platforms can process this data with greater accuracy, in a faction of the time and cost.

That’s probably the last thing researchers — especially quantitative researchers — want to hear. But humans are and will continue to be essential to quality market research. For all its workhorse capacity, AI is rife with inaccuracies and ripe for fraud. Quant research needs human intervention to identify and weed out AI-spam respondents and maintain data integrity. Humans are still needed to design nuanced survey questions and interpret outlier data that AI may misunderstand. And humans are still necessary to provide context for the data and ensure research models align with real-world variables, ethics, and compliance issues.

The role of human — especially one with specialized expertise — is even more critical when it comes to qualitative research.

Qualitative Research Will Always Be Human-Dependent

Here’s why. Unlike quantitative research, where AI can excel at number crunching and pattern recognition, qualitative research goes beyond the cold, hard data. Qual research delves into human emotions, motivations, and experiences to tell the story behind the data — and that’s something AI can’t do. Yes, AI can handle routine research tasks: transcribing interviews, tagging key words, collecting, culling, and analyzing data. But AI can’t think like you do. It can’t replicate the nuances of face-to-face conversations or the intuition of a skilled moderator. And it doesn’t have your specialized knowledge and expertise.

AI can’t interpret facial expressions, body language, or tone of voice. You, human researcher, can. AI can’t adapt its line of questioning on-the-fly based on nonverbal cues, group dynamics, off-hand comments, or unexpected shifts in the conversation. With your human intuition and specialized understanding of the topic, you know how to direct and guide the discussion.

AI doesn’t bring lived experience or contextual knowledge to the conversation. You, human researcher, have years of experience to call on as you dig deeper into a respondent’s thought process or motivations to provide additional shading. AI can’t build trust, rapport, or empathetic connections with respondents, or reassure uneasy participants when discussing sensitive or emotionally charged subjects. You can, and know how to sense when a respondent is upset, frustrated, or flustered and recalibrate accordingly. AI is constrained by pre-programmed logic, training data, algorithms, and machined-learned patterns. You aren’t limited by those constraints, and can use your creativity and spontaneity to reveal the nuanced, game-changing insights businesses need.

Qual research isn’t just about asking questions that any AI could ask. It involves actively listening to participants to understand the hidden meaning behind their words. It requires strategically probing to uncover buried insights. It relies on interpreting body language and tone to detect subtle emotional cues that reveal what data alone can’t. These skills don’t get much attention, but they’re absolutely vital to revealing truly game-changing insight. And they’re skills that AI doesn’t have. But you do.

The Role of Specialists in Qual

We’d take it a step further: great qual research doesn’t just need humans, it needs specialists — especially in an AI-driven landscape. While the AI intern handles the grunt work, it’s the specialists with specific and relevant areas of expertise who step in to ask the right targeted questions to get to the meaningful insight. It’s the specialists who then interpret, contextualize, and strategically advise based on that insight. Here are three key areas where specialists deliver what AI can’t.

  • Strategic interpretation: AI might be able to tell you what’s happening, but specialists can tell you why it matters — and more importantly, what you should do about it.
  • Specialized expertise: Specialists with expertise in subject areas relevant to the study bring the in-depth knowledge of complex products, services, topics, and industries, to not only understand the data but the specific context in which it operates. This applies to B2B and CPG.
  • Emotional and human understanding: AI may process data efficiently, but it can’t tap into the emotional layers of human experiences. Specialists know how to read between the lines, capturing the feelings, motivations, and concerns that quantitative data alone can’t reveal.

The Adolescence of AI

Keep in mind that AI in market research is still in its awkward adolescent phase. Handing over all your market research responsibilities to AI as it is today, is akin to asking a 12-year-old who went to NASA Space Camp to pilot a space shuttle to the moon. The general ingredients are there, but it’s not even close to being fully baked. And it’s constantly evolving, with new players, features, and capabilities dropping practically every week.

When it comes to using AI, we in market research are adolescents too. We’re still trying to figure out best practices, navigating potential risks, fearful of fraud, and wary of ethical conundrums. As the AI landscape rapidly changes, we find ourselves struggling to keep up let alone stay ahead.

Should market researchers be using AI? Absolutely. Market research firms that don’t adapt and embrace AI will be left behind (see our previous blog post about Kodak for more on that). But we believe the key to success with AI in qual market research is finding that ideal harmony between this shiny new thing and expert human researchers who do what AI can’t: go far beyond the data to deliver insights that drive business forward.

It’s going to take some time for us to figure it out, but we have every confidence we’ll get there. Think of our earliest ancestors following the discovery of fire. They probably suffered through some serious burns before they figured out how to control and harness this new-found power to do all kinds of miraculous things, like heat their caves and cook their Mammoth burgers. We imagine our industry’s experience with AI will follow a similar trajectory.

Ready to thrive in the new age of market research? Let Thinkpiece show you how we combine AI and human expertise to give you the best of both worlds. Reach out today and let’s explore what’s possible!