bedda.tech logobedda.tech
← Back to blog

Not Everyone Uses AI: What the Data Actually Shows

Matthew J. Whitney
9 min read
artificial intelligencemachine learningai integrationllm

The AI adoption reality check hit me hardest in a boardroom, not a codebase. I was three weeks into a fractional CTO engagement with a mid-sized logistics company. The CEO had just come back from a conference — you know the type, the ones where every keynote ends with "and AI will transform your entire operation." He wanted AI in everything. The customer portal. The dispatch system. The invoicing workflow. He'd already told his investors it was coming.

When I sat down with the actual users — the dispatchers, the billing team, the customer service reps — the picture was completely different. Two people on the team used AI tools daily. One used ChatGPT to draft emails. Another used GitHub Copilot. The rest? They'd tried it, found it inconsistent, and gone back to their spreadsheets and muscle memory. Not because they were technophobes. Because the tools didn't reliably solve their actual problems better than what they already had.

We spent two months building a focused AI integration for a single, high-value workflow instead of the sprawling "AI everywhere" roadmap the CEO had pitched. It worked. But I keep thinking about what would have happened if we'd just built what the conference told us to build.

The Hacker News Signal You Shouldn't Ignore

This week, a thread on Hacker News crossed 465 upvotes with a premise that's uncomfortable for the AI vendor community: a significant portion of people don't use AI tools habitually, and the ones who do use them selectively, not universally. The post cut through the noise precisely because it named something practitioners have been quietly observing for months — the gap between AI hype and AI adoption reality is enormous, and nobody selling AI products wants to talk about it.

The comments were illuminating. Engineers described using LLMs for specific tasks — boilerplate generation, rubber-duck debugging, documentation drafts — while completely ignoring them for others. Product managers talked about mandated AI tooling that their teams had learned to route around. A recurring theme: people adopt AI tools the same way they adopt any tool. Habitually, selectively, and only when the tool reliably reduces friction on something they do repeatedly.

This is not a niche observation. It's a structural feature of how technology actually spreads.

What Machine Learning Researchers Have Known for Years

The AI industry's marketing operates on a fundamentally different timeline than actual machine learning adoption curves. Researchers who study technology diffusion will tell you that adoption is always uneven — it clusters around early adopters, then stalls in the early majority until the tool becomes either dramatically better or dramatically cheaper. We're somewhere in that stall right now for most AI integration use cases.

The data that does exist is telling. Surveys from the Pew Research Center have consistently shown that while awareness of tools like ChatGPT is nearly universal, regular use is concentrated in specific demographics and specific task types. The "everyone is using AI for everything" narrative is a vendor narrative. The actual distribution looks like most technology distributions: a power law, not a bell curve.

What makes this moment different is the pressure. I've never seen engineering teams pressured into adopting a technology this aggressively, this fast, with this little regard for whether it actually fits their workflow. The FOMO is institutional. CEOs are afraid their competitors are getting a 10x productivity boost from AI right now, and they're going to get left behind if they don't ship an AI feature in the next quarter.

That fear is being manufactured and sold. And it's leading to bad technical decisions at scale.

The "Reverse Centaur" Problem Nobody's Talking About

A piece that surfaced on Lobste.rs this week titled "I Am Not a Reverse Centaur" touches on something adjacent but important: the way AI tooling is being positioned often inverts the human-machine relationship in ways that degrade the human's actual capabilities rather than augmenting them. The reverse centaur metaphor — a human body doing the mechanical work while an AI head does the thinking — captures exactly what bad AI integration looks like in practice.

This is the failure mode I see most often in AI integration projects: the tool gets inserted into a workflow in a way that makes the human a validator of machine output rather than a practitioner using a tool. That sounds fine in theory. In practice, it means the human gradually loses the context and judgment needed to catch the machine's mistakes. You end up with a system that's confidently wrong and a human who's no longer equipped to notice.

Good AI integration keeps the human's expertise in the loop in a meaningful way. Bad AI integration turns skilled practitioners into rubber stamps. The HN thread was full of people describing the latter — and quietly opting out.

The Uncomfortable Numbers Behind Artificial Intelligence Adoption

Let me be direct about what the AI adoption reality actually looks like from where I sit, having architected systems across multiple industries and talked to engineering teams at dozens of companies in the last eighteen months.

Habitual daily use is concentrated. The engineers who use AI tools every day and swear by them are real, but they're not representative. They tend to be in roles with high volumes of repetitive text or code generation tasks — the kind of work where LLM output is easy to validate and the cost of a wrong answer is low. Expand beyond that profile and adoption drops sharply.

Mandated adoption doesn't stick. I've seen multiple organizations roll out enterprise AI tooling with fanfare and a mandate. Six months later, the dashboards show a handful of power users and a long tail of people who logged in twice. You cannot mandate a habit. You can only create conditions where a habit forms naturally because the tool genuinely helps.

The ROI case is thinner than advertised. GitHub's own research on Copilot showed productivity gains in specific task categories — particularly boilerplate and test generation. That's real and worth taking seriously. But "Copilot helps with boilerplate" is a very different claim than "AI will transform your entire engineering organization." The former is a useful tool. The latter is a sales pitch.

Integration complexity is being systematically underestimated. The demos are always clean. The production reality involves hallucination rates, latency, context window limitations, data privacy constraints, model versioning, and the ongoing cost of prompt engineering as a hidden labor expense. These aren't dealbreakers, but they're costs that don't show up in the vendor's ROI calculator.

What This Means If Your Team Is Being Pressured Right Now

If you're an engineering leader or CTO being pushed to "add AI" by your board or your CEO, here's my actual advice based on what I've seen work and what I've seen fail.

Start with the workflow, not the technology. Find the specific tasks your team does repeatedly where the cost of a wrong answer is low and the volume is high. That's where LLM integration has a genuine ROI case. Don't start with "how do we add AI to our product" — start with "what does our team do fifty times a day that's annoying and low-stakes."

Measure adoption, not deployment. The metric that matters isn't whether you shipped an AI feature. It's whether people use it habitually after thirty days. If they don't, you have a workflow fit problem, not a marketing problem. Don't try to solve it with more onboarding. Solve it by going back to the workflow.

Resist the "AI everywhere" architecture. I've reviewed codebases where LLM calls were inserted into workflows where a simple regex or a lookup table would have been faster, cheaper, and more reliable. Artificial intelligence is a powerful tool for specific problem classes. It's a liability when used as a general-purpose solution to avoid thinking carefully about what the actual problem is.

The competitive threat is probably overstated. Your competitors are dealing with the same adoption reality you are. Some of them are shipping AI features their users ignore. Some are quietly building focused integrations that actually work. The ones winning aren't the ones who shipped AI fastest — they're the ones who shipped AI that fit their users' actual workflows. That takes time and rigor, not speed.

The Vendors Are Not Lying, But They're Not Telling the Whole Truth

I want to be fair here. The productivity gains from well-implemented AI integration are real. I've seen them. Engineers writing better documentation because an LLM makes the first draft painless. Support teams resolving tickets faster because an LLM surfaces relevant knowledge base articles. Data teams exploring datasets more fluidly because natural language querying actually works now.

These are genuine improvements. The tools are genuinely good. OpenAI's API has become remarkably capable and accessible. The ecosystem around LLMs has matured significantly in the last eighteen months. None of that is hype.

What is hype is the universality claim. The idea that AI adoption is happening uniformly, that everyone is using these tools for everything, that teams not shipping AI features are falling catastrophically behind — that's the part the data doesn't support. And it's the part that's driving bad decisions.

The 465-upvote HN thread matters because it's practitioners pushing back on a narrative that doesn't match their lived experience. That's not Luddism. That's the engineering community doing what it does best: insisting that the evidence actually supports the claim before committing to a direction.

My Take

The AI adoption reality is this: the tools are real, the gains are real, and the hype is real. All three are true simultaneously. The mistake is letting the hype drive the architecture decisions instead of the actual evidence about where these tools create value for your specific users doing your specific work.

Teams being pressured into broad AI integration right now should be asking one question before any other: where does this tool create a habit, not just a feature? If you can't answer that from user research and workflow analysis, you're building for the press release, not for the user. And in my experience, press release features have a way of becoming technical debt with very good PR.

The conference circuit will keep selling the "AI everywhere" dream. The HN thread will keep accumulating upvotes from practitioners who know better. The teams that win will be the ones who listened to the practitioners.

Have Questions or Need Help?

Our team is ready to assist you with your project needs.

Contact Us