Login

Partners

Support

  • English
Pricing

Who manages the AI workforce?

Who manages the AI workforce?

AI agents are becoming part of the customer service workforce, but deploying them is only the beginning. Success depends on managing AI with the same rigor applied to human teams through observability, governance, and performance management.

July 2, 2026

06:42 min read

Listen to article

08:25

Imagine hiring 500 new employees overnight. They speak every language your customers speak, work around the clock, can handle thousands of conversations simultaneously, and never need a break.

Now imagine having no manager to oversee them. No visibility into how they make decisions. No clear way to measure performance. No process for identifying mistakes before they affect customers. No customer service leader would accept that level of risk. Many companies are doing exactly that with AI.

Customer service leaders have systems for managing people. They know how to coach performance, improve quality, forecast staffing needs, and scale operations. What they have never had to manage before is a workforce where part of the team is not human. AI agents are turning customer service into one of the first business functions to operate a hybrid workforce. The question is not whether AI can do the work— it already is— the question is how to manage it.

Deploying AI is relatively easy. Operating it requires a new discipline built around AI observability, AI governance, and hybrid workforce management. And with it comes a new leadership role: the CX operations manager, responsible for ensuring humans and AI work together safely, and at scale.



The CX operations manager’s primary weapon: AI observability.

The CX operations manager’s primary weapon: AI observability.

Customer experience leaders would never allow a team of human agents to interact with customers without visibility into performance. Deploying AI without deep visibility into its behavior is highly risky. For a CX operations manager, running unmonitored AI is the operational equivalent of driving a car at high speed while blindfolded.

The blindfold needs to come off. AI observability provides visibility into how AI agents reason, retrieve information, follow instructions, and make decisions during live interactions. AI can’t be a black box. It must be able to show what happened, why it happened, and how to improve future outcomes.

A single incorrect response may appear insignificant. At scale, however, a small issue can quickly become thousands of poor customer experiences, compliance violations, or missed business opportunities. AI observability allows CX operation managers to identify issues early, understand root causes, and continuously improve performance. More importantly, it creates confidence and transforms AI from a black box into something operators can understand, improve, and trust. That trust is usually the difference between a successful pilot and large-scale adoption.



Bridging the gap between AI hype and operational reality.

Bridging the gap between AI hype and operational reality.

One of the hardest parts of the CX operations manager role is separating what AI promises from what it takes to make it work.

On the one side, the excitement surrounding AI has created high expectations. Executive leadership is being asked to move faster, reduce costs, improve customer experiences, and increase productivity—all at the same time.

On the other side, the CX operations manager knows that AI is not a magic wand. Successful AI deployments don’t happen by accident, and building effective AI agents requires a careful, deliberate, and highly structured setup. AI agents need to understand what they should do, what they should not do, and where to find reliable information when customers need help.. They require clear prompts and explicit instructions so they can’t misinterpret their boundaries. Before AI can deliver value, the foundations must be in place.



The data readiness audit: Two critical areas of focus.

The data readiness audit: Two critical areas of focus.

Preparing for AI starts long before the first interaction. To prevent silent operational failures, the CX operations manager must audit and prepare the underlying infrastructure in two key areas.



1. Eliminating latency traps.

In controlled technology demonstrations, conversational AI sounds fluid, natural, and instantaneous. In real-world application, however, AI must connect to legacy backend APIs, such as procurement, healthcare, or billing databases.

A human agent can sometimes navigate delays through conversation and context. AI has fewer options. If the APIs take four to eight seconds to return data, the conversational flow completely breaks down. Repeated pauses and filler responses like “Let me look that up for you” create friction, making interactions feel slow and disconnected. The manager must work with IT to optimize system integration and API response times first to support a natural-sounding conversational flow.



2. Preparing knowledge for machine consumption.

Human-facing documents are often poorly formatted for machine consumption. For example, a company might use a single training document where text highlighted in blue can be shared with customers, while text highlighted in red is strictly for internal reference.

A human agent understands this instantly. But if an AI agent is connected directly to that document, it does not understand visual color boundaries. It will read and potentially output the restricted internal text to a customer.

If a human agent makes this mistake, it is an isolated error. If an AI agent makes this mistake it happens at scale. AI governance starts long before deployment. The CX operations manager must review structure and prepare knowledge sources for AI to access the right information while respecting the boundaries that protect customers and the business.



Rethinking performance in a hybrid workforce.

Rethinking performance in a hybrid workforce.

In a hybrid environment, traditional contact center metrics no longer tell the true story of performance. A CX operations manager must lead the charge in redefining how we measure success.

Consider average handle time (AHT). Historically, contact center managers have been pressured to reduce this metric as much as possible. AI naturally absorbs the simplest and most repetitive interactions first. Tasks such as tracking an order, checking locations, or confirming opening hours can be resolved without human involvement.

Because these rapid, simple interactions are deflected, only the highly complex, emotionally sensitive, and time-consuming cases reach human agents. As a result, human AHT will inevitably rise. If a CX operations manager looks at this metric in isolation, they might falsely conclude that operations are declining despite a massive investment in AI.

To prove the value of a hybrid workforce, the CX operations manager must refocus performance tracking on:

  • Automated deflection: Measuring the volume of tier-one issues successfully resolved end-to-end by AI.

  • First contact resolution: Ensuring complex cases are fully resolved when they reach human agents.

  • Material labor impact: Tracking how AI deployment optimizes human labor forecasting, reducing the overall need for additional full-time equivalents (FTEs).



The next evolution of customer service leadership.

The next evolution of customer service leadership.

As AI becomes an active participant in customer experience operations, new responsibilities are emerging around visibility, governance, readiness, and performance management. These responsibilities do not fit neatly into traditional roles. That is why the CX operations manager matters.

The role reflects a broader shift taking place across customer service. Managing people is no longer enough. Leaders must now oversee a workforce that combines human expertise with AI to run a world-class hybrid workforce.

Pedro Andrade Partner Tech Connect

About Pedro Andrade

Pedro Andrade is vice-president of AI at Talkdesk, where he oversees a suite of AI-driven products aimed at optimizing contact center operations and enhancing customer experience. Pedro is passionate about the influence of AI and digital technologies in the market and particularly keen on exploring the potential of generative AI as a source of innovative solutions to disrupt the contact center industry.

Pedro Andrade Partner Tech Connect

By Pedro Andrade

Vice-president of AI

SHARE

SHARE

AI-generated podcast further exploring the topic.

LISTEN NOW