Headimage.png

Virtual service agent

 From fully managed to self-serve: Scaling a support agent

THE ASK

Atlassian acquired a virtual service agent startup built on a fully managed service model — where a dedicated team handled everything on the customer's behalf.

The goal is to integrate it into Jira Service Management (Atlassian's IT service management product) and scale it into a feature where teams could use on their own.

RESULTS

Multi-channel expansion
The virtual service agent started in Slack and expanded to MS Teams, the help centre, portal, and an embeddable widget.

Moved with the market
Successfully evolved the virtual service agent to match a market and behaviour shift towards generative AI.

 

 
 

INTRODUCING

The Virtual Service Agent

The Virtual Service Agent (VSA) is a chat-based automation tool built into Jira Service Management. It helps customers get answers instantly and gives project admins a way to reduce support tickets without having to scale their team.

To set up the VSA, project admins create intents with pre-set responses to common questions, such as 'how do I reset my password?', and build out a conversation flow. When a customer asks that question, the VSA recognises it and responds automatically, deflecting the ticket before it ever reaches a human. Admins can identify common questions and customise the conversation flow.

 
 
 

THE PROBLEM

A done-for-you model doesn't transfer on its own

The acquisition product came with a dedicated team that handled everything behind the scenes, monitoring performance, refining conversation flows, and improving the virtual service agent over time. With the self-serve model, all of that work lands on the project admin, who has no guidance, no guardrails, and no way to know if the virtual service agent is performing the way they intended.

 

Diagram of identified self-service gaps

 

Our approach

Qualitative and market research gave us a clear picture of the current state. I ran a cross-functional ideation workshop, drawing on the team's product expertise and existing research to explore how the virtual service agent could deliver more value beyond IT teams, while staying grounded in what was technically feasible.

 
 

 
 

PHASE 01

Making it easier to get started

Early on, we rebuilt the VSA’s core capabilities, but a gap quickly emerged. Admins were handed a blank form with no guidance on where to start. The VSA is only as good as what does in.

Following a data mapping workshop, I initiated a feasibility experiment with a machine learning engineer to explore whether we could cluster existing support ticket data into themes. The goal was to give project admins a starting points with ready-made templates.

 

Creating an intent discovery library
Our intent discovery library gives project admins a running start. Personalised templates generated from their own data history ensure the virtual service agent is trained on real questions from their own help seekers. For those with no project history, generic templates fill the gap.

 Intent discovery template with training phrases

 
 
 

 
 

PHASE 02: Utilising new AI tools

The world changed. So did we

A few months into the build, ChatGPT launched. Overnight, our manual-first approach felt outdated. Why are we asking project admins to hand-build every conversation flow when generative AI can do the heavy lifting? We had to pivot.

We introduced AI Answers, a new capability that searches customer’s existing knowledge base bank and uses generative AI to respond to customer questions instantly. The VSA now has two capabilities:

  • Intents: high-control, manually curated responses

  • AI Answers: fast to set up, knowledge-base-driven responses

This changed two fundamental experiences. How project admins set the VSA up, and how help seekers get help. We had to make the distinction between the two modes clear without adding complexity with the goal of defining a new routing logic to resolve as many help seeker queries as possible before reaching a human.

 
 
 
 

From architect to approver

We redesigned the intent creation experience around a single idea. Project admins should be able to review, refine, and launch without having to build the conversation flows from scratch with the help of AI.

We moved from a static template library with just training phrases to an end-to-end flow where admins can create, test, and deploy with minimal friction. Conversation flows and suggested responses are now auto-generated. And before going live, admins can test their VSA directly in the product.

 
 

Intent templates with build-in conversation flow and training phrases for the VSA

Integrated in-product testing and "Chat and Build" capabilities that allows projects admins to test before going live.

 

 

PHASE 03: IMPROVE THE OPTIMISATION PHASE

Analytics that drive action, not just awareness

At launch, admins had four static numbers and a conversation log. It told them what happened, not what to do about it. Without clearer signals, project admins were back to manually combing through conversations to find problems.

With the goal of shifting admins from passive observers to confident decision makers, I established a design framework to shift admins from passive observers to confident decision makers.

Each component was built around three principles

  • Set context: detect patterns in VSA activity so admins understand what is happening

  • Provide guidance: surface what needs fixing first so admins know where to focus

  • Enable action: link admins directly to the fix so nothing gets lost between insight and solution

 
 

Analytics design principles

 
 

Principles into practice

 
 

Reduce unanswered conversation component: 1. Set context 2. Provide guidance 3. Enable action

Reduce unanswered conversations component
Instead of leaving admins to comb through conversation logs, the agent surfaces unanswered question clusters in order of priority. Admins can use this insight to act directly —  either by creating an intent or a a knowledge base article.

 

Overall performance components
The redesign added small inline trend charts to show movement over time, pattern detection to surface what's changing, and direct prompts to act. Same data — completely different signal.

Examples of overall performance components: 1. Set context 2. Provide guidance 3. Enable action

 

Conversation flow’s funnel analysis
Not every conversation follows the path you designed. The statistics surfaces where customers drop off or ask something unexpected — revealing gaps between what admins built and what users actually need. Fix the drop-off, improve the flow.

Funnel analysis: 1. Set context 2. Provide guidance 3. Enable action