Onboarding a chatbot: how to ensure a smooth start

Mia Schulz
Chatbots Life
Published in
5 min readMar 8, 2019

--

As soon as a company decides to implement a chatbot in their service process, the actual development of the chatbot can be completed in a matter of weeks. But what happens when the chatbot sees the light of day? When it encounters customers through live chat on the website, in Facebook Messenger or on WhatsApp for the first time. What are the first month of its life going to look like and how do you ensure a smooth start?

Long before the chatbot has his first interactions with customers or with his human colleagues, the fundamental things of his existence are determined. At the beginning of each new chatbot development project a feasibility check, clarifies the following questions: In which business areas does the use of a chatbot offer an added value? What is the goal of applying a chatbot? Which problems should the chatbot solve? In which channels should he be used? Should it be connected to external systems? Answering these questions plays a crucial role in the later success of the chatbot.

Top 4 Most Popular Bot Design Articles:

1. Ultimate Bot Design Guide

2. How to design a Chatbot

3. Chatbot Conference 2019 in NYC

4. One metric, one platform and one vertical

But in order to successfully implement the chatbot, the following 4 points should be paid close attention to:

1. Prepare employees for the new virtual colleague

The employees who will deal with the chatbot on a daily basis, mostly the customer service employees, should be involved from the beginning. They need to know exactly how the chatbot works, which tasks it should solve and what it is allowed and not allowed to do. This not only facilitates collaboration and greater acceptance of the new colleague, but is also essential for the performance of the chatbot. After all, it is the customer service staff who monitors the chatbot’s work and help it to become better. They can optimize its answers and/or add new questions to its repertoire, as well as point out its mistakes. Arent Stienstra, chatbot developer at OBI4wan says:

“Ideally, there should be a direct line of communication between the customer service staff and the product owner or technical team responsible for the chatbot. Customer service employees who work hand in hand with the chatbot are usually the first to notice when the chatbot is not behaving as it should. It is important that this can be reported directly.”

2. Don’t expect too much of the chatbot

To ensure the success of the chatbot, its tasks should be clearly defined and limited. Instead of giving the bot a broad repertoire of tasks to solve at its first day, it is better to first entrust it with a specific task or the answering of a specific question. See our blog post “Chatbots: the most interesting applications for your organisation” for the most common tasks. The amount of tasks, can be increased over time. This way the chatbot can be better monitored and improved. Arent emphasizes:

“You shouldn’t expect a chatbot to be perfect from the start. He’s more like a human employee who’s constantly getting better and better every day.”

3. Introduce the chatbot step by step

The effects of a chatbot on user behaviour can be well monitored with a soft launch. A soft launch is also recommended to eliminate possible functional errors without having too many users exposed to them. Soft launch means, that the chatbot is introduced step by step, so that only a limited number of website visitors (e.g. 10%) can see it at the start. While constantly monitoring KPI’s, the number is increased until the chatbot is finally 100% visible. An additional possibility is to first show the chatbot on website page only, for example on the FAQ page, and then slowly implement it on other pages.

4. Regular maintenance of the chatbot

The implementation of a chatbot is not a one-time thing. It needs regular maintenance to make it better — by providing it with new input, correcting its mistakes and adjusting its answers.

“Don’t let your chatbot out of your sight — especially at the beginning it needs to be constantly monitored.” says Arent Stienstra

Customer needs can also change over time. New products may be introduced or external influences, such as the season, may change the nature of the frequently asked questions. A university or technical college that receives many questions about the choice of study subject in spring may receive completely different questions in autumn, e.g. about exams.

What metrics and KPI’s should be monitored to check the chatbot?

To measure the effectiveness of the chatbot, the number of conversations it has been involved with is an important indicator. Also check, which part of the conversations was successfully completed by the chatbot and which part was handed over to a human employee. In order to determine how good the chatbot already is in recognizing the intention of the customer, the number of correctly classified requests and statistics on Natural Language Processing (NPL) should be looked at. In addition to these indicators, which reflect the performance of the chatbot, the effect on customers and employees should also be examined. Has the NPS score, or any other measure of customer satisfaction, changed positively? Have waiting times become shorter? Do customer service representatives have more time to deal with complex customer cases?

What effect can you expect in the first months with a chatbot?

Within the first months, the chatbot should become a fully integrated and accepted member of the customer service team. The workload of customer service employees should go down and they should have more time to advise customers on complex issues. Both the number of questions correctly classified (intent recognition) by the chatbot and the number of questions answered by it should have increased significantly. As a rule of thumb you can expect a chatbot at this stage to correctly recognize the intent of a message in 80% of cases and to participate in about 15% of incoming messages. Be aware though that these numbers strongly depend on the type of chatbot applied, on the number of tasks he is solving and on the input that it receives from the team to become better.

Don’t forget to give us your 👏 !

--

--