ChatBot System Design Integrated with Text-to-Speech and

Speech Recognition as Merchant Assistant

F RAMDANI
Departement of Informatics, Indonesia Computer University

Jl. Dipati Ukur No.112 – 116, Bandung, Indonesia

Correspondence email: fakhriramdani@email.unikom.ac.id

Abstract

With the high cost of labor today many parties are difficult to meet the needs of employees,
especially small traders, and to overcome these problems then made chatbot application that is
integrated with text-to-speech and speech recognition to help traders serve customers, for the
manufacture is done with planning process including observation, interview, and literature study.
Then plan, implement, and last test. The result of making this chatbot is expected to ease the
merchant's expenses and increase sales turnover.

1. INTRODUCTION

Chatbot is a software system that can interact or "send messages" with humans, using
human language [1]. Text-to-Speech In general the notion of Text-To-Speech is a system that
converts a text into a speech form. According to some literature, the notion of TTS is as the
production of speech automatically by grapheme to phoneme transcription of a sentence [2].
Speech Recognition is a system that can translate voice input into string or command [3]. By
integrating the three systems then the user can use a system like chatting. That way Traders can
make this system as an assistant to help serve more customers.
Chatbots can help in human computer interactions and they have the ability to check and
influence user behavior [4].
The research method used is first to formulate the problem, then collect data by
interview, observation and literature study. Then the design process, the implementation process,
and the last testing process.

2. METHOD

For the design of this chatbot system begins with a planning process that includes the
process of observation or systematic observation of the symptoms studied. This observation
becomes one of the techniques of data collection when it is in accordance with research
objectives, which are planned and recorded systematically, and can be controlled for reliability
(reliability) and validity (validity). By doing the process of direct observation to the market is
expected to record the data needed to build Chatbot system. Then the process of interviewing or
 collecting data orally done directly with traders or customers about the process of buying and
selling goods, especially bargaining process, then study the library or collect data from books or
media.

Furthermore, the design process, the results of planning data in the process to design the
basis of this chatbot system starts from the platform, language, and what equipment is needed for
the design of this chatbot application.

Furthermore, the implementation process or application of chatbot design and application

results start to enter the development stage.

And the last stage of testing where chatbots are tested first to avoid errors when released
to the market.

3. RESULT AND DECISION

The result of this research formed a chatbot system that can interact like human with
human, using speech recognition which change buyer's speech into string form to be understood
by chatbot, then chatbot response in the form of string is changed into speech with the help of
text-to- speech. after the chatbot system is integrated with speech recognition and text-to-speech
successfully created and the merchant can use it well. Here are the results:

From Figure 1 can be seen the process of speech recognition, which turns the buyer's
voice into a string or plain text.
 Figure 1 - Speech Recognition

The result data of speech recognition above is in the form of plain text in process by
chatbot like Figure 2, then chatbot processing phrase with Natural Language Processing (NLP),
then phrase result of Natural Language Processing process sent back to Chatbot and processed in
Data Service to find the answer feasible, viable answers are sent back to chatbot for answers to
buyers. in string form.
 Figure 2 – Chatbot

From Figure 3 it is known that the answer string data from Figure 2 is processed using
text analysis to compose speech and then done linguistic analysis to determine the phoneme for
the input string data before, then processed by wave form generator then pronounced with human
language.
 Figure 3 - Text-to-Speech

Among the advantages of using a chatbot system that is integrated with speech
recognition and text-to-speech include:

The chatbot system can help the merchant while serving many customers at once.

Increase the merchant's earnings, if the merchant usually only serves one or two customers, with a
chatbot merchant application can serve multiple customers at once.

4. CONCLUSION

With the making of this chatbot it can increase the merchant's profit, compared to adding
employees who need a lot of chatbot application costs only require electricity costs and a little
skill. The benefits of chatbot are helping merchant services like telling prices, adding up total
grocery, and managing finances.

5. ACKNOWLEDGEMENT

First thanks to Allah SWT for his grace and grace until I can finish this paper entitled
"Designing ChatBot System Integrated with Text-to-Speech and Speech Recognition as Assistant
Traders". And thanks to Mr. Ir. Eddy Soeryanto Soegoto as the Rector of University Computer
Indonesia and Team of Entrepreneurship Lecturer who has helped writing this paper.
6. REFERENCE

[1] B. A. Syawar, E. Atwell(2007), “Different measurements metrics to evaluate a chatbot

system”.

[2] T. Duroit(1999),” A Short Introduction to Text-To-Speech Synthesis”.

[3] C. M. Karat, C. Halverson, D. Horn, J. Karat(1999), “Patterns of Entry and Correction in

Large Vocabulary Continuous Speech Recognition Systems”.

[4] A. M. Galvao, F. A. Barros, A. M. Neves, and G. L. Ramalho(2004), "Persona-aiml: An

architecture developing chatterbots with personality." pp. 1266-1267.

[5] G. F. Bowerman(2007), “Data server administration using a chatbot”.

[6] M. Qiu, F. L. Li, S. Wang, X. Gao, Y. Chen, W. Zhao, H. Chen, J. Huang, W.

Chu(2017), ” AliMe Chat: A Sequence to Sequence and Rerank based Chatbot Engine”.

[7] B. Behara(2016), “Chappie - A Semi-automatic Intelligent Chatbot”.

[8] M. Collins(1999), “Head-Driven Statistical Models for Natural Language Parsing. PhD
thesis, University of Pennsylvania”.

[9] R. Collobert(2004), “Large Scale Machine Learning. PhD thesis, Universit´e Paris VI”.

[10] A. Haghighi, K. Toutanova, and C. D. Manning(2005), “A joint model for semantic role
labeling. In Conference on Computational Natural Language Learning (CoNLL)”.
Commented [TV1]: Format penulisan referensi lihat di
cth paper yg ada di kuliah online dan perbanyak referensi
dari jurnal internasional yg berhubungan dengan topik
pembahasan (lihat cth paper di kuliah online format
penulisan paper dan layout)