Bonfring International Journal of Software Engineering and Soft Computing, Vol. 9, No.
2, April 2019 58
Smart Home Implementing IOT Technology with
Multilingual Speech Recognition System
Angshuman Chakrabartty, Ashish Adhikari,
Jurisra Sorokhaibam and Dr.J. Nirmala Devi
Abstract--- There is nothing like staying at home for real
comfort. This era is a technical era. People are searching for
smart way of doing every little-to-big things in their life.so
there is no exception for home at all. We can use automation
technologies to make life easier for all kinds of people. Analog
switches are mounted on the walls and operating them is
tedious job to do for everyone and is very challenging to
physically disabled and elderly people. So this proposed
system is targeted to all kinds of people to make their life
better. We have designed and implemented a low-cost,
reliable, efficient and secure automation with speech operated
system in different languages. As of today, the literacy rate are
increasing but there are people who are uneducated or
someone might prefer speaking their own languages. As of
today, Google Assistant can support up to eight of the
languages of India so as to support the indigenous people
residing in India. Since it is using Google Assistant so, it
removes the complexity for voice train process and voice
recognition process. This system has both the feature of
Bluetooth and Wi-Fi so, both of them can be utilized to control
the loads of the home. The proposed system also gives the
facility of operating the appliances through the internet by
utilizing port forwarding technology. This paper is proposed
to implement the smart home automation that controls the
devices such as Fan, Lights, AC and door from within home
using Bluetooth or from remote places using Node MCU and
operates the devices using web, android application and
Google Assistant. The main objective of this system is to be
flexible for all kinds of people with specific needs.
Keywords--- Home Automation, Smartphone, Arduino,
Bluetooth, Home Appliances, Node MCU, Wi-Fi, Google
Assistant.
I. INTRODUCTION
W E live in the era of technology where things are being
done in a smart way and IOT holds a substantial credit
for this. Recently, the abundance of work and life are in battle
Angshuman Chakrabartty, Final Year, Department of Computer Science
and Engineering, Excel Engineering College, Komarapalayam, Tamil Nadu,
India.
Ashish Adhikari, Final Year, Department of Computer Science and
Engineering, Excel Engineering College, Komarapalayam, Tamil Nadu,
India.
Jurisra Sorokhaibam, Final Year, Department of Computer Science and
Engineering, Excel Engineering College, Komarapalayam, Tamil Nadu,
India.
Dr.J. Nirmala Devi, Professor, Department of Information Technology,
Excel Engineering College, Komarapalayam, Tamil Nadu, India.
DOI:10.9756/BIJSESC.9027
ISSN 2277-5099 | © 2019 Bonfring
and the output might be a contradiction with sustainable and
healthy lifestyle. To mitigate the situation, the use of
technology to reduce human labor are increasing
exponentially. People are fighting with the sword of
technologies against hard, tedious and mind wrecking tasks.
Internet of Things (IOT) is revolutionary for that change.
Home automation system is smart way of using of information
technologies and control system to reduce the human labor.
The rapid growth of technologies to use smartphones to
remotely control the home appliances are becoming a normal
thing now. An automated devices has ability to work with
versatility, diligence and with lowest error rate [1-2]. The idea
of home automation system is a significant issue for
researchers and home appliances companies. Automation
system not only helps to decrease the human labor but it also
saves time and energy [3-4].
Early home automation systems were used in labor saving
machines but nowadays its main objective is provide facilities
to elderly and handicapped people to perform their daily
routine tasks and control the home appliances remotely.
Everyone nowadays has smart phones and an internet
connection. In wireless based home automation system
different type of technologies such as ZigBee [5], Z-Wave [6],
and Global System for Mobile (GSM) [7], General Packet
Radio Service (GPRS) [8], Infrared [9], wireless fidelity (Wi-
Fi) [10-11] and Bluetooth [12] are used, each technology has
their own pros and cons. A Bluetooth based wireless home
automation system is a very basic one and can be implement
with a low cost and it is easy to install in an existing home
[13]. A research work proved that Bluetooth system are faster
than wireless and GSM systems and also they are least
harmful [14]. Bluetooth technology has ability to transmit data
serially up to 3 Mbps within a physical range of 10m to 100m
depending on the type of Blue tooth device. And Wi-Fi has a
physical range of 50m [15]. And of course with Wi-Fi module
you can access it from anywhere around the world.
The primitive man realized that a highly effective way to
communicate with on another is through words [16].The
advantages of using voice as interfacing medium are
multifarious.
And, the easiest things of these servicers would entail a larger
adoption of existing technology and would assist individuals
with varied disabilities, sick and tired person and elderly
people. The speech recognition system comes with Google
Assistant which comes bundled with android os system, and
by implementing this we will be using the machine learning
and voice recognition software of google itself which is an
advanced system. There are language support for google
assistant so that one can use their native language for
operation which brings simplicity for all kinds of people.
Bonfring International Journal of Software Engineering and Soft Computing, Vol. 9, No. 2, April 2019 59

In this paper, a low cost, reliable, efficient and flexible system Digilent chipKIT. Although this system mentioned as low
of home automation is presented which utilizes the voice cost system but it is much expensive than Bluetooth base
recognition method and also touch button method for home automation system [17].
activating any electrical devices. The application can A low cost and wireless controlled automation system was
In next section Literature Survey is discussed. In next designed by researchers [18]. Bluetooth technology was used
section implementation of overall system description is to provide remote controlled wireless access to user. Although
presented. Section IV describes the hardware architecture and this system achieved high accuracy but it only aimed to
section V describes the software architecture of proposed provide facilities and assistance to disabled and elderly.
work. Result and analysis are highlighted in section VI. In [20], an overview of different home automation systems
Finally section VII, described the conclusion and future work. in presents. Authors highlight the advantages and
disadvantages of different technologies such as Bluetooth,
II. LITERATURE SURVEY ZigBee, GSM and EnOcean. The Bluetooth based automation
Several remote controlled home automation systems have system are low cost and enables the user to control appliances
been studied. Neha A. Wahile, Priyanka D. Hatwar, Isha M. within the range of Bluetooth network.
Padiya research work [21] provided a speaker dependent In [19], a petrol level indicator was designed and
method of home automation using speech recognition system implemented on hardware using two ultrasonic sensors (HC
which uses MATLAB R2009a to turn on/off loads via parallel SR-04), liquid crystal display (LCD), micro SD card and
port of a computer. Atmel ARV controller. The system has ability to measure the
A NodeMCU based home automation system by rathmesh petrol level 0.03-3 meters inside the fuel tank. Moreover
Shelke, Shubham Kulkarni, Swapnil Yelpale, Omkar Pawar, system indicate the users if the petrol level drop below the
Ravdeep Singh & Kirti Deshpande [22], utilized the inbuilt fixed level.
Wi-Fi method to enable and disable the switches through the
web browser so as to reduce cost and have a remote access to III. SYSTEM DESCRIPTION
the appliances from anywhere around the world. The proposed system has two main parts hardware and
R.Piyare and M.Tazil research work [14] provided full software. The hardware part consists of three main hardware
functionality to remotely control home appliances via wireless components smartphone, Arduino board and Bluetooth
communication between the Arduino BT and cell phone using module. Software part consist of Arduino integrated
Bluetooth technology. Arduino BT board was connected with development environment (IDE) and Bluetooth terminal
home appliance and it was controlled by a Symbian OS cell smartphone application which is used for wireless
phone application. Symbian OS cell phone can only support communication between smartphone and Arduino board. Node
the python language scripts and this system failed to support MCU and port forwarding methods are also used in this
Java based application, nowadays mostly smartphone method to provide more ease and facilities to the users. Fig. 1
applications are developed in Java. Similarly, another study illustrates block diagram of proposed home automation system
presented home automation system using Bluetooth and and the flow chart is depicted in Fig. 2.
android application. However, this was designed only for 4
lights and it was not feasible to control more than 4.
Rozita Teymourzadeh, Salah Addin Ahmed [5] designed a
GSM based system for home automation. Using the GSM
protocol, it became possible to access the system by using the
Short Message System (SMS). The system also gave feedback
to the user about the current state of any desired object.
Through detailed study of “Home Automation Using
Internet of Thing” proposed by Shopan Dey, Ayon Roy and
Sandip Das, it is found that they have used Raspberry pi
module to connect ESP8266-01 module to the internet.
Through this module they are controlling various devices
through web page and also through android application [23].
Miss. Aboli Mane , Miss. Pooja Pol, Mr. Amar Patil, Prof. Figure: Bluetooth Module
Mahesh Patil designed a project[24] on homne automastion
using NodeMCU and blynk app. Blynk app is usesd as a third
party app.it provide open source to user to design automation
in less price.
A project by N. Prathima, P. Sai Kumar, SK. Lal Ahmed
and G. Chakradhar home automation for paralyzed people by
voice recognition proposed a system for people suffering from
quadriplegia or paraplegia to control various home appliances
just by his/her voice commands.
A home monitoring and automation system was also
studied, it was implemented by using Arduino Uno and
Figure: Node MCU Module

ISSN 2277-5099 | © 2019 Bonfring

Bonfring International Journal of Software Engineering and Soft Computing, Vol. 9, No. 2, April 2019 60

Implementation
The details of the project are classified as two –
(a) Hardware Implementation
(b) Software Implementation
(a) Hardware Implementation
The Idea is to use both module but at a separate time
duration. The Bluetooth will be activate when the user enters
home and when he go outside the NodeMCU module will be
activated during that time period. The idea is that when the
user stay inside controlling the appliances with Bluetooth will
be suitable inside the house with Bluetooth 4.0 Technology.
The Devices will be connected with the Arduino device when
the Bluetooth sets to ON. With smartphone user can control
the devices inside the home like a charm. When the user go
outside he will on the Node Mcu module with which he can
access the appliances before he came home i.e. for example if
he wants AC to be on 5 minute before he arrive, so he can turn
it on. With this mechanism user can open the garage door
before his arrival to park the car. The user can light on the
household devices.
The NodeMCU will create a webserver that can be accessed
from the browser and with that also the user can access the
devices in case of emergency.
(b) Software Implementation
The Software connects the Arduino, Bluetooth module and
NodeMCU but one at a time. The App is created for both
Click and Voice Recognition technology. With this controlling
the Bluetooth with HC-05 module and NodeMCU with Wi-Fi
module is very easy. The Devices that are connected by the
module are set to be activated by connecting first then they are
commanded to do the particular task. The App was created as
to have both English and Hindi command for users to have
friendly experience.
Figure 2: NodeMCU Implementation

IV. HARDWARE ARCHITECTURE

The proposed home automation system contains three
hardware components smartphone, Arduino board and
Bluetooth module.
Smartphone is used to communicate with Arduino board
using a smartphone application and Bluetooth technology. In
this research work Bluetooth module HC 06 and Arduino Uno
are used for hardware implementation.
A. Arduino Uno
Arduino Uno is open source hardware and microcontroller
board which is based on A Tmega328P Processor. It has 14
digital input/output and 6 analog input pins and operates at 5
volts and 16 MHz quartz crystal frequency. It has 32 KB flash
memory, 2 Kb SRAM and 1 KB EEPROM.
B. Bluetooth module HC-06
Bluetooth module HC-06 is used for wireless
communication between Arduino Uno and smartphone. HC-06
is a slave device and it can operates at power 3.6 to 6 volts. It
has 6 pins: State, RXD, TXD, GND, VCC and EN. For serial
communication connect TXD pin of Bluetooth module HC-06
with RX (pin 0) of Arduino Uno and RXD pin with TX (pin 1)
of Arduino Uno.
Figure 1: Bluetooth Module Implementation

ISSN 2277-5099 | © 2019 Bonfring

Bonfring International Journal of Software Engineering and Soft Computing, Vol. 9, No. 2, April 2019 61

Connection diagram of Adriano and Bluetooth (BT) module Graphical User Interface
is illustrated in Figure.

V. SOFTWARE ARCHITECTURE
In this research work two software Arduino Integrated
Development Environment (IDE) and Bluetooth terminal
application are used.
A. Arduino IDE
IDE stands for Integrated Development Environment, entire
programming for proposed system is done in Arduino IDE
tool.
Baud rate is set to 9600 bits per second for serial
communication between Arduino board and smartphone.
Arduino IDE command "Serial.
A vailable 0" is used to receive data serially from
smartphone and "Serial.println" command is used to transmit
data serially from Arduino board to smartphone.
Similarly state variable is compared with different
conditions to control more appliances.
B. Bluetooth terminal application
A smartphone application named Bluetooth (BT) Simple
terminal is used for wireless communication between
smartphones and Arduino board. It has ability to transmit
ASCII data serially from smartphone to Arduino board using
Bluetooth module.
ASCII data and their equated operation are given in Table
2. According to proposed method users will be able to control Figure 3: Smart Home Page
maximum 18 appliances and sensors using Bluetooth terminal
application.
ASCII Operation Data
0 Turn ON light 1
1 Turn OFF light 1
2 Turn ON light 2
3 Turn OFF light 2
4 Turn ON FAN
5 Turn OFF FAN
6 Turn ON air Conditioner
7 Turn OFF air Conditioner
8 Turn ON television
9 Turn OFF television

VI. RESULTS
Proposed home automation system implemented on
hardware using Arduino Uno, NodeMCU, and Bluetooth
module HC-06 and smartphone.
Bluetooth module TXD and RXD pins were connected with
user specified Arduino Uno RX and TX pins respectively,
while NodeMCU and Arduino is connected similarly with the
rest of the appliances with its GPIO pins and output pins
respectively.
VCC pins were connected with 5V DC supply and the
outputs have a common ground pins. The home appliances
lamp, electric motor and fan, AC were connected with
Arduino Uno digital output ports and with the help of relay.
Relays can be used for 5V to 240V switching circuitry. Figure 4: Device Selection

ISSN 2277-5099 | © 2019 Bonfring

Bonfring International Journal of Software Engineering and Soft Computing, Vol. 9, No. 2, April 2019
Figure 5: Voice Command Panel
The suggested home automation system was tested within
the range of 20 meters and it attained 100% accuracy. All the
connected LEDs and appliances were controlled from the
smartphone application.
Smart Home application was installed in smartphone and a
Bluetooth wireless connection was established between
smartphone and Arduino Uno. Password protection was used
for pairing of smartphone with Bluetooth Module HC-05 to
only allow authorized user. Figure1: illustrates the interface
of Bluetooth in Smart Home application and NodeMCU was
connected to router & appliances were controlled via
application and a PC through ip address. Figure2: illustrates
the interface of NodeMCU application.
VII. CONCLUSION
In this research work a low cost and user friendly design for
home automation system is presented. It has better
performance than existing Bluetooth based conventional home
automation systems, it provides a general approach for home
automation which is not only suitable for elderly and
handicapped people but it is also beneficial to reduce human
labor and save energy with the help of sensors. For the
knowledge of readers, this is the first paper on home
automation system in which both Bluetooth and Wi-Fi module
are used for Smart Home automation. In addition proposed
system has ability of speech recognition in many languages.
Moreover smartphone application used in proposed system has
ability to interface up to 18 home appliances and sensors.
Proposed system is analyzed and tested within the range of 10
meters and it achieved 100% accuracy using Bluetooth and
Wide range using Wi-Fi.
Proposed system is only able to control the appliances
within short range using Bluetooth and long range using Wi-
ISSN 2277-5099 | © 2019 Bonfring
62
Fi, for future research work it is recommended to increase the
range and interface more sensors and it should be a low cost
and user friendly system. Moreover home automation system
can be interfaced with biomedical (EMG) signals. It will be
beneficial for amputees, they will be able to control the
appliances using their muscle's movement and it can also be
useful to the people suffering from dementia to remind them
of doing. With the coupling of both Bluetooth and Wi-Fi
technology, there is a wide range of opportunities and ideas
that could be centered on security of home and the same
concept can be utilized in many sectors like offices, hospitals,
hotels, factories with changes as per the surrounding and the
usage of multiple different sensors. And also the smart watch
technology can be utilized with the home automation which
further increases the flexibility and ergonomic value of the
system.
REFERENCES
[1] M.S. Soliman, M.O. Dwairi1, I.I.M. Abu Sulayman & S.H.A. Almalki,
“Towards the Design and Implementation a Smart Home Automation
System Based on Internet of Things Approach”, International Journal of
Applied Engineering Research, Vol. 12, No. 11, Pp. 2731-2737, 2017.
[2] K. Mandula, R. Parupalli, C.A.S. Murty, E. Magesh and R. Lunagariya,
“Mobile based home automation using Internet of Things(loT)”,
International Conference on Control, Instrumentation, Communication
and Computational Technologies (ICcrCCT), Kumaracoil, Pp. 340-343,
2015.
[3] N. Skeledzija, J.C. Edin, V. Bachler, H.N. Vucemilo and H. Dzapo,
“Smart home automation system for energy efficient housing”, 37th
International Convention on Information and Communication
Technology, Electronics and Microelectronics (MIPRO), Pp. 166-171,
2014.
[4] R.A. Ramlee, M.A. Othman, M.H. Leong, M.M. Ismail and S.S.S.
Ranjit, “Smart home system using android application”, International
Conference of information and Communication Technology (fCoiCT),
Bandung, Pp. 277-280, 2013.
[5] R. Gogawale, “Bluetooth remote home automation system using android
application”, International Engineering Research Journal (fERJ), Vol. 2,
No. 2, Pp. 848- 850, 2016.
[6] M. Asadullah and A. Raza, “An overview of home automation systems”,
2nd international Conference on Robotics and Artificial intelligence
(fCRAi), Rawalpindi, Pp. 27-31, 2016.
[7] "Bluetooth Simple Terminal Application retrieved on June 19, 2016
retrieved from < hltps: l/play.google.com/ store/apps/
details?id=wingood. bluetooth.bts impleterminal & hl=en. [Accessed:
06-Feb-2017].
[8] N.M. Morshed, G.M. Muid-Ur-Rahman, M.R. Karim and H.U. Zaman,
“Microcontroller based home automation system using Bluetooth, GSM,
Wi-Fi and DTMF”, International Conference on Advances in Electrical
Engineering (iCAEE), Dhaka, Pp. 101-104, 2015.
[9] R.K. Kodali, V. Jain, S. Bose and L. Boppana, “loT based smart
security and home automation system”, International Conference on
Computing, Communication and Automation (ICCCA), Noida, Pp.
1286-1289, 2016.
[10] M. Asadullah and A. Recai Celik, “An Effective Approach to Build
Smart Building Based on Internet of Things (loT)”, Journal of Basic and
Applied Scientific Research (JBASR), Vol. 6, No. 5, Pp. 56-62, 2016.
[11] V. Puri and A. Nayyar, “Real time smart home automation based on
PIC microcontroller, Bluetooth and Android technology”, 3rd
international Conference on Computing for Sustainable Global
Development (INDIA Com), New Delhi, Pp. 1478-1484, 2016.
[12] S. Palaniappan, N. Hariharan, N.T. Kesh and A. Deborah, “Home
automation systems - A study”, International Journal of Computer
Applications, Vol. 116, No. 2, Pp. 11- 18, 2015.
[13] R. Piyare and M. Tazil, “Bluetooth based home automation system using
cell phone”, IEEE 15th International Symposium on Consumer
Electronics (ISCE), Singapore, Pp. 192-195, 2011.
[14] N. Prathima, P. Sai Kumar, S.K. Lal Ahmed and G. Chakradhar, “Voice
Recognition Based Home Automation System for Paralyzed People”,
Bonfring International Journal of Software Engineering and Soft Computing, Vol. 9, No. 2, April 2019 63

International Journal for Modern Trends in Science and Technology,

Vol. 3, No. 2, Pp. 101-106, 2017.
[15] M.A.E.L. Mowad, A. Fathy and A. Hafez, “Smart home automated
control system using android application and microcontroller”,
International Journal of Scientific & Engineering Research, Vol. 5, No.
5, Pp. 935-939, 2014.
[16] S. Raghavan and G.S. Tewolde, “Cloud based low-cost Home
Monitoring and Automation System”, Proceedings of the 20i5 ASEE
North Central Section Conference, Pp. 1-10, 2015.
[17] R.A. Ramlee, M.A. Othman, M.H. Leong, M.M. Ismail and S.S.S.
Ranjit, “Smart home system using android application”, 2013
international Conference of information and Communication
Technology (fCoiCT), Bandung, Pp. 277-280, 2013.
[18] R. Gogawale, “Bluetooth remote home automation system using android
application”, International Engineering Research Journal (fERJ), Vol. 2,
No. 2, Pp. 848- 850, 2016.
[19] M. Asadullah and A. Raza, “An overview of home automation
systems”, 2016 2nd international Conference on Robotics and Artificial
intelligence (fCRAi), Rawalpindi, Pp. 27-31, 2016.
[20] P.D. Hatwar, N.A. Wahile and I.M. Padiya, “Home Automation System
Based on Gesture Recognition System”, International Journal of
Emerging Technologies in Engineering Research (IJETER) Vol. 5, No.
3, 2017.
[21] P. Shelke, S. Kulkarni, S. Yelpale, O. Pawar, R. Singh, K. Deshpande,
“Design and Implementation of PID Controller using HDL on FPGA”,
International Research Journal of Engineering and Technology (IRJET)
Vol. 5, No. 6, 2018.
[22] S. Dey, A. Roy and S. Das, “Home Automation Using Internet of
Thing”, IRJET, Vol. 2, No. 3, Pp. 1965-1970, 2016.
[23] A. Mane, P. Pol, A. Patil, M. Patil, “IOT based advanced home
automation using Node MCU controller and blynk Framework”, Zerone
Scholar.

ISSN 2277-5099 | © 2019 Bonfring