IRJET- A Cloud based Virtual Brain Connectivity with EEG Sensor using Internet of Things (IoT)
0 likes134 views
This document describes a cloud-based virtual brain connectivity system using an EEG sensor and the Internet of Things. It uses an EEG sensor to measure brain activity, an Arduino microcontroller to process the EEG signals, an ESP8266 WiFi module to connect to the cloud, and a touchscreen display. The system can determine if the brain is alive or dead by analyzing the EEG signals. If any abnormal activity is detected, it will send alerts by SMS and email. The goal is to monitor brain activity and store the data in the cloud for analysis. This could help with conditions like autism or detect forgery. The system aims to scale up processing of large brain datasets in the future.
IRJET- A Cloud based Virtual Brain Connectivity with EEG Sensor using Internet of Things (IoT)
- 1. International Research Journal of Engineering and Technology (IRJET) e-ISSN: 2395-0056 Volume: 06 Issue: 05 | May 2019 www.irjet.net p-ISSN: 2395-0072 © 2019, IRJET | Impact Factor value: 7.211 | ISO 9001:2008 Certified Journal | Page 7871 A Cloud based Virtual Brain Connectivity with EEG Sensor using Internet of Things (IoT) M. Vasuki1, R. Ramakrishnan2, Dr.T. Amalraj Victoire3, B. Preethi4 1Assistant Professor, Department of Master Computer Application, Sri Manakula Vinayagar Engineering College, Pondicherry-605 107. 2Associate Professor, Department of Master Computer Application, Sri Manakula Vinayagar Engineering College, Pondicherry-605 107. 3Associate Professor, Department of Master Computer Application, Sri Manakula Vinayagar Engineering College, Pondicherry-605 107. 4P.G Student, Department of Master Computer Application, Sri Manakula Vinayagar Engineering College, Pondicherry-605 107. ----------------------------------------------------------------------***--------------------------------------------------------------------- ABSTRACT:- Virtual brain research is accelerating the development of inexpensive real-time Brain Computer Interface (BCI). Hardware improvements that increase the capability of Virtual brain analyse and Brain Computer wearable sensors have made possible several new software frameworks for developers to use and create applications combining BCI and IoT. In this paper, we complete a survey on BCI in IoT from various perspectives; including Electroencephalogram (EEG) based BCI models, machine learning, and current active platforms. Based on our investigations, the main findings of this survey highlights three major development trends of BCI, which are EEG, IoT, and cloud computing. Using this it is completely useful for finding the true state of whether the brain is alive or dead. If it is alive, then the activity of the brain is monitored and stored. Through this anyone can come to conclusion that whether the action done is legal or illegal. And this has an advantage for 2 scenarios. First is for AUTISM affected people and secondly Forgery in asset documents. And if any changes in the status of the brain then it will be send to the specific person in their relation using SMS & Email id. Keywords: BCI, IoT, EEG sensor, cloud, machine learning, Arduino. INTRODUCTION Top on the list of the US Government’s BRAIN Initiative is the ability to map the human brain at different scales with improved throughput and resolutions. A complete picture of the brain structure will provide new insights into how the human brain functions and may facilitate new treatments and drug discovery for brain disorders. Recent advances in intact brain imaging, such as the CLARITY and MAP (Magnified Analysis of the Proteome) tissue clearing techniques, make it possible to collect large volumetric images of brain tissue at cellular and sub-cellular resolutions. The high throughput and high resolution brain imagery, however, poses a challenge for efficient processing and analysis. Brain graphs offer a framework to represent the structural or functional topology at multiple levels. A number of software tools exist for analysing topology of brain networks using graph theory. They primarily focus on studying the correlations of anatomically separated brain regions. Few are designed for high throughput dense and long-range neuron analysis at the cellular level, which is critical for understanding brain circuits and for comparing healthy and diseased brains. High throughput and low latency analysis of brain data will require high speed databases and programming interfaces amenable to large scale graph analytics. REQUIREMENTS: Hardware: EEG Sensor EEG Signalling unit Arduino Uno TFT Touchscreen IoT Module ESP8266 Software: Arduino Uno IDE FLOW CHART:
- 2. International Research Journal of Engineering and Technology (IRJET) e-ISSN: 2395-0056 Volume: 06 Issue: 05 | May 2019 www.irjet.net p-ISSN: 2395-0072 © 2019, IRJET | Impact Factor value: 7.211 | ISO 9001:2008 Certified Journal | Page 7872 VIRTUAL BRAIN MODULE: Figure1: Structure of the project Description: The above figure shows the structure of the project and flow of control how it goes on. Figure2: Device before Activation Description: The above figure shows the hardware kit of the project after connection and before activation. Figure3: Device after Activation Description: The above figure shows the project after it gets activated and for few seconds it checks for the EEG signal. Figure4: Device with output (NORMAL) Description: From the above figure, it is confirmed that after the EEG signal gets received, it checks for the state of the brain whether it is normal (alive). Figure5: Device with output (ABNORMAL/ BRAIN DEAD) Description: From the above figure, after getting the signal and checks for the status , if it is abnormal it shows the message on the touch panel as Brain dead. COMPONENTS DETAILS: EEG SENSOR: EEG sensor has the work to measure the electrical activities which is generated by the synchronized activity of multiple neurons in volts which results in turn gives
- 3. International Research Journal of Engineering and Technology (IRJET) e-ISSN: 2395-0056 Volume: 06 Issue: 05 | May 2019 www.irjet.net p-ISSN: 2395-0072 © 2019, IRJET | Impact Factor value: 7.211 | ISO 9001:2008 Certified Journal | Page 7873 outstanding resolution in terms of time, which makes us to find the activity within the limit of different divisions of cortical areas even at sub-second timescales. EEG, the fastest imaging techniques available has high sample rate. Firstly when discovered many many years ago EEG was plotted on paper. Nowadays in current systems, it digitally displays the data as a continuous flow of voltages on scenarios which we want. EEG SIGNAL: EEG signal which is calculated in terms of intensity and frequency. Signal intensity is measured in microvolts (μV). Signal frequency of the human. EEG waves are of four types and they are theta, delta, alpha and beta. MICROCONTROLLER – ARDUINO: Arduino Microcontroller is one of the powerful single board computers that have gained special interest on the markets to make many inventions with technologies. The Arduino is open-source, means and development software is free. In United States, Sparkfun is a good source in Arduino hardware. Using this Arduino board, we can create interface circuits to read switches and other sensors, and to control operations like motors and lights with less effort. TFT TOUCHSCREEN: TFT Touch Screen is an Arduino with compatible multi- coloured TFT display with compatible footprint. The TFT driver has professional Driver IC with 8 bit data and 4 bit control interface. We can draw text or do anything with the TFT library. It also has on board micro-SD card slot on the back of the screen and store bitmap images to display on the screen. The TFT library interfaces/interacts with the controller of the screen through SPI when using the TFT library. ESP8266: ESP8266 - Wi-Fi Module, self-contained SOC (System on Chip)/integrated circuits (i.e.), chip with connection to the TCP/IP protocol stack that can give any different microcontroller access to other Wi-Fi network. The microcontroller which we are using in this project is ARDUINO. The ESP8266 suits whether for hosting an
- 4. International Research Journal of Engineering and Technology (IRJET) e-ISSN: 2395-0056 Volume: 06 Issue: 05 | May 2019 www.irjet.net p-ISSN: 2395-0072 © 2019, IRJET | Impact Factor value: 7.211 | ISO 9001:2008 Certified Journal | Page 7874 application or offloading all Wi-Fi networking functions from processor of other applications. This module comes with AT commands firmware allows Arduino Wi-Fi shield. It’s completely fast growing community support in economy. This module has on-board 80 MHz low power 32 bit processor and supports Bluetooth co- existence interfaces; it contains special feature of self- calibrated RF which works under all operating conditions. And also it has APSD – (Automatic Power Save Delivery) with power saving mechanism. ARDUINO UNO IDE: This is a cross-platform application (for Windows, macOS, Linux) that is written in the programming language Java and is used to write and upload programs to Arduino compatible boards, and also with the help of 3rd party cores, other vendor development boards. The source code for the IDE is released under the GNU General Public License, version 2. The Arduino IDE supports the languages C and C++ using some special conditions with rules of code structuring. IMPLEMENTATION Here, firstly the EEG headset with sensor is connected to the microprocessor ARDUINO board and it is connected to the ESP8266 which is interconnected to the TFT Touchscreen. Firstly the EEG headset sensors the EEG signal from the brain with the electrodes present in the headset and it checks whether it is alive or dead. After sensing, if the result comes it is normal, and then it will be displayed on the touch screen. If we want in Software application, then we can check the status of the brain in ARDUINO IDE using the cable connected to hardware kit and the device is to be installed into the system/laptop in which Arduino software has been installed. In Tools menu, present in the Arduino application, click on the port which is enabled and after that we can directly see the status of the brain in the monitor. If any modification or update is noticed then the status will be sent through SMS and Email id for specific person in contact. Figure: 6 Brain Status Table with date and time. CONCLUSION & FUTURE ENHANCEMENT In this paper, we described a cloud-based system for performing large-scale brain connectivity analysis. We demonstrated that our approach can achieve fast data query and extraction for analytics and visualization. There are many avenues for future work. First, we would like to enhance the web GUI by making it more interactive and user friendly. Further, we intend to scale up to process much larger datasets (terabytes and above) with the goal of one day being able to perform such analysis on the human brain. We are also exploring the use of a polystore database such as BigDAWG as a data. Here we are using logid for every user, through that they are accessing their data. In future, thumb impression for every user can be added instead of logid. With this logid, misuse of data is possible. And this great kit can be converted into a chip and can insert either internally or externally. For autism people and illness people this can be inserted internally. And also, every person can use this in day to day life and can definitely escape from accidental health issues and also from forgeries being done without the particular person’s knowledge. REFERENCES: 1. Surekha, M. and Aswathy, R.H. A Survey Paper-EEG Based Keyboard for Crippled with Mind Wave Sensor using IAUI. International Conference on Advanced Computing and Communication Systems (2015). 2. Mufti Mahmud, David Hawellek, Aleksander Valjamae (2009): A Brain Machine Interface Based on EEG: Extracted Alpha Waves Applied to Mobile Robot 3. N.R. Raajan, G.N.Jayabhavani (2007) : A smart way to play using Brain Machine Interfacing 4. Chen, X., Wang, Y., Gao, S., Jung, T.P. and Gao, X. Filter bank canonical correlation analysis for implementing a high-speed SSVEP-based brain–computer interface. Journal of neural engineering 12 (4) (2015).
- 5. International Research Journal of Engineering and Technology (IRJET) e-ISSN: 2395-0056 Volume: 06 Issue: 05 | May 2019 www.irjet.net p-ISSN: 2395-0072 © 2019, IRJET | Impact Factor value: 7.211 | ISO 9001:2008 Certified Journal | Page 7875 5. Jae-Ho Han, Ji-hyun Kim, Jaeyoung Shin, Yiyu Chen, Shi Chang, Seungbae Ji, Seung-Beom Yu, Jichai Jeong (2014) : Non- Invasive Optical Methods for Brain Machine Interfacing and Imaging. 6. Francisco, Á., Ricardo, R.A., Leandro, S.S. and Salvador, S.R. BCI-based Navigation in Virtual and Real Environments. 12th International Work-Conference on Artificial Neural Networks, 2014. 7. Krusienski, D.J. and Shih, J.J. Control of a Visual Keyboard Using an Electrocortico graphic Brain– Computer Interface, Neurorehabilitation and neural repair 25 (4) (2011) 323-331. 8. Chatterjee, R. and Bandyopadhyay, T. EEG based Motor Imagery Classification using SVM and MLP. 2nd International Conference on Computational Intelligence and Networks (CINE), 2016, 84-89. 9. Ehsan Kamrani, S.K.Hahn, S.H.Andy Yun (2015); Optical EEG (OEEG): A Novel Technique toward Plug and Play Non-Invasive Brain Imaging and Human – Machine Interfacing. 10. John Paul Muelle, What is the Internet of Things? https://smartbear.com/learn/software- testing/internet-ofthings 11. Bi, L., Lian, J., Jie, K., Lai, R. and Liu, Y. A speed and direction-based cursor control system with P300 and SSVEP. Biomedical Signal Processing and Control 14 (1) (2014) 126-133. 12. Ponce, P., Molina, A., Balderas, D.C. and Grammatikou, D. Brain computer interfaces for cerebral palsy. Cerebral Palsy-Challenges for the Future, Access book publisher, 2014. 13. Gandhi, V., Prasad, G., McGinnity, T.M., Coyle, D. and Behera, L. Intelligent adaptive user interfaces for BCI based robotic control. Proceedings of the Fifth International Brain-Computer Interface Meeting, 2013. 14. Chambayil, B., Singla, R. and Jha, R. EEG Eye Blink Classification Using Neural Network. Proceedings of the World Congress on Engineering, 2010, 2-5. 15. Chambayil, B., Singla, R. and Jha, R. Virtual Keyboard BCI using Eye blinks in EEG. IEEE 6th International Conference on Wireless and Mobile Computing, Networking and Communications, 2010.