IVE 2024 Short Course - Lecture16- Cognixion Axon-R

Cognixion Axon-R
Realtime Biosignals for Augmented Reality

Integrating Neural Data into
VR/AR is expensive, difficult
and unreliable. Until now.
1. Prototype Limitations: Custom-
built solutions increase costs,
time and complexity, hindering
study speed and validity.
2. Isolated Systems: Solutions
limited to isolating displays with
monitors and an emphasis on
VR.
3. Complex Systems: Existing
systems with difficult
integrations, long set-up times
and steep learning curves.
4. Clinical Compatible Equipment:
Difficulty in obtaining patient
safe, medical-grade hardware.
5. Space Constraints: Conducting
study outside a lab setting is
extremely difficult and limited.
©2024 Proprietary and Confidential. International Patents Issued & Pending. All Rights Reserved. 2

Cognixion is making it EASIER
To setup, develop, test, and deploy neural data acquisition for XR applications
Conceptualization and Initial
Research
Experiment Definition
Device Evaluation & Procurement
Development & Prototyping
Experimentation and Data Collection
Data Analysis & Troubleshooting
Summation of Findings
Publication and Dissemination
We solved the problem for ourselves. And
are now making our internal innovation
available to you.

Our Solution for Integrating BCI + Generative AI + Spatial Computing
Axon-R the complete platform for Multimodal Healthcare & Advanced HMI Research
BCI STUDIO™
DENDRITE™ BIPOLAR CABLE FOR
EXTENDED EMG, ECG/EKG, EOG, EEG
NUCLEUS™ NEURAL HUB™
AXON-R™ BCI + AR HEADSET

Method of Operation
Axon-R enables precise measurement and modulation of brain activity through
visual stimuli, biofeedback, and neurofeedback
AR Display
Visual stimuli is presented to the subject eliciting response
Biosignal Input
Primary: EEG signals are collected on the occipital area of the subject
using the electrode headband.
Secondary: Expanded optional data collection such as Headpose
and ExG* with the optional DENDRITE™ CABLE
Biosignal Processing
Collected data is ingested in the off body NUCLEUS™ NEURAL HUB™
and sent as raw data for computation
On-Device Compute
Biosignal data is processed and classified on-device with the
Cognixion BCI classifier
Wireless Data Stream
Data streamed wirelessly though LSL channels and saved on a
laboratory computer for application integration and/or further
analysis
1
2
3
4
5

BCI Studio™
API Based Configurator: JSON/REST API based
configuration using Postman or Python.
LSL Stream: LSL streams with raw, filtered and
classified data for easy integration.
Impedance Check: Integrated Impedance check
to ensure data integrity across all experiments.
Expanded Support: Support for integration and
dataflows with: Python, AcqKnowledge, Intheon
Neuropype, Openvibe and Unity
API BASED CONFIG
LSL STREAM
IMPEDENCE CHECK

Off-Device
Python
Support for off-device
Python integration
and dataflows.
Out of the box compatibility with your current workflows and data pipelines
Software Integrations & Architecture
Unity 3D Game
Engine
The Axon-R OS (Android)
presents as a Unity
development target. Port or
build your Unity apps to
Axon-R for immersive
neural integration.
OpenVibe
Create and run custom
applications, along with pre-
configured and demo
programs. Sample scenes
included.
BIOPAC
AcqKnowledge
Direct device
integration into
AcqKnowledge -
compatible with other
BIOPAC lab systems.
Lab Streaming
Layer (LSL)
All sensor data presents as
LSL channels over WiFi
2kHz/channel.
Intheon
Creators of the popular
NeuroPype and NeuroScale
that simplify the process of
multi-modal analysis and
make data science
accessible to more people.

Sources of Value
Immersive Neurophysiology-focused System: Only purpose-built fully AR device with
unique on-device ssVEP classifier system.
Untethered Research Versatility: Wearable and fully portable form factor allows for in-
field and diverse environment studies.
Multimodal System: 6+2 EEG Cable and Din 8 ExG accessory for diverse placement and
use.
Medical-Grade Components: research-backed medical-grade components
Patient-Centric Design: Focus on safety and comfort, suitable for various medical
conditions and positions (laying down etc.)
Lab Grade Signal Quality: ensuring quality and consistency that includes a built in
impedance check across all channels.
LSL Integration: Offers comprehensive data streams over WiFi for seamless analysis and
across 16 channels of sensor data at 2kHz samples per second.
No-Code SDK: BCI Studio™ enables easy, rapid development without deep programming
knowledge.
Robust SW Support: Python, Intheon, and AcqKnowledge, as well as Unity support for
developing custom XR applications.
1
2
3
4
5
6
7
8
9

Where can this platform be used?
Translational Research & Innovative Applications
Education &Training
Entertainment and
Immersive Experiences
Emotional States &
Measuring Affect
Clinical Diagnostics
& Rehabilitation
Wellness &
Mental Health
Assistive Tech
for Daily Living
Accessibility
Visual, Auditory
Attention

Leading The Way
Unmatched Relationships & Influence
Over 50 international patents
FDA Breakthrough Designation for medical version
Leading Healthcare & Research Organizations
Leading Big Tech companies
US Delegate for International Standards
Customers
Research
Strategics
Standards
&
Advocates
Integrations

Sensor Fusion: Merge Other Data into Axon-R
Blurring the lines between invasive and non-invasive, unlocking the future of healthcare

Use Cases Examples
Passive, Adaptive and Active BCI
1.
2.
Overlay device controls using AR and enable BCI based selection.
Exploratory Areas: Hands-free controls, Accessibility device control for
(ALS, CP, Stroke, etc), Prosthetic limb control, machinery control.
Use Case Examples:
In manufacturing settings, users can control machinery or access information
through AR using only their thoughts.
Allow individuals to adjust room lighting, call for assistance, or even control
TV/entertainment systems through thoughts.
Human-Computer Interaction

Use Cases Examples
1.
2.
Use in clinical diagnostics, rehabilitation, and monitoring of
neurological conditions.
Exploratory Areas: Stroke rehab, epilepsy diagnostic and monitoring,
cognitive rehabilitation, degenerative retinal diseases.
Use Case Examples
For stroke patients, combine EEG readings with AR-guided physical tasks,
allowing the patient to interact with and move virtual objects, aiding in
motor recovery.
Continuous monitoring of brain activity in patients with conditions like
epilepsy, autism, providing valuable data to healthcare providers.
Medical and Clinical Research

Use Cases Examples
1.
2.
3.
Enhancing learning experiences and operational training.
Exploratory Areas: Adaptive learning materials, skill acquisition, and
language learning.
Use Case Examples
AR study material that dynamically adjusts complexity or provides
additional details when the EEG detects a user is confused or has lost
concentration.
For professionals learning a new language or skill, an AR interface
provides hints or translations when confusion is detected.
In technical settings, provide context-aware information and (optionally)
translate technical jargon.
Educational and Training Tools

Use Cases Examples
1.
2.
Addressing mental health through brain wellness exercises and mood
tracking.
Exploratory Areas: Stress management, meditation, mood
assessment, and brain training games.
Use Case Examples:
AR tasks/games that help users train their ability to focus or shift attention.
(Lumosity)
Users can get real-time feedback on their brain states during meditation and
visualize their progress using augmented reality (AR) visual cues.
Wellness and Mental Health

Use Cases Examples
1.
2.
Enhancing safety in high-risk areas & jobs through monitoring and
adaptive controls.
Exploratory Areas: Fatigue detection, focus detection automated
safety responses, and smart device integrations.
Use Case Examples:
AR warnings or signals for workers in hazardous environments, adapting
based on fatigue or distractibility detected by the EEG.
If an individual is detected to be incapacitated or under extreme stress,
automated systems could be activated for safety.
Safety and Prevention

Use Cases Examples
1.
2.
Creating immersive and personalized entertainment experiences.
Exploratory Areas: Adaptive gaming, mood-based media control, and
interactive virtual environments.
Use Case Examples
AR games that change and adapt based on the user's emotional state or
level of concentration, providing an immersive experience.
Play music, video or soundscapes by just thinking about a specific mood
or genre.
Entertainment and Personalization

Use Cases Examples
1.
Investigating brain functions, cognitive processes, and neural
responses.
Exploratory Areas: Memory, attention, perception, and cognitive load.
Use Case Examples
Axon-R serving as a mobile lab reducing the need for dedicated spaces
and rooms to conduct research.
Neuroscience and Cognitive Research

AR + Brain-Computer Interface Research continues to rapidly grow
Human-Computer
Interaction
Medical and Clinical
Applications
Safety and Prevention
Educational and
Training Tools
Wellness and Mental
Health
Entertainment and
Personalization
Angrisani, Leopoldo & Arpaia, Pasquale & De Benedetto, Egidio & Duraccio, Luigi & Regio, Fabrizio & Tedesco, Annarita. (2023). Wearable Brain–Computer Interfaces
Based on Steady-State Visually Evoked Potentials and Augmented Reality: A Review. IEEE Sensors Journal. PP
. 1-1. 10.1109/JSEN.2023.3287983.

Axon-R makes impossible things possible:
Neural AR interface for Mobility Controls for people with SCI, TBI,
Quadriplegia, Stroke, ALS/MND, amputated limbs,
speech paralysis or dysarthria.

Device Control
Visual Stimuli Classification

Axon-R makes impossible things possible:
Personalized AI+Neural Speech Prosthesis for
Stroke, TBI, ALS, Parkinsons & Other Disabilities

Order Axon-R
Unlock the Power
of Neural Data in
your AI and AR
initiatives.
Standard
Advanced
Elite
Cognixion One Axon-R with
WiFi & Bluetooth; Indoor Lens
Bipolar Cable with 8 Additional
Channels for ExG Sensing
(ECG, EMG, EOG)
Extended Warranty, Platinum
Support
BCI Studio™
AR Templates, Online
Resources, Customer Support
Tinted Outdoor Lens

Shipping Now
Worldwide
North America
Shipping Late 2024

Hardware:
1. Axon-R™ BCI headset
2. Nucleus™ Neural Hub™
3. Dendrite™ Cable

IVE 2024 Short Course - Lecture16- Cognixion Axon-R

More Related Content

Similar to IVE 2024 Short Course - Lecture16- Cognixion Axon-R (20)

More from Mark Billinghurst (20)

Recently uploaded (20)

IVE 2024 Short Course - Lecture16- Cognixion Axon-R