Applied Human-Machine and Media Interaction Modeling

Automated Modeling of Brain Activity Using Electroencephalographic Data

[Home ][Expertise][Contact Us]

Brain Activity>> [Brain Activity Playing Video Games][Real-Time Brain Activity Analysis][Application of Models to Intervention and Recovery]

 

 

Electroencephalographic (EEG) Data to Build Automated Models of Brain Function

We have recently created an analysis tool that facilitates the construction of models of brain function that describe what parts of the brain were active while persons performed various tasks.  The tool has thus far been used to create models of brain function while people play video games in two separate studies.  The major advancement of the current tool is that it allows for the analysis of brain activity using EEG data for novel behavioral tasks.  This frees the investigator from being limited to understanding brain function of tasks that have been well-established in neuroscience research.  This means that we can now study the brain activity of unique individuals, such as people with unique brain dysfunctions. This also means that we can now explore the brain activities assocated with novel situations such as viewing web sites, playing video games, viewing advertising, or watching television programs. 

 

Example Brain Activity Model

The figure and video on the right side of this page shows two models of brain activity constructed from EEG data collected while persons played a 1st-person video game based on the UnReal (tm) gaming engine.  The figure shows a recent model constructed from a large data set. The video shows a model constructed from a different, smaller dataset. Our modeling and analysis method shows what areas of the brain are active and how the activities of each area of the brain are coordinated during game playing. Viewing this in the context of what is currently known about the localization of function in the brain, we can begin to infer how people are using their brains to play the video game. The EEG data used in this example were collected using a BioSemi Active 2 EEG acquisition system with 64 (top figure) and 32 (bottom animation) electrodes.

Brain Analysis Method Used: MORE and MOST

The tool we created to provide this type of information utilizes our custom data mining and validation engine which employs our recently developed Multiple Origin Spatio-Temoral algorithm (known simply as the MOST algorithm).  The MOST algorithm is used in combination with other analysis steps in an advanced methodology for extracting meaningful information from EEG data. We call this Multiple Origin Relational EEG analysis (known as MORE analysis). The objective of all of this is to tell the story of brain function; to describe how the activities of various parts of the brain relate to each other given various human behaviors.

Applications: From Brain Injury to Advertising

We are currently evaluating MOST and MORE in two main contexts. (1) We are developing and evaluating the MOST algorithm and MORE analysis methodology for investigations of brain dysfunction.  For example, we are determining whether or not application of these methods can be used to determine how people with brain injuries use their brains differently than healthy persons and compensate for their injuries.  Once differences in brain activity are identify, then intervention and recovery can be pursued. (2) We are investigating how MOST and MORE might be applied in understanding how people interact with visual media such as web sites, digital signs, and standard static advertising.  For example, analysis of brain activity while viewing web sites can show us what parts of the brain become active for various types of visual information presented on a computer screen.  We are also examining if areas of the brain that process spatial relationships become active when related images are presented in various spatial configurations on a computer screen.

More information describing MOST-EEG applications and the related MORE analysis methodology are given in detail on our applications page.

BULLETIN: Applied Brain and Vision Sciences now provides access to the MOST-EEG algorithm via their Data Processing Portal.
Data Processing Portal Button