Brain control interfaces are changing human computer action in exciting, profound new ways. One of the brightest and boldest engines driving this change is the affordable Emotiv EPOC consumer EEG headset. This 14-electrode headset can detect facial gestures, head movements, even strong thoughts or feelings. The goal of the eSharp project is to bring this technology to the massive C# developer community with a powerful toolkit that wraps the power of the Emotiv SDK in a convenient, easy to use set of components and gadgets.
This is the important part. As a modern software developer you know how vital a rich set of mature tools and solid use case examples can be to a software development project, especially since time is always scarce and deadlines are relentless. I am a veteran programmer that has spent the last few years developing applications for the Emotiv EPOC. I already have an existing toolkit for the EPOC written for Delphi 6 that dramatically reduces the time it takes to develop brain control applications, allowing me, and soon you, to concentrate on the fun and intriguing parts of the app instead of the Emotiv SDK. My affection for Delphi is as deep as the ocean but the reality is C# is also a terrific development environment and the dominant player in the PC desktop marketplace, so that's where I'm heading. The purpose of the eSharp project is to raise the funds needed to provide the time and tools necessary to port my existing toolkit in Delphi to C#.
The Project Goal - Open Source C# Toolkit
The end result of the project will be a set of open source tools for C# ported directly from my existing Delphi toolkit. The open source license will be a liberal BSD style license instead of a license that requires you to take actions that you may not be able to comply with. It will be a "just use it" license instead of one that requires you to share your source code. If you get rich building the next killer app with brain control then you keep all the rewards.
Who Am I?
My name is Robert Oschler, a veteran programmer with a passion for pushing the envelope of what computers and software can do. Please see the list of quotes about my work and myself at the bottom of this page. For a quick overview see this New York Times article that talked about my work with robots and the Emotiv EPOC. Also, you will find a wealth of comments about my work and myself near the bottom of this page.
Robodance, the app mentioned in the article, used the same toolkit that is shown in the video and at the heart of the eSharp project. Later I added the ability to record movies of remote telepresence sessions directly to Evernote. Robodance won the prestigious Project Of The Month award from SourceForge, the largest open source respository on the web in May 2005.
Detecting Facial Gestures
eSharp contains a wealth of events that fire whenever the EPOC detects a facial gesture, so you can write apps that detect smiles, laughs, eye blinks, and more, opening the door to intriguing new apps that can change based on the users mood, or note when they have a positive or negative reaction to entertainment media like videos, pictures, etc., an example of this was shown in the project video. There is one easy to use event for when the facial gesture starts and another for when it stops, giving you all the information you need to react to a facial gesture when it begins and ends, or to note the exact time interval a facial gesture occurred in.
Detecting Head Movement
There are convenient events that fire whenever the EPOC detects head movement giving you easy access to the horizontal and vertical head movement change values. eSharp goes even further than the Emotiv SDK by providing higher level events that tell you when the user shakes their head YES or NO, which can be useful for EPOC based dialogs that prompt the user for action, or for creating applications that can tell when a user agrees or disagrees with the current content like during a Skype call, a watching video or speech, or anything else your imagination as a developer conjures up. It even has a built-in event for detecting a series of voluntary eye-blinks by the user, an effortless movement that can be used to trigger key actions in your software.
Detecting Mood or Mental State
You can even record or react to the user's mental state detecting key attributes like Frustration, Boredom, Engagement, and others. The eSharp component gives you easy access to those values from the provided events as shown in the YouTube example in the pitch video that combined mood detection with the Evernote API.
Detecting a Strong Thought or Feeling
One of the most fascinating features of the EPOC headset is that it can be trained to detect a strong thought or feeling the user has and then detect or react to that thought or feeling when the user experiences it. The eSharp component provides a set of events that fire for each key event that occurs during the training process. More importantly, one of the many examples that will be provided as part of the project is how to use the component to do training and you can use that example to build your own code for your application.
Quotes about me
Here are some quotes about me from some of the most talented inventors and entrepreneurs in the world:
"Robert Oschler has shown himself to be a 21st century media-robot renaissance man. Sing, program, video, and can pull it all together admirably. He's been a one-man pro-robot advocate and as such will be one of the last destroyed during the machine uprising."
--- Mark Tilden, Robotics Physicist and inventor of the best-selling Robosapien line of robots distributed by WowWee, Ltd.
"Robert is one of the few developers who really understands the future of Robotics."
--- Caleb Chung, inventor of the mega-hit Furby animatronic toy and the Pleo baby robot dinosaur.
(Regarding my Rovio spy robot demonstration with the EPOC EEG headset).
"This is a great demonstration of the capabilities of the Emotiv EPOC. Robert has cleverly integrated several applications with the Emotiv SDK to provide a remote roving security robot under full hands-free control of the user. The application takes advantage of encrypted remote internet control and video acquisition using Skype to provide a secure and foolproof link to the robot, which could be in your apartment, inside a nuclear reactor or even on Mars (expect a bit of transmission lag for your Martian robot)."
--- Tan Le, CEO of Emotiv Systems Inc.
"Robert has a been a great supporter of WowWee's consumer robot products over the years. His program Robodance is an impressive software program that really highlights the features of our best-selling line of robot products, and also makes them easier to use. In addition, he has an unusual knack for getting the praise and attention of the top gadget blogs and web sites like Gizmodo, Engadget, SlashDot, and many others who have covered on numerous occasions his video reviews and high tech demonstrations involving our products. His best work though has been with Rovio, our WiFi enabled mobile spy cam robot, a revolutionary product for home telepresence. His recent video, where he used the Emotiv EEG headset to pilot a Rovio remotely over a Skype video call using only his thoughts and facial gestures, has become an instant favorite with us."
--- Amy Weltman, VP Marketing, WowWee USA Inc.
In May of 2005 version 2 my Robodance software program won the coveted Project Of The Month award from SourceForge.net, the largest open source repository in the world. Out of thousands and thousands of software projects, SourceForge awards just one of them the Project Of The Month award for the current month.
Quotes about Robodance
“Amazing i-SOBOT & WiiMote Mash-up (Video)”
--- Lem Fugitt, one of PC Magazine’s favorite robotics bloggers in his post about the Robodance 4 sneak peek video I released late last year.
"In my opinion this (Robodance, my software program) is the gold standard that all other PC based control programs should seek to emulate."
--- Jamie Samans popular book “The Robosapien Companion”, pp. 211
"Using Emotiv's SDK and his own Robodance software, RobotsRule resident mad scientist Robert Oschler hacked together a system that allows him to use the headset to control the robot remotely via Skype. We can't find a good reason to put this all together except one: it's totally awesome."
--- Matt Hickey, Crave blogger at C|Net and also a writer at Gizmodo.
"You've seen Rovio hackery before, but not like this. Not with MIND CONTROL and Skype both involved. In regards to my Robodance software and the Rovio spy robot."
--- Kat Hannaford staff writer at Gizmodo.