Project Xense is a museum exhibit that showcases both the challenges and the advances in implant and prosthetic technology.  The project is part of a larger “CyberPeople” exhibit at the National Museum of Health and Medicine, located in Washington D.C. and features interactive experiences about:

Simulations utilizing EEG headsets, head-mounted displays, real-time video processing, and more will allow guests to gain first-hand experience of the mental and physical challenges of using implants and to learn more about both the current and future technologies involved.  This union of medical science with media technology will hopefully educate and inspire the researchers as well as policy-makers of this generation and beyond.

Project Xense is funded by the Telemedicine and Advanced Technology Research Center (TATRC) and produced by students at Carnegie Mellon University’s Entertainment Technology Center (ETC).

Retinal Implants: Visual Experience
The “Visual Experience” demonstrates the technology of retinal implants. It is a sandbox tech demo that serves as a learning experience about vision loss. Guests will wear a head-mounted display equipped with a camera; the display will show video from the camera that has been processed in real-time to resemble the low-resolution vision afforded by retinal implants. In this sandbox experience, guests will be able to freely look about the room and at deliberately designed posters and physical objects. This experience encourages guests to experiment with and adapt to their new vision, helping them empathize with those who suffer from vision loss as well as appreciate what can be accomplished even with low-resolution vision.

Cochlear Implants: Audio Experience
The “Audio Experience” demonstrates the technology of cochlear implants. It is a cinematic experience about hearing loss and recovery. Utilizing film and post-processed audio, this experience tells the story of hearing loss and recovery from a first-person perspective. Along the way, interactive social situations involving dialogue trees place guests in virtual social situations that they must navigate with their limited hearing. As they clear each stage, however, they are given the ability to hear through simulations of what more and more modern cochlear implants sound like. This experience compels guests to reflect upon the difficulty of social communication with hearing loss and appreciate hearing implant technology. To experience the interactive cinematic, click on the the image below.

Full Interactive Demo (Opens new window)

Neuroprosthetics: Neuro Experience
The “Neuro Experience” demonstrates the technology of neuroprosthetics. It is a game-like simulation about rehabilitation that will ask guests to re-learn a familiar task. EEG headsets that detect brainwaves will mimic and simulate the interface of a neuroprosthetic limb by gathering the guest’s brainwave activity. Guests will have to try and move a virtual leg by actively controlling their own thoughts. Controlling one’s brainwave activity is inherently less familiar and intuitive than using a mouse or a keyboard, and guests will initially find it awkward and even frustrating; however, as they gradually adapt and succeed, and even if they don’t, the experience will leave them with humble respect for the difficulty that real amputees must go through to rehabilitate – to re-learn things that are often taken for granted but necessary to be self-sufficient in society.

Animation Assets – Main Menu Animation
Tools: Photoshop, Illustrator, After Effects

Loop-able animation made for Project Xense’s interactive museum installations during its idle-state. The graphics were made in Photoshop and Illustrator, and were animated in After Effects.