#1755: Hand-Tracked Sign Language as Story Beat Triggers in “Eddie and I”

I interviewed Maya Shekel about Eddie and I on Monday, September 1, 2025 at Venice Immersive in Venice, Italy.

Here is the story synopsis for Eddie and I:

"How do you overcome the fear of the unknown? Eight-year-old deaf Ron is afraid of his first camping trip. To calm him, his mother tells the story of Eddie the Camper, a friendly monster who grew up in the forest and is the perfect companion for a nature adventure. Despite her efforts, Ron, struggles to believe the story, and his fear persists. That night, Ron falls into a deep sleep and awakens in a surreal forest where he meets the player, embodied as Eddie the Camper. Together, they embark on an adventure full of challenges. But there’s one barrier standing in the way: Ron can’t hear, and the player doesn’t know sign language. Across this interactive VR experience, the player and Ron will need to work together to complete tasks like building a campfire, skipping stones in the river, stargazing, and even confronting a menacing carnivorous flower. Along the way, the player’ll navigate the forest, learn simple sign language keywords, and build trust. Will the player and Ron bridge the gap, overcome communication barriers, and succeed in the adventure?"

Here are the contextual domains that are explored:

Communication [3] in the context of feeling a bit exiled from the cutulre via the experience of deafness [12], but you cultivate empathy and connection [7] as you travel to a camping adventure [9] and be a friend to the main character [11]. You also embody a monster [12], but it is treated functionally as an invisble [12] friend [11].

Here is the Elemental Center of Gravity:

1st Center of Gravity of Emotional Presence: Scenes at home, and then off to a camping adventure with a 3-4 different distinct scenes. It's very story-driven, but the emodied interactions are also a main focal point2nd Center of Gravity of Fire Element / Active Presence: sign language actions very much inform the arc of the narrative, and emphasize the desire to connecct and empathize with the deaf protagonist3rd Center of Gravity of Earth Element / Environmental and Embodied Presence: The embodied interactions of doing the sign language with hand tracking, You are embodied as a main character within this story -- in fact the monster of Eddie4th Center of Gravity of Air Element / Mental and Social Presence: There is a bit of educational quality to it such that the end result does seem to be to teach various different sign language signs. But this is also very much not an educational application. It has teaching moments contained within the context of the story. So it is very-much still story-driven, but can still have a pedagocial edge to it, which can be in tension with the inherent narrative tensions of the story. More Air / Thinking than Water / Emotion overall in the piece for me

Archetypal Themes and Character Explored:

Communication through embodied actions. Empathy

Artist Statement:

"How can we communicate when we don’t share a common language? Whether it’s French, Arabic, or sign language, how can we bridge the gap between the unfamiliar and ourselves? This question goes beyond sign language, touching on the deeper challenge of connecting across cultures, communities, and different lived realities. Eddie and I transforms barriers into opportunities for connection. Users play Eddie, a friendly monster helping Ron, a deaf boy, overcome his fear of camping, using storytelling and hand-tracking to learn simple sign language and build trust. In an increasingly polarised world, Eddie and I seeks to reduce alienation, stigma, and intolerance, offering a safe, playful, empathetic encounter with “the other”. This embodied, memorable experience shows how technology can serve as a powerful tool to foster deeper understanding and empathy across all walks of life."

https://www.youtube.com/watch?v=9Cmrp3POKKo

This is a listener-supported podcast through the Voices of VR Patreon.

Music: Fatality