An AR Display Kit for Deaf Education
A Better Model of Gauging Fear of Height
A Soft Robot Companion for Depressed People
Enhancing AI with Eye Data
Visualizing Orchestra Music for Deaf People
“Bridging Deaf Children to Quality Education Recovery”
Resonant Echoes is an innovative augmented reality interface that helps teachers understand the intentions of language-impaired kids, facilitating better rehabilitation and social engagement for deaf students.
Deaf children often lack sufficient language skills during rehabilitation, which hinders their socialization due to difficulties in communication. The ‘Resonant Echoes’ helps therapists overcome understanding difficulties with an XR display and embedded AI, focusing on a role-play game scenario.
Current Status: IMWUT 24′ under review
“Unlock the secret of fear”
Acrophobia, the fear of heights, significantly affects overall quality of life. People who suffer from acrophobia know this fear is excessive and unreasonable, yet 6.4% of total population suffer from this issue.
We investigated the feasibility of passive sensing data for fear measurement and discern the most influential physiological and behavioral indicators.
“Record and soothe depression with a soft robot”
Fufu’s diary is program aimed at helping the depression patients, especially in the situation thatCOVID-19 pandemic is separating people physically, making it harder to get offline treatment.
Fufu contains both Online And Offline (OAO) product, all the way to an integrated service system. Here we present fufu’s diary, in a very story-telling way.
Current Status: IMWUT 24′ under review
“Can AI understand us better if eye data is shared?”
As developers of general artificial intelligence increasingly shift their focus towards incorporating more modalities of information such as images and sounds, we can’t help but wonder: If we provide such rich eye movement information to artificial intelligence, could it enable them to better understand us?
“Supporting Remote Communication with Hand Interactions”
Zing Ring is a wearable platform that allows personalized, continuous and tangible support for remote communication. It utilizes hand gestures as a supplementary of intense communication.
This project is an application of Dual IMU Rings technology developed by PI Lab, inspired by the difficulties encountered by people in remote relationships during the COVID-19.
TabcT (Thermal Activated Bacteria Cancer Therapy) is a temperature-controlled bacterial therapy developed by Tsinghua 2023, targeting breast cancer, and it offers the advantages of being 5C: cheap, convenient, controlled, continuous, and comprehensive. This is a collaborative project, Yuchen partook in this program as a design advisor and software developer.
“Reimagine the unheard miracles in an alternate expression”
Imagine a world where no mellifluous birdsong, soft-spoken words, or majestic melodies exist. How poignant to miss these sounds! Yet, 448 million globally endure this quietude due to auditory impairment.
In 2021, a group of Tsinghua University students aspired to bridge this void. They sought to ‘play’ a symphony in lights, enabling those with hearing loss to partake in the symphony’s wonder, in a one-to-one sensory dance.
An artistic installation that embodies a variety of light and shadow patterns within its Sisyphean cycle.
Tools: Raspberry Pi, Smart Car
An astronaut-specific tea kettle leveraging space’s zero-gravity. It’s engineered to avoid spills and enables convenient swapping of tea bags.
Tools: Rhino, Realflow
An artistic phone sound amplifier with a special chamber design for audio enhancement, doubling as a vase for fresh flowers, offering both visual and auditory delight.
Tools: Rhino, Keyshot
A biomimetic animal based on a four-bar linkage, replicating an insect’s gait, composed entirely of one type of part.
Tools: Solidworks, Mechanical Manufacturing
A dynamic art installation, emulating Alexandar’s style, depicting a Chinese verse：
“You stand on the bridge, beholding the view / While from the tower, the viewers behold you / The bright moon adorns your window’s frame / And in others’ dreams, you do the same.”
A personal companion app that establishes a unique personality, founded on the ‘I as my own partner’ principle, by constructing a virtual self from user’s linguistic inputs.
Tool: Swift
‘Moonster’ has identified users’ tendencies to either venture beyond or stick to their comfort zones in music.
This platform allows you to explore what songs others are enjoying and adapt your monster persona to mingle in various music-listening groups.
Tools: Figma
Utilizing NeRF technology, I achieved the reconstruction of virtual avatars from 2D photos to 3D models. A 3D model was rebuilt from 24 high-definition photographs.
‘New Wave’ is a memorable art performance event. It took five months of preparation and was presented to over 1,000 spectators. Yuchen served as the stage director, and the event featured a ‘vintage radio’ artistic concept, linking all performances in a time-traveling radio story.
An exploration into a new reading medium. I’ve envisioned a virtual space where users can create virtual buildings, embedding articles, videos, and other information within, offering a non-linear reading experience.
Tool: Minecraft
#UX #CV #Assistive Technology
#UX #LLM #Interface
#Algorithm #AI Design #Knowledge Map
