MyNote: Making
Emotion Tangible

Interaction Design, Affective Computing, Sound, Spatial Interfaces, App Development

When
May – November 2025
Practice
Multi-sensory interaction · App & spatial experience
My contribution
Three-person team
Concept, research & UI/UX
MyNote — the complete project introduction

A feeling doesn’t always begin with a word.

MyNote explores emotional expression through sound, musical characters, and spatial interaction. A feeling becomes something to listen to, look at, and revisit.

I led the concept and contributed research, product analysis, UI/UX, visual materials, and front-end design within a three-person team. We refined the experience through mentor feedback and distributed the application through TestFlight.

A handheld mood check-in in MyNote.
01

Express

A gentle check-in opens a personal conversation.

02

Listen

Musical and visual responses give a feeling a sensory form.

03

Revisit

A personal score and emotional traces create continuity over time.

Making room for more than a text entry

The research considers the gap between digital connection and the ability to communicate an internal experience. Emotional granularity, affective interaction, and calm technology informed a system with several expressive channels.

Three principles emerged: make expression tangible, connect sensory modes, and preserve room for a person’s own interpretation.

The background and theoretical lens informing emotional expression.
From the design opportunity to principles, interaction, and emotion mappings.

From a daily check-in to a personal score

Mood recording, musical response, immersive listening, and emotional history belong to one connected journey. Each representation offers a way to reflect; the person remains the authority on what their experience means.

MyNote’s connected journey: check in, listen, and revisit.
The immersive listening and viewing environment.

An emotion can occupy a space.

The spatial experience gives visual and sonic elements a surrounding presence. A shared visual language connects a brief mobile check-in with a more immersive moment of listening.

One language across sensing, sound, and space

The visual identity grows from musical notation: a personified “M” and expressive note characters connect MyNote to the idea of a personal score.

The team’s technical exploration connects SwiftUI, HealthKit, Core ML, AudioKit, and RealityKit with a FastAPI and Firebase/Firestore backend. My contribution centred on the concept, research, product analysis, UI/UX, visual materials, and front-end design. Local musical feedback and asynchronous generation were explored to balance responsiveness with richer output.

The architecture boards document several model configurations and experiments. They describe the development process rather than one fully validated production pipeline.

Sensing, expressive input, and the musical response pipeline.
A visual language across musical characters, mobile UI, and spatial prototypes.

Taking MyNote into a wider conversation

MyNote received a National Second Prize in the 2025 Mobile Application Innovation Competition and a National Third Prize at UXDA. I also joined the competition’s project showcase workshop.

2025

National Second Prize

China Collegiate Computing Contest
Mobile Application Innovation Competition

UXDA

National Third Prize

17th User Experience
Design Award

At the Mobile Application Innovation Competition.
At the competition’s project showcase workshop.

The showcase offered a place to share the project and continue developing the experience.

View competition posters & photographs +
Mobile Application Innovation Competition — project poster.
UXDA — project poster.
Competition photograph.
Sharing the competition experience.

What makes an emotional representation feel personal?

Further work would explore how people interpret the connection between a mood and its musical or visual response over longer-term use.

The original portfolio

Every board, in full.
Open a board to explore the details.

View all 6 complete boards
01 — Project introduction
02 — Background and theoretical lens
03 — Opportunity, principles, and interaction mappings
04 — Architecture and music-generation experiments
05 — Implementation and connected user journey
06 — Visual identity and prototype family