I work on generative modeling, representation learning, and efficient inference.
I am a senior research engineer at Huawei Hong Kong Research Center. My recent work spans full-duplex spoken dialogue models and neural audio codecs for music generation. My work includes synthetic data generation, post-training, self-supervised representations, vector quantization, and flow-matching decoders.
I received my Ph.D. in Electrical and Electronic Engineering from the University of Hong Kong, supervised by Prof. Ngai Wong and Prof. Edmund Y. Lam. My earlier research explored efficient neural representations and inference; collaborative work also spans GUI agents and multimodal evaluation.
I explore how models learn useful representations, generate structured outputs, and run efficiently. My recent applications include full-duplex spoken dialogue and neural audio codecs for music generation.
01
SPOKEN DIALOGUE
Learning when to listen and respond
Full-duplex dialogue requires more than recognizing speech. I work on synthetic dialogue data and post-training for turn-taking, backchannels, and interruptions, adapting a turn-based model for continuous interaction.
Spoken dialogue · Synthetic data · Post-training
02
REPRESENTATION LEARNING & GENERATION
Neural audio codecs for music generation
My neural audio codec work brings together self-supervised encoders, vector quantization, and flow-matching decoders. I have led a team of four engineers and researchers exploring these components for music generation, with a focus on representation learning and generative modeling.
From compact neural representations to LLM decoding, I study how model design and inference algorithms affect computational cost. My work spans activation sharing, lookup tables, low-bit quantization, and parallel and speculative decoding.
Selected publications from my work on GUI agents and efficient neural representations, explained through the problem each addresses. Full citations and resources follow below.
EMNLP 2025
Knowledge for GUI agents
KG-RAG uses structured knowledge of app interactions to guide an agent’s decisions through retrieval-augmented generation.
A milestone example connects our trajectory scorer to Jev’s structured decisions. Compare progress, proximity, expected scores, and confidence—and explore what they could change about BFS.
Generative AI research spanning full-duplex spoken dialogue models and neural audio codecs for music generation, alongside work on speech recognition. Previously a research intern at Fermat Lab, working on GUI agents.
2023 — 2024
TCL Corporate Research (HK)
Research Intern
LLM inference acceleration, parallel and speculative decoding, and efficient diffusion models for edge devices.
2020 — 2024
The University of Hong Kong
Ph.D., Electrical and Electronic Engineering
Supervised by Prof. Ngai Wong and Prof. Edmund Y. Lam. Previously B.Eng. in Electronic Engineering, Class of 2020.