February 3
@
3:00 PM
–
4:00 PM
Location TBD
Diffusion-enabled 3D human pose tracking, data augmentation, completion, and acceleration
Abstract:
In recent years, 3D human activity recognition and tracking has become an important topic in human-computer interaction. To preserve the privacy of users, there is considerable interest in techniques without using a video camera. In this talk, Mao first presents RFID-Pose, a vision-assisted 3D human pose estimation system based on deep learning (DL). The performance of DL models depends on the availability of sufficient high-quality radio frequency (RF) data, which is more difficult and expensive to collect than other types of data. To overcome this obstacle, in the second part of this talk, he presents generative AI approaches to generate labeled synthetic RF data for multiple wireless sensing platforms, such as WiFi, RFID, and mmWave radar, including a conditional Recurrent Generative Adversarial Network (R-GAN) approach and diffusion/latent diffusion based approaches. Next, he proposes a novel framework that leverages latent diffusion transformers to synthesize high quality RF data, as well as a latent diffusion transformer with cross-attention conditioning to accurately infer missing joints in skeletal poses, completing full 25-joint configurations from partial (i.e., 12-joint) inputs utilizing received RF sensory data. Finally, he presents recent work TF-Diff, a novel training-free diffusion framework for cross-domain radio frequency (RF)-based human activity recognition (HAR) system, which enables effective adaptation with minimal target-domain data.
Professor Shiwen Mao
Bio:
Shiwen Mao is a Professor and Earle C. Williams Eminent Scholar and Director of the Wireless Engineering Research and Education Center at Auburn University. Dr. Mao’s research interest includes wireless networks, multimedia communications, RF sensing and IoT, smart health, and smart grid. He is the editor-in-chief of IEEE Transactions on Cognitive Communications and Networking, a member-at-large on the Board of Governors of IEEE Communications Society, and Vice President of Technical Activities of IEEE Council on Radio Frequency Identification (CRFID). He is a co-recipient of several technical and service awards from the IEEE. He is a Fellow of the IEEE.