Hi! I am Jiaqi Zhang (Chinese name: 张家旗)

Southern University of Science and Technology (SUSTech)

Research Assistant.

Technical University of Munich (TUM)

Research Assistant.

Advisor: Prof. Björn Schuller (IEEE Fellow)

• We propose PriMD, a primitive memory distillation framework that disentangles shared semantics from modality-specific information and dynamically compensates missing modalities with primitive memory, addressing the instability of missing-modality compensation caused by existing methods’ holistic generation, alignment, or distillation of missing modalities without distinguishing shared semantics from modality-specific details.
• We propose D²IB, a differentiated dual-level information bottleneck framework that models differences in modality reliability and modality-combination dominance, and performs differentiated information compression at two bottleneck levels, addressing the problems of insufficient noise suppression and inadequate learning of weak modalities caused by existing methods’ neglect of such differences.