Multimodal Perception
Hydra
Complementary mmWave–vision fusion for sensing under adverse conditions
Research question. Can complementary sensing modalities preserve physical perception when one channel degrades?
Core idea. Fuse mmWave depth images and RGB features with a learned multimodal encoder.
Key result. Up to 96% accuracy across evaluated scenarios, with around 90% accuracy in rainy, dawn, or poorly lit farm conditions.