Suhas Lohit

Suhas Lohit
Suhas' Quick Links

  • Biography

    Before coming to MERL, Suhas worked as an intern at MERL (summer 2018), SRI International (summer 2017) and Nvidia (summer 2016). His research interests include computer vision, computational imaging and deep learning. Recently, his research focus has been on creating hybrid model- and data-driven neural architectures for various applications in imaging and vision. He won the Best Paper Award at the CVPR workshop on Computational Cameras and Displays in 2015 and the University Graduate Fellowship at ASU for 2015-16.

  • Recent News & Events

    •  NEWS    MERL Papers and Workshops at CVPR 2025
      Date: June 11, 2025 - June 15, 2025
      Where: Nashville, TN, USA
      MERL Contacts: Matthew Brand; Moitreya Chatterjee; Anoop Cherian; François Germain; Michael J. Jones; Toshiaki Koike-Akino; Jing Liu; Suhas Lohit; Tim K. Marks; Pedro Miraldo; Kuan-Chuan Peng; Naoko Sawada; Pu (Perry) Wang; Ye Wang
      Research Areas: Artificial Intelligence, Computer Vision, Machine Learning, Signal Processing, Speech & Audio
      Brief
      • MERL researchers are presenting 2 conference papers, co-organizing two workshops, and presenting 7 workshop papers at the IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2025 conference, which will be held in Nashville, TN, USA from June 11-15, 2025. CVPR is one of the most prestigious and competitive international conferences in the area of computer vision. Details of MERL contributions are provided below:


        Main Conference Papers:

        1. "UWAV: Uncertainty-weighted Weakly-supervised Audio-Visual Video Parsing" by Y.H. Lai, J. Ebbers, Y. F. Wang, F. Germain, M. J. Jones, M. Chatterjee

        This work deals with the task of weakly‑supervised Audio-Visual Video Parsing (AVVP) and proposes a novel, uncertainty-aware algorithm called UWAV towards that end. UWAV works by producing more reliable segment‑level pseudo‑labels while explicitly weighting each label by its prediction uncertainty. This uncertainty‑aware training, combined with a feature‑mixup regularization scheme, promotes inter‑segment consistency in the pseudo-labels. As a result, UWAV achieves state‑of‑the‑art performance on two AVVP datasets across multiple metrics, demonstrating both effectiveness and strong generalizability.

        Paper: https://www.merl.com/publications/TR2025-072

        2. "TailedCore: Few-Shot Sampling for Unsupervised Long-Tail Noisy Anomaly Detection" by Y. G. Jung, J. Park, J. Yoon, K.-C. Peng, W. Kim, A. B. J. Teoh, and O. Camps.

        This work tackles unsupervised anomaly detection in complex scenarios where normal data is noisy and has an unknown, imbalanced class distribution. Existing models face a trade-off between robustness to noise and performance on rare (tail) classes. To address this, the authors propose TailSampler, which estimates class sizes from embedding similarities to isolate tail samples. Using TailSampler, they develop TailedCore, a memory-based model that effectively captures tail class features while remaining noise-robust, outperforming state-of-the-art methods in extensive evaluations.

        paper: https://www.merl.com/publications/TR2025-077


        MERL Co-Organized Workshops:

        1. Multimodal Algorithmic Reasoning (MAR) Workshop, organized by A. Cherian, K.-C. Peng, S. Lohit, H. Zhou, K. Smith, L. Xue, T. K. Marks, and J. Tenenbaum.

        Workshop link: https://marworkshop.github.io/cvpr25/

        2. The 6th Workshop on Fair, Data-Efficient, and Trusted Computer Vision, organized by N. Ratha, S. Karanam, Z. Wu, M. Vatsa, R. Singh, K.-C. Peng, M. Merler, and K. Varshney.

        Workshop link: https://fadetrcv.github.io/2025/


        Workshop Papers:

        1. "FreBIS: Frequency-Based Stratification for Neural Implicit Surface Representations" by N. Sawada, P. Miraldo, S. Lohit, T.K. Marks, and M. Chatterjee (Oral)

        With their ability to model object surfaces in a scene as a continuous function, neural implicit surface reconstruction methods have made remarkable strides recently, especially over classical 3D surface reconstruction methods, such as those that use voxels or point clouds. Towards this end, we propose FreBIS - a neural implicit‑surface framework that avoids overloading a single encoder with every surface detail. It divides a scene into several frequency bands and assigns a dedicated encoder (or group of encoders) to each band, then enforces complementary feature learning through a redundancy‑aware weighting module. Swapping this frequency‑stratified stack into an off‑the‑shelf reconstruction pipeline markedly boosts 3D surface accuracy and view‑consistent rendering on the challenging BlendedMVS dataset.

        paper: https://www.merl.com/publications/TR2025-074

        2. "Multimodal 3D Object Detection on Unseen Domains" by D. Hegde, S. Lohit, K.-C. Peng, M. J. Jones, and V. M. Patel.

        LiDAR-based object detection models often suffer performance drops when deployed in unseen environments due to biases in data properties like point density and object size. Unlike domain adaptation methods that rely on access to target data, this work tackles the more realistic setting of domain generalization without test-time samples. We propose CLIX3D, a multimodal framework that uses both LiDAR and image data along with supervised contrastive learning to align same-class features across domains and improve robustness. CLIX3D achieves state-of-the-art performance across various domain shifts in 3D object detection.

        paper: https://www.merl.com/publications/TR2025-078

        3. "Improving Open-World Object Localization by Discovering Background" by A. Singh, M. J. Jones, K.-C. Peng, M. Chatterjee, A. Cherian, and E. Learned-Miller.

        This work tackles open-world object localization, aiming to detect both seen and unseen object classes using limited labeled training data. While prior methods focus on object characterization, this approach introduces background information to improve objectness learning. The proposed framework identifies low-information, non-discriminative image regions as background and trains the model to avoid generating object proposals there. Experiments on standard benchmarks show that this method significantly outperforms previous state-of-the-art approaches.

        paper: https://www.merl.com/publications/TR2025-058

        4. "PF3Det: A Prompted Foundation Feature Assisted Visual LiDAR 3D Detector" by K. Li, T. Zhang, K.-C. Peng, and G. Wang.

        This work addresses challenges in 3D object detection for autonomous driving by improving the fusion of LiDAR and camera data, which is often hindered by domain gaps and limited labeled data. Leveraging advances in foundation models and prompt engineering, the authors propose PF3Det, a multi-modal detector that uses foundation model encoders and soft prompts to enhance feature fusion. PF3Det achieves strong performance even with limited training data. It sets new state-of-the-art results on the nuScenes dataset, improving NDS by 1.19% and mAP by 2.42%.

        paper: https://www.merl.com/publications/TR2025-076

        5. "Noise Consistency Regularization for Improved Subject-Driven Image Synthesis" by Y. Ni., S. Wen, P. Konius, A. Cherian

        Fine-tuning Stable Diffusion enables subject-driven image synthesis by adapting the model to generate images containing specific subjects. However, existing fine-tuning methods suffer from two key issues: underfitting, where the model fails to reliably capture subject identity, and overfitting, where it memorizes the subject image and reduces background diversity. To address these challenges, two auxiliary consistency losses are porposed for diffusion fine-tuning. First, a prior consistency regularization loss ensures that the predicted diffusion noise for prior (non- subject) images remains consistent with that of the pretrained model, improving fidelity. Second, a subject consistency regularization loss enhances the fine-tuned model’s robustness to multiplicative noise modulated latent code, helping to preserve subject identity while improving diversity. Our experimental results demonstrate the effectiveness of our approach in terms of image diversity, outperforming DreamBooth in terms of CLIP scores, background variation, and overall visual quality.

        paper: https://www.merl.com/publications/TR2025-073

        6. "LatentLLM: Attention-Aware Joint Tensor Compression" by T. Koike-Akino, X. Chen, J. Liu, Y. Wang, P. Wang, M. Brand

        We propose a new framework to convert a large foundation model such as large language models (LLMs)/large multi- modal models (LMMs) into a reduced-dimension latent structure. Our method uses a global attention-aware joint tensor decomposition to significantly improve the model efficiency. We show the benefit on several benchmark including multi-modal reasoning tasks.

        paper: https://www.merl.com/publications/TR2025-075

        7. "TuneComp: Joint Fine-Tuning and Compression for Large Foundation Models" by T. Koike-Akino, X. Chen, J. Liu, Y. Wang, P. Wang, M. Brand

        To reduce model size during post-training, compression methods, including knowledge distillation, low-rank approximation, and pruning, are often applied after fine- tuning the model. However, sequential fine-tuning and compression sacrifices performance, while creating a larger than necessary model as an intermediate step. In this work, we aim to reduce this gap, by directly constructing a smaller model while guided by the downstream task. We propose to jointly fine-tune and compress the model by gradually distilling it to a pruned low-rank structure. Experiments demonstrate that joint fine-tuning and compression significantly outperforms other sequential compression methods.

        paper: https://www.merl.com/publications/TR2025-079
    •  
    •  NEWS    Suhas Lohit presents invited talk at Boston Symmetry Day 2025
      Date: March 31, 2025
      Where: Northeastern University, Boston, MA
      MERL Contact: Suhas Lohit
      Research Areas: Artificial Intelligence, Computer Vision, Machine Learning
      Brief
      • MERL researcher Suhas Lohit was an invited speaker at Boston Symmetry Day, held at Northeastern University. Boston Symmetry Day, an annual workshop organized by researchers at MIT and Northeastern, brought together attendees interested in symmetry-informed machine learning and its applications. Suhas' talk, titled “Efficiency for Equivariance, and Efficiency through Equivariance” discussed recent MERL works that show how to build general and efficient equivariant neural networks, and how equivariance can be utilized in self-supervised learning to yield improved 3D object detection. The abstract and slides can be found in the link below.
    •  

    See All News & Events for Suhas

  • Awards

    •  AWARD    Best Paper - Honorable Mention Award at WACV 2021
      Date: January 6, 2021
      Awarded to: Rushil Anirudh, Suhas Lohit, Pavan Turaga
      MERL Contact: Suhas Lohit
      Research Areas: Computational Sensing, Computer Vision, Machine Learning
      Brief
      • A team of researchers from Mitsubishi Electric Research Laboratories (MERL), Lawrence Livermore National Laboratory (LLNL) and Arizona State University (ASU) received the Best Paper Honorable Mention Award at WACV 2021 for their paper "Generative Patch Priors for Practical Compressive Image Recovery".

        The paper proposes a novel model of natural images as a composition of small patches which are obtained from a deep generative network. This is unlike prior approaches where the networks attempt to model image-level distributions and are unable to generalize outside training distributions. The key idea in this paper is that learning patch-level statistics is far easier. As the authors demonstrate, this model can then be used to efficiently solve challenging inverse problems in imaging such as compressive image recovery and inpainting even from very few measurements for diverse natural scenes.
    •  
    See All Awards for MERL

  • Research Highlights

  • MERL Publications

    •  Sawada, N., Miraldo, P., Lohit, S., Marks, T.K., Chatterjee, M., "FreBIS: Frequency-Based Stratification for Neural Implicit Surface Representations", IEEE Conference on Computer Vision and Pattern Recognition Workshop (CVPR), June 2025.
      BibTeX TR2025-074 PDF
      • @inproceedings{Sawada2025jun,
      • author = {Sawada, Naoko and Miraldo, Pedro and Lohit, Suhas and Marks, Tim K. and Chatterjee, Moitreya},
      • title = {{FreBIS: Frequency-Based Stratification for Neural Implicit Surface Representations}},
      • booktitle = {IEEE Conference on Computer Vision and Pattern Recognition Workshop (CVPR)},
      • year = 2025,
      • month = jun,
      • url = {https://www.merl.com/publications/TR2025-074}
      • }
    •  Hegde, D., Lohit, S., Peng, K.-C., Jones, M.J., Patel, V.M., "Multimodal 3D Object Detection on Unseen Domains", IEEE Conference on Computer Vision and Pattern Recognition (CVPR) Workshop, June 2025.
      BibTeX TR2025-078 PDF
      • @inproceedings{Hegde2025jun,
      • author = {Hegde, Deepti and Lohit, Suhas and Peng, Kuan-Chuan and Jones, Michael J. and Patel, Vishal M.},
      • title = {{Multimodal 3D Object Detection on Unseen Domains}},
      • booktitle = {IEEE Conference on Computer Vision and Pattern Recognition (CVPR) Workshop},
      • year = 2025,
      • month = jun,
      • url = {https://www.merl.com/publications/TR2025-078}
      • }
    •  Basu, S., Lohit, S., Brand, M., "G-RepsNet: A Lightweight Construction of Equivariant Net- works for Arbitrary Matrix Groups", Transactions on Machine Learning Research (TMLR), May 2025.
      BibTeX TR2025-056 PDF Software
      • @article{Basu2025may,
      • author = {Basu, Sourya and Lohit, Suhas and Brand, Matthew},
      • title = {{G-RepsNet: A Lightweight Construction of Equivariant Net- works for Arbitrary Matrix Groups}},
      • journal = {Transactions on Machine Learning Research (TMLR)},
      • year = 2025,
      • month = may,
      • url = {https://www.merl.com/publications/TR2025-056}
      • }
    •  Tang, H., Ellis, K., Lohit, S., Jones, M.J., Chatterjee, M., "Programmatic Video Prediction Using Large Language Models", International Conference on Learning Representations Workshops (ICLRW), April 2025.
      BibTeX TR2025-049 PDF
      • @inproceedings{Tang2025apr,
      • author = {Tang, Hao and Ellis, Kevin and Lohit, Suhas and Jones, Michael J. and Chatterjee, Moitreya},
      • title = {{Programmatic Video Prediction Using Large Language Models}},
      • booktitle = {International Conference on Learning Representations Workshops (ICLRW)},
      • year = 2025,
      • month = apr,
      • url = {https://www.merl.com/publications/TR2025-049}
      • }
    •  Hu, Y., Lohit, S., Kamilov, U., Marks, T.K., "Multimodal Diffusion Bridge with Attention-Based SAR Fusion for Satellite Image Cloud Removal", arXiv, April 2025.
      BibTeX arXiv
      • @article{Hu2025apr,
      • author = {Hu, Yuyang and Lohit, Suhas and Kamilov, Ulugbek and Marks, Tim K.},
      • title = {{Multimodal Diffusion Bridge with Attention-Based SAR Fusion for Satellite Image Cloud Removal}},
      • journal = {arXiv},
      • year = 2025,
      • month = apr,
      • url = {https://arxiv.org/abs/2504.03607}
      • }
    See All MERL Publications for Suhas

  • Other Publications

    •  Suhas Lohit, Qiao Wang and Pavan Turaga, "Temporal Transformer Networks: Joint Learning of Invariant and Discriminative Time Warping", Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2019, pp. 12426-12435.
      BibTeX
      • @Inproceedings{lohit2019temporal,
      • author = {Lohit, Suhas and Wang, Qiao and Turaga, Pavan},
      • title = {Temporal Transformer Networks: Joint Learning of Invariant and Discriminative Time Warping},
      • booktitle = {Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition},
      • year = 2019,
      • pages = {12426--12435}
      • }
    •  Suhas Lohit, Kuldeep Kulkarni, Ronan Kerviche, Pavan Turaga and Amit Ashok, "Convolutional neural networks for noniterative reconstruction of compressively sensed images", IEEE Transactions on Computational Imaging, Vol. 4, No. 3, pp. 326-340, 2018.
      BibTeX
      • @Article{lohit2018convolutional,
      • author = {Lohit, Suhas and Kulkarni, Kuldeep and Kerviche, Ronan and Turaga, Pavan and Ashok, Amit},
      • title = {Convolutional neural networks for noniterative reconstruction of compressively sensed images},
      • journal = {IEEE Transactions on Computational Imaging},
      • year = 2018,
      • volume = 4,
      • number = 3,
      • pages = {326--340},
      • publisher = {IEEE}
      • }
    •  Suhas Lohit, Ankan Bansal, Nitesh Shroff, Jaishanker Pillai, Pavan Turaga and Rama Chellappa, "Predicting Dynamical Evolution of Human Activities from a Single Image", Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops, 2018, pp. 383-392.
      BibTeX
      • @Inproceedings{lohit2018predicting,
      • author = {Lohit, Suhas and Bansal, Ankan and Shroff, Nitesh and Pillai, Jaishanker and Turaga, Pavan and Chellappa, Rama},
      • title = {Predicting Dynamical Evolution of Human Activities from a Single Image},
      • booktitle = {Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops},
      • year = 2018,
      • pages = {383--392}
      • }
    •  Suhas Lohit and Pavan Turaga, "Learning invariant Riemannian geometric representations using deep nets", Proceedings of the IEEE International Conference on Computer Vision Workshops, 2017, pp. 1329-1338.
      BibTeX
      • @Inproceedings{lohit2017learning,
      • author = {Lohit, Suhas and Turaga, Pavan},
      • title = {Learning invariant Riemannian geometric representations using deep nets},
      • booktitle = {Proceedings of the IEEE International Conference on Computer Vision Workshops},
      • year = 2017,
      • pages = {1329--1338}
      • }
    •  Kuldeep Kulkarni, Suhas Lohit, Pavan Turaga, Ronan Kerviche and Amit Ashok, "Reconnet: Non-iterative reconstruction of images from compressively sensed measurements", Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2016, pp. 449-458.
      BibTeX
      • @Inproceedings{kulkarni2016reconnet,
      • author = {Kulkarni, Kuldeep and Lohit, Suhas and Turaga, Pavan and Kerviche, Ronan and Ashok, Amit},
      • title = {Reconnet: Non-iterative reconstruction of images from compressively sensed measurements},
      • booktitle = {Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition},
      • year = 2016,
      • pages = {449--458}
      • }
    •  Suhas Lohit, Kuldeep Kulkarni and Pavan Turaga, "Direct inference on compressive measurements using convolutional neural networks", 2016 IEEE International Conference on Image Processing (ICIP), 2016, pp. 1913-1917.
      BibTeX
      • @Inproceedings{lohit2016direct,
      • author = {Lohit, Suhas and Kulkarni, Kuldeep and Turaga, Pavan},
      • title = {Direct inference on compressive measurements using convolutional neural networks},
      • booktitle = {2016 IEEE International Conference on Image Processing (ICIP)},
      • year = 2016,
      • pages = {1913--1917},
      • organization = {IEEE}
      • }
    •  Qiao Wang, Suhas Lohit, Meynard John Toledo, Matthew P Buman and Pavan Turaga, "A statistical estimation framework for energy expenditure of physical activities from a wrist-worn accelerometer", 2016 38th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), 2016, pp. 2631-2635.
      BibTeX
      • @Inproceedings{wang2016statistical,
      • author = {Wang, Qiao and Lohit, Suhas and Toledo, Meynard John and Buman, Matthew P and Turaga, Pavan},
      • title = {A statistical estimation framework for energy expenditure of physical activities from a wrist-worn accelerometer},
      • booktitle = {2016 38th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC)},
      • year = 2016,
      • pages = {2631--2635},
      • organization = {IEEE}
      • }
    •  Suhas Lohit, Kuldeep Kulkarni, Pavan Turaga, Jian Wang and Aswin C Sankaranarayanan, "Reconstruction-free inference on compressive measurements", Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops, 2015, pp. 16-24.
      BibTeX
      • @Inproceedings{lohit2015reconstruction,
      • author = {Lohit, Suhas and Kulkarni, Kuldeep and Turaga, Pavan and Wang, Jian and Sankaranarayanan, Aswin C},
      • title = {Reconstruction-free inference on compressive measurements},
      • booktitle = {Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops},
      • year = 2015,
      • pages = {16--24}
      • }

  • Software & Data Downloads

  • Videos

  • MERL Issued Patents

    • Title: "System and Method for Generating a Radar Image of a Scene"
      Inventors: Mansour, Hassan; Lohit, Suhas; Boufounos, Petros T.
      Patent No.: 12,287,398
      Issue Date: Apr 29, 2025
    • Title: "Systems and Methods for Multi-Spectral Image Fusion Using Unrolled Projected Gradient Descent and Convolutinoal Neural Network"
      Inventors: Liu, Dehong; Lohit, Suhas; Mansour, Hassan; Boufounos, Petros T.
      Patent No.: 10,891,527
      Issue Date: Jan 12, 2021
    See All Patents for MERL