Software & Data Downloads — RETR

Radar dEtection TRansformer for object detection and segmentation in the image plane.

PyTorch training and evaluation code for RETR (Radar dEtection TRansformer). RETR inherits the advantages of DETR, eliminating the need for hand-crafted components for object detection and segmentation in the image plane. RETR incorporates carefully designed modifications: 1) depth-prioritized feature similarity via a tunable positional encoding (TPE); 2) a tri-plane loss from both radar and camera coordinates; 3) using a calibrated or learnable radar-to-camera transformation via reparameterization, to account for the unique multi-view radar setting.

    •  Yataka, R., Cardace, A., Wang, P., Boufounos, P.T., Takahashi, R., "RETR: Multi-View Radar Detection Transformer for Indoor Perception", Advances in Neural Information Processing Systems (NeurIPS), November 2024.
      BibTeX TR2024-159 PDF Software
      • @inproceedings{Yataka2024nov3,
      • author = {Yataka, Ryoma and Cardace, Adriano and Wang, Pu and Boufounos, Petros T. and Takahashi, Ryuhei}},
      • title = {RETR: Multi-View Radar Detection Transformer for Indoor Perception},
      • booktitle = {Advances in Neural Information Processing Systems (NeurIPS)},
      • year = 2024,
      • month = nov,
      • url = {https://www.merl.com/publications/TR2024-159}
      • }

    Access software at https://github.com/merlresearch/radar-detection-transformer.