Software & Data Downloads — PEAC

Plane Extraction using Agglomerative Clustering for extracting planes from 3D point clouds.

Real-time plane extraction in 3D point clouds is crucial to many robotics applications. We present a novel algorithm for reliably detecting multiple planes in real time in organized point clouds obtained from devices such as Kinect sensors. By uniformly dividing such a point cloud into non-overlapping groups of points in the image space, we first construct a graph whose node and edge represent a group of points and their neighborhood respectively. We then perform an agglomerative hierarchical clustering on this graph to systematically merge nodes belonging to the same plane until the plane fitting mean squared error exceeds a threshold. Finally we refine the extracted planes using pixel-wise region growing. Our experiments demonstrate that the proposed algorithm can reliably detect all major planes in the scene at a frame rate of more than 35Hz for 640x480 point clouds, which to the best of our knowledge is much faster than state-of-the-art algorithms.

  •  Taguchi, Y., Jian, Y.-D., Ramalingam, S., Feng, C., "SLAM Using Both Points and Planes for Hand-Held 3D Sensors", International Symposium on Mixed and Augmented Reality (ISMAR), November 2012.
    BibTeX TR2012-091 PDF Software
    • @inproceedings{Taguchi2012nov,
    • author = {Taguchi, Y. and Jian, Y.-D. and Ramalingam, S. and Feng, C.},
    • title = {SLAM Using Both Points and Planes for Hand-Held 3D Sensors},
    • booktitle = {International Symposium on Mixed and Augmented Reality (ISMAR)},
    • year = 2012,
    • month = nov,
    • url = {https://www.merl.com/publications/TR2012-091}
    • }
  •  Taguchi, Y., Jian, Y.-D., Ramalingam, S., Feng, C., "Point-Plane SLAM for Hand-Held 3D Sensors", IEEE International Conference on Robotics and Automation (ICRA), DOI: 10.1109/​ICRA.2013.6631318, May 2013, pp. 5182-5189.
    BibTeX TR2013-031 PDF Software
    • @inproceedings{Taguchi2013may,
    • author = {Taguchi, Y. and Jian, Y.-D. and Ramalingam, S. and Feng, C.},
    • title = {Point-Plane SLAM for Hand-Held 3D Sensors},
    • booktitle = {IEEE International Conference on Robotics and Automation (ICRA)},
    • year = 2013,
    • pages = {5182--5189},
    • month = may,
    • doi = {10.1109/ICRA.2013.6631318},
    • issn = {1050-4729},
    • isbn = {978-1-4673-5641-1},
    • url = {https://www.merl.com/publications/TR2013-031}
    • }
  •  Ataer-Cansizoglu, E., Taguchi, Y., Ramalingam, S., Garaas, T., "Tracking an RGB-D Camera Using Points and Planes", IEEE Workshop on Consumer Depth Cameras for Computer Vision (CDC4CV), December 2013.
    BibTeX TR2013-106 PDF Software
    • @inproceedings{Ataer-Cansizoglu2013dec,
    • author = {Ataer-Cansizoglu, E. and Taguchi, Y. and Ramalingam, S. and Garaas, T.},
    • title = {Tracking an RGB-D Camera Using Points and Planes},
    • booktitle = {IEEE Workshop on Consumer Depth Cameras for Computer Vision (CDC4CV)},
    • year = 2013,
    • month = dec,
    • url = {https://www.merl.com/publications/TR2013-106}
    • }
  •  Feng, C., Taguchi, Y., Kamat, V., "Fast Plane Extraction in Organized Point Clouds Using Agglomerative Hierarchical Clustering", IEEE International Conference on Robotics and Automation (ICRA), DOI: 10.1109/​ICRA.2014.6907776, May 2014, pp. 6218-6225.
    BibTeX TR2014-066 PDF Software
    • @inproceedings{Feng2014may,
    • author = {Feng, C. and Taguchi, Y. and Kamat, V.},
    • title = {Fast Plane Extraction in Organized Point Clouds Using Agglomerative Hierarchical Clustering},
    • booktitle = {IEEE International Conference on Robotics and Automation (ICRA)},
    • year = 2014,
    • pages = {6218--6225},
    • month = may,
    • publisher = {IEEE},
    • doi = {10.1109/ICRA.2014.6907776},
    • url = {https://www.merl.com/publications/TR2014-066}
    • }
  •  Ataer-Cansizoglu, E., Taguchi, Y., Ramalingam, S., Miki, Y., "Calibration of Non-overlapping Cameras Using an External SLAM System", International Conference on 3D Vision (3DV), DOI: 10*1109/​eDV.2014.106, December 2014, pp. 509-516.
    BibTeX TR2014-106 PDF Software
    • @inproceedings{Cansizoglu2014dec,
    • author = {Ataer-Cansizoglu, E. and Taguchi, Y. and Ramalingam, S. and Miki, Y.},
    • title = {Calibration of Non-overlapping Cameras Using an External SLAM System},
    • booktitle = {International Conference on 3D Vision (3DV)},
    • year = 2014,
    • pages = {509--516},
    • month = dec,
    • publisher = {IEEE},
    • doi = {10*1109/eDV.2014.106},
    • url = {https://www.merl.com/publications/TR2014-106}
    • }

Access software at https://github.com/merlresearch/PEAC.