Software & Data Downloads — CASENet

Deep Category-Aware Semantic Edge Detection for multi-label semantic edge detection.

Boundary and edge cues are highly beneficial in improving a wide variety of vision tasks such as semantic segmentation, object recognition, stereo, and object proposal generation. Recently, the problem of edge detection has been revisited and significant progress has been made with deep learning. While classical edge detection is a challenging binary problem in itself, the category-aware semantic edge detection by nature is an even more challenging multi-label problem. We model the problem such that each edge pixel can be associated with more than one class as they appear in contours or junctions belonging to two or more semantic classes. To this end, we propose a novel end-to-end deep semantic edge learning architecture based on ResNet and a new skip-layer architecture where category-wise edge activations at the top convolution layer share and are fused with the same set of bottom layer features. We then propose a multi-label loss function to supervise the fused activations. We show that our proposed architecture benefits this problem with better performance, and we outperform the current state-of-the-art semantic edge detection methods by a large margin on standard datasets such as SBD and Cityscapes.

    •  Yu, Z., Feng, C., Liu, M.-Y., Ramalingam, S., "CASENet: Deep Category-Aware Semantic Edge Detection", IEEE Conference on Computer Vision and Pattern Recognition (CVPR), DOI: 10.1109/​CVPR.2017.191, July 2017.
      BibTeX TR2017-100 PDF Video Data Software
      • @inproceedings{Yu2017jul,
      • author = {Yu, Zhiding and Feng, Chen and Liu, Ming-Yu and Ramalingam, Srikumar},
      • title = {CASENet: Deep Category-Aware Semantic Edge Detection},
      • booktitle = {IEEE Conference on Computer Vision and Pattern Recognition (CVPR)},
      • year = 2017,
      • month = jul,
      • doi = {10.1109/CVPR.2017.191},
      • url = {https://www.merl.com/publications/TR2017-100}
      • }
    •  Yu, Z., Feng, C., Liu, M.-Y., Ramalingam, S., "CASENet: Deep Category-Aware Semantic Edge Detection", arXiv, May 2017.
      BibTeX arXiv Data Video Data Software
      • @article{Yu2017may,
      • author = {Yu, Zhiding and Feng, Chen and Liu, Ming-Yu and Ramalingam, Srikumar},
      • title = {CASENet: Deep Category-Aware Semantic Edge Detection},
      • journal = {arXiv},
      • year = 2017,
      • month = may,
      • url = {https://arxiv.org/abs/1705.09759}
      • }

    Access software at https://github.com/merlresearch/CASENet.

    Access data at https://doi.org/10.5281/zenodo.7872003.