Small-scale Dataset for Training an OOD Detector in Duckietown
I. Background
Duckietown [1] is a low-cost mobile robotics platform used to simulate autonomous vehicles. One important task in autonomous driving is out-of-distribution (OOD) detection [2]. OOD detection involves training a model on only an in-distribution (ID) training set and identifying samples that fall outside of this distribution at test-time. As such, this dataset only contains labels on the test data, all training and calibration data is assumed to be ID.
II. Details
A. Training The training data was collected from the same track with 4 different backgrounds (areas of the lab). For each background the robot navigated the track three times (runs) and each run became a scene. Each scene is stored in a subdirectory TRAIN/backgroun and contains 640x480 png images. Each sene ranges from 450 to 510 sequential images.
B. Calibration The calibration data is gathered from the same 4 backgrounds as the training data, but there is only one scene per background. This data can also be used as cross-validation data as it is assumed to come from the same distribution as the training set. Each scene is stored in a subdirectory CALIBRATE/d. Each scene ranges from 470 to 490 sequential images.
C. Test The test set consists of eight scenes that contain some ID images and some OOD images. The OOD images are generated by sprinkling confetti on the track to simulate snowfall. The test images are stored in folders TEST/ood and corresponding CSV files TEST/ood_gt.csv tell whether an image in the folder is ID (0) or OOD (1).
III. Contact
Dataset author: michaelj004@e.ntu.edu.sg
IV. References
[1] L. Paull et al., "Duckietown: An open, inexpensive and flexible platform for autonomy education and research," in 2017 IEEE International Conference on Robotics and Automation (ICRA), May 2017, pp. 1497--1504, doi: 10.1109/ICRA.2017.7989179.
[2] M. Yuhas, Y. Feng, D. J. X, Ng, Z. Rahiminasab, and A. Easwaran, "Embedded Out-of-Distribution Detection on an Autonomous Robot Platform," in Proceedings of the Workshop on Design Automation for CPS and IoT, May 2021, pp. 13--18, doi:\10.1145/3445034.3460509. |