Eric T. Psota
Date of this Version
Peace, J. Brennan. (2020). An End-to-End Trainable Method for Generating and Detecting Fiducial Markers (Master's Thesis). University of Nebraska-Lincoln.
Existing fiducial markers are designed for efficient detection and decoding. The methods are computationally efficient and capable of demonstrating impressive results, however, the markers are not explicitly designed to stand out in natural environments and their robustness is difficult to infer from relatively limited analysis. Worsening performance in challenging image capture scenarios - such as poorly exposed images, motion blur, and off-axis viewing - sheds light on their limitations. The method introduced in this work is an end-to-end trainable method for designing fiducial markers and a complimentary detector. By introducing back-propagatable marker augmentation and superimposition into training, the method learns to generate markers that can be detected and classified in real-world environments using a fully convolutional detector network. Results demonstrate that E2ETag outperforms existing methods in ideal conditions and performs much better with challenging poses, motion blur, contrast fluctuations, and noise. Augmentations are analyzed with ablation studies to convey the significance of each augmentation in training simulations for better detection in real-world deployment.
Advisor: Eric T. Psota