Electrical & Computer Engineering, Department of
First Advisor
Dr. Dongming Peng
Second Advisor
Dr. Hamid Sharif
Third Advisor
Dr. Kuan Zhang
Date of this Version
Spring 5-2018
Abstract
The use of resource constrained inexpensive hardware places restrictions on the design of streaming video and image processing system performance. In order to achieve acceptable frame-per-second (fps) performance with low latency, it is important to understand the response time requirements that the system needs to meet. For humans to be able to process and react to an image there should not be more than a 100ms delay between the time a camera captures an image and subsequently displays that image to the user.
In order to accomplish this goal, several design considerations need to be taken into account that limit the use of high level abstractions in favor of techniques that optimize performance. The reference design shown in this work uses embedded Linux on commercially available hardware costing $150. Performance is optimized by employing Linux user-space to kernel level functions including Video for Linux 2 (V4L2) and the Linux frame buffer. Optimized algorithms for color space conversion and image processing using a Haar Discrete Wavelet Transform (DWT) are also presented.
The results of this work show that real-time streaming video and image processing performance of 10 fps to 15 fps with 67ms to 100ms of latency can be achieved on embedded Linux using low cost hardware, kernel level abstractions and optimized algorithms.
Advisor: Dongming Peng
Comments
A THESIS Presented to the Faculty of The Graduate College at the University of Nebraska In Partial Fulfillment of Requirements For the Degree of Master of Science, Major: Telecommunications Engineering, Under the Supervision of Professor Dongming Peng. Lincoln, Nebraska: May 2018.
Copyright (c) 2018 Richard L. Gregg
Source code on github: https://github.com/rickgregg/real-time-streaming-video