Computer Science and Engineering, Department of

 

Document Type

Article

Date of this Version

5-2023

Citation

Proc. ACM Hum.-Comput. Interact., Vol. 7, No. ETRA, Article 166. Publication date: May 2023. https://doi.org/10.1145/3591135

Comments

Used by permission.

Abstract

Eye movement data provides valuable insights that help test hypotheses about a software developer’s comprehension process. The pupillary response is successfully used to assess mental processing effort and attentional focus. Relatively little is known about the impact of expertise level in cognitive effort during programming tasks. This paper presents a quantitative analysis that compares the eye movements of 207 experts and novices collected while solving program comprehension tasks. The goal is to examine changes of developers’ eye movement metrics in accordance with their expertise. The results indicate significant increase in pupil size with the novice group compared to the experts, explaining higher cognitive effort for novices. Novices also tend to have a significant number of fixations and higher gaze time compared to experts when they comprehend code. Moreover, a correlation study found that programming experience is still a powerful indicator when explaining expertise in this eye-tracking dataset among other expertise variables.

Share

COinS