An Investigation of the Longitudinal Effects of Network Latency on Pedagogic Efficacy: A Comparison of Disciplines

Abstract

Interactive web-based learning tools, such as engineering simulations, are becoming increasingly common. Universities find them cost-effective, and students find them convenient. Professors find web-based simulations effective to intuitively convey the complex cause-and-effect relationships that are central in engineering education. For example, moving a slider can be used to interactively see how changing a resistor’s value changes current flow through a current divider. There are many studies investigating the effectiveness of interactive web-based learning materials, yet, little systematic investigation of the pedagogic impact of network delay. This paper, therefore, seeks to quantify the relationship that network latency, or delay, has upon student enjoyment and student comprehension. An interactive software application was designed purportedly to teach Fourier Analysis concepts, but embeds a hidden delay between the time a student moves one of the interactive controls and the time that the screen updates. Different versions of the application were designed, each identical except for the delay. Students were randomly assigned application versions, ensuring double-blind test conditions. Students used the application while completing a short guided lesson that used the Socratic Method to intuitively teach Fourier Analysis. After completing the tutorial questions, which provide an objective assessment of student comprehension, students self-rated their comprehension and enjoyment, and recorded their program version number which encoded the delay. The data was least-squares fit to several different functions with varying degrees of freedom and residuals were computed. Data involving 281 students from four universities and one high school using eight equally spaced delays from 0 to 420 ms was analyzed. Student objective comprehension, as measured by an objective test following a learning experience with one of these Fourier Analysis programs, was compared to their self-reported comprehension estimate, and their self-reported enjoyment. Relationships were compared between students in technical majors or humanities and social sciences. The study suggests that the accumulation of experience and choice of major are important factors in mitigating the effects of network delay on learning.