Literature Review
Understanding Online Course Quality
Prior literature in the field of online learning has suggested that course quality is a multi-
dimensional construct. In part, this is due to the multiple stakeholders involved, “learners,
instructors, employers, and society” (Esfijani, 2018, p. 58). Each has different perspectives and
concerns that affect what standards of excellence they prioritize. As one example, since students
manage their learning differently than faculty manage their teaching, students tend to value
techniques like “posting due date checklists” more highly than do faculty (Bolliger & Martin,
2018, p. 580). More broadly, Lenert and Janes (2017) identified a variety of differing standards
that scholars have used to measure online course quality. These included students’ satisfaction,
how well course designers followed the proper processes of course design, whether courses
exemplified certain properties considered to be high quality, and the forms of interaction that
instructors employed with their students. As a whole, existing literature indicated that course
quality is a somewhat flexible construct, defined in a variety of ways depending on the interests
of individual researchers, or the situational concerns of the contexts they studied. Interestingly,
despite the seeming logic that course quality should also include some measure of how well
students achieved desired learning outcomes, Esfijani (2018) found that this has not been the
case in much of the existing research: “The literature showed that researchers and practitioners
tend to more readily consider the easily measurable aspects, that is, inputs and resources, rather
than the outputs and outcomes” of online courses (p. 64).
Prior literature has also addressed how to design for quality in online courses. A frequent
theme has been collaboration, “designing a high-quality online course requires various sources of
expertise not usually possessed by one person” (Chao et al., 2010, p. 107; see also Y. Chen &
Carliner, 2021; Davey et al., 2019; Halupa, 2019; Zimmerman et al., 2020). Another theme has
been whether designers adhere to the guidelines specified in course design rubrics (L.-L. Chen,
2016; Lenert & Janes, 2017; Martin et al., 2021; Martin & Bolliger, 2022). Providing faculty and
other staff the proper training has also been identified as important to achieving quality (Regan et
al., 2012; Scoppio & Luyt, 2017). Further, some researchers have highlighted the value of
iterative design processes in creating quality course designs (Bawa & Watson, 2017; Bowers et
al., 2021; Chartier, 2021; Moore, 2016). Iteration typically connotes either returning to a
previous phase of a design process, or repeating the same phase, based on one’s monitoring of
the results one achieves during a current phase (Adams, 2002; Verstegen et al., 2006). Although
the value of iteration for improving quality seems logical, Verstegen et al. (2006) questioned
whether this was always the case. In their experimental study of design iterations, they found that
while all their subjects iterated (corroborating the conclusion that there is an “inherent nature” of
iterating in instructional design, see Stefaniak & Hwang, 2021, p. 3351), “the number of
iterations [did] not correlate with the quality of the results” (p. 506). There is reason to temper
their assessment, however, given the nature of their experiment that placed student designers in a
highly controlled, artificial situation. Empirical research in other settings has concluded
iterations are often important for achieving high levels of design quality (Adams, 2002).
Understanding Everyday Practices and Everydayness
A common assumption underlying much of the prior literature is that formal design
processes, along with the related, specialized strategies that instructional designers are trained to
employ, are the proper unit of analysis when studying how they pursue the creation of high-
quality online courses (however so defined). Chen and Carliner (2021) summarized this in their