Published on October 11, 2023 b y Virginia Clinton-Lisell on Research in Learning Technology.

ORIGINAL RESEARCH ARTICLE

Social annotation: what are students’ perceptions and how does social annotation relate to grades?

Virginia Clinton-Lisell^*

Educational Foundations and Research, University of North Dakota, Grand Forks, ND, USA

(Received: 5 March 2023; Revised: 18 July 2023; Accepted: 31 July 2023; Published: 9 October 2023)

Social annotation is a teaching and learning technique in which students post comments on electronic course materials in a shared space. The purpose of this study is to examine students’ perceptions of social annotation in the context of motivation and social justice. In addition, the connections between social annotation and course grades were examined. Students in a face-to-face course engaged in social annotation on their course textbook and completed a questionnaire on their perceptions (N = 41). Based on the findings, students had higher overall motivation for social annotation compared with quizzes. In contrast, comparisons of motivation between social annotation and individual notetaking were mixed depending on the motivational construct. Students reported average higher-than-average opportunities for representational justice with social annotation (i.e. opportunities to share experiences and speak from their identities). Regarding grades, multiple social annotation constructs were positively associated with course grades. However, only active reading time appeared to be uniquely predictive of course grades. These findings suggest that social annotations promote active reading, which may encourage better understanding of the course content. Importantly, these findings indicate that students are motivated to engage in social annotation.

Keywords: social annotation; collaborative annotation; college students; motivation; representational justice

^*Corresponding author. Email: virginia.clinton@und.edu

Research in Learning Technology 2023. © 2023 V. Clinton-Lisell. Research in Learning Technology is the journal of the Association for Learning Technology (ALT), a UK-based professional and scholarly society and membership organisation. ALT is registered charity number 1063519. http://www.alt.ac.uk/. This is an Open Access article distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), allowing third parties to copy and redistribute the material in any medium or format and to remix, transform, and build upon the material for any purpose, even commercially, provided the original work is properly cited and states its license.

Citation: Research in Learning Technology 2023, 31: 3050 - http://dx.doi.org/10.25304/rlt.v31.3050

Social annotation, also referred to as collaborative annotation, involves students sharing their comments and highlights on an electronic document with their peers (Murphy Contributor, 2021). Social annotation has been shown to promote engagement and peer interaction in online courses (Kalir, 2020; Lazzara & Clinton-Lisell, 2022; Zhu et al., 2020), but more needs to be known about its role in face-to-face instruction. Furthermore, much of social annotation research has lacked a theoretical lens (Sun et al., 2023). Grounding research in social annotation in established theory would foster connections with previous findings. Moreover, reading from electronic textbooks is becoming more commonplace although reading comprehension is generally better from paper (Clinton, 2019; Delgado et al., 2018; Kong et al., 2018). However, studies finding an advantage of paper over screen for reading comprehension typically do not incorporate the affordances of screens, such as social annotations (Clinton-Lisell et al., 2023). Therefore, it is essential to examine methods of leveraging the advantages of reading from screens using electronic tools to best support student comprehension (Ross et al., 2017). The purpose of this study is to examine student perceived motivation and social justice for using social annotation in a face-to-face course. The self-determination theory of motivation (Deci & Ryan, 2000) and social justice principle of representational justice (Fraser, 2008) are incorporated to ground this study.

Social annotation allows students to interact on a shared document. Unlike traditional, individual notetaking, social annotation allows students’ peers to see their comments on the readings. In this way, social annotation promotes peer-to-peer interactions as well as interactions with the text (Adams & Wilson, 2020). Social annotation is often used as a method to foster community, which is often the motivation for its use in online courses. Social annotation is a method to promote engagement with course readings, such as preparing for face-to-face classes (Miller et al., 2018). Students generally do not complete assigned readings before class unless there are accountability measures, such as quizzes or reflection assignments (Bassett et al., 2020; Heiner et al., 2014; Kolpikova et al., 2019). However, being prepared for class may improve learning course content (Bassett et al., 2020,); therefore, it follows that social annotation could foster student learning. This could explain why students who were required to complete social annotations for preclass reading assignments had higher exam performance than their peers without such a requirement (Miller et al., 2018). However, it is unclear if the annotations themselves or the promotion of active reading through the annotations were responsible for the learning benefits (Miller et al., 2018). A secondary purpose of this study is to examine how social annotations metrics, such as the number of annotations and reading time, as well as students’ perceptions of social annotations, relate to course performance.

Theoretical frameworks

Overall, examinations of students’ perceptions of social annotations have indicated positive attitudes (e.g. Kalir et al., 2020; Lazzara & Clinton-Lisell, 2022). For example, students who engaged in social annotation reported higher levels of positive emotions (e.g. excited, happy) and lower levels of negative emotions (e.g. worried, distressed) than their peers who read the texts individually from paper (Razon et al., 2012). According to interviews of students, social annotation supports collaboration and shared meaning-making in the course (Kalir, 2020). However, these studies have typically needed more theoretical grounding and examined social annotation in isolation (e.g. not comparing to another task; Sun et al., 2023). The theoretical frameworks of self-determination theory and the social justice principle of representational justice were used in this study to build on prior work on social annotation.

Social annotation may prompt higher levels of motivation than quizzes or individual notetaking based on self-determination theory. Self-determination theory is a well-established understanding of human motivation. According to self-determination theory, humans have basic psychological needs of competence, autonomy, and relatedness (Ryan & Deci, 2000). Competence is the perception that one is adequately skilled for a task and able to successfully meet the task goals (Deci et al., 1981). Competence for social annotation is anticipated to be strong, given that the platform is considered user friendly (Har & Ho, 2023). Autonomy is the experience of having options and freedom from external pressure (Deci & Ryan, 2012). Because social annotation allows for choice in terms of what and how to comment on the reading, it is anticipated that autonomy will be higher for social annotation than for quizzes in which students do not get to decide which questions to answer. However, because individual note taking is rarely required, it may have higher perceived autonomy than the required social annotation assignments. Relatedness, when referring to students, involves perceiving that one’s peers and instructors approve of them and accept their ideas (Ryan & Niemiec, 2009). Students interact with their peers as an inherent component of social annotation, whereas quizzes and individual notetaking do not require peer interaction. Subsequently, relatedness is anticipated to be higher for social annotation.

When these needs of competence, autonomy, and relatedness for a task are met, motivation for that task is higher than when these needs are unmet (Deci & Ryan, 2012). Self-determination theory generally focuses on intrinsic motivation, in which one wishes to engage in an activity due to inherent interest or enjoyment (as opposed to extrinsic motivation, which is based on external rewards or punishments; (Ryan & Deci, 2000). Intrinsic motivation is well-known to promote student learning and success across disciplines (Howard et al., 2020). Therefore, social annotation is anticipated to yield higher levels of intrinsic motivation than quizzes or individual annotations.

In all educational research, social justice is of critical importance due to historical systems of inequity in the field (hooks, 2003; Ladson-Billings, 2004, 2014). Social justice can be defined as ‘… an ideal condition in which all members of a society have the same rights, protections, opportunities, obligations, and social benefits. Implicit in this concept is the notion that historical inequalities should be acknowledged and remedied through specific measures’ (Barker, 2003, p. 405). Social justice is specifically relevant to social annotation as it can be a means of ‘expressing power’ by having a dialogue with the text (Brown & Croft, 2020). In this way, students become knowledge producers with the power to express their ideas and critiques of the text (Kalir & Dean, 2018). Digital spaces such as social annotation allow students to produce and share knowledge in manners contrary to traditional systems in which students are meant to solely consume knowledge (Lambert, 2018; Traxler, 2016). Specific to social justice frameworks, social annotation may provide opportunities for representational justice. Representational justice is intentionally having opportunities for expression by students who have been historically underserved by educational systems (Fraser, 2008; Lambert, 2018). These opportunities may be provided through democratic education practices that empower student voices in classroom activities (Rector-Aranda & Raider-Roth, 2015). Because students may share their ideas and experiences in social annotation rather than only receiving ideas from the text, social annotation may provide opportunities for representational justice. However, social annotations can also become a space for exacerbating inequities. For examples, social annotations that centre on nonminoritized identities, involve microaggressions, invalidate experiences of nondominant identities will likely yield harmful, unsafe, and inequitable outcomes for students (Brown & Croft, 2020).

The current study

Social annotation is a promising tool, but in need of more inquiry. To address this need, a study was conducted in which students in a face-to-face course were assigned social annotation of their textbook content prior to class. This allows for seeing if the positive engagement observed with social engagement online courses would transfer to promoting better preclass reading assignments (Chen et al., 2020). Furthermore, this study builds on prior research on social annotation by examining student perceptions through theoretical lenses of motivation and social justice. Previous studies have indicated that students perceived learning benefits from reading peer annotations and that social annotation overall improves comprehension of course content (Kalir et al., 2020; Miller et al., 2018). This study would examine how social annotation metrics (e.g. number of annotations and reading time) relate to grades in the course. In this study, social annotation was compared with another method of accountability for required readings: quizzes on readings (Gyllen et al., 2021). In addition, students were asked to compare social annotation to their experiences with individual notetaking, which is a more traditional form of annotation.

Three research questions guide this study:

1. What are students’ motivation levels for social annotation compared with chapter quizzes and individual notetaking?
2. What are students’ perceived levels of representational justice for social annotations?
3. What are the associations with motivation for social annotation, representational justice in social annotation, social annotation metrics, and student grades?

Methods

Context

This study occurred in an undergraduate, face-to-face child development course (introductory level) with a total enrollment of 45 students at a mid-sized, predominantly white institution in the Great Plains region of the United States. The course textbook was Child Growth and Development (Paris et al., 2019), an open educational resource that is freely available without access fees. For the first chapter, students were required to complete a multiple-choice quiz through the course learning management system before covering the material in class. For the remaining 14 chapters, students were required to annotate the chapter using Perusall before class. Students were in groups of 5–6 students and could only see the annotations of their group members. The directions were to post six annotations on the reading with encouragement to upvote (similar to ‘liking’ a social media post) or reply to others’ annotations. Students received full credit for completing the six annotations regardless of the content of the annotations (e.g. the Perusall automated scoring algorithm was not used). The instructor reviewed the annotations and responded to questions posed by the students.

Deidentified data (i.e. demographics were removed) and the measures used in this study are available on Open Science Framework (Clinton-Lisell, 2023).

Participants

Prior to data collection, ethics approval was received from the institution’s review board. Students were invited to complete an online survey on their motivation for social annotations on the eighth week of the semester (semesters are 16 weeks long). They were given extra credit as an incentive with an option to write a short essay if they wished to receive extra credit without participating. To encourage candour in responses, a colleague gave the course instructor and author of this study a list of students who participated and should receive extra credit, but the instructor did not view the responses until after grades were entered for the term. Forty-one students consented to participate and completed at least some sections of the survey. Based on the demographics reported in the survey, the average age was 19.05 years (SD = 1.10 years). Regarding race, the overwhelming majority of the 36 students who reported race were Caucasian (30 students), with one Hispanic, one African American, and two reporting multiracial backgrounds. In terms of gender, five reported being male (he/him pronouns), one reported being both male and gender nonconforming (he/they pronouns), and 32 reported being female (she/her pronouns). Nineteen per cent indicated that they were first-generation college students (first in their families to attend college), 12.8% indicated they received Pell Grants for financial aid, and 6.4% indicated they received accommodations for their learning due to a disability.

Measures

Motivation

Motivation was examined in the context of self-determination theory through subscales of autonomy (choice and pressure), competence, and relatedness (items from Deci et al., 1994). In addition, intrinsic motivation through inherent interest and enjoyment was also assessed (also items from Deci et al.,1994). Parallel items were developed for social annotation, quizzes on readings, and individual notetaking for each of the subscales. For each subscale, students were asked to report how true of themselves each item was on a Likert scale of 1–5, with one being not at all true and five being very true.

Representational justice

Representational justice, which in educational contexts is student opportunities to voice their experiences and speak from their identities, was measured using a self-report instrument adapted from Clinton-Lisell and Gwozdz (2023). This instrument consists of six items regarding student self-expression in social annotation in which students reported their level of agreement on a Likert scale of 1–5. Because quizzes do not have analogous self-expression opportunities and individual notetaking is not typically shared with others, only representational justice items for social annotation were developed.

Social annotation

Perusall, the social annotation tool used in this study, provides analytics on student participation and reading. For this study, the metrics used were the annotations per chapter, time spent actively reading (as opposed to only having the document open without interacting with it as indicated by some keystroke or mouse movement every 2 min) per chapter, and the average number of words in each chapter’s annotations.

Course grades

Course grades were based on a case study, lesson plans, short papers and assignments, three exams, in-class assignments (participation), and completion of social annotation. For this study, points earned from social annotations were subtracted from the total course grades to examine how these annotations related to grades on other aspects of the course. Course grades were reported in terms of the percentage of possible points to allow for ease of interpretation.

Results

Descriptive statistics of study variables are provided in Tables 1 and 2. A Type I error rate of 0.05 was used throughout these analyses.

Motivation

To address the first research question, repeated measures ANOVA comparing student-perceived choice, pressure, competence, relatedness, and interest/enjoyment (dependent variables) for social annotation, quizzes, and individual note taking (independent variables) were conducted. If statistically significant, follow up comparisons to social annotation with Bonferonni corrections were reported. The within-subjects effects for choice were significant, F(2, 37) = 38.28, p < 0.001. Based on pairwise comparisons, choice for social annotation was significantly higher than choice for quizzes (p < 0.001), but choice for social annotation was lower than choice for individual note taking (p < 0.001). The within-subjects effects for pressure were significant, F(2, 37) = 29.38, p < 0.001. Pressure for social annotations was significantly lower than pressure for quizzes with no reliable differences between social annotations and individual note taking (p = 0.99). The within-subjects effects for competence was significant, F(2, 37) = 8.14, p < 0.001, with social annotation competence being higher than quiz competence, p < 0.001, but no differences were noticed with individual note taking competence (p = 0.99). Within-subjects effects for relatedness were significant with social annotation relatedness being higher than relatedness with quizzes and individual note taking (both p < 0.001). Within-subjects effects for interest and enjoyment were significant, F(2, 37) = 8.14, p < 0.001, with social annotation being higher than quizzes (p < 0.001), but no reliable differences with individual note taking (p = 0.37).

Representational justice

The scores regarding representational justice were used to answer the research question about students’ perceived levels of representational justice in social annotations. To interpret students’ self-report of perceived representational justice opportunities in the social annotations, an independent t-test (two-sided significance testing) was conducted comparing students’ reported values with the midpoint (3 as it was a 1–5 scale). According to the results of this independent t-test, t(40) = 8.22, p < 0.001, students reported significantly higher than midpoint levels of perceived representational justice.

Social annotation and grades

To address the third research question, a correlation matrix based on Spearman’s rho was created (see Table 3). Three social annotations metrics (active reading time, number of annotations, and number of words per annotation) were positively associated with course grade. Two motivation variables for social annotation (competence and relatedness) were positively associated with course grades as well. As may be observed in the correlation matrix, some of these variables associated with grades were also associated with each other. To examine the unique contribution of these constructs with course grades, a linear regression model was estimated with course grades as the dependent variable and the five variables significantly associated with grades as the predictor variables. These predictor variables explained 38.7% of the variance in course grades (based on the R ²). As noticed in Table 4, only active reading time reliably predicted course grade when controlling for all positively associated variables.

Discussion

The purpose of this study was to examine students’ perceptions of social annotation in the context of motivation and representational justice (opportunity for self-expression). Based on this study’s findings, students had more motivation for social annotation than quizzes on the reading, but results comparing social annotation to individual notetaking were mixed. Students reported higher-than-average opportunities for representational justice with social annotation. When examining grades, three social annotation metrics and two motivation constructs (competence and relatedness) were positively associated with course grades. However, only one of the social annotation metrics, active reading time, uniquely predicted course grades.

Motivation

Self-determination theory was used as a lens to investigate motivation for social annotation. In self-determination theory, motivation is optimal when the basic needs of autonomy, competence, and relatedness are met (Ryan & Deci, 2000, 2017). In this study, autonomy was based on choice (indicating higher levels of autonomy) and pressure (indicating lower levels of autonomy; Reeve & Cheon, 2021). Students reported more autonomy regarding higher choice and less pressure with social annotations than quizzes, but less choice with social annotations compared with individual note taking. The greater autonomy with social annotations compared with quizzes could be due to social annotations allowing more freedom in interacting with the textbook compared with quizzes, which are a predetermined set of questions (Shih, 2021). However, social annotations and quizzes are both required for grades in the course used for this study, whereas individual note taking was not required. The absence of a requirement could explain why perceived choice was higher for individual note taking than social annotations and quizzes (Hartnett, 2015).

Competence is one of the basic needs in self-determination theory (Ryan & Deci, 2017). In this study’s findings, students perceived that they were similarly skilled for social annotations and individual note taking. In contrast, competence for social annotations was perceived as greater than quizzes. Because both social annotations and individual notetaking involve writing comments on the reading, it follows that competence for the skills involved would be rated similarly. One potential reason for greater perceived competence with social annotation compared with quizzes is that, unlike quizzes, there are no ‘wrong’ answers when commenting on the textbook (Gentrup et al., 2020). Moreover, the instructor answering questions posted as social annotation may have been perceived as competence support, which may foster motivation (Kulakow, 2020). Relatedness was higher for social annotation than for quizzes or individual note taking, which is likely because social annotation is based on peer interaction, whereas quizzes and individual notetaking do not inherently involve other students (Shih, 2021). Intrinsic motivation in terms of the inherent interest and the enjoyment of the activity was also examined (Ryan & Deci, 2000). Students indicated that they found social annotation more interesting and enjoyable than quizzes, but similar levels of interest and enjoyment were noticed for social annotation and individual note taking. These findings could be interpreted that students find commenting on the textbook interesting and enjoyable regardless of whether those comments are shared with their peers.

Perceptions of social justice were examined for two reasons. The first was due to the need to explicitly include social justice in education research to address historical inequities (hooks, 2003; Ladson-Billings, 2004, 2014). The second was to examine whether social annotations offered students a more equitable learning experience in which they were knowledge creators and sharers rather than only consumers (Brown & Croft, 2020). Specific to this study, the social justice component of representational justice was examined to see if students perceived they had opportunities to speak from their experiences and identities (Lambert, 2018). Social annotation has been proposed as a means to support representational justice in education; however, there are concerns that social annotation could become another inequitable space due to microaggressions and invalidation of student experiences (Brown & Croft, 2020). Moreover, digital spaces, such as social annotation, provide opportunities for students to express and create rather than only consume knowledge (Traxler, 2016). Based on the findings of this study, students indicated higher-than-average levels of representational justice opportunities with social annotation. Comparisons to quizzes and individual notetaking were not made given the inherent lack of opportunity for expression and voice in these typically solitary activities.

In previous work on social annotation, it was unclear whether the annotations themselves or the increased reading prompted by the social annotations promoted better learning of the course content (Miller et al., 2018). Based on correlational analyses in this study, course grades were positively associated with the number of annotations, active reading time, average word length per annotation, relatedness for social annotation, and competence for social annotation. However, when these variables were controlled for each other in a regression analysis, only active reading time significantly predicted course grades. These findings can be interpreted that the increases in active reading of the textbook may drive the benefits of social annotations on course grades. In other words, writing the annotations and experiencing positive feelings about social annotations may promote more reading of the textbook, which subsequently enhances comprehension of course content. This interpretation of the findings is supported by previous research findings indicating reading the course textbook support is positively associated with learning course content ( Junco & Clem, 2015; Landrum et al., 2012).

Limitations and future directions

It is important to notice that the students in the course were generally not from groups traditionally underserved in higher education. That is, the students in this study were overwhelmingly nonminoritized, continuing-generation college students, economically disadvantaged (based on their financial aid statuses), and without learning accommodations for disabilities. Therefore, social annotation must be examined with students from backgrounds historically underserved in higher education in order to truly understand if social annotation is a safe and useful technique for providing opportunities for representational justice. Notably, the potential for the collaboration space of social annotation to be used to perpetuate dominant narratives and express microaggressions much be monitored in future work (Brown & Croft, 2020). Moreover, the software used for social annotation in this study, Perusall, has several accessibility features (Perusall, 2023). It would be valuable to hear from students with disabilities about the usefulness of these accessibility features.

It is important to note that this study’s design does not allow for causal claims to be made; these explanations are simply interpretations of the findings. Future studies with randomisation to control groups are necessary in order to determine if social annotation does indeed promote active reading of the textbook and subsequently better learning as indicated by course grades.

Conclusion

Social annotation provides a means for students to engage with the course material collaboratively. In this study, students reported higher motivation levels for social annotation than quizzes, also used as a method to encourage preclass reading. Students also reported that they had opportunities to speak from their personal experiences through social annotations. Social annotations were positively linked to course grades, possibly due to encouraging more active textbook reading. Based on these findings, social annotation is a useful technique to motivate and encourage students to engage in the course textbook.

Acknowledgements

The author would like to thank my Child Development Fall 2022 students for sharing their experiences on social annotation that made this study possible.

References

Adams, B., & Wilson, N. S. (2020). Building community in asynchronous online higher education courses through collaborative annotation. Journal of Educational Technology Systems, 49(2), 250–261. https://doi.org/10.1177/0047239520946422Barker, R. (2003). The social work dictionary (5th ed.). NASW Press.Bassett, K., Olbricht, G. R., & Shannon, K. B. (2020). Student preclass preparation by both reading the textbook and watching videos online improves exam performance in a partially flipped course. CBE—Life Sciences Education, 19(3), ar32. https://doi.org/10.1187/cbe.19-05-0094Brown, M., & Croft, B. (2020). Social annotation and an inclusive praxis for open pedagogy in the college classroom. Journal of Interactive Media in Education, 2020(1). https://doi.org/10.5334/jime.561Chen, C. M., Li, M. C., & Chen, T. C. (2020). A web-based collaborative reading annotation system with gamification mechanisms to improve reading performance. Computers & Education, 144, 103697. https://doi.org/10.1016/j.compedu.2019.103697Clinton, V. (2019). Reading from paper compared to screens: A systematic review and meta-analysis. Journal of Research in Reading, 42(2), 288–325. https://doi.org/10.1111/1467-9817.12269Clinton-Lisell, V. (2023). Social annotation. Open science framework. Retrieved from https://osf.io/cf96j/?view_only=e1ab03adb51c41e2957ca0839612da20Clinton-Lisell, V., & Gwozdz, L. (2023). Understanding student experiences of renewable and traditional assignments. College Teaching, 71(2), 125–134. https://doi.org/10.1080/87567555.2023.2179591Clinton-Lisell, V. et al. (2023) Interactive features of e-texts’ effects on learning: A systematic review and meta-analysis. Interactive Learning Environments, 31(6), 3728–3743. https://doi.org/10.1080/10494820.2021.1943453Deci, E. L., & Ryan, R. M. (2000). The “what” and “why” of goal pursuits: Human needs and the self-determination of behavior. Psychological Inquiry, 11(4), 227–268. https://doi.org/10.1037/0022-0663.73.5.642Deci, E. L., & Ryan, R. M. (2012). Self-determination theory. In Van Lange, P. A. M., Kruglanski, A. W. & Higgins T. (Eds.). Handbook of theories of social psychology (Vol. 1). Sage, 416–436.Deci, E. L., Schwartz, A. J., Sheinman, L., & Ryan, R. M. (1981). An instrument to assess adults’ orientations toward control versus autonomy with children: Reflections on intrinsic motivation and perceived competence. Journal of Educational Psychology, 73, 642–650. https://doi.org/10.1037/0022-0663.73.5.642Deci, E. L. et al. (1994). Facilitating internalization: The self-determination theory perspective. Journal of Personality, 62(1), 119–142.Delgado, P., Vargas, C., Ackerman, R., & Salmerón, L. (2018). Don’t throw away your printed books: A meta-analysis on the effects of reading media on reading comprehension. Educational Research Review, 25, 23–38. https://doi.org/10.1016/j.edurev.2018.09.003Fraser, N. (2008). From redistribution to recognition? Dilemmas of justice in a “postsocialist” age. In, Seidman, S. & Alexander, J. C. (Eds.). The new social theory reader. Routledge, 188–196.Gentrup, S., Lorenz, G., Kristen, C., & Kogan, I. (2020). Self-fulfilling prophecies in the classroom: Teacher expectations, teacher feedback, and student achievement. Learning and Instruction, 66, 101296. https://doi.org/10.1016/j.learninstruc.2019.101296Gyllen, J. G. et al. (2021). Priming productive study strategies with preparatory quizzes in an engineering course. Applied Cognitive Psychology, 35(1), 169–180. https://doi.org/10.1002/acp.3750Har, F., & Ho, E. (2023). Use of Perusall for pre-class reading assignments in an English reading and writing course at the Tertiary Level: Students’ perception of a flipped approach. In, Tso, A. W. B. et al. (Eds.). The Post-pandemic landscape of education and beyond: Innovation and transformation. Springer Nature, 30–42.Hartnett, M. K. (2015). Influences that undermine learners’ perceptions of autonomy, competence and relatedness in an online context. Australasian Journal of Educational Technology, 31(1), Article 1. https://doi.org/10.14742/ajet.1526Heiner, C. E., Banet, A. I., & Wieman, C. (2014). Preparing students for class: How to get 80% of students reading the textbook before class. American Journal of Physics, 82(10), 989–996. https://doi.org/10.1119/1.4895008hooks, b. (2003). Teaching community: A pedagogy of hope. Routledge.Howard, J. L., Chong, J. X. Y., & Bureau, J. S. (2020). The tripartite model of intrinsic motivation in education: A 30-year retrospective and meta-analysis. Journal of Personality, 88(6), 1268–1285. https://doi.org/10.1111/jopy.12570Junco, R., & Clem, C. (2015). Predicting course outcomes with digital textbook usage data. The Internet and Higher Education, 27, 54–63. https://doi.org/10.1016/j.iheduc.2015.06.001Kalir, J. H. (2020). Social annotation enabling collaboration for open learning. Distance Education, 41(2), 245–260. https://doi.org/10.1080/01587919.2020.1757413Kalir, J. H., & Dean, J. (2018). Web annotation as conversation and interruption. Media Practice and Education, 19(1), 18–29. https://doi.org/10.1080/14682753.2017.1362168Kalir, J. H. et al. (2020). “When I saw my peers annotating”: Student perceptions of social annotation for learning in multiple courses. Information and Learning Sciences, 121(3/4), 207–230. https://doi.org/10.1108/ILS-12-2019-0128Kolpikova, E. P., Chen, D. C., & Doherty, J. H. (2019). Does the format of preclass reading quizzes matter? An evaluation of traditional and gamified, adaptive preclass reading quizzes. CBE—Life Sciences Education, 18(4), ar52. https://doi.org/10.1187/cbe.19-05-0098Kong, Y., Seo, Y. S., & Zhai, L. (2018). Comparison of reading performance on screen and on paper: A meta-analysis. Computers & Education, 123, 138–149. https://doi.org/10.1016/j.compedu.2018.05.005Kulakow, S. (2020). Academic self-concept and achievement motivation among adolescent students in different learning environments: Does competence-support matter? Learning and Motivation, 70, 101632. https://doi.org/10.1016/j.lmot.2020.101632Ladson-Billings, G. (2004). New directions in multicultural education. In, Banks, J. A. & Banks, C. A. M. (Eds.). Handbook of research on multicultural education. Jossey-Bass, 50–65.Ladson-Billings, G. (2014). Culturally relevant pedagogy 2.0: A.k.a. the remix. Harvard Educational Review, 84(1), 74–84. https://doi.org/10.17763/haer.84.1.p2rj131485484751Lambert, S. R. (2018). Changing our (dis)course: A distinctive social justice aligned definition of open education. Journal of Learning for Development, 5(3), 225–244. https://eric.ed.gov/?id=EJ1197463Landrum, R. E., Gurung, R. A. R., & Spann, N. (2012). Assessments of textbook usage and the relationship to student course performance. College Teaching, 60(1), 17–24. https://doi.org/10.1080/87567555.2011.609573Lazzara, J., & Clinton-Lisell, V. (2022). Using social annotation to enhance student engagement in psychology courses. Scholarship of Teaching and Learning in Psychology. https://doi.org/10.1037/stl0000335Miller, K. et al., (2018). Use of a social annotation platform for pre-class reading assignments in a flipped introductory physics class. Frontiers in Education, 3. Retrieved from https://www.frontiersin.org/articles/10.3389/feduc.2018.00008Murphy Contributor, J. A. (2021). Collaborative annotation: Tools for enhancing learning and scholarly communication. Serials Review, 47(3/4), 157–162. https://doi.org/10.1080/00987913.2021.1986917Paris, J. Ricardo, A., & Rymond, D. (2019). Child growth and development. College of the Canyons. Retrieved from https://open.umn.edu/opentextbooks/textbooks/750Perusall. (2023). Accessibility statement. Retrieved from https://support.perusall.com/hc/en-us/articles/360033993894-Accessibility-statementRazon, S. et al., (2012). Effects of a collaborative annotation method on students’ learning and learning-related motivation and affect. Computers in Human Behavior, 28(2), 350–359. https://doi.org/10.1016/j.chb.2011.10.004Reeve, J., & Cheon, S. H. (2021). Autonomy-supportive teaching: Its malleability, benefits, and potential to improve educational practice. Educational Psychologist, 56(1), 54–77. https://doi.org/10.1080/00461520.2020.1862657Rector-Aranda, A., & Raider-Roth, M. (2015). ‘I finally felt like I had power’: student agency and voice in an online and classroom-based role-play simulation. Research in Learning Technology, 23. https://doi.org/10.3402/rlt.v23.25569Ross, B. et al., (2017). Print versus digital texts: Understanding the experimental research and challenging the dichotomies. Research in Learning Technology, 25. https://doi.org/10.25304/rlt.v25.1976Ryan, R. M., & Deci, E. L. (2000). Intrinsic and extrinsic motivations: Classic definitions and new directions. Contemporary Educational Psychology, 25(1), 54–67. https://doi.org/10.1006/ceps.1999.1020Ryan, R. M., & Deci, E. L. (2017). Self-determination theory: Basic psychological needs in motivation, development, and wellness. Guilford Publications.Ryan, R. M., & Niemiec, C. P. (2009). Self-determination theory in schools of education: Can an empirically supported framework also be critical and liberating? Theory and Research in Education, 7(2), 263–272. https://doi.org/10.1177/1477878509104331Shih, J.H. (2021). The use of individual and collaborative learning logs and their impact on the development of learner autonomy in the EFL classroom in Taiwan. Innovation in Language Learning and Teaching, 15(3), 195–209. https://doi.org/10.1080/17501229.2020.1737703Sun, C., Hwang, G. J., Yin, Z., Wang, Z., & Wang, Z. (2023). Trends and issues of social annotation in education: A systematic review from 2000 to 2020. Journal of Computer Assisted Learning, 39(2), 329–350. https://doi.org/10.1111/jcal.12764Sun, Y., & Gao, F. (2017). Comparing the use of a social annotation tool and a threaded discussion forum to support online discussions. The Internet and Higher Education, 32, 72–79. https://doi.org/10.1016/j.iheduc.2016.10.001Traxler J. (2016) Inclusion in an age of mobility. Research in Learning Technology, 24. https://doi.org/10.3402/rlt.v24.31372Zhu, X. et al. (2020). Reading and connecting: Using social annotation in online classes. Information and Learning Sciences, 121(5/6), 261–271. https://doi.org/10.1108/ILS-04-2020-0117