Wednesday, August 6, 2008 - 1:50 PM

COS 64-2: Effectiveness of calibrated peer review (CPR) on student learning in a web- and inquiry-based environment

Denise Celeste Robledo, X. Ben Wu, Stephanie Knight, and Cheryl Ann Peterson. Texas A&M University

Background/Question/Methods

Inquiry and writing are two main facets of educational reform implemented to promote student understanding of science. Writing to enhance science understanding in higher education, however, has usually been reserved for small classes due to logistical limitations. Recent advances in e-learning and online tools such as Calibrated Peer Review (CPR) have made writing in large science classes possible, however, little is known about the effectiveness of CPR in enhancing student learning. A web-based authentic inquiry project was developed based on spatial interactions among grizzly bears and implemented in a large (up to 500 students) introductory ecology course at Texas A&M University in the Fall of 2007. Individual students observed the spatial distribution and behavior of the grizzly bears at McNeil River Falls in Alaska using stills captured by the Bear Cam. They posted their observations and developed hypotheses about the pattern of spatial distribution and interactions of grizzly bears in online group discussion. Students tested their hypotheses by collecting data from Bear Cam stills and wrote individual reports about their findings. They participated in an on-line CPR process to review the works of peers as well as their own report. Finally, they revised their reports based on their peer reviews.

Results/Conclusions

This study examined the effect of CPR on student learning through comparing a subset (180) of pre and post CPR reports using a 10-item rubric, supplemented by information from a post-project survey. Preliminary results showed statistically significant improvement in student reports with respect to interpretation and discussion of the findings as well as the organization of the report and clarity of the writing. The effect of CPR on other aspects of the student reports are not clear based on the preliminary results and additional reports are being evaluated to further explore the effects of CPR. This study will provide the first direct evidence on the effects of CPR on student understanding of the research process and scientific writing in ecology, which will contribute to our understanding of the role of peer review in e-learning and help develop more effective instructional strategies to enhance student learning in large science classes.