Investigating substantive and consequential validity of student ratings of instruction

Project description

This study aimed at exploring faculty and student perspectives on student evaluations, as well as identifying their perceptions of the usefulness and appropriateness of the ratings for evaluating teaching effectiveness. More specifically, the study aimed at identifying the consequences, both intended and unintended, of using the evaluations, in addition to better understanding the process students used in responding to evaluations and what use faculty members made of them. Two surveys were developed and placed on the website of the Office of Institutional Research and Assessment. Emails were sent to all students and faculty participating in evaluations soliciting their cooperation and requesting their input. Faculty and student perceptions were compared qualitatively and statistically. Results revealed that students and faculty believe in the effectiveness and usefulness of the system with the need to overcome some negative consequences and biases inherent in its application at the University. Recommendations for system improvement are provided.

Researchers

First name Last name Gender Rank Affiliated Institution Country
Karma Hassan Female Associate Professor American University of Beirut Lebanon

Bio: Associate Professor of Educational Psychology Measurement and Evaluation at the American University of Beirut, Lebanon, and Director of the Office of Institutional Research & Assessment (OIRA) at the University. Has extensive experience in teaching, undergraduate and graduate courses, training, and research in area of expertise. Has conducted and supervised research in test development/adaptation, validation, and use. As Director of OIRA, engaged in institutional assessment, development of annual assessment plans, and preparations for accreditation, program, and peer review in higher education. Participated and presented in local, regional, and international conferences on modern assessment, assessment in higher education, criterion of quality, conditions for student success, quality of student life, and language policies. Has published in international and regional journals and books in areas of expertise. A member of local, regional, and international organizations involved with educational research, assessment, and quality, as well as the Basic Education Strategic Planning Committee, the National Task Force for Governance in Higher Education in Lebanon. and the R4R Research Project. As UNESCO Consultant since 2007, has prepared several country and regional reports and conducted assessment studies.

Website

 

Scientific field

Education
 

Start Year

2012
 

End Year

2013
 

Social impact

Are you interested in disseminating your research work outside the academic institutions?

No

Are there institutions/organizations contacted you to disseminate your research project?

No

How did you disseminate your research work outside academic institutions?

Workshops

What obstacles have you faced as you tried to facilitate the social impact of your research?

Time availability