{"id":9474,"date":"2019-03-14T10:55:36","date_gmt":"2019-03-14T14:55:36","guid":{"rendered":"https:\/\/ofd.ncsu.edu\/?page_id=9474"},"modified":"2023-10-06T17:45:20","modified_gmt":"2023-10-06T17:45:20","slug":"classeval-faq","status":"publish","type":"page","link":"https:\/\/provost.ncsu.edu\/ofe\/teaching-learning\/evaluation-of-teaching-at-nc-state\/classeval-faq\/","title":{"rendered":"ClassEval Frequently Asked Questions (FAQ)"},"content":{"rendered":"\n\n\n\n\n

Response Rates<\/h2>\n\n\n\n
\n
<\/span><\/span>

How might low response rates with online evaluations effect instructor ratings?<\/h2><\/a>
\n

Research indicates that higher achieving students are more likely to participate and tend to rate their instructors more favorably than lower achieving students.1<\/sup><\/strong><\/p>\n\n\n\n

In many cases, student responses focus on the organization, rapport, entertainment level, and difficulty of the course, not on instructor pedagogy.2<\/sup><\/p>\n\n\n\n

Low response rates are likely to increase bias in results if the students filling out the evaluations are not representative of the entire class population.1, 3<\/sup><\/p>\n<\/div><\/div><\/div>\n\n\n\n

<\/span><\/span>

Do less successful students participate in online evaluations at a higher rate than other students?<\/h2><\/a>
\n

Research indicates that higher-performing students appear to be more likely than less successful students to complete online evaluations.1<\/sup><\/strong><\/p>\n\n\n\n

A study at NC State showed that higher-performing and engaged students have higher response rates (e.g., students complete evaluations for classes in their major at higher rates).1<\/sup><\/p>\n\n\n\n

Students with GPAs between 1-1.99 had an average response rate of 23% while the response rates for GPAs between 2-2.99 and 3-4.00 were 37% and 48.1% respectively.1<\/sup><\/p>\n<\/div><\/div><\/div>\n\n\n\n

<\/span><\/span>

Do online evaluations lead to higher response rates than in-class paper evaluation systems?<\/h2><\/a>
\n

Research indicates that online evaluations have nearly always lower response rates than paper systems.4<\/sup><\/strong><\/p>\n\n\n\n

The majority of studies, including one at NC State, confirm lower response rates for online versus in-class paper systems.1, 3, 4<\/sup><\/p>\n\n\n\n

Students often lack the motivation to complete online evaluations because of the length and number of evaluations to complete. On average, students at NC State are asked to complete 5.96 class evaluations per semester.1<\/sup><\/p>\n<\/div><\/div><\/div>\n\n\n\n

<\/span><\/span>

How might response rates vary between online and paper-based evaluation systems?<\/h2><\/a>
\n

Research indicates several differences between online and paper-based evaluation systems<\/strong><\/p>\n\n\n\n

Research shows that there is a 50-75% increase in the number of written comments on online versus paper evaluations.<\/p>\n\n\n\n

Comments written online are typically longer and provide greater detail than comments on paper evaluations making them more useful for instructional improvement.<\/p>\n\n\n\n

There is not an overall increase in negative comments on online evaluations. As with paper evaluations, low-rated teachers \u2014 those perceived by students to be poorer \u2014 typically get more negative online comments while teachers perceived to be better receive only a few negative comments.1, 5<\/sup><\/p>\n<\/div><\/div><\/div>\n\n\n\n

<\/span><\/span>

Can low response rates make the class evaluation results unusable or meaningless?<\/h2><\/a>
\n

Because research findings indicate online evaluation systems nearly always have low response rates and potential biases, caution should be taken when using response data to evaluate teacher effectiveness.<\/strong><\/p>\n\n\n\n

As with any self-administered surveys, student evaluations of teaching potentially suffer from nonresponse bias. In addition, because of small samples, they often also suffer from sampling error.<\/p>\n\n\n\n

Because of possible errors in representation, the EoT committee recommends to use caution when interpreting evaluation results. Relying on results from one section or even one semester is not advised. Instead it is best to look at patterns across classes in multiple semesters.<\/p>\n\n\n\n

Class evaluation results are one part of the complex issue of the measurement of teaching effectiveness. In order to make this data more meaningful and useful, it should be triangulated with multiple sources including peer evaluations of teaching and students’ qualitative comments, among others.<\/p>\n\n\n\n

Evaluation data can be useful for faculty seeking to improve their courses. In particular, many faculty find that student comments can be used for improving learning.<\/p>\n\n\n\n

Faculty should strive to increase participation by employing methods below, reducing nonresponse error.<\/p>\n<\/div><\/div><\/div>\n<\/div><\/div>\n\n\n\n

Ways to Increase ClassEval Response Rates<\/h2>\n\n\n\n
\n
<\/span><\/span>

Method 1: Conduct a mid-semester evaluation<\/h2><\/a>
\n

Time Commitment:<\/em> 10-20 minutes in class to administer. The time to review and discuss feedback varies based on the size of class.<\/p>\n\n\n\n

Potential to improve ClassEval response rates by 9-16%.6, 7, 8<\/sup><\/p>\n\n\n\n

Conducting mid-course evaluations can improve ratings on end of-course evaluations, as students become more able evaluators as well as more engaged in the course.7<\/sup><\/p>\n\n\n\n

Students respond positively when their comments result in changes to the course, leading to improved student attitudes about the class and\/or instructor.8<\/sup><\/p>\n<\/div><\/div><\/div>\n\n\n\n

<\/span><\/span>

Method 2: Include phrasing about evaluations in your syllabus<\/h2><\/a>
\n

Time Commitment:<\/em> 5 -10 minutes to modify provided verbiage and mention how you have used the feedback.<\/p>\n\n\n\n

Showing students in multiple ways that their feedback is valued can increase response rates. In one instance, average rates rose to over 95% as a result of using this strategy along with several other techniques to demonstrate the importance of evaluations to students.9, 10<\/sup><\/p>\n<\/div><\/div><\/div>\n\n\n\n

<\/span><\/span>

Method 3: Discuss ClassEval with your students<\/h2><\/a>
\n

Time Commitment:<\/em> Periodic announcements take less than five minutes at the beginning\/end of class.<\/p>\n\n\n\n

Faculty discussion of the importance of completing evaluations was associated with an increase in online evaluation rates from 54% to 72% in one study.11<\/sup><\/p>\n\n\n\n

Write the response rate on the board daily.<\/p>\n\n\n\n

Turn it into a competition with another section or last year\u2019s class. Compete to see which section or class receives the highest response rate.<\/p>\n<\/div><\/div><\/div>\n\n\n\n

<\/span><\/span>

Method 4: Send personal email reminders\/announcements to the class during the ClassEval time period<\/h2><\/a>
\n

Time Commitment:<\/em> Less than five minutes to send an email or announcement.<\/p>\n\n\n\n

Reminders from faculty, including emails and online discussion board postings, have been shown to increase evaluation response rates.12, 13<\/sup><\/p>\n<\/div><\/div><\/div>\n\n\n\n

<\/span><\/span>

Method 5: Conduct evaluations synchronously<\/h2><\/a>
\n

Time Commitment:<\/em> 10-20 minutes during one class to administer. Book a computer lab or ask students to bring laptops\/tablets\/smart phones to class.<\/p>\n\n\n\n

Online evaluations completed in class have a 30% higher response rate than when completed outside of class.4,14,15 In 2013, an NC State CHASS Pilot saw the same increase with 76% of sections receiving 60% or higher rates as compared to 13% in the same 2012 sections.<\/p>\n\n\n\n

The ability to update\/save evaluations will make it easier for students to fill out the scaled questions of the evaluation during class allowing for comments\/changes later.<\/p>\n<\/div><\/div><\/div>\n<\/div><\/div>\n\n\n\n

Where can I go for more information?<\/h2>\n\n\n\n
\n
Visit OFE Teacher Evaluation Site<\/span>\n<\/svg>\n<\/span><\/a><\/div>\n<\/div>\n\n\n\n
\n
<\/span><\/span>

Works Cited<\/h2><\/a>
\n

Adams, M. J. D., & Umbach, P. D. (2012). Nonresponse and on-line student evaluations of teaching: Understanding the influence of salience, fatigue, and academic environments. Research in Higher Education<\/em>, 53, 576-591.<\/p>\n\n\n\n

Young, K., Joines, J., Standish, T., & Gallagher, V. (2019). Student evaluations of teaching: the impact of faculty procedures on response rates. Assessment & Evaluation in Higher Education<\/em>, 44(1), 37-49.<\/p>\n\n\n\n

Chapman, D., & Joines, J. A. (2017). Strategies for increasing response rates for online end-of-course evaluations. International Journal of Teaching and Learning in Higher Education<\/em>, 29(1), 47\u201360.<\/p>\n\n\n\n

Nulty, D. D. (2008). The adequacy of response rates to on-line and paper surveys: What can be done?, Assessment and Evaluation in Higher Education<\/em>, 33, 301-314.<\/p>\n\n\n\n

Hativa, N. (2013). Student ratings of instruction: A practical approach to designing, operating, and reporting. Create Space Independent Publishing Platform.<\/em><\/p>\n\n\n\n

McGowen, W.R. & Osgathorpe, R.T. (2011). Student and faculty perceptions of effects of midcourse evaluation. To Improve the Academy<\/em>, 29, 160-172.<\/p>\n\n\n\n

Lewis, K. (2001). Using mid semester student feedback and responding to it. New Directions for Teaching and Learning, <\/em>87, 33-44.<\/p>\n\n\n\n

Marsh, H.W. & Overall, J.U. (1979) Long-term stability of students\u2019 evaluations: A note on Feldman\u2019s \u201cConsistency and variability among college students in rating their teachers and courses.\u201d Research in Higher Education, <\/em>10(2),139-147.<\/p>\n\n\n\n

Keutzer, C.S. (1993). Midterm evaluation of teaching provides helpful feedback to instructors. Teaching of Psychology<\/em> 20(4), 238-240.<\/p>\n\n\n\n

Tucker, B., Jones, S., & Straker, L. (2008). Online student evaluation improves course experience questionnaire results in a physiotherapy program. Higher Education Research and Development<\/em>, 27, 281-296.<\/p>\n\n\n\n

University of British Columbia Vancouver (April 15, 2010). Student evaluation of teaching: Response rates<\/em>. Retrieved from http:\/\/teacheval.ubc.ca\/files\/2010\/05\/Student-Evaluations-of-Teaching-Report-Apr-15-2010.pdf<\/a><\/p>\n\n\n\n

Laubsch, P. (2006). Online and in-person evaluations: A literature review and exploratory comparison. Journal of Online Learning and Teaching<\/em> 2(2). Retrieved from http:\/\/jolt.merlot.org\/Vol2_No2_Laubsch.htm<\/a><\/p>\n\n\n\n

Wode, J.,& Keiser, J.(2011). Online course evaluation literature review and findings. A report from Academic Affairs, Columbia University, Chicago<\/em>. Retrieved from https:\/\/facultysenate.mst.edu\/media\/campussupport\/facultysenate\/documents\/cet\/2012\/Course%20Evaluation%20Literature%20Review(2011).pdf<\/a><\/p>\n\n\n\n

Smith, P., & Morris, O. (2012). Effective course evaluation: The future for quality and standards in higher education. Electric Paper Ltd. International House<\/em>. Retrieved from http:\/\/www.slideshare.net\/surveyresults\/effective-course-evaluation<\/a><\/p>\n\n\n\n

Evaluation of Teaching Committee, OFD (2013). Survey of fall 2012 faculty with response rates > 70%. Unpublished raw data. North Carolina State University, Raleigh, NC<\/em>.<\/p>\n<\/div><\/div><\/div>\n<\/div><\/div>\n\n\n\n

\n
<\/span><\/span>

Additional References<\/h2><\/a>
\n

Crews, T. B., & Curtis, D. F. (2011). Online course evaluations: Faculty perspective and strategies for improved response rates. Assessment & Evaluation in Higher Education 36<\/em>(7), 865\u2013878.<\/p>\n\n\n\n

Hornstein, H. A. (2017). Student evaluations of teaching are an inadequate assessment tool for evaluating faculty performance. Cogent Education<\/em>, 4<\/em>(1), 1304016.<\/p>\n\n\n\n

Boring, A., Ottoboni, K., & Stark, P. (2016). Student evaluations of teaching (mostly) do not measure teaching effectiveness. ScienceOpen Research<\/em>. Retrieved from https:\/\/www.scienceopen.com\/document_file\/25ff22be-8a1b-4c97-9d88-084c8d98187a\/ScienceOpen\/3507_XE6680747344554310733.pdf<\/a><\/p>\n\n\n\n

Benton, S. L., & Ryalls, K. R. (2013). Challenging misconceptions about student ratings of instruction. IDEA Paper #58. The IDEA Center<\/em>. Retrieved from https:\/\/www.ideaedu.org\/Portals\/0\/Uploads\/Documents\/IDEA%20Papers\/IDEA%20Papers\/PaperIDEA_58.pdf<\/a><\/p>\n\n\n\n

Wright, R. E. (2000). Student evaluations and consumer orientation of universities. Journal of Nonprofit and Public Sector Marketing<\/em>, 8<\/em>, 33-40.<\/p>\n\n\n\n

Cohen, P. (1980). Effectiveness of student-rating feedback for improving college instruction: A meta-analysis of findings. Research in Higher Education, 13<\/em>(4), 321-341.<\/p>\n\n\n\n

Ladson-Billings, G. (1996). Silences as weapons: Challenges of a black professor teaching white students. Theory into Practice, 35<\/em>(2), 79-85.<\/p>\n\n\n\n

Standish, T., Joines, J. A., Young, K. R., & Gallagher, V. J. (2018). Improving SET response rates: Synchronous online administration as a tool to improve evaluation quality. Research in Higher Education, 59<\/em>(6), 812-823.<\/p>\n\n\n\n

Chapman, D. D. (2019). Mid-semester evaluation: Don\u2019t wait until it\u2019s too late for student feedback. ISETL website<\/em>. Retrieved from http:\/\/www.isetl.org\/mid-semester-evaluation-dont-wait-until-its-too-late-for-student-feedback\/<\/a><\/p>\n<\/div><\/div><\/div>\n<\/div><\/div>\n\n\n\n

Download this page as a PDF for offline viewing and printing<\/a>.<\/h4>\n\n\n\n

Updated by the Evaluation of Teaching (EOT) Standing Committee<\/a> – Spring 2019<\/p>\n","protected":false},"excerpt":{"rendered":"

Response Rates Ways to Increase ClassEval Response Rates Where can I go for more information? Download this page as a PDF for offline viewing and printing. Updated by the Evaluation…<\/p>\n","protected":false},"author":32,"featured_media":0,"parent":2288,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"","meta":{"_acf_changed":false,"source":"","ncst_custom_author":"","ncst_show_custom_author":false,"ncst_dynamicHeaderBlockName":"ncst\/default-header","ncst_dynamicHeaderData":"{}","ncst_content_audit_freq":"","ncst_content_audit_date":"","footnotes":""},"class_list":["post-9474","page","type-page","status-publish","hentry"],"acf":[],"_links":{"self":[{"href":"https:\/\/provost.ncsu.edu\/ofe\/wp-json\/wp\/v2\/pages\/9474","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/provost.ncsu.edu\/ofe\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/provost.ncsu.edu\/ofe\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/provost.ncsu.edu\/ofe\/wp-json\/wp\/v2\/users\/32"}],"replies":[{"embeddable":true,"href":"https:\/\/provost.ncsu.edu\/ofe\/wp-json\/wp\/v2\/comments?post=9474"}],"version-history":[{"count":20,"href":"https:\/\/provost.ncsu.edu\/ofe\/wp-json\/wp\/v2\/pages\/9474\/revisions"}],"predecessor-version":[{"id":28759,"href":"https:\/\/provost.ncsu.edu\/ofe\/wp-json\/wp\/v2\/pages\/9474\/revisions\/28759"}],"up":[{"embeddable":true,"href":"https:\/\/provost.ncsu.edu\/ofe\/wp-json\/wp\/v2\/pages\/2288"}],"wp:attachment":[{"href":"https:\/\/provost.ncsu.edu\/ofe\/wp-json\/wp\/v2\/media?parent=9474"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}