Clickers

Joosten, T. (2005). Exploring the Potential and Assessment Impact of Student Response Systems: A Student Survey. University of Wisconsin-Milwaukee, Learning Technology Center. Retrieved from: http://mysurveys.wikispaces.com/Clickers

**Abstract for EXEMPT Protocol ** **Student Response Systems (SRS): Exploring Potential and Assessing Impact **

 The purpose of this study is to evaluate the impact of student response systems (SRS) on teaching and learning. Student response systems, more commonly called clickers, are wireless communication systems that allow faculty to poll students and students respond using a clicker or response pad. In our study, we will utilize both quantitative and qualitative methodologies in evaluation of the project outcomes.

In this study, data will be collected from approximately 2500 students and 11 faculty members. The 11 faculty members have integrated student response systems into the course for the fall 2005 semester. The students will have participated in the courses and used the student response system technology. Students who participate in this study will be provided with an information sheet about the study. They can withdraw from this study during filling out the questionnaire for any reason. Filling out the questionnaire will be approximately 15 minutes. All data will be treated confidentially. No raw data will be shared. Grouped or "aggregate" data may be shared in class or published in professional journals.

First, we will be organizing various faculty focus groups in order to gather faculty reports on the SRS for analysis. Also, a thematic analysis of narratives will be conducted using individual comments and stories gathered during one-on-one training appointments and from email correspondence from faculty queries during the Project. For selected faculty participants, we will conduct a case study focusing on two courses conducted in parallel with one lecture utilizing a student response system and the other offered in a traditional setting without SRS. All faculty will remain anonymous in any written reports or publications that result from the study. In addition, we will administer a faculty survey containing a series of questions intended to measure instructor’s attitudes toward the SRS. The data collected will be anonymous. Surveys will be sent to faculty through campus mail and returned to me using campus mail. No identifying information is required on the faculty surveys.

Next, we will gather anonymous student evaluations by survey, which will contain a series of questions that asks about students' previous technology use, attitudes towards the use of SRS in the classroom, their evaluation of the course itself, their evaluation of the clicker technology itself, their perception of their learning in relation to SRS, and their performance in the course in relation to SRS. Questionnaires will be distributed to 2500 students who have participated in a course by one of the 11 faculty who are using student response systems in his or her classroom. Each faculty member will be given a packet with the number of questionnaire corresponding to the number of students he or she has taught and asked to distribute the questionnaire to the students. Each instructor’s packet will be coded with a letter so that questionnaires from the same classroom can be grouped for analysis. Survey will be collected by the faculty member and sent intercampus mail to the research at the Learning Technology Center. We will conduct various multivariate analyses in analyzing the data to produce quantifiable results of the effectiveness of the technology.

In addition to the data gathered through questionnaires, faculty will gather performance data, average grades and pass rates from previous semesters without SRS, to run comparisons as well as gather learning assessments in class. Also, faculty will gather student evaluation from current and previous semesters prior to SRS to run comparisons.

 Survey data will be kept in a secure desk drawer in my office until the data is entered into a database. All surveys will be destroyed at the completion of the study.

 This study is considered exempt under Category 1 because it involves research being conducted in a traditional education setting involving normal education practices and the effectives of instructional technique. Also, this study is exempt under Category 2 because it involves the user of survey procedures and interview procedures. Finally, this study is exempt because it involves research in which we will collect or study existing data, documents, and records.

**/// //**

**//Information Sheet //**

** Student Response Systems **

 I am Tanya Joosten of the Learning Technology Center at the University of Wisconsin-Milwaukee. We are conducting a study of how student response systems (a.k.a. clickers) impact teaching and student learning. We would appreciate your participation in this study, as it will assist us in making recommendations for improving the teaching of students throughout the UWM campus.

 If you agree to be in this study, you will be asked to fill out a survey and to answer several questions about your experience in using clickers. The survey should take 15 minutes to complete. There are over 2000 students at UWM participating in the study. This study will take place between September 2005 and January 2006. There are no known risks associated with your being in the study. Possible benefits are that you will have a voice in helping shape the instruction that students on the UWM campus receive.

 The questionnaire you fill out will be treated confidentially. PLEASE DO NOT PUT YOUR NAME ANYWHERE ON THE SURVEY. There will be no way to link you to your responses. Data from this study will be shared with my classmates and teacher and may be published in professional journals. Only grouped data will be presented or published.

<span style="font-family: Verdana,sans-serif; font-size: 10pt;"> You do not have to be in the study. You can withdraw from this study during filling out the questionnaire for any reason. There is no penalty for withdrawing.

<span style="font-family: Verdana,sans-serif; font-size: 10pt;"> Once the study is completed, we would be glad to give the results to you. In the meantime, if you have any questions, please contact me:

<span style="font-family: Verdana,sans-serif; font-size: 10pt;"> Tanya Joosten <span style="font-family: Verdana,sans-serif; font-size: 10pt;">Learning Technology Center <span style="font-family: Verdana,sans-serif; font-size: 10pt;">University of Wisconsin-Milwaukee

<span style="font-family: Verdana,sans-serif; font-size: 10pt;"> PO Box 604

<span style="font-family: Verdana,sans-serif; font-size: 10pt;"> Milwaukee, WI 53201

<span style="font-family: Verdana,sans-serif; font-size: 10pt;"> tjoosten@uwm.edu <span style="font-family: Verdana,sans-serif; font-size: 10pt;">414.229.4319

<span style="font-family: Verdana,sans-serif; font-size: 10pt;"> **If you have any complaints about your experience as a participant in this study, please call or write:**

<span style="font-family: Verdana,sans-serif; font-size: 10pt;"> Chris Buth Furness

<span style="font-family: Verdana,sans-serif; font-size: 10pt;"> IRB Administrator

<span style="font-family: Verdana,sans-serif; font-size: 10pt;"> Institutional Review Board for the

<span style="font-family: Verdana,sans-serif; font-size: 10pt;"> Protection of Human Subjects

<span style="font-family: Verdana,sans-serif; font-size: 10pt;"> The Graduate School

<span style="font-family: Verdana,sans-serif; font-size: 10pt;"> University of Wisconsin-Milwaukee

<span style="font-family: Verdana,sans-serif; font-size: 10pt;"> PO Box 340, MIT 206

<span style="font-family: Verdana,sans-serif; font-size: 10pt;"> Milwaukee, WI 53201

<span style="font-family: Verdana,sans-serif; font-size: 10pt;"> 414-229-3173 phone; 414-229-5000 fax

<span style="font-family: Verdana,sans-serif; font-size: 10pt;"> chrisb@uwm.edu

<span style="font-family: Verdana,sans-serif; font-size: 10pt;"> Although Ms. Furness will ask your name, all complaints are kept in confidence.

<span style="font-family: Verdana,sans-serif; font-size: 10pt;"> This research project has been approved by the University of Wisconsin-Milwaukee Institutional Review Board for the Protection of Human Subjects for a one year period.

<span style="font-family: Verdana,sans-serif; font-size: 10pt;"> **STUDENT SURVEY**

<span style="font-family: Verdana,sans-serif; font-size: 10pt;">Filling out this survey indicates that I am at least 18 years old and that I am giving my informed consent to be a subject in this study.

<span style="font-family: Verdana,sans-serif; font-size: 10pt;">Course Number, Course Name, Date, Time and Location:

<span style="font-family: Verdana,sans-serif; font-size: 10pt;">Student ID


 * <span style="font-family: Verdana,sans-serif; font-size: 10pt;">Demographics **

//<span style="font-family: Verdana,sans-serif; font-size: 9pt;">Please indicate with an “X” which of the following best describes yourself //

<span style="font-family: Verdana,sans-serif; font-size: 10pt;">Age: <span style="font-family: Verdana,sans-serif; font-size: 10pt;">17 - 19 _____ __<span style="font-family: Verdana,sans-serif; font-size: 10pt;">20 - 22 ___ <span style="font-family: Verdana,sans-serif; font-size: 10pt;">23 - 25 _____ __<span style="font-family: Verdana,sans-serif; font-size: 10pt;">25+ ___

<span style="font-family: Verdana,sans-serif; font-size: 10pt;">Gender: <span style="font-family: Verdana,sans-serif; font-size: 10pt;">Male _____ __<span style="font-family: Verdana,sans-serif; font-size: 10pt;">Female ___

<span style="font-family: Verdana,sans-serif; font-size: 10pt;">Race: <span style="font-family: Verdana,sans-serif; font-size: 10pt;">African American _____ __<span style="font-family: Verdana,sans-serif; font-size: 10pt;">Latino ___ <span style="font-family: Verdana,sans-serif; font-size: 10pt;">Asian _____ __<span style="font-family: Verdana,sans-serif; font-size: 10pt;">European American/Caucasian ___ <span style="font-family: Verdana,sans-serif; font-size: 10pt;">Other: Please identify

__<span style="font-family: Verdana,sans-serif; font-size: 10pt;">Marital Status: __ __<span style="font-family: Verdana,sans-serif; font-size: 10pt;">Single ___ <span style="font-family: Verdana,sans-serif; font-size: 10pt;">Married _____ __<span style="font-family: Verdana,sans-serif; font-size: 10pt;">Divorced/Separated ___

<span style="font-family: Verdana,sans-serif; font-size: 10pt;">Student Status: <span style="font-family: Verdana,sans-serif; font-size: 10pt;">Full-time _____ __<span style="font-family: Verdana,sans-serif; font-size: 10pt;">Part-time ___

<span style="font-family: Verdana,sans-serif; font-size: 10pt;">Education Level: <span style="font-family: Verdana,sans-serif; font-size: 10pt;">Freshman _____ __<span style="font-family: Verdana,sans-serif; font-size: 10pt;">Sophomore ___ <span style="font-family: Verdana,sans-serif; font-size: 10pt;">Junior _____ __<span style="font-family: Verdana,sans-serif; font-size: 10pt;">Senior ___

<span style="font-family: Verdana,sans-serif; font-size: 10pt;">Have you previously taken a course that used clickers? Yes (1) No (2)

<span style="font-family: Verdana,sans-serif; font-size: 10pt;">Did you use a clicker in this course? Yes (1) No (2)

<span style="font-family: Verdana,sans-serif; font-size: 10pt;">Which clicker did you use? Turning Point Response Pad (1) CPS/eInstruction (2) Other (3)


 * <span style="font-family: Verdana,sans-serif; font-size: 10pt;">Computer Use **

<span style="font-family: Verdana,sans-serif; font-size: 10pt;">Please rate your use of computers or computer software. There are no correct answers or preferred answers. Each item is rated on a 5-point scale ranging from frequently (5) to never (1).

<span style="font-family: Verdana,sans-serif; font-size: 10pt;">(5) Frequently | (4) Often | (3) Sometimes | (2) Rarely (1) Never

__<span style="font-family: Verdana,sans-serif; font-size: 10pt;">10. ___ How often do you use a word processor (Word, WordPerfect)? <span style="font-family: Verdana,sans-serif; font-size: 10pt;">11.___ How often do you use spreadsheets (Excel, Lotus)?__ __<span style="font-family: Verdana,sans-serif; font-size: 10pt;">12. ___ How often do you use the computer for games? <span style="font-family: Verdana,sans-serif; font-size: 10pt;">13.___ How often do you use the computer to view or edit graphics/photo images?__ __<span style="font-family: Verdana,sans-serif; font-size: 10pt;">14. ___ How often do you use a courseware product (e.g., Desire2Learn, D2L)?
 * 1) <span style="font-family: Verdana,sans-serif; font-size: 10pt;">1. ___ How often do you use a computer at home?__
 * 2) __<span style="font-family: Verdana,sans-serif; font-size: 10pt;">2. ___ How often do you use a computer at school?
 * 3) <span style="font-family: Verdana,sans-serif; font-size: 10pt;">3. ___ How often do you use a computer at work?__
 * 4) __<span style="font-family: Verdana,sans-serif; font-size: 10pt;">4. ___ How often do you use a computer in a library?
 * 5) <span style="font-family: Verdana,sans-serif; font-size: 10pt;">5. ___ How often do you use a computer at a friend or family member’s house?__
 * 6) __<span style="font-family: Verdana,sans-serif; font-size: 10pt;">6. ___ How often do you use a computer?
 * 7) <span style="font-family: Verdana,sans-serif; font-size: 10pt;">7. ___ How often do you use the Internet?__
 * 8) __<span style="font-family: Verdana,sans-serif; font-size: 10pt;">8. ___ How often do you use send or receive electronic mail?
 * 9) <span style="font-family: Verdana,sans-serif; font-size: 10pt;">9. ___ How often do you use chat software/instant messenger (AOL, MSN, ICQ, etc.)?__


 * <span style="font-family: Verdana,sans-serif; font-size: 10pt;">Student Response System Grant Evaluation: Student Survey Items **

//<span style="font-family: Verdana,sans-serif; font-size: 10pt;">Note: The items would be randomized the survey. The reverse coded items are noted by (r) and are required to increase the reliability of this instrument. The headings in bold are specific to the variable they are measuring. Some of the survey items are taken from proven reliable surveys and are otherwise grounded in research examined. Once the survey is administered, I will run a factor analysis to make sure the items factor to their corresponding variable. Multiple regression will be run to analyze relationships between variables. //

<span style="font-family: Verdana,sans-serif; font-size: 10pt;"> The following statements address different aspects of your experience in taking a course that uses a student response system or clickers. For each of the statements, please enter 5 if you strongly agree with the statement with a range to 1 if you strongly disagree with the statement.

<span style="font-family: Verdana,sans-serif; font-size: 10pt;">(5) Strongly Agree | (4) Agree | (3) Neutral | (2) Disagree | (1) Strongly Disagree

<span style="font-family: Verdana,sans-serif; font-size: 10pt;">note/ classroom interaction and student satisfaction with course instruments would be given to both classes using and not using SRS along with other course documents (exam grades, overall grade averages, etc.) for a parallel comparison


 * __<span style="font-family: Verdana,sans-serif;">Classroom Interaction __**

<span style="font-family: Verdana,sans-serif; font-size: 10pt;">(Communication, Participation, Engagement)

<span style="font-family: Verdana,sans-serif; font-size: 10pt;">I felt involved in this course <span style="font-family: Verdana,sans-serif; font-size: 10pt;">I was engaged <span style="font-family: Verdana,sans-serif; font-size: 10pt;">I felt like an outsider (r) <span style="font-family: Verdana,sans-serif; font-size: 10pt;">I felt a part of the class <span style="font-family: Verdana,sans-serif; font-size: 10pt;">This course was alienating (r) <span style="font-family: Verdana,sans-serif; font-size: 10pt;">Using clickers helps me to pay attention in class <span style="font-family: Verdana,sans-serif; font-size: 10pt;">The classroom environment was very lively and active <span style="font-family: Verdana,sans-serif; font-size: 10pt;">This class was boring (r) <span style="font-family: Verdana,sans-serif; font-size: 10pt;">Communication with my classmates was good <span style="font-family: Verdana,sans-serif; font-size: 10pt;">Communication with my instructor was effective in class <span style="font-family: Verdana,sans-serif; font-size: 10pt;">I wish there was more opportunity to participate with my classmates (r) <span style="font-family: Verdana,sans-serif; font-size: 10pt;">I didn’t communicate very will with my instructor (r) <span style="font-family: Verdana,sans-serif; font-size: 10pt;">Amount of communication in the classroom was adequate <span style="font-family: Verdana,sans-serif; font-size: 10pt;">I would have liked to see more interactions in the class (r) <span style="font-family: Verdana,sans-serif; font-size: 10pt;">There is little misunderstanding. <span style="font-family: Verdana,sans-serif; font-size: 10pt;">There seemed to be confusion a lot of the time (r) <span style="font-family: Verdana,sans-serif; font-size: 10pt;">My participation in the course is frequent <span style="font-family: Verdana,sans-serif; font-size: 10pt;">I didn’t participate much in class (r) <span style="font-family: Verdana,sans-serif; font-size: 10pt;">My presence in this class makes no difference (r) <span style="font-family: Verdana,sans-serif; font-size: 10pt;">Students day dream, write letter, or read the newspaper during class (r)

<span style="font-family: Verdana,sans-serif; font-size: 10pt;">(Instructor, Course Design, Course Management, Grades, Feedback, Subject, Peers)
 * __<span style="font-family: Verdana,sans-serif;">Student Satisfaction with Course __**


 * <span style="font-family: Verdana,sans-serif; font-size: 10pt;">Instructor **

<span style="font-family: Verdana,sans-serif; font-size: 10pt;">The instructor motivated active interaction <span style="font-family: Verdana,sans-serif; font-size: 10pt;">The instructor was not enthusiastic about the class (r) <span style="font-family: Verdana,sans-serif; font-size: 10pt;">The instructor facilitated authentic collaboration <span style="font-family: Verdana,sans-serif; font-size: 10pt;">The instructor failed to create a socially welcoming environment (r) <span style="font-family: Verdana,sans-serif; font-size: 10pt;">The instructor built rapport with us <span style="font-family: Verdana,sans-serif; font-size: 10pt;">I don’t feel like I had a good working relationship with my instructor (r) <span style="font-family: Verdana,sans-serif; font-size: 10pt;">The instructor stimulated my interest <span style="font-family: Verdana,sans-serif; font-size: 10pt;">My interests were never peaked in the class (r) <span style="font-family: Verdana,sans-serif; font-size: 10pt;">The instructor was available when I have questions <span style="font-family: Verdana,sans-serif; font-size: 10pt;">Many of my questions have gone unanswered (r) <span style="font-family: Verdana,sans-serif; font-size: 10pt;">The instructor was likeable <span style="font-family: Verdana,sans-serif; font-size: 10pt;">I don’t care for the instructor (r) <span style="font-family: Verdana,sans-serif; font-size: 10pt;">I feel the instructor is knowledgeable <span style="font-family: Verdana,sans-serif; font-size: 10pt;">The instructor doesn’t know what they were talking about(r) <span style="font-family: Verdana,sans-serif; font-size: 10pt;">Overall, my instructor was good. <span style="font-family: Verdana,sans-serif; font-size: 10pt;">I was able to easily communicate with my instructor. <span style="font-family: Verdana,sans-serif; font-size: 10pt;">Communication with my instructor was difficult (r)


 * <span style="font-family: Verdana,sans-serif; font-size: 10pt;">Course Design **

<span style="font-family: Verdana,sans-serif; font-size: 10pt;">The class activities are carefully structured <span style="font-family: Verdana,sans-serif; font-size: 10pt;">The activities in class were unorganized (r) <span style="font-family: Verdana,sans-serif; font-size: 10pt;">The course objectives were clear <span style="font-family: Verdana,sans-serif; font-size: 10pt;">I didn’t understand the goals of the class (r) <span style="font-family: Verdana,sans-serif; font-size: 10pt;">The class was well organized <span style="font-family: Verdana,sans-serif; font-size: 10pt;">The class was chaotic (r) <span style="font-family: Verdana,sans-serif; font-size: 10pt;">The information in class was easy to manage <span style="font-family: Verdana,sans-serif; font-size: 10pt;">The content of this course is well arranged and logically presented <span style="font-family: Verdana,sans-serif; font-size: 10pt;">I couldn’t manage all the information I was receiving in class (r) <span style="font-family: Verdana,sans-serif; font-size: 10pt;">The instructor provided clear guidelines as to what needs to be done <span style="font-family: Verdana,sans-serif; font-size: 10pt;">Class guidelines did not help maintain order (r) <span style="font-family: Verdana,sans-serif; font-size: 10pt;">The instructor is not specific about deadlines (r) <span style="font-family: Verdana,sans-serif; font-size: 10pt;">The requirements for the course were clearly outlined <span style="font-family: Verdana,sans-serif; font-size: 10pt;">Class expectations were not clearly spelled out (r) <span style="font-family: Verdana,sans-serif; font-size: 10pt;">I didn’t know what was required to complete the course <span style="font-family: Verdana,sans-serif; font-size: 10pt;">Course concepts were taught in the context of real life experiences <span style="font-family: Verdana,sans-serif; font-size: 10pt;">There was not opportunity to share my real life experiences as they relate to the course material (r) <span style="font-family: Verdana,sans-serif; font-size: 10pt;">I was able to place abstract concepts in my own frame of reference <span style="font-family: Verdana,sans-serif; font-size: 10pt;">I could not relate to abstract concepts (r) <span style="font-family: Verdana,sans-serif; font-size: 10pt;">Other students’ description of concepts helped me understand the course material <span style="font-family: Verdana,sans-serif; font-size: 10pt;">Assignments were aligned with course objectives <span style="font-family: Verdana,sans-serif; font-size: 10pt;">Exams and quizzes were aligned with course objectives <span style="font-family: Verdana,sans-serif; font-size: 10pt;">The guidelines for evaluation we unclear (r) <span style="font-family: Verdana,sans-serif; font-size: 10pt;">Assignments did not allow me to demonstrate my learning (r)


 * <span style="font-family: Verdana,sans-serif; font-size: 10pt;">Course Management **

<span style="font-family: Verdana,sans-serif; font-size: 10pt;">The instructor was prepared each day <span style="font-family: Verdana,sans-serif; font-size: 10pt;">The instructor never seemed prepared to teach (r) <span style="font-family: Verdana,sans-serif; font-size: 10pt;">The organization of the lessons was logical and easy to follow. <span style="font-family: Verdana,sans-serif; font-size: 10pt;">The presentations used in class needed to be better designed (r) <span style="font-family: Verdana,sans-serif; font-size: 10pt;">There were sufficient examples and non-examples to clarify instruction. <span style="font-family: Verdana,sans-serif; font-size: 10pt;">I felt that class time was wasted (r) <span style="font-family: Verdana,sans-serif; font-size: 10pt;">Class time was productive <span style="font-family: Verdana,sans-serif; font-size: 10pt;">The lectures were useful <span style="font-family: Verdana,sans-serif; font-size: 10pt;">Lectures were a waste of my time (r) <span style="font-family: Verdana,sans-serif; font-size: 10pt;">There was plenty of time to ask questions in class <span style="font-family: Verdana,sans-serif; font-size: 10pt;">I never had time to have my questions answered in class (r) <span style="font-family: Verdana,sans-serif; font-size: 10pt;">Help was available when I needed clarification of course materials.


 * <span style="font-family: Verdana,sans-serif; font-size: 10pt;">Grades **

<span style="font-family: Verdana,sans-serif; font-size: 10pt;">I understood how to do well in the class <span style="font-family: Verdana,sans-serif; font-size: 10pt;">I didn’t know how to success in this class (r) <span style="font-family: Verdana,sans-serif; font-size: 10pt;">My grade reflected the quality and timeliness of my contribution <span style="font-family: Verdana,sans-serif; font-size: 10pt;">My grade reflected the quantity (number or size) of my contribution (r) <span style="font-family: Verdana,sans-serif; font-size: 10pt;">Grading was fair <span style="font-family: Verdana,sans-serif; font-size: 10pt;">It was very clear what students needed to do in order to make good grades in this class


 * <span style="font-family: Verdana,sans-serif; font-size: 10pt;">Feedback **

<span style="font-family: Verdana,sans-serif; font-size: 10pt;">Instructor responded to my e-mails in a timely manner <span style="font-family: Verdana,sans-serif; font-size: 10pt;">Feedback from my instructor was clear and effective <span style="font-family: Verdana,sans-serif; font-size: 10pt;">The feedback I received lacked quality (r) <span style="font-family: Verdana,sans-serif; font-size: 10pt;">I need to receive feedback more frequently (r) <span style="font-family: Verdana,sans-serif; font-size: 10pt;">Instructor provided timely feedback <span style="font-family: Verdana,sans-serif; font-size: 10pt;">I did not receive constructive feedback on my assignments.


 * <span style="font-family: Verdana,sans-serif; font-size: 10pt;">Subject **

<span style="font-family: Verdana,sans-serif; font-size: 10pt;">I liked this subject area <span style="font-family: Verdana,sans-serif; font-size: 10pt;">I would prefer not to take a class in this subject area in the future (r) <span style="font-family: Verdana,sans-serif; font-size: 10pt;">The course content was interesting


 * <span style="font-family: Verdana,sans-serif; font-size: 10pt;">Peers **

<span style="font-family: Verdana,sans-serif; font-size: 10pt;">I enjoyed interactions with my peers <span style="font-family: Verdana,sans-serif; font-size: 10pt;">I didn’t have very good interactions with my peers (r) <span style="font-family: Verdana,sans-serif; font-size: 10pt;">There were people in the class with whom I would like to be friends <span style="font-family: Verdana,sans-serif; font-size: 10pt;">Relationships established among students in this class carry over outside the classroom <span style="font-family: Verdana,sans-serif; font-size: 10pt;">Students in this class have not gotten to know each other very well (r)

<span style="font-family: Verdana,sans-serif; font-size: 10pt;">(Acquisition, Support, Use, Training, Fun, Validity, Overall)
 * __<span style="font-family: Verdana,sans-serif;">Satisfaction with Technology __**


 * <span style="font-family: Verdana,sans-serif; font-size: 10pt;">Acquiring a Clicker **<span style="font-family: Verdana,sans-serif; font-size: 10pt;"> (Cost, Purchasing, and Registration)

<span style="font-family: Verdana,sans-serif; font-size: 10pt;">The clicker was too expensive (r) <span style="font-family: Verdana,sans-serif; font-size: 10pt;">I feel the cost was worth it <span style="font-family: Verdana,sans-serif; font-size: 10pt;">It was easy to purchase my clicker at the bookstore <span style="font-family: Verdana,sans-serif; font-size: 10pt;">I didn’t understand how to get a clicker (r) <span style="font-family: Verdana,sans-serif; font-size: 10pt;">Registering my clicker was a simple process <span style="font-family: Verdana,sans-serif; font-size: 10pt;">I was a little lost when it came to registering my clicker (r)


 * <span style="font-family: Verdana,sans-serif; font-size: 10pt;">Support **

<span style="font-family: Verdana,sans-serif; font-size: 10pt;">The Help Desk was able to answer any questions I had about using my clicker <span style="font-family: Verdana,sans-serif; font-size: 10pt;">The Help Desk was not able to solve my registration issue (r) <span style="font-family: Verdana,sans-serif; font-size: 10pt;">The Help Desk was able to resolve my problem with registering my clicker <span style="font-family: Verdana,sans-serif; font-size: 10pt;">The Help Desk did not answer my question about using the clicker (r) <span style="font-family: Verdana,sans-serif; font-size: 10pt;">My instructor was able to answer my questions about my clicker <span style="font-family: Verdana,sans-serif; font-size: 10pt;">My instructor did not have answers to my questions about my clicker (r) <span style="font-family: Verdana,sans-serif; font-size: 10pt;">Technical support was available when I needed it <span style="font-family: Verdana,sans-serif; font-size: 10pt;">I need technical support with my clicker (r)


 * <span style="font-family: Verdana,sans-serif; font-size: 10pt;">Ease of Use **

<span style="font-family: Verdana,sans-serif; font-size: 10pt;">I had no problems with the student response system <span style="font-family: Verdana,sans-serif; font-size: 10pt;">Using the clickers was easy <span style="font-family: Verdana,sans-serif; font-size: 10pt;">Using the clickers is hard (r) <span style="font-family: Verdana,sans-serif; font-size: 10pt;">I don’t really understand how the response system work (r) <span style="font-family: Verdana,sans-serif; font-size: 10pt;">Programming my clicker was confusing (r) <span style="font-family: Verdana,sans-serif; font-size: 10pt;">I was able to program my clicker with no problems <span style="font-family: Verdana,sans-serif; font-size: 10pt;">Using my clicker in class was simple <span style="font-family: Verdana,sans-serif; font-size: 10pt;">I sometimes had difficulty using my clicker in class (r)


 * <span style="font-family: Verdana,sans-serif; font-size: 10pt;">Training **

<span style="font-family: Verdana,sans-serif; font-size: 10pt;">The introductory explanations on how to use the technology were sufficient <span style="font-family: Verdana,sans-serif; font-size: 10pt;">The introductory explanations on how to use the clickers were clear <span style="font-family: Verdana,sans-serif; font-size: 10pt;">After the introduction, I still wasn’t sure how to use this technology (r) <span style="font-family: Verdana,sans-serif; font-size: 10pt;">Listening to the introductory explanations, I understood quickly how this technology works.

<span style="font-family: Verdana,sans-serif; font-size: 10pt;"> **Fun**

<span style="font-family: Verdana,sans-serif; font-size: 10pt;">Using the clickers was fun <span style="font-family: Verdana,sans-serif; font-size: 10pt;">I always enjoyed using the new technology <span style="font-family: Verdana,sans-serif; font-size: 10pt;">Using clickers as a way of interacting in class is exciting <span style="font-family: Verdana,sans-serif; font-size: 10pt;">The technology was annoying (r) <span style="font-family: Verdana,sans-serif; font-size: 10pt;">I really enjoyed using the clickers. <span style="font-family: Verdana,sans-serif; font-size: 10pt;">I enjoyed this course <span style="font-family: Verdana,sans-serif; font-size: 10pt;">This course was a waste of my time (r)


 * <span style="font-family: Verdana,sans-serif; font-size: 10pt;">Validity **

<span style="font-family: Verdana,sans-serif; font-size: 10pt;">Having to use the response systems influenced the way influenced the way I answered questions (r) <span style="font-family: Verdana,sans-serif; font-size: 10pt;">I never thought about the technology while answering questions. <span style="font-family: Verdana,sans-serif; font-size: 10pt;">I’m not sure my answers were accurate. (r) <span style="font-family: Verdana,sans-serif; font-size: 10pt;">Having to use clickers had no effect on how I answered the questions. <span style="font-family: Verdana,sans-serif; font-size: 10pt;">I wasn’t always able to answer the way I wanted because of the technology. (r)


 * <span style="font-family: Verdana,sans-serif; font-size: 10pt;">Overall Effectiveness **

<span style="font-family: Verdana,sans-serif; font-size: 10pt;">Overall, I am happy with using clickers <span style="font-family: Verdana,sans-serif; font-size: 10pt;">Using clickers in a course is a waste of time (r) <span style="font-family: Verdana,sans-serif; font-size: 10pt;">I would take another course that used a response system <span style="font-family: Verdana,sans-serif; font-size: 10pt;">I will avoid classes using clickers in the future (r) <span style="font-family: Verdana,sans-serif; font-size: 10pt;">I would recommend that the instructor continue to use a response system <span style="font-family: Verdana,sans-serif; font-size: 10pt;">I would hope the instructor would think twice about using clickers in the future (r) <span style="font-family: Verdana,sans-serif; font-size: 10pt;">I would recommend this course to others <span style="font-family: Verdana,sans-serif; font-size: 10pt;">I would not recommend this course to a classmate (r) <span style="font-family: Verdana,sans-serif; font-size: 10pt;">The technology used in this course motivated me to learn <span style="font-family: Verdana,sans-serif; font-size: 10pt;">Compared with other courses, this course was excellent


 * __<span style="font-family: Verdana,sans-serif;">Perceived Learning __**

<span style="font-family: Verdana,sans-serif; font-size: 10pt;">Clickers have been beneficial to my learning <span style="font-family: Verdana,sans-serif; font-size: 10pt;">Clickers had no impact on my learning (r) <span style="font-family: Verdana,sans-serif; font-size: 10pt;">Clickers allow me to connect concepts to one another <span style="font-family: Verdana,sans-serif; font-size: 10pt;">The technology did not allow me understand concepts better (r) <span style="font-family: Verdana,sans-serif; font-size: 10pt;">Clickers allow me to apply concepts to real world situations <span style="font-family: Verdana,sans-serif; font-size: 10pt;">I don’t feel that what I learned using clickers is practical (r) <span style="font-family: Verdana,sans-serif; font-size: 10pt;">Clickers made it difficult for me to figure out what I didn’t know (r) <span style="font-family: Verdana,sans-serif; font-size: 10pt;">The technology helped me to focus my studying <span style="font-family: Verdana,sans-serif; font-size: 10pt;">Clickers didn’t help me figure out what I needed to study for (r) <span style="font-family: Verdana,sans-serif; font-size: 10pt;">The new technology really helped me better prepare for exams <span style="font-family: Verdana,sans-serif; font-size: 10pt;">The clickers were useless in preparing for exams (r) <span style="font-family: Verdana,sans-serif; font-size: 10pt;">Using the clickers reinforced my reading <span style="font-family: Verdana,sans-serif; font-size: 10pt;">The technology had nothing to do with my homework (r) <span style="font-family: Verdana,sans-serif; font-size: 10pt;">The new technology had no relation to my reading (r) <span style="font-family: Verdana,sans-serif; font-size: 10pt;">The student response systems helped emphasize what I learned in my homework <span style="font-family: Verdana,sans-serif; font-size: 10pt;">Clickers helped me understand the course material <span style="font-family: Verdana,sans-serif; font-size: 10pt;">Clickers helped me assess my knowledge <span style="font-family: Verdana,sans-serif; font-size: 10pt;">Clickers did help me assess the knowledge I had learned (r) <span style="font-family: Verdana,sans-serif; font-size: 10pt;">The clickers made it easy to connect course materials


 * __<span style="font-family: Verdana,sans-serif;">Perceived Performance __**

<span style="font-family: Verdana,sans-serif; font-size: 10pt;">Using the clickers helped me get a better grade in this class <span style="font-family: Verdana,sans-serif; font-size: 10pt;">The new technology made it difficulty for me to get a good grade in this class (r) <span style="font-family: Verdana,sans-serif; font-size: 10pt;">The clickers help me do better on my quizzes and/or exams <span style="font-family: Verdana,sans-serif; font-size: 10pt;">Using the clickers did not help be score higher on the quizzes and/or exams (r) <span style="font-family: Verdana,sans-serif; font-size: 10pt;">I got higher scores on my assignments and homework because of the new technology <span style="font-family: Verdana,sans-serif; font-size: 10pt;">Using clickers did not improve my homework grades (r)


 * <span style="font-family: Verdana,sans-serif;">PART II: Open-ended Questions **

//<span style="font-family: Verdana,sans-serif; font-size: 10pt;">Placed at the end of the survey and to be coded for thematic analysis //

<span style="font-family: Verdana,sans-serif; font-size: 10pt;">What did you like best about your experience using clickers in this class?

<span style="font-family: Verdana,sans-serif; font-size: 10pt;">What were some barriers to your use of clickers in this class?

<span style="font-family: Verdana,sans-serif; font-size: 10pt;">What is one thing you would improve about your experience?

<span style="font-family: Verdana,sans-serif; font-size: 10pt;">Would you recommend this course to others, if it used the same technology? Why or Why not?


 * <span style="font-family: Verdana,sans-serif;">Part III: Other Historical Data to Gather from Faculty to Assess Student Impact **

<span style="font-family: Verdana,sans-serif; font-size: 10pt;">Student performance variables:

//<span style="font-family: Verdana,sans-serif; font-size: 10pt;">(to be collected from current and previous semesters, if available) //


 * 1) <span style="font-family: Verdana,sans-serif; font-size: 10pt;">Drop/Retention Rate (Number of students as of 9.18 versus as of 12.28
 * 2) <span style="font-family: Verdana,sans-serif; font-size: 10pt;">Pass Rate
 * 3) <span style="font-family: Verdana,sans-serif; font-size: 10pt;">Individual Exam Average
 * 4) <span style="font-family: Verdana,sans-serif; font-size: 10pt;">Overall Exam Average
 * 5) <span style="font-family: Verdana,sans-serif; font-size: 10pt;">Overall Homework Average
 * 6) <span style="font-family: Verdana,sans-serif; font-size: 10pt;">Overall Grade Average

<span style="font-family: Verdana,sans-serif; font-size: 10pt;">Satisfaction variable:


 * 1) <span style="font-family: Verdana,sans-serif; font-size: 10pt;">Average student evaluations (standard department or university teaching evaluations from current course and from previous semester, if taught the course before)

<span style="font-family: Verdana,sans-serif; font-size: 10pt;">Please send the numbers in points and percentages, if available. Feel free to contact tjoosten@uwm.edu with any questions regarding gathering this data.

<span style="font-family: Verdana,sans-serif; font-size: 10pt;">Due: January 15th

Abstract for EXEMPT Protocol ||
 * //**Perceived Performanc**//

<span style="display: block; font-family: 'Times New Roman'; font-size: medium; line-height: normal; margin-bottom: 0in; margin-top: 0in; text-align: center;"> **Student Response Systems (SRS): Exploring Potential and Assessing Impact** <span style="display: block; font-family: 'Times New Roman'; font-size: medium; line-height: normal; margin-bottom: 0in; margin-top: 0in; text-align: left;"> The purpose of this study is to evaluate the impact of student response systems (SRS) on teaching and learning. Student response systems, more commonly called clickers, are wireless communication systems that allow faculty to poll students and students respond using a clicker or response pad. In our study, we will utilize both quantitative (multiple regression) and qualitative (thematic analysis) methodologies in evaluation of the project outcomes. <span style="display: block; font-family: 'Times New Roman'; font-size: medium; line-height: normal; margin-bottom: 0in; margin-top: 0in; text-align: left;"> In this study, data will be collected from approximately 2500 students and 11 faculty members. The 11 faculty members have integrated student response systems into their courses for the fall 2005 semester. Approximately 2500 students are enrolled in the courses of the 11 faculty members; therefore, students participating in the study will have engaged in a course using the student response system technology. Students who participate in this study will be provided with an information sheet about the study and a questionnaire to complete. They can withdraw from this study for any reason at any time. Any data collected from that student will be destroyed and not used in the analysis. Filling out the questionnaire will be approximately 15 minutes. All data will be treated confidentially. No raw data will be shared. Grouped or "aggregate" data may be shared in class or published in professional journals. <span style="display: block; font-family: 'Times New Roman'; font-size: medium; line-height: normal; margin-bottom: 0in; margin-top: 0in; text-align: left;"> Part I of the study will focus on the instructors’ experiences. First, we will be organizing various focus groups in order to gather faculty reports on the SRS for analysis. A thematic analysis of narratives will be conducted using the focus group data, individual comments and stories gathered during one-on-one training appointments, and email correspondence and queries during the Project. For selected faculty participants, we will conduct a case study focusing on two courses conducted in parallel with one lecture utilizing a student response system and the other offered in a traditional setting without SRS. All instructors will remain anonymous in any written reports or publications that result from the study. In addition, we will administer a faculty survey containing a series of questions intended to measure instructor’s attitudes toward the SRS. The data collected will be anonymous. Surveys will be sent to faculty through electronic mail and returned to me using electronic mail or campus mail. No identifying information is required on the faculty surveys. <span style="display: block; font-family: 'Times New Roman'; font-size: medium; line-height: normal; margin-bottom: 0in; margin-top: 0in; text-align: left;"> Part II of this study focuses on student variables. We will gather anonymous student evaluations by survey, which will contain a series of questions that asks about students' previous technology use, attitudes towards the use of SRS in the classroom, their evaluation of the clicker technology itself, their perception of their learning in relation to SRS, and their performance in the course in relation to SRS. Questionnaires will be distributed to 2500 students who have participated in a course by one of the 11 faculty who are using student response systems in his or her classroom. Each faculty member will be given a packet with the number of questionnaire corresponding to the number of students he or she has taught and asked to distribute the questionnaire to the students. Each instructor’s packet will be coded with a letter so that questionnaires from the same classroom can be grouped for analysis. Survey will be collected by the faculty member and sent intercampus mail to the research at the Learning Technology Center. We will conduct various multivariate analyses in analyzing the data to produce quantifiable results of the effectiveness of the technology. <span style="display: block; font-family: 'Times New Roman'; font-size: medium; line-height: normal; margin-bottom: 0in; margin-top: 0in; text-align: left;"> In addition to the data gathered through questionnaires, faculty will gather historical data, including performance data, average grades and pass rates, from the semester courses being studied as well as previous semesters without SRS in order to run comparisons as well as gather learning assessments in class. Also, faculty will gather student evaluation from current and previous semesters prior to SRS to run comparisons. <span style="display: block; font-family: 'Times New Roman'; font-size: medium; line-height: normal; margin-bottom: 0in; margin-top: 0in; text-align: left;"> All survey data will be kept in a secure desk drawer in my office until the data is entered into a database. All surveys will be destroyed at the completion of the study.

This study is considered exempt under Category 1 because it involves research being conducted in a traditional education setting involving normal education practices and the effectives of instructional technique. Also, this study is exempt under Category 2 because it involves the user of survey procedures and interview procedures. Finally, this study is exempt because it involves research in which we will collect or study existing data, documents, and records.

<span style="display: block; font-family: 'Times New Roman'; font-size: medium; line-height: normal; margin-bottom: 0in; margin-top: 0in; text-align: center;"> **Information Sheet** <span style="display: block; font-family: 'Times New Roman'; font-size: medium; line-height: normal; margin-bottom: 0in; margin-top: 0in; text-align: left; text-indent: 0.5in;"> I am Tanya Joosten of the Learning Technology Center at the University of Wisconsin-Milwaukee. We are conducting a study of how student response systems (a.k.a. clickers) impact teaching and student learning. We would appreciate your participation in this study, as it will assist us in making recommendations for improving the teaching of students throughout the UWM campus.
 * Student Response Systems**

If you agree to be in this study, you will be asked to fill out a survey and to answer several questions about your experience in using clickers. The survey should take 15 minutes to complete. There are over 2000 students at UWM participating in the study. This study will take place between September 2005 and January 2006. There are no known risks associated with your being in the study. Possible benefits are that you will have a voice in helping shape the instruction that students on the UWM campus receive.

The questionnaire you fill out will be treated confidentially. PLEASE DO NOT PUT YOUR NAME ANYWHERE ON THE SURVEY. There will be no way to link you to your responses. Data from this study will be shared with my classmates and teacher and may be published in professional journals. Only grouped data will be presented or published.

You do not have to be in the study. You can withdraw from this study during filling out the questionnaire for any reason. There is no penalty for withdrawing.

Once the study is completed, we would be glad to give the results to you. In the meantime, if you have any questions, please contact me:

Tanya Joosten <span style="display: block; font-family: 'Times New Roman'; font-size: medium; line-height: normal; margin-bottom: 0in; margin-top: 0in; text-align: left;"> Learning Technology Center <span style="display: block; font-family: 'Times New Roman'; font-size: medium; line-height: normal; margin-bottom: 0in; margin-top: 0in; text-align: left;"> University of Wisconsin-Milwaukee PO Box 604 Milwaukee, WI 53201 __tjoosten@uwm.edu__ <span style="display: block; font-family: 'Times New Roman'; font-size: medium; line-height: normal; margin-bottom: 0in; margin-top: 0in; text-align: left;"> 414.229.4319 <span style="display: block; font-family: 'Times New Roman'; font-size: medium; line-height: normal; margin-bottom: 0in; margin-top: 0in; text-align: left;"> **If you have any complaints about your experience as a participant in this study, please call or write:**

Chris Buth Furness IRB Administrator Institutional Review Board for the Protection of Human Subjects The Graduate School University of Wisconsin-Milwaukee PO Box 340, MIT 206 Milwaukee, WI 53201 414-229-3173 phone; 414-229-5000 fax __chrisb@uwm.edu__

Although Ms. Furness will ask your name, all complaints are kept in confidence.

This research project has been approved by the University of Wisconsin-Milwaukee Institutional Review Board for the Protection of Human Subjects for a one year period.

<span style="display: block; font-family: 'Times New Roman'; font-size: medium; line-height: normal; margin-bottom: 0in; margin-top: 0in; text-align: left;"> **STUDENT SURVEY** <span style="display: block; font-family: 'Times New Roman'; font-size: medium; line-height: normal; margin-bottom: 0in; margin-top: 0in; text-align: left;"> Filling out this survey indicates that I am at least 18 years old and that I am giving my informed consent to be a subject in this study. <span style="display: block; font-family: 'Times New Roman'; font-size: medium; line-height: normal; margin-bottom: 0in; margin-top: 0in; text-align: left;"> 1. <span style="border-top-style: solid; border-top-width: 1pt; display: block; font-family: 'Times New Roman'; font-size: medium; line-height: normal; margin-bottom: 0in; margin-top: 0in; text-align: left;"> Course Number, Course Name, Date, Time and Location: <span style="display: block; font-family: 'Times New Roman'; font-size: medium; line-height: normal; margin-bottom: 0in; margin-top: 0in; text-align: left;"> 2. <span style="border-top-style: solid; border-top-width: 1pt; display: block; font-family: 'Times New Roman'; font-size: medium; line-height: normal; margin-bottom: 0in; margin-top: 0in; text-align: left;"> Student ID <span style="display: block; font-family: 'Times New Roman'; font-size: medium; line-height: normal; margin-bottom: 0in; margin-top: 0in; text-align: left;"> **Demographics** <span style="display: block; font-family: 'Times New Roman'; font-size: medium; line-height: normal; margin-bottom: 0in; margin-top: 0in; text-align: left;"> //Please indicate with an “X” which of the following best describes yourself// <span style="display: block; font-family: 'Times New Roman'; font-size: medium; line-height: normal; margin-bottom: 0in; margin-top: 0in; text-align: left;"> 3. Age: <span style="display: block; font-family: 'Times New Roman'; font-size: medium; line-height: normal; margin-bottom: 0in; margin-top: 0in; text-align: left;"> 17 - 19 _

<span style="display: block; font-family: 'Times New Roman'; font-size: medium; line-height: normal; margin-bottom: 0in; margin-top: 0in; text-align: left;">__ 20 - 22 __ _

<span style="display: block; font-family: 'Times New Roman'; font-size: medium; line-height: normal; margin-bottom: 0in; margin-top: 0in; text-align: left;"> 23 - 25 _

<span style="display: block; font-family: 'Times New Roman'; font-size: medium; line-height: normal; margin-bottom: 0in; margin-top: 0in; text-align: left;">__ 25+ __ _

<span style="display: block; font-family: 'Times New Roman'; font-size: medium; line-height: normal; margin-bottom: 0in; margin-top: 0in; text-align: left;"> 4. Gender: <span style="display: block; font-family: 'Times New Roman'; font-size: medium; line-height: normal; margin-bottom: 0in; margin-top: 0in; text-align: left;"> Male _

<span style="display: block; font-family: 'Times New Roman'; font-size: medium; line-height: normal; margin-bottom: 0in; margin-top: 0in; text-align: left;">__ Female __ _

<span style="display: block; font-family: 'Times New Roman'; font-size: medium; line-height: normal; margin-bottom: 0in; margin-top: 0in; text-align: left;"> 5. Race: <span style="display: block; font-family: 'Times New Roman'; font-size: medium; line-height: normal; margin-bottom: 0in; margin-top: 0in; text-align: left;"> African American _

<span style="display: block; font-family: 'Times New Roman'; font-size: medium; line-height: normal; margin-bottom: 0in; margin-top: 0in; text-align: left;">__ Latino __ _

<span style="display: block; font-family: 'Times New Roman'; font-size: medium; line-height: normal; margin-bottom: 0in; margin-top: 0in; text-align: left;"> Asian _

<span style="display: block; font-family: 'Times New Roman'; font-size: medium; line-height: normal; margin-bottom: 0in; margin-top: 0in; text-align: left;">__ European American/Caucasian __ _

<span style="display: block; font-family: 'Times New Roman'; font-size: medium; line-height: normal; margin-bottom: 0in; margin-top: 0in; text-align: left;"> Other: Please identify

<span style="display: block; font-family: 'Times New Roman'; font-size: medium; line-height: normal; margin-bottom: 0in; margin-top: 0in; text-align: left;">

<span style="display: block; font-family: 'Times New Roman'; font-size: medium; line-height: normal; margin-bottom: 0in; margin-top: 0in; text-align: left;">__ 6. Student Status: __

<span style="display: block; font-family: 'Times New Roman'; font-size: medium; line-height: normal; margin-bottom: 0in; margin-top: 0in; text-align: left;">__ Full-time __ _

<span style="display: block; font-family: 'Times New Roman'; font-size: medium; line-height: normal; margin-bottom: 0in; margin-top: 0in; text-align: left;"> Part-time _

<span style="display: block; font-family: 'Times New Roman'; font-size: medium; line-height: normal; margin-bottom: 0in; margin-top: 0in; text-align: left;">__ 7. Education Level: __

<span style="display: block; font-family: 'Times New Roman'; font-size: medium; line-height: normal; margin-bottom: 0in; margin-top: 0in; text-align: left;">__ Freshman __ _

<span style="display: block; font-family: 'Times New Roman'; font-size: medium; line-height: normal; margin-bottom: 0in; margin-top: 0in; text-align: left;"> Sophomore _

<span style="display: block; font-family: 'Times New Roman'; font-size: medium; line-height: normal; margin-bottom: 0in; margin-top: 0in; text-align: left;">__ Junior __ _

<span style="display: block; font-family: 'Times New Roman'; font-size: medium; line-height: normal; margin-bottom: 0in; margin-top: 0in; text-align: left;"> Senior _

<span style="display: block; font-family: 'Times New Roman'; font-size: medium; line-height: normal; margin-bottom: 0in; margin-top: 0in; text-align: left;">__ 8. Have you previously taken a course that used clickers? Yes (1) No (2) __

<span style="display: block; font-family: 'Times New Roman'; font-size: medium; line-height: normal; margin-bottom: 0in; margin-top: 0in; text-align: left;">__ 9. Did you use a clicker in this course? Yes (1) No (2) __

<span style="display: block; font-family: 'Times New Roman'; font-size: medium; line-height: normal; margin-bottom: 0in; margin-top: 0in; text-align: left;">__ If yes to #9, please answer number 10. __

<span style="display: block; font-family: 'Times New Roman'; font-size: medium; line-height: normal; margin-bottom: 0in; margin-top: 0in; text-align: left;">__ If no to #9, please move onto the next session. __

<span style="display: block; font-family: 'Times New Roman'; font-size: medium; line-height: normal; margin-bottom: 0in; margin-top: 0in; text-align: left;">__ 10. Which clicker system did you use? __

<span style="display: block; font-family: 'Times New Roman'; font-size: medium; line-height: normal; margin-bottom: 0in; margin-top: 0in; text-align: left;">__ Turning Point (1) CPS/eInstruction (2) Other (3) __

<span style="display: block; font-family: 'Times New Roman'; font-size: medium; line-height: normal; margin-bottom: 0in; margin-top: 0in; text-align: left;">__ **Computer Use** __

<span style="display: block; font-family: 'Times New Roman'; font-size: medium; line-height: normal; margin-bottom: 0in; margin-top: 0in; text-align: left;">__ Please rate your use of computers or computer software. There are no correct answers or preferred answers. Each item is rated on a 5-point scale ranging from frequently (5) to never (1). __

<span style="display: block; font-family: 'Times New Roman'; font-size: medium; line-height: normal; margin-bottom: 0in; margin-top: 0in; text-align: left;">__ (5) Frequently | (4) Often | (3) Sometimes | (2) Rarely | (1) Never __

<span style="display: block; font-family: 'Times New Roman'; font-size: medium; line-height: normal; margin-bottom: 0in; margin-top: 0in; text-align: left;">

<span style="display: block; font-family: 'Times New Roman'; font-size: medium; line-height: normal; margin-bottom: 0in; margin-left: 0.25in; margin-top: 0in; text-align: left; text-indent: -0.25in;">__ 11. __ _ How often do you use a computer at home?

<span style="display: block; font-family: 'Times New Roman'; font-size: medium; line-height: normal; margin-bottom: 0in; margin-left: 0.25in; margin-top: 0in; text-align: left; text-indent: -0.25in;"> 12. ___ How often do you use a computer at school?__

<span style="display: block; font-family: 'Times New Roman'; font-size: medium; line-height: normal; margin-bottom: 0in; margin-left: 0.25in; margin-top: 0in; text-align: left; text-indent: -0.25in;">__ 13. __ _ How often do you use a computer at work?

<span style="display: block; font-family: 'Times New Roman'; font-size: medium; line-height: normal; margin-bottom: 0in; margin-left: 0.25in; margin-top: 0in; text-align: left; text-indent: -0.25in;"> 14. ___ How often do you use a computer in a library?__

<span style="display: block; font-family: 'Times New Roman'; font-size: medium; line-height: normal; margin-bottom: 0in; margin-left: 0.25in; margin-top: 0in; text-align: left; text-indent: -0.25in;">__ 15. __ _ How often do you use a computer at a friend or family member’s house?

<span style="display: block; font-family: 'Times New Roman'; font-size: medium; line-height: normal; margin-bottom: 0in; margin-left: 0.25in; margin-top: 0in; text-align: left; text-indent: -0.25in;"> 16. ___ How often do you use a computer?__

<span style="display: block; font-family: 'Times New Roman'; font-size: medium; line-height: normal; margin-bottom: 0in; margin-left: 0.25in; margin-top: 0in; text-align: left; text-indent: -0.25in;">__ 17. __ _ How often do you use the Internet?

<span style="display: block; font-family: 'Times New Roman'; font-size: medium; line-height: normal; margin-bottom: 0in; margin-left: 0.25in; margin-top: 0in; text-align: left; text-indent: -0.25in;"> 18. ___ How often do you use send or receive electronic mail?__

<span style="display: block; font-family: 'Times New Roman'; font-size: medium; line-height: normal; margin-bottom: 0in; margin-left: 0.25in; margin-top: 0in; text-align: left; text-indent: -0.25in;">__ 19. __ _ How often do you use chat software/instant messenger (AOL, MSN, ICQ, etc.)?

<span style="display: block; font-family: 'Times New Roman'; font-size: medium; line-height: normal; margin-bottom: 0in; margin-left: 0.25in; margin-top: 0in; text-align: left; text-indent: -0.25in;"> 20. ___ How often do you use a word processor (Word, WordPerfect)?__

<span style="display: block; font-family: 'Times New Roman'; font-size: medium; line-height: normal; margin-bottom: 0in; margin-left: 0.25in; margin-top: 0in; text-align: left; text-indent: -0.25in;">__ 21. __ _ How often do you use spreadsheets (Excel, Lotus)?

<span style="display: block; font-family: 'Times New Roman'; font-size: medium; line-height: normal; margin-bottom: 0in; margin-left: 0.25in; margin-top: 0in; text-align: left; text-indent: -0.25in;"> 22. ___ How often do you use the computer for games?__

<span style="display: block; font-family: 'Times New Roman'; font-size: medium; line-height: normal; margin-bottom: 0in; margin-left: 0.25in; margin-top: 0in; text-align: left; text-indent: -0.25in;">__ 23. __ _ How often do you use the computer to view or edit graphics/photo images?

<span style="display: block; font-family: 'Times New Roman'; font-size: medium; line-height: normal; margin-bottom: 0in; margin-left: 0.25in; margin-top: 0in; text-align: left; text-indent: -0.25in;"> 24. ___ How often do you use a courseware product (e.g., Desire2Learn, D2L)?__

<span style="display: block; font-family: 'Times New Roman'; font-size: medium; line-height: normal; margin-bottom: 0in; margin-top: 0in; text-align: left;">__ **Student Response System Grant Evaluation: Student Survey Items** __

<span style="display: block; font-family: 'Times New Roman'; font-size: medium; line-height: normal; margin-bottom: 0in; margin-top: 0in; text-align: left;">__ //Note: The following items would be randomized the survey. The reverse coded items are noted by (r) and are required to increase the reliability of this instrument. The headings in bold are specific to the variable they are measuring. Some of the survey items are taken from proven reliable surveys and are otherwise grounded in research examined. Once the survey is administered, I will run a factor analysis to make sure the items factor to their corresponding variable. Multiple regression will be run to analyze relationships between variables.// __

<span style="display: block; font-family: 'Times New Roman'; font-size: medium; line-height: normal; margin-bottom: 0in; margin-top: 0in; text-align: left;">__ Sample instructions and Likert scale: __

<span style="display: block; font-family: 'Times New Roman'; font-size: medium; line-height: normal; margin-bottom: 0in; margin-top: 0in; text-align: left;">__ The following statements address different aspects of your experience in taking a course that uses a student response system or clickers. For each of the statements, please enter 5 if you strongly agree with the statement with a range to 1 if you strongly disagree with the statement. __

<span style="display: block; font-family: 'Times New Roman'; font-size: medium; line-height: normal; margin-bottom: 0in; margin-top: 0in; text-align: left;">__ (5) Strongly Agree | (4) Agree | (3) Neutral | (2) Disagree | (1) Strongly Disagree __
 * Classroom Interaction**

<span style="display: block; font-family: 'Times New Roman'; font-size: medium; line-height: normal; margin-bottom: 0in; margin-top: 0in; text-align: left;">__ (Communication, Participation, Engagement) __

<span style="display: block; font-family: 'Times New Roman'; font-size: medium; line-height: normal; margin-bottom: 0in; margin-top: 0in; text-align: left;">__ Option 1: Insert a statement advising them to compare to another course. __ Read Carefully__. Please review each of the following statements. Each statement reflects a comparison to the classes you have taken that did not use clickers.__

<span style="display: block; font-family: 'Times New Roman'; font-size: medium; line-height: normal; margin-bottom: 0in; margin-top: 0in; text-align: left;">__ I felt involved in this course __

<span style="display: block; font-family: 'Times New Roman'; font-size: medium; line-height: normal; margin-bottom: 0in; margin-top: 0in; text-align: left;">__ I was engaged __

<span style="display: block; font-family: 'Times New Roman'; font-size: medium; line-height: normal; margin-bottom: 0in; margin-top: 0in; text-align: left;">__ I felt like an outsider (r) __

<span style="display: block; font-family: 'Times New Roman'; font-size: medium; line-height: normal; margin-bottom: 0in; margin-top: 0in; text-align: left;">__ I felt a part of the class __

<span style="display: block; font-family: 'Times New Roman'; font-size: medium; line-height: normal; margin-bottom: 0in; margin-top: 0in; text-align: left;">__ This course was alienating (r) __

<span style="display: block; font-family: 'Times New Roman'; font-size: medium; line-height: normal; margin-bottom: 0in; margin-top: 0in; text-align: left;">__ Using clickers helps me to pay attention in class __

<span style="display: block; font-family: 'Times New Roman'; font-size: medium; line-height: normal; margin-bottom: 0in; margin-top: 0in; text-align: left;">__ The classroom environment was very lively and active __

<span style="display: block; font-family: 'Times New Roman'; font-size: medium; line-height: normal; margin-bottom: 0in; margin-top: 0in; text-align: left;">__ This class was boring (r) __

<span style="display: block; font-family: 'Times New Roman'; font-size: medium; line-height: normal; margin-bottom: 0in; margin-top: 0in; text-align: left;">__ Communication with my classmates was good __

<span style="display: block; font-family: 'Times New Roman'; font-size: medium; line-height: normal; margin-bottom: 0in; margin-top: 0in; text-align: left;">__ Communication with my instructor was effective in class __

<span style="display: block; font-family: 'Times New Roman'; font-size: medium; line-height: normal; margin-bottom: 0in; margin-top: 0in; text-align: left;">__ I wish there was more opportunity to participate with my classmates (r) __

<span style="display: block; font-family: 'Times New Roman'; font-size: medium; line-height: normal; margin-bottom: 0in; margin-top: 0in; text-align: left;">__ I didn’t communicate very will with my instructor (r) __

<span style="display: block; font-family: 'Times New Roman'; font-size: medium; line-height: normal; margin-bottom: 0in; margin-top: 0in; text-align: left;">__ Amount of communication in the classroom was adequate __

<span style="display: block; font-family: 'Times New Roman'; font-size: medium; line-height: normal; margin-bottom: 0in; margin-top: 0in; text-align: left;">__ I would have liked to see more interactions in the class (r) __

<span style="display: block; font-family: 'Times New Roman'; font-size: medium; line-height: normal; margin-bottom: 0in; margin-top: 0in; text-align: left;">__ There is little misunderstanding. __

<span style="display: block; font-family: 'Times New Roman'; font-size: medium; line-height: normal; margin-bottom: 0in; margin-top: 0in; text-align: left;">__ There seemed to be confusion a lot of the time (r) __

<span style="display: block; font-family: 'Times New Roman'; font-size: medium; line-height: normal; margin-bottom: 0in; margin-top: 0in; text-align: left;">__ My participation in the course is frequent __

<span style="display: block; font-family: 'Times New Roman'; font-size: medium; line-height: normal; margin-bottom: 0in; margin-top: 0in; text-align: left;">__ I didn’t participate much in class (r) __

<span style="display: block; font-family: 'Times New Roman'; font-size: medium; line-height: normal; margin-bottom: 0in; margin-top: 0in; text-align: left;">__ My presence in this class makes no difference (r) __

<span style="display: block; font-family: 'Times New Roman'; font-size: medium; line-height: normal; margin-bottom: 0in; margin-top: 0in; text-align: left;">__ Students day dream, write letters, or read the newspaper during class (r) __

<span style="display: block; font-family: 'Times New Roman'; font-size: medium; line-height: normal; margin-bottom: 0in; margin-top: 0in; text-align: left;">__ Option 2: Rewrite of items, specifically addressing the clickers. __

<span style="display: block; font-family: 'Times New Roman'; font-size: medium; line-height: normal; margin-bottom: 0in; margin-top: 0in; text-align: left;">__ Clickers made me feel involved in the course __

<span style="display: block; font-family: 'Times New Roman'; font-size: medium; line-height: normal; margin-bottom: 0in; margin-top: 0in; text-align: left;">__ Clickers led me to be engaged in class __

<span style="display: block; font-family: 'Times New Roman'; font-size: medium; line-height: normal; margin-bottom: 0in; margin-top: 0in; text-align: left;">__ Clickers made me develop the feelings of an outsider (r) __

<span style="display: block; font-family: 'Times New Roman'; font-size: medium; line-height: normal; margin-bottom: 0in; margin-top: 0in; text-align: left;">__ I felt a part of the class because of using my clicker __

<span style="display: block; font-family: 'Times New Roman'; font-size: medium; line-height: normal; margin-bottom: 0in; margin-top: 0in; text-align: left;">__ Using clickers helps me to pay attention in class __

<span style="display: block; font-family: 'Times New Roman'; font-size: medium; line-height: normal; margin-bottom: 0in; margin-top: 0in; text-align: left;">__ The classroom environment was very lively and active thanks to the clickers __

<span style="display: block; font-family: 'Times New Roman'; font-size: medium; line-height: normal; margin-bottom: 0in; margin-top: 0in; text-align: left;">__ I would have liked to see more interactions in the class (r) __

<span style="display: block; font-family: 'Times New Roman'; font-size: medium; line-height: normal; margin-bottom: 0in; margin-top: 0in; text-align: left;">__ Clickers facilitated good communication with my classmates __

<span style="display: block; font-family: 'Times New Roman'; font-size: medium; line-height: normal; margin-bottom: 0in; margin-top: 0in; text-align: left;">__ The clickers did not provide an opportunity for me to participate with my classmates (r) __

<span style="display: block; font-family: 'Times New Roman'; font-size: medium; line-height: normal; margin-bottom: 0in; margin-top: 0in; text-align: left;">__ Clickers made communication with my instructor more effective in class __

<span style="display: block; font-family: 'Times New Roman'; font-size: medium; line-height: normal; margin-bottom: 0in; margin-top: 0in; text-align: left;">__ The clickers made it difficult to communicate very will with my instructor (r) __

<span style="display: block; font-family: 'Times New Roman'; font-size: medium; line-height: normal; margin-bottom: 0in; margin-top: 0in; text-align: left;">__ Clickers decreased misunderstandings about course material __

<span style="display: block; font-family: 'Times New Roman'; font-size: medium; line-height: normal; margin-bottom: 0in; margin-top: 0in; text-align: left;">__ Clickers seemed to cause confusion about the material a lot of the time (r) __

<span style="display: block; font-family: 'Times New Roman'; font-size: medium; line-height: normal; margin-bottom: 0in; margin-top: 0in; text-align: left;">__ Clickers increased the frequency of my participation in the course __

<span style="display: block; font-family: 'Times New Roman'; font-size: medium; line-height: normal; margin-bottom: 0in; margin-top: 0in; text-align: left;">__ The clickers did not impact my participation much in class (r) __
 * Satisfaction with Technology**

<span style="display: block; font-family: 'Times New Roman'; font-size: medium; line-height: normal; margin-bottom: 0in; margin-top: 0in; text-align: left;">__ (Acquisition, Support, Use, Training, Fun, Validity, Overall) __

<span style="display: block; font-family: 'Times New Roman'; font-size: medium; line-height: normal; margin-bottom: 0in; margin-top: 0in; text-align: left;">__ **Acquiring a Clicker** (Cost, Purchasing, and Registration) __

<span style="display: block; font-family: 'Times New Roman'; font-size: medium; line-height: normal; margin-bottom: 0in; margin-top: 0in; text-align: left;">__ The clicker was too expensive for its purpose (r) __

<span style="display: block; font-family: 'Times New Roman'; font-size: medium; line-height: normal; margin-bottom: 0in; margin-top: 0in; text-align: left;">__ I feel the cost was worth it __

<span style="display: block; font-family: 'Times New Roman'; font-size: medium; line-height: normal; margin-bottom: 0in; margin-top: 0in; text-align: left;">__ It was easy to purchase my clicker at the bookstore __

<span style="display: block; font-family: 'Times New Roman'; font-size: medium; line-height: normal; margin-bottom: 0in; margin-top: 0in; text-align: left;">__ I didn’t understand how to get a clicker (r) __

<span style="display: block; font-family: 'Times New Roman'; font-size: medium; line-height: normal; margin-bottom: 0in; margin-top: 0in; text-align: left;">__ Registering my clicker was a simple process __

<span style="display: block; font-family: 'Times New Roman'; font-size: medium; line-height: normal; margin-bottom: 0in; margin-top: 0in; text-align: left;">__ I was a little lost when it came to registering my clicker (r) __

<span style="display: block; font-family: 'Times New Roman'; font-size: medium; line-height: normal; margin-bottom: 0in; margin-top: 0in; text-align: left;">__ **Support** __

<span style="display: block; font-family: 'Times New Roman'; font-size: medium; line-height: normal; margin-bottom: 0in; margin-top: 0in; text-align: left;">__ The Help Desk was able to answer any questions I had about using my clicker __

<span style="display: block; font-family: 'Times New Roman'; font-size: medium; line-height: normal; margin-bottom: 0in; margin-top: 0in; text-align: left;">__ The Help Desk did not answer my question about using the clicker (r) __

<span style="display: block; font-family: 'Times New Roman'; font-size: medium; line-height: normal; margin-bottom: 0in; margin-top: 0in; text-align: left;">__ My instructor/TA was able to answer my questions about my clicker __

<span style="display: block; font-family: 'Times New Roman'; font-size: medium; line-height: normal; margin-bottom: 0in; margin-top: 0in; text-align: left;">__ My instructor/TA did not have answers to my questions about my clicker (r) __

<span style="display: block; font-family: 'Times New Roman'; font-size: medium; line-height: normal; margin-bottom: 0in; margin-top: 0in; text-align: left;">__ Technical support was available when I needed it __

<span style="display: block; font-family: 'Times New Roman'; font-size: medium; line-height: normal; margin-bottom: 0in; margin-top: 0in; text-align: left;">__ I needed better technical support with my clicker (r) __

<span style="display: block; font-family: 'Times New Roman'; font-size: medium; line-height: normal; margin-bottom: 0in; margin-top: 0in; text-align: left;">__ **Ease of Use** __

<span style="display: block; font-family: 'Times New Roman'; font-size: medium; line-height: normal; margin-bottom: 0in; margin-top: 0in; text-align: left;">__ I had no problems using the clickers __

<span style="display: block; font-family: 'Times New Roman'; font-size: medium; line-height: normal; margin-bottom: 0in; margin-top: 0in; text-align: left;">__ Programming my clicker was confusing (r) __

<span style="display: block; font-family: 'Times New Roman'; font-size: medium; line-height: normal; margin-bottom: 0in; margin-top: 0in; text-align: left;">__ Programming my clicker was easy too similar to reverse, what about “It was easy to program my clicker” __

<span style="display: block; font-family: 'Times New Roman'; font-size: medium; line-height: normal; margin-bottom: 0in; margin-top: 0in; text-align: left;">__ Using my clicker in class was simple __

<span style="display: block; font-family: 'Times New Roman'; font-size: medium; line-height: normal; margin-bottom: 0in; margin-top: 0in; text-align: left;">__ I sometimes had difficulty using my clicker in class (r) __

<span style="display: block; font-family: 'Times New Roman'; font-size: medium; line-height: normal; margin-bottom: 0in; margin-top: 0in; text-align: left;">__ **Training** __

<span style="display: block; font-family: 'Times New Roman'; font-size: medium; line-height: normal; margin-bottom: 0in; margin-top: 0in; text-align: left;">__ The introductory explanations on how to use the technology were sufficient __

<span style="display: block; font-family: 'Times New Roman'; font-size: medium; line-height: normal; margin-bottom: 0in; margin-top: 0in; text-align: left;">__ The introductory explanations on how to use the clickers were clear __

<span style="display: block; font-family: 'Times New Roman'; font-size: medium; line-height: normal; margin-bottom: 0in; margin-top: 0in; text-align: left;">__ After the introduction, I still wasn’t sure how to use this technology (r) __

<span style="display: block; font-family: 'Times New Roman'; font-size: medium; line-height: normal; margin-bottom: 0in; margin-top: 0in; text-align: left;">__ **Fun** __

<span style="display: block; font-family: 'Times New Roman'; font-size: medium; line-height: normal; margin-bottom: 0in; margin-top: 0in; text-align: left;">__ Using the clickers was fun __

<span style="display: block; font-family: 'Times New Roman'; font-size: medium; line-height: normal; margin-bottom: 0in; margin-top: 0in; text-align: left;">__ Using clickers as a way of interacting in class is exciting __

<span style="display: block; font-family: 'Times New Roman'; font-size: medium; line-height: normal; margin-bottom: 0in; margin-top: 0in; text-align: left;">__ The technology was annoying (r) __

<span style="display: block; font-family: 'Times New Roman'; font-size: medium; line-height: normal; margin-bottom: 0in; margin-top: 0in; text-align: left;">__ I really enjoyed using the clickers __

<span style="display: block; font-family: 'Times New Roman'; font-size: medium; line-height: normal; margin-bottom: 0in; margin-top: 0in; text-align: left;">__ **Validity** __

<span style="display: block; font-family: 'Times New Roman'; font-size: medium; line-height: normal; margin-bottom: 0in; margin-top: 0in; text-align: left;">__ I was never certain that my clicker response was received by the system (r) __

<span style="display: block; font-family: 'Times New Roman'; font-size: medium; line-height: normal; margin-bottom: 0in; margin-top: 0in; text-align: left;">__ Having to use clickers had no effect on how I answered the questions __

<span style="display: block; font-family: 'Times New Roman'; font-size: medium; line-height: normal; margin-bottom: 0in; margin-top: 0in; text-align: left;">__ I never thought about the technology while answering questions __

<span style="display: block; font-family: 'Times New Roman'; font-size: medium; line-height: normal; margin-bottom: 0in; margin-top: 0in; text-align: left;">__ I lost __ credit __in class because by clicker response didn’t register with the system (r)__

<span style="display: block; font-family: 'Times New Roman'; font-size: medium; line-height: normal; margin-bottom: 0in; margin-top: 0in; text-align: left;">__ Additional statements Alan had: __

<span style="display: block; font-family: 'Times New Roman'; font-size: medium; line-height: normal; margin-bottom: 0in; margin-top: 0in; text-align: left;">__ I didn’t feel like 1 or 3 were validity statements. We might want to insert somewhere else (e.g., is #3 a classroom interaction issue?) __

<span style="display: block; font-family: 'Times New Roman'; font-size: medium; line-height: normal; margin-bottom: 0in; margin-top: 0in; text-align: left;">__ **Overall Effectiveness** __

<span style="display: block; font-family: 'Times New Roman'; font-size: medium; line-height: normal; margin-bottom: 0in; margin-top: 0in; text-align: left;">__ Overall, I am happy with using clickers __

<span style="display: block; font-family: 'Times New Roman'; font-size: medium; line-height: normal; margin-bottom: 0in; margin-top: 0in; text-align: left;">__ Using clickers in a course is a waste of time (r) __

<span style="display: block; font-family: 'Times New Roman'; font-size: medium; line-height: normal; margin-bottom: 0in; margin-top: 0in; text-align: left;">__ I would take another course that used a response system __

<span style="display: block; font-family: 'Times New Roman'; font-size: medium; line-height: normal; margin-bottom: 0in; margin-top: 0in; text-align: left;">__ I will avoid classes using clickers in the future (r) __

<span style="display: block; font-family: 'Times New Roman'; font-size: medium; line-height: normal; margin-bottom: 0in; margin-top: 0in; text-align: left;">__ I would recommend that the instructor continue to use a response system __

<span style="display: block; font-family: 'Times New Roman'; font-size: medium; line-height: normal; margin-bottom: 0in; margin-top: 0in; text-align: left;">__ I would hope the instructor would think twice about using clickers in the future (r) __

<span style="display: block; font-family: 'Times New Roman'; font-size: medium; line-height: normal; margin-bottom: 0in; margin-top: 0in; text-align: left;">__ I would recommend this course to others __

<span style="display: block; font-family: 'Times New Roman'; font-size: medium; line-height: normal; margin-bottom: 0in; margin-top: 0in; text-align: left;">__ I would not recommend this course to a classmate (r) __

<span style="display: block; font-family: 'Times New Roman'; font-size: medium; line-height: normal; margin-bottom: 0in; margin-top: 0in; text-align: left;">__ The technology used in this course motivated me to learn __
 * Perceived Learning**

<span style="display: block; font-family: 'Times New Roman'; font-size: medium; line-height: normal; margin-bottom: 0in; margin-top: 0in; text-align: left;">__ Clickers have been beneficial to my learning __

<span style="display: block; font-family: 'Times New Roman'; font-size: medium; line-height: normal; margin-bottom: 0in; margin-top: 0in; text-align: left;">__ Clickers had little impact on my learning (r) __

<span style="display: block; font-family: 'Times New Roman'; font-size: medium; line-height: normal; margin-bottom: 0in; margin-top: 0in; text-align: left;">__ Clickers allow me to better understand concepts __

<span style="display: block; font-family: 'Times New Roman'; font-size: medium; line-height: normal; margin-bottom: 0in; margin-top: 0in; text-align: left;">__ The technology did not allow me understand concepts better (r) __

<span style="display: block; font-family: 'Times New Roman'; font-size: medium; line-height: normal; margin-bottom: 0in; margin-top: 0in; text-align: left;">__ The new technology really helped me better prepare for exams __

<span style="display: block; font-family: 'Times New Roman'; font-size: medium; line-height: normal; margin-bottom: 0in; margin-top: 0in; text-align: left;">__ The clickers were not much help in preparing for exams (r) __

<span style="display: block; font-family: 'Times New Roman'; font-size: medium; line-height: normal; margin-bottom: 0in; margin-top: 0in; text-align: left;">__ Clickers helped me understand the course material __

<span style="display: block; font-family: 'Times New Roman'; font-size: medium; line-height: normal; margin-bottom: 0in; margin-top: 0in; text-align: left;">__ Clickers helped me get instant feedback on what I knew and didn’t know __

<span style="display: block; font-family: 'Times New Roman'; font-size: medium; line-height: normal; margin-bottom: 0in; margin-top: 0in; text-align: left;">__ Clickers failed to help me identify what I still needed to learn (r) __

<span style="display: block; font-family: 'Times New Roman'; font-size: medium; line-height: normal; margin-bottom: 0in; margin-top: 0in; text-align: left;">__ The clickers made it easy to connect ideas together __

<span style="display: block; font-family: 'Times New Roman'; font-size: medium; line-height: normal; margin-bottom: 0in; margin-top: 0in; text-align: left;">__ Using clickers helped me think more deeply about course materials __ <span style="display: block; font-family: 'Times New Roman'; font-size: medium; line-height: normal; margin-bottom: 0in; margin-top: 0in; text-align: left;"> Using the clickers helped me get a better grade in this class <span style="display: block; font-family: 'Times New Roman'; font-size: medium; line-height: normal; margin-bottom: 0in; margin-top: 0in; text-align: left;"> The new technology made it difficult for me to get a good grade in this class (r) <span style="display: block; font-family: 'Times New Roman'; font-size: medium; line-height: normal; margin-bottom: 0in; margin-top: 0in; text-align: left;"> The clickers helped me do better on my exams <span style="display: block; font-family: 'Times New Roman'; font-size: medium; line-height: normal; margin-bottom: 0in; margin-top: 0in; text-align: left;"> Using the clickers did not help be score higher on the exams (r) <span style="display: block; font-family: 'Times New Roman'; font-size: medium; line-height: normal; margin-bottom: 0in; margin-top: 0in; text-align: left;"> I got higher scores on my assignments because of the new technology <span style="border-bottom-style: solid; border-bottom-width: 2pt; display: block; font-family: 'Times New Roman'; font-size: medium; line-height: normal; margin-bottom: 0in; margin-top: 0in; text-align: left;"> Using clickers did not improve my assignment grades (r) <span style="display: block; font-family: 'Times New Roman'; font-size: medium; line-height: normal; margin-bottom: 0in; margin-top: 0in; text-align: left;"> **PART II: Open-ended Questions** <span style="display: block; font-family: 'Times New Roman'; font-size: medium; line-height: normal; margin-bottom: 0in; margin-top: 0in; text-align: left;"> //Placed at the end of the survey and to be coded for thematic analysis// <span style="display: block; font-family: 'Times New Roman'; font-size: medium; line-height: normal; margin-bottom: 0in; margin-top: 0in; text-align: left;"> What did you like best about your experience using clickers in this class? <span style="display: block; font-family: 'Times New Roman'; font-size: medium; line-height: normal; margin-bottom: 0in; margin-top: 0in; text-align: left;"> What were some barriers to your use of clickers in this class? <span style="display: block; font-family: 'Times New Roman'; font-size: medium; line-height: normal; margin-bottom: 0in; margin-top: 0in; text-align: left;"> What is one thing you would improve about your experience? <span style="display: block; font-family: 'Times New Roman'; font-size: medium; line-height: normal; margin-bottom: 0in; margin-top: 0in; text-align: left;"> Would you recommend this course to others, if it used the same technology? Why or Why not? <span style="display: block; font-family: 'Times New Roman'; font-size: medium; line-height: normal; margin-bottom: 0in; margin-top: 0in; text-align: left;"> **Part III: Other Historical Data to Gather from Faculty to Assess Student Impact** <span style="display: block; font-family: 'Times New Roman'; font-size: medium; line-height: normal; margin-bottom: 0in; margin-top: 0in; text-align: left;"> Student performance variables: <span style="display: block; font-family: 'Times New Roman'; font-size: medium; line-height: normal; margin-bottom: 0in; margin-top: 0in; text-align: left;"> <span style="display: block; font-family: 'Times New Roman'; font-size: medium; line-height: normal; margin-bottom: 0in; margin-top: 0in; text-align: left;"> //(to be collected from current and previous semesters, if available)// <span style="display: block; font-family: 'Times New Roman'; font-size: medium; line-height: normal; margin-bottom: 0in; margin-left: 0.5in; margin-top: 0in; text-align: left; text-indent: -0.25in;"> 1. Drop/Retention Rate (Number of students as of 9.18 versus as of 12.28 <span style="display: block; font-family: 'Times New Roman'; font-size: medium; line-height: normal; margin-bottom: 0in; margin-left: 0.5in; margin-top: 0in; text-align: left; text-indent: -0.25in;"> 2. Pass Rate  <span style="display: block; font-family: 'Times New Roman'; font-size: medium; line-height: normal; margin-bottom: 0in; margin-left: 0.5in; margin-top: 0in; text-align: left; text-indent: -0.25in;"> 3. Individual Exam Average  <span style="display: block; font-family: 'Times New Roman'; font-size: medium; line-height: normal; margin-bottom: 0in; margin-left: 0.5in; margin-top: 0in; text-align: left; text-indent: -0.25in;"> 4. Overall Exam Average  <span style="display: block; font-family: 'Times New Roman'; font-size: medium; line-height: normal; margin-bottom: 0in; margin-left: 0.5in; margin-top: 0in; text-align: left; text-indent: -0.25in;"> 5. Overall Homework Average <span style="display: block; font-family: 'Times New Roman'; font-size: medium; line-height: normal; margin-bottom: 0in; margin-left: 0.5in; margin-top: 0in; text-align: left; text-indent: -0.25in;"> 6. Overall Grade Average <span style="display: block; font-family: 'Times New Roman'; font-size: medium; line-height: normal; margin-bottom: 0in; margin-top: 0in; text-align: left;"> Satisfaction variable: <span style="display: block; font-family: 'Times New Roman'; font-size: medium; line-height: normal; margin-bottom: 0in; margin-left: 0.5in; margin-top: 0in; text-align: left; text-indent: -0.25in;"> 1. Average student evaluations (standard department or university teaching evaluations from current course and from previous semester, if taught the course before) <span style="display: block; font-family: 'Times New Roman'; font-size: medium; line-height: normal; margin-bottom: 0in; margin-top: 0in; text-align: left;"> Please send the numbers in points and percentages, if available. Feel free to contact __tjoosten@uwm.edu__ with any questions regarding gathering this data. Due: January 15th
 * Perceived Performance__**

<span style="display: block; font-family: 'Times New Roman'; font-size: medium; line-height: normal; margin-bottom: 0in; margin-top: 0in; text-align: left;"> We need to discuss delivery methods of the survey. Implications of delivery via SRS, web-based,d2l, and paper based. <span style="display: block; font-family: 'Times New Roman'; font-size: medium; line-height: normal; margin-bottom: 0in; margin-top: 0in; text-align: left;"> <span style="display: block; font-family: 'Times New Roman'; font-size: medium; line-height: normal; margin-bottom: 0in; margin-top: 0in; text-align: left;"> <span style="display: block; font-family: 'Times New Roman'; font-size: medium; line-height: normal; margin-bottom: 0in; margin-top: 0in; text-align: left;">See --> <span style="display: block; font-family: 'Times New Roman'; font-size: medium; line-height: normal; margin-bottom: 0in; margin-top: 0in; text-align: left;"> <span style="display: block; font-family: 'Times New Roman'; line-height: normal; margin-bottom: 0in; margin-top: 0in; text-align: left;">Evaluating a Wireless Course Feedback System:The Role of Demographics, Expertise, Fluency, Competency, and UsageRonald E. RiceUlla BunzDepartment of CommunicationSchool of Communication, Information & Library ScienceRutgers University4 Huntington St., New Brunswick, NJ 08901-1071rrice@scils.rutgers.edu; bunz@scils.rutgers.edufax: 732-932-3756We acknowledge the generous support of this project by the Office of the Vice President forUndergraduate Education.

[]