In February, as part of an ongoing evaluation, we distributed a survey to the UMass Amherst audience response system (PRS) user community. We had 44 respondents from the list of 230 users. Here is a summary of the results:
Course Size
Faculty have an average of 222 students in each class/section that they teach using PRS, with 35 being the smallest number reported and 475 being the largest.
Operating System
77.3 % of faculty use Windows operating systems, 25% use Mac operating systems, and 2.3% use both.
Satisfaction
The overall level of satisfaction with our currently supported PRS system is concerning, with a significant 47.6% instructors reporting being somewhat or very dissatisfied. This matches a similar level of dissatisfaction that we have seen among faculty who seek out support for PRS through the Instructional Media Lab and is what led us to evaluate other audience response systems.

Common Issues
Based on a list of possible issues that faculty experience with PRS, the largest number of respondents cited sometimes having problems with:
• Students unable to submit answers — 25
• The PRS software crashing/freezing during class — 23
• Issues with running PRS when multiple programs are open — 19
• Students reporting problems you can’t track — 15
• Delays in opening the PRS software — 14
• The PRS software running exceedingly slow — 13
• Losing data from a PRS Session —13
• Not being able to merge students/IDs — 12
It is significant that 25 of the 42 responses notes sometimes having students unable to submit answers, while 23 responses cited the PRS software crashing/freezing during class.
How Instructors Would Like To Use PRS
If faculty were not limited by issues with the stability and flexibility of PRS, the types of questions they would like to use are as follows (Note: A significant 24 out of 43 responses cited the desire to have students enter numeric answers.):

We asked what instructors would like to do with PRS that is not currently possible. A sample of their responses:
• “The ability to integrate online, web-based submissions of answers by students who bring their laptops/smartphones but forget their clicker.”
• “It would be interesting if it could be used for exam administration, but that would require a monumental leap in terms of stability and reliability (and authentication/verification/logging).”
• “Better text entry. Twitter-like responses would be very useful.”
• “Being able to know the profile of the student answers, such as: freshman vs. sophomores; in my major vs. no in my major; prior experience in this topic vs. no experience; etc.”
• “I would use text entries more to foster communication than for assessment, so some innovative ways to process text entry (such as word clouds) would be great.”