Top Ten Common Community Survey Mistakes to Avoid

Local governments need survey results that are representative and reliable. So it is important for cities and towns to avoid these very common survey mistakes.

Your local government organization has decided to conduct a community survey. Decision-makers, stakeholders, and residents are all eager to see the results that will be used to improve quality of life in the city or town.

Taking positive action on survey results is the ultimate goal. But many municipalities struggle to incorporate their data with master plans moving forward. With plenty of interest in evidence-based decision-making, how can this be?

Local governments need survey results that are representative and reliable. When data never hatch into action, the fault often lies with the process. A cracked survey process can hurt response rates, yield inaccurate data and hinder the usefulness of those results.

So, whether working with an outside firm or conducting a community survey yourself, it is important for cities and towns to avoid these ten common survey mistakes

Ten Most Common Community Survey Mistakes

1. Residents are contacted only once to take the survey.

Whether sending notifications about the survey by mail or online, contacting residents only once just won’t do the trick. People may miss that note or call or simply forget about it. Instead, send multiple contacts to your residents to ask them to take the survey.

2. The survey is not available online.

Research indicates that a very large and growing number of residents prefer to engage with their city digitally, especially since the pandemic. And as our society becomes more survey-saturated, it’s hard enough to get people to answer a list of questions in the first place. Even if a resident has some motivation to respond, they won’t likely make an effort if the survey is not easy for them to take. Having the option to survey online will make it more convenient and accessible to a wider range of respondents.

3. The survey is not publicized.

If a survey is conducted, but nobody knows about it, it might as well have never existed. A robust response rate depends on a strong marketing effort. Make sure to use all of your existing communications channels (like the town newsletter), press releases, and social media to get the word out about your survey.

4. Questions contain government jargon, acronyms, and other terms unfamiliar to most residents.

Government has a language all its own. And when that language is second nature to city employees with insider knowledge, it can be easy to forget that the average resident may not be familiar with it. If you would not use a term at a holiday dinner party, it’s probably best not to use that term on a community survey.

5. The survey is too long and complex.

A long questionnaire with complex wording can quickly cause survey fatigue. Respondents feeling tired by the survey may leave it unfinished or select answers without reading them first, just to get to the end. You can avoid this by keeping survey questions clear, concise, and limited in number. Even a comprehensive survey should not take more than about 10-15 minutes for the average resident to complete.

6. The pool of responses does not reflect the whole community.

Improving the community for everyone requires feedback from all types of residents. Traditionally underheard demographics include those whose first language is not English, racial and ethnic minorities, lower-income residents, and youth. To garner more participation from these groups, cities, and towns can survey in multiple languages, partner with trusted community leaders, oversample attached units, and weight the data appropriately. This will help to ensure the survey data are representative of the entire community.

7. It is assumed that surveys given by phone interviews will get the same results as surveys taken alone by mail or web.

When answering interview questions for a person on the phone, people have a natural tendency to give answers they think the other person wants to hear. Survey researchers call this social desirability bias. This documented phenomenon has been observed in political poll results leading to inaccurate predictions. When it comes to community assessments, responses tend to skew more positively during phone interviews. But people are more honest when they take the survey themselves by mail or web. So it is best to conduct self-administered surveys (mail or web) that don’t involve an interview, to get the most candid data possible.

8. Questions with answers that are not really wanted or needed are asked.

It can be tempting to ask a survey question because you think the answers will support a decision the city has already made. But what if the results come back with surprises? Residents can feel betrayed when it looks clear to them that their feedback really doesn’t matter. And that is devastating to the level of trust they have in their local government. Also, unnecessary questions can simply be a waste of time. If your town has never seen snow, it’s best not to ask questions about snow removal services. Don’t ask what you won’t use.

9. Survey results are available for internal eyes only.

A city or town may feel reluctant to share survey data when ratings aren’t as high as they hoped. But it is vitally important for local governments to demonstrate transparency and make the results available to the public. This is one of the greatest ways to build a stronger sense of civic trust within the community. Also, remember there is no such thing as “bad” data. A lower rating is merely an opportunity to do better. Residents will respect your organization more for acknowledging their feedback and taking action to improve.

10. There is no vision for how the results will be used.

The number one reason why survey results may never see action is lack of vision. Knowing ahead of time the kinds of answers you need will help you craft better questions. Having a plan in place will keep the process timely and efficient. Communicating your intent to residents will increase public trust. Using the final results to strategize will be what ultimately leads to improvements that will stick for the long haul.

Do you recognize any of these community survey mistakes?

Oftentimes the easiest, most effective approach to avoiding the pitfalls is to work with a pro. They can offer guidance when you engage residents with your own polls. They can provide data and expertise that will help you track and make use of your findings. They can even conduct larger assessments from start to finish for you. Polco can take care of all that for you, so you can focus on your important work.

Related Articles

• How To Know if You Can Trust Your Survey
• Why Political Polling Is Often Wrong
• Is Your Community Survey Data Representative?