Designing and using questionnaires
Using questionnaires and surveys to find out what people think
Questionnaires can be used to find out:
- if people want or need a new service (such as a playgroup or a youth club)
- how successful or effective an event or project was
- the opinions of a local community about an issue (such as plans to open a new supermarket, refuse collection services or changes to bus routes)
To be effective questionnaires should:
- be easy to fill in
- give you clear information that you will be able to understand and use
- give respondents enough choice to express their views and opinions
To achieve this you need to think carefully about the content of your questionnaire, how you will persuade people to fill it in, and what you will do with the information afterwards.
Writing the questions
- Keep the questionnaire as short as possible
- Only ask questions that you really need to know about
- Use clear and simple language – avoid jargon, slang or technical terms
- Put straightforward questions at the beginning of the questionnaire, and more sensitive or complex questions towards the end
- Put the questions in a logical sequence, or group them
- Insert a category for ‘don’t know’ or ‘not applicable’ where relevant
- Only include one topic per question.
For example, do not ask if people would like a new pelican crossing AND traffic calming measures in the same question. They may want one OR the other.
Closed questions come with a series of boxes that respondents can tick. They:
- take less time to answer
- are easier to analyse
- limit the responses that can be given
Open questions give respondents space to answer in their own words. They:
- take longer to answer
- are more complicated to analyse
- give people more freedom to say what they think or feel
Use closed questions for as many questions as possible, with possibly a few open questions to give respondents the opportunity to express their own thoughts, feelings or opinions.
Designing the questionnaire
The appearance of the questionnaire will affect how many people take the trouble to complete it.
- Explain clearly and briefly the purpose of the questionnaire
- Give clear instructions on how to complete it
- Space out the questions – dense print is off putting and will affect the response rate
- Make sure there is enough space for people to write their answers
- Remember to include the name of your organisation and contact details
- Test your questionnaire on a couple of people and ask them:
how easy it was to fill in;
if all the questions were clear;
if they think you have included anything that is not necessary or missed out anything important.
Other things to consider
Personal information and confidentiality
It is better to ask personal questions such as age, income or ethnic origin by offering grouped categories with tick boxes. For Example:
|Which age group are you in?|
|0 – 15yrs|
|17 – 25yrs|
|25 – 59yrs|
|60 yrs and over|
If you are asking for personal information, some people may prefer not to give their name and address. Think about whether you really need to ask for this information. What will you do with the questionnaires after you have evaluated them? Will you need to keep them in a safe place?
Bias and leading questions
Try not to ask questions in a way that will lead respondents to a particular answer.
For example, the following biased question:
|Do you think the grass cutting service is an appalling waste of public money?|
Could be changed to:
|What do you think about the grass cutting service?
(tick as many boxes as you wish)
|It is good value for money|
|It is a waste of money|
|It helps keep the estate looking tidy|
|It does nothing to improve the estate|
|It should be stopped|
|I want it to continue|
Who do you want to complete the questionnaire?
Before you write the questionnaire you need to know who will be filling it in. This could be:
- Members of your group
- People who in live in a particular area
- Users of a service
- Everyone attending an event/course/activity
Distributing the questionnaires to everyone is not always feasible, so you can take a sample of people instead. However, it is good to try and get a good cross section of your members, users, or local residents.
You could do this is several ways, such as:
- Everyone at your Annual General Meeting
- Every tenth house in each local street
- Everyone that uses your services during April
How will you ensure as many people as possible fill in the questionnaire?
It can be very difficult to get people to fill in questionnaires, so it is worth thinking about a few strategies to persuade people. Having a questionnaire that is short and easy to fill will make this a lot easier. You could also:
- Explain to people why you are carrying out the questionnaire and encourage them to fill it in
- Have volunteers to interview people and complete the questionnaire with them
- Have a fixed time when you distribute the questionnaires and ask everyone to complete them and return them straight away (at an event, course or activity)
- Provide a Freepost address or stamped addressed envelopes (if you do this give a deadline by which questionnaires should be returned)
- Enter all completed questionnaires into a prize draw
Are there potential respondents who cannot read and write in English?
If there are, consider offering people a range of ways that they can fill in the questionnaire, such as:
- With a volunteer interviewer
- With an interpreter
- Written in their mother tongue
What will you do with the completed questionnaires?
Keep a record of how many blank questionnaires you give out, and count how many are returned to you. You will then be able to work out what percentage of people completed the questionnaire – your ‘response rate’.
If you give out 200 questionnaires and only 10 are returned, the responses you get are probably not very representative. However, if you give out 200 questionnaires and 150 are returned, your information will have a lot more weight.
The easiest way to collect together all the responses is to create a tally chart on a sheet of paper or on the computer. It could look something like this:
|Number of questionnaires distributed||90|
|Number of questionnaires completed||52|
|% response rate||57%|
|Question 1. Age|
|0 – 16 yrs||12||23%|
|17 – 25yrs||23||44%|
|26 – 59yrs||10||19%|
|60yrs and over||7||13%|
|Question 2. Which events did you attend in 2007?|
|I have not attended any events||1111||4||1%|
If you have used open questions you will need to record all the responses. It is worth seeing if there is a pattern, general trends, or suggestions, ideas or comments that need to be acted on.
You may want to analyse your findings in a bit more detail. This can be done by using a large sheet of squared paper and ‘cross tabulation’.
|Activity attended||0-16 yrs||17 – 25 yrs||26 – 59 yrs||60 yrs and over|
|I have not attended any events|
Examples of closed questions:
|Which events did you attend in 2007:|
|I did not attend any events|
|How satisfied are you with the following services?|
|Very satisfied||Satisfied||Not satisfied|
|School crossing patrol|
|Do you think Anyplace Estate would benefit from having a Playgroup?|
|Do you have children aged 2- 4 years?|
|Would you bring them to the Playgroup?|
Examples of open questions:
What improvements would you like to see in the waste recycling service?
What new skills have you learnt on this course?
Is there anything else you would like to see the group do?
Sometimes you can mix open and closed questions:
|Do you feel the drama workshops have:
(Tick as many boxes as you like)
|Made you feel more confident|
|Helped you to improve your spoken English|
|Enabled you to make new friends|
|Helped you to think about issues that affect young people|
|Other (please specify)|
Updated February 2014