surveys are a tool for getting to know people. that makes them a great place to start if you want to build a culture where people feel valued, connected to one another, and inspired by their work.
but effective employee surveys don’t happen by accident. constructing surveys that return useful results – surveys that actually make peoples’ lives better – is both an art and a rigorous science.
through my academic research in psychometrics and quantitative psychology, i’ve spent my career studying how we can use analytical methods to understand people’s experiences and behaviors. now, as a senior researcher on atlassian’s people insights team, i help design surveys that meaningfully improve work and life for our employees.
you might not have the resources to work with a professional survey scientist. but by following these best practices for collecting and analyzing human data, you can start gathering the knowledge you need to create a better employee experience.
what are employee surveys?
an employee survey is any assessment designed to capture data about how employees experience their work.
employee surveys might ask open-ended questions, requiring written responses. or, they might capture more quantitative data with numeric scales or multiple-choice questions.
typically, organizations conduct employee surveys because they want to create a better employee experience. they need data to understand both the current baseline they’re starting from, and specific actions they can take to improve it.
of course, “employee experience” is a broad and all-encompassing term! good employee surveys often target and investigate specific parts of this experience, like onboarding, job satisfaction, or manager-employee relationships.
common types of employee surveys
- company culture surveys: how are employees experiencing their company’s culture?
- pulse surveys: how is the employee experience changing from month to month?
- onboarding or training surveys: how did employees experience training and onboarding? did it help them settle in and become productive faster?
- employee engagement or satisfaction surveys: are employees feeling happy, challenged, and inspired by their work?
- manager effectiveness surveys: how do employees experience relationships with their managers?
the power of effective employee surveys
obviously, improving peoples’ working lives is a worthwhile goal on its own. but happier, more inspired employees elevate their organization in very tangible ways, too.
throughout my career, i’ve seen that ultimately, more engaged and happy employees perform better, are more productive, and stay with the organization longer. all these qualities can help a company achieve its goals – and surveys are the most direct way to uncover how you can achieve them.
another excellent survey goal is to foster belonging – a sense of personal connection to the organization, its values, and the people within it. belonging is an often-overlooked precursor to engagement – according to some research, 91% of employees who feel they belong are engaged, compared to 20% of employees who don’t.
5 ingredients for a survey that’s worth your time
want your survey to help you create positive change? these five principles are a great place to start.
know your goal
instead of trying to capture every aspect of your employees’ experience, think critically about your goal. what actual outcomes are you trying to achieve? what are you trying to move the needle on?
then, work backwards from your desired outcome. what aspects of the employee experience impact the outcome you want, and how can you investigate them? what questions will help you take an informed action?
when your survey doesn’t have a clear goal, you may end up asking questions you can’t take action on. that’s a surefire route to survey fatigue, damaged employee trust, and diminished morale.
for example, maybe you want to reduce turnover. so, you could ask questions about employees’ relationships with their managers, desired future prospects with the organization, and work-life balance.
survey fatigue
imagine if a friend asked how you felt about your relationship, but never acted on your concerns. you wouldn’t feel heard or respected – and you might even betrayed or angry that they wasted your time.
employee surveys are no different. people quickly get sick of opening up and sharing their experience if doing so doesn’t actually improve their life at work.
“survey fatigue” sounds like it’s caused by surveys that are too long, or conducted too often. while that’s certainly possible, it’s not the whole picture.
when employers send out surveys that don’t lead to action, it damages trust and engagement, especially if it happens repeatedly. often, folks just stop participating. but even worse, they feel let down and disrespected.
focus on actionability
once your goal is clear, it’s easier to ask questions that will help you achieve it. while you can include some general, “sense check” questions, your survey should be geared towards informing concrete action.
actionability has three components:
- ask questions that can inform action. for example, “what does an ideal work-life balance look like for you?” is more actionable than “how satisfied are you with your work-life balance?”
- don’t ask questions you can’t take action on. a classic example is “how satisfied are you with your compensation?” nearly everyone would like a raise, but it’s unlikely an employer can grant one to their entire workforce at the same time.
- show people you’re taking action. for example, you could hold an all-hands meeting after your survey, sharing the data and outlining your action plan. then, check back in periodically to follow up and show them you meant what you said.
keep context in mind
every organization is different, and the employee experience changes over time. if you don’t keep organizational climate in mind when designing questions, your survey can come across as insensitive, and return unhelpful answers.
here are some examples of how context can inform survey questions:
- asking a question like “how optimistic are you about the future with this company?” after there’s just been a round of layoffs and morale is low will most certainly return unfavorable responses
- if your workforce includes hourly, salaried, and contractor employees, don’t ask all of them the same questions about compensation.
- if you ask people’s opinions of managers or leadership right before their annual performance review, you might get biased responses.
test out (pilot) your survey items
“survey piloting” might sound technical, and it definitely can be! survey scientists use sophisticated statistical modeling and cognitive testing techniques to make sure survey items will actually drive the changes they’re looking for.
but piloting is a great idea for anyone who’s running an employee survey. piloting survey items essentially means testing them, with a small random sample, before releasing them to your entire organization. piloting helps improve your questions, so you’ll get better data when you run the survey at full scale.
it’s very important that your sample be randomly selected – don’t just ask your teammates to pilot the survey with you. the idea is to understand how the survey will land with people in different demographic groups, areas of the company, and levels of seniority.
if you work at a small organization, you can still gain meaningful insights from a pilot survey – even a focus group as small as five people is worthwhile. you can also try piloting more questions than you’ll want in the finished survey, so you can identify the ones that perform best.
there are two ways of testing survey questions: qualitatively and quantitatively.
qualitative testing: also called “cognitive testing” by survey scientists, qualitative testing is like a focus group for your survey. after running your test, you’ll talk to the respondents about their experience. did the survey flow well? were any items confusing or hard to understand?
based on their answers, you’ll be able to evaluate how the items resonated with people from different backgrounds, and whether the questions were relevant to your goal.
quantitative testing: quantitative testing happens once your random sample has actually answered your questions, rather than just giving you feedback on the survey design. you’ll analyze this first batch of data, looking for irregularities that could indicate something is amiss.
quantitative testing follows the same basic principles as interpreting a larger set of data. we’re covering those next, so keep reading!
interpret your results critically
evaluating your answers is just as important as asking the right questions. when you get your results back, don’t just take them at face value! even if you carefully tested your survey, there are many ways data can be biased or skewed.
here are four best practices to follow when interpreting survey data.
consider response rates
if not many people responded to your survey, you won’t have statistically significant data – and the data you do have might not accurately represent your organization. for example, maybe respondents skewed heavily towards employees in your department, because you’d reminded them multiple times.
if you don’t have enough data, or it’s not distributed across your company evenly, you may need to re-run your survey. to avoid this problem, send the survey to double or triple the number of participants you’ll actually need to get useful data.
look for irregularities
normally, survey responses roughly distribute along a bell curve. answers may trend in one area, but there will be responses on either side.
if you see dramatic trends that don’t follow this distribution, it probably indicates an issue with your question. for example, if almost everyone responded to a question with “strongly agree” or “strongly disagree,” that typically means your item is not worded in a way that would elicit varying opinions.
if everyone shares the same super-strong opinion about something, there’s very little additional information you can glean, or actions you can take from those results.
use benchmarks whenever possible
say 70% of your survey respondents love their managers. is that good or bad? one way to know is to use benchmarks – a company or industry standard to compare your results against.
some companies compile and sell benchmark data for this exact purpose. even better, you can use your own company’s past performance as a starting point.
it’s not the end of the world if you don’t have benchmark data, and you shouldn’t over-rely on it anyway. you’ll get better results by focusing on the outcomes that matter to you, not pushing to get engagement from 76% to 80% just because that’s the industry standard.
focus on what will actually move the needle – not on your “worst” results
one super-common pitfall when interpreting survey data is to focus attention where the company performed worst.
in reality, action should be directed not to what feels like an emergency, but to areas that will have the biggest impact on your goal. in survey science, this is referred to as “predictive power.”
for example, say your desired outcome was improved employee retention, and survey respondents were highly dissatisfied with manager communication. that doesn’t mean you need to push every manager into communication training!
what if a more generous vacation policy would do more to entice your employees to stay? in that case, a question about vacation would have more “predictive power,” and would be a better way to guide action.
survey scientists use statistical modeling to evaluate predictive power. even if that’s not within reach for you, it’s a good reminder to stay focused on your goal – not rush into hasty actions because you underperformed in one area.
special thanks to genevieve michaels for her contributions to this article.