Survey Design for Needs Assessment

A good survey works like a therapy session. You don’t begin by asking for deep truths, you guide the person gently through context, emotion, and interpretation. When done in the right sequence, your questions help people articulate thoughts they didn’t even realize they had. Most UX surveys fall short not because users hold back, but because the design doesn’t help them get there. They capture behavior and preferences but often miss the emotional drivers, unmet expectations, and mental models behind them. In cognitive psychology, we understand that thoughts and feelings exist at different levels. Some answers come automatically, while others require reflection and reconstruction. If a survey jumps straight to asking why someone was frustrated, without first helping them recall the situation or how it felt, it skips essential cognitive steps. This often leads to vague or inconsistent data. When I design surveys, I use a layered approach grounded in models like Levels of Processing, schema activation, and emotional salience. It starts with simple, context-setting questions like “Which feature did you use most recently?” or “How often do you use this tool in a typical week?” These may seem basic, but they activate memory networks and help situate the participant in the experience. Visual prompts or brief scenarios can support this further. Once context is active, I move into emotional or evaluative questions (still gently) asking things like “How confident did you feel?” or “Was anything more difficult than expected?” These help surface emotional traces tied to memory. Using sliders or response ranges allows participants to express subtle variations in emotional intensity, which matters because emotion often turns small usability issues into lasting negative impressions. After emotional recall, we move into the interpretive layer, where users start making sense of what happened and why. I ask questions like “What did you expect to happen next?” or “Did the interface behave the way you assumed it would?” to uncover the mental models guiding their decisions. At this stage, responses become more thoughtful and reflective. While we sometimes use AI-powered sentiment analysis to identify patterns in open-ended responses, the real value comes from the survey’s structure, not the tool. Only after guiding users through context, emotion, and interpretation do we include satisfaction ratings, prioritization tasks, or broader reflections. When asked too early, these tend to produce vague answers. But after a structured cognitive journey, feedback becomes far more specific, grounded, and actionable. Adaptive paths or click-to-highlight elements often help deepen this final stage. So, if your survey results feel vague, the issue may lie in the pacing and flow of your questions. A great survey doesn’t just ask, it leads. And when done right, it can uncover insights as rich as any interview. *I’ve shared an example structure in the comment section.

Remember that bad survey you wrote? The one that resulted in responses filled with blatant bias and caused you to doubt whether your respondents even understood the questions? Creating a survey may seem like a simple task, but even minor errors can result in biased results and unreliable data. If this has happened to you before, it's likely due to one or more of these common mistakes in your survey design: 1. Ambiguous Questions: Vague wording like “often” or “regularly” leads to varied interpretations among respondents. Be specific—use clear options like “daily,” “weekly,” or “monthly” to ensure consistent and accurate responses. 2. Double-Barreled Questions: Combining two questions into one, such as “Do you find our website attractive and easy to navigate?” can confuse respondents and lead to unclear answers. Break these into separate questions to get precise, actionable feedback. 3. Leading/Loaded Questions: Questions that push respondents toward a specific answer, like “Do you agree that responsible citizens should support local businesses?” can introduce bias. Keep your questions neutral to gather unbiased, genuine opinions. 4. Assumptions: Assuming respondents have certain knowledge or opinions can skew results. For example, “Are you in favor of a balanced budget?” assumes understanding of its implications. Provide necessary context to ensure respondents fully grasp the question. 5. Burdensome Questions: Asking complex or detail-heavy questions, such as “How many times have you dined out in the last six months?” can overwhelm respondents and lead to inaccurate answers. Simplify these questions or offer multiple-choice options to make them easier to answer. 6. Handling Sensitive Topics: Sensitive questions, like those about personal habits or finances, need to be phrased carefully to avoid discomfort. Use neutral language, provide options to skip or anonymize answers, or employ tactics like Randomized Response Survey (RRS) to encourage honest, accurate responses. By being aware of and avoiding these potential mistakes, you can create surveys that produce precise, dependable, and useful information. Art+Science Analytics Institute | University of Notre Dame | University of Notre Dame - Mendoza College of Business | University of Illinois Urbana-Champaign | University of Chicago | D'Amore-McKim School of Business at Northeastern University | ELVTR | Grow with Google - Data Analytics #Analytics #DataStorytelling

Designing effective surveys is not just about asking questions. It is about understanding how people think, remember, decide, and respond. Cognitive science offers powerful models that help researchers structure surveys in ways that align with mental processes. The foundational work by Tourangeau and colleagues provides a four-stage model of the survey response process: comprehension, retrieval, judgment, and response selection. Each step introduces potential for cognitive error, especially when questions are ambiguous or memory is taxed. The CASM model -Cognitive Aspects of Survey Methodology- builds on this by treating survey responses as cognitive tasks. It incorporates working memory limits, motivational factors, and heuristics, emphasizing that poorly designed surveys increase error due to cognitive overload. Designers must recognize that the brain is a limited system and build accordingly Dual-process theory adds another important layer. People shift between fast, automatic responses (System 1) and slower, more effortful reasoning (System 2). Whether a user relies on one or the other depends heavily on question complexity, scale design, and contextual framing. Higher cognitive load often pushes users into heuristic-driven responses, undermining validity. The Elaboration Likelihood Model explains how people process survey content: either centrally (focused on argument quality) or peripherally (relying on surface cues). Users may answer based on the wording of the question, the branding of the survey, or even the visual aesthetics rather than the actual content unless design intentionally promotes central processing. Cognitive Load Theory offers tools for managing effort during survey completion. It distinguishes intrinsic load (task difficulty), extraneous load (poor design), and germane load (productive effort). Reducing the unnecessary load enhances both data quality and engagement. Attention models and eye-tracking reveal how layout and visual hierarchy shape where users focus or disengage. Surveys must guide attention without overwhelming it. Similarly, the models of satisficing vs. optimizing explain when people give thoughtful responses and when they default to good-enough answers because of fatigue, time pressure, or poor UX. Satisficing increases sharply in long, cognitively demanding surveys. The heuristics and biases framework from cognitive psychology rounds out this picture. Respondents fall prey to anchoring effects, recency bias, confirmation bias, and more. These are not user errors, but expected outcomes of how cognition operates. Addressing them through randomized response order and balanced framing reduces systematic error. Finally, modeling approaches like like cognitive interviewing, drift diffusion models, and item response theory allow researchers to identify hesitation points, weak items, and response biases. These tools refine and validate surveys far beyond surface-level fixes.

Often when we ask caregivers what they need, they say information. Curious health, social, and community providers will ask: Information about what? Curiosity is excellent. But what about having a structured way to ask? What about a needs assessment tool designed to elicit caregiver-defined support needs — not just burden or stress? We wondered: What caregiver needs’ assessment tools already exist? Do they truly capture what caregivers say they need? And why aren’t these tools routinely used in practice? Our rapid scoping review — just published — begins to answer those questions: “Mapping Caregiver Needs’ Assessment Tools for Family and Friend Caregivers: A Rapid Scoping Review” 📍 International Journal of Environmental Research and Public Health (Vol. 23, Issue 3) We identified 19 caregiver needs’ assessment instruments (17 instrument families) across 43 studies. What we found was both encouraging and concerning. Across tools, we identified seven domains of caregiver-defined support needs: 1️⃣ Caregiver health and self-care 2️⃣ Emotional and psychological support 3️⃣ Information, communication, and navigation 4️⃣ Practical and instrumental support 5️⃣ Social and relational support 6️⃣ Autonomy and life participation 7️⃣ Spiritual, cultural, and existential support Information and navigation were most frequently assessed. Autonomy and spiritual domains were least represented. Importantly, many instruments demonstrated what we call “construct drift.” Instead of explicitly eliciting caregiver-defined support needs, they often measured burden, strain, or preparedness. These are important constructs — but they are not the same as asking caregivers what support they need. We also found: Few tools are designed for longitudinal reassessment Limited attention to workflow integration Minimal integration into electronic medical records Limited support for interdisciplinary care pathways If we are serious about embedding caregiver-centered care into routine practice, we need tools that: ✔ Explicitly elicit caregiver-defined support needs ✔ Support ongoing reassessment ✔ Integrate into clinical workflows ✔ Enable documentation and shared care planning Caregivers are already integral to health and social systems. Our assessment tools should reflect that reality. I’d love to hear from clinicians, leaders, and researchers: Are you using a caregiver needs’ assessment tool in practice? If so, how is it working? #CaregiverCenteredCare #FamilyCaregivers #HealthSystemTransformation #IntegratedCare #CarePartners

I've worked on SEVEN reports this year. I normally ask you all "is that too many? Is that very few?" but for this one, I have my answer. It's a lot. But a lot of briefs skip out this ONE thing: No survey strategist. No strategic input for category, quality, or order of the questions. No answers to the question "why are we asking what we are asking?" And that leaves it to the report creator(me) to "find" a POV after the responses are already in. This is much harder to do than if we go in with a mission. Unbiased, but directional. For example, you could be asking "Have you received a promotion in the last year?" to learn how promotions correspond with salary increases. But how does this question fit into the bigger story? If you can't answer that, you have a floating fact, at best and wasted respondent time, at worst. A survey strategist would frame a series of questions that explore the bigger story of career progression. They might ask: 👉 “Have you received a promotion in the last year?” (that’s your baseline, your starting point for career movement) 👉 “Did this promotion come with a salary increase?” (now you’re tying that movement to financial impact) 👉 “How did the promotion affect your job satisfaction?” (the emotional weight of advancement) 👉 “How do you perceive your growth opportunities within the company?” ( here, you’re getting at the big picture: loyalty, ambition, future potential) They'll understand the question logic, how an analyst would layer the responses, and what the designer would need to tell the story via graphs. Survey design doesn't need to be expensive. You can do it in-house and get a research report creator (me, Becky Lawlor) to sanity-check the questions, refine the flow, and tie them back to a clear narrative. It'll save you time, money, and peace of mind down the line. If this is something you're thinking about, send me a note! 📩

Needs are not abstract—they are the pulse of crisis, the first truth emerging from the rubble, and the foundation for any response that aims to do more good than harm. This guide provides a rare, field-tested framework for conducting humanitarian needs assessments that are rapid yet reliable, simple yet serious. Built for those closest to the frontline—national responders, field managers, and emergency specialists—it transforms complex methodology into practical tools for saving lives, supporting dignity, and ensuring accountability, even in chaotic and data-scarce environments. – It presents core assessment principles: Timeliness, Simplicity, Participation, Coordination, and Accountability – It outlines each step of the assessment cycle: Preparedness, Design, Implementation, Analysis, and Sharing – It provides 15 operational tools: from Secondary Data Collection to Sampling, Field Visits, Questionnaire Design, and Community Engagement – It addresses critical cross-cutting issues: Vulnerability, Gender, Local Capacities, Stakeholder Analysis, and Managing Expectations This is not a polished protocol for bureaucrats—it is a practical, resilient guide for those who assess when everything else is falling apart. Whether navigating post-disaster uncertainty, coordinating joint assessments, or leading rapid appraisals in conflict zones, this document equips humanitarian professionals to ask the right questions, to listen well, and to act based on evidence that is “good enough” to make a difference when time and resources are short.

Data collection is the foundation of credible research and evidence-based decision-making. The Guide to Effective Data Collection provides a complete roadmap for designing and executing high-quality surveys that deliver accurate, actionable insights. It walks through every stage—from defining research questions and indicators to selecting data collection methods, writing strong survey questions, and managing field implementation. Key highlights include: ↳ The importance of data quality and how poor survey design leads to unreliable results ↳ Developing clear research questions, outcomes, and measurable indicators ↳ Comparing data collection methods such as observation, interviews, questionnaires, and focus group discussions ↳ Applying qualitative and quantitative approaches effectively ↳ Using the MECE (Mutually Exclusive, Collectively Exhaustive) framework for clear and consistent survey questions ↳ Sampling strategies, including probability and non-probability techniques, and reducing sampling errors ↳ Piloting surveys, training field teams, and ensuring ethical and accurate implementation Good data starts with good design. Reliable evidence depends on rigorous planning, sound methodology, and strong execution. #DataCollection #Research #SurveyDesign #MonitoringAndEvaluation #DataQuality #ImpactMeasurement #QuantitativeResearch #QualitativeResearch #EvidenceBasedDecisionMaking #LearningAndAccountability

Let's run a survey! 🗣️ In a sense, it's nice when stakeholders want to do things that are related to research. But they have a million questions they want to ask (or even show you as they've already made a draft survey) and while you may want to jump in the air screaming, sometimes we can also just go along with them and show them a bit of goodwill. So, stakeholder coming at you with wanting to run a survey? Here are 14 tips for designing surveys (and for you to redesign the survey you've received 😜) 1. Understand your survey type ↳ Quantitative surveys are for counting—great for large-scale data. ↳ Qualitative surveys are for diving deep—perfect for open-ended responses. 2. Define clear learning goals ↳ Decide upfront what you want to learn and report on. This guides your question design. 3. Write neutral questions ↳ Avoid leading questions that hint at the answer you’re expecting. Stay neutral. 4. Test your survey ↳ Draft questions, get feedback, and revise. Test with real users, not just colleagues. 5. Mix open and closed questions ↳ Open-ended questions give rich data but can be a pain to analyse. Use them during testing to see if they’re necessary and yield the results you need. 6. Randomise sections ↳ Avoid biases by randomising question order (where possible). This helps ensure balanced data. 7. Use multiple-answer Options ↳ Let respondents choose multiple answers where applicable. It’s more accurate. 8. Front-load key questions ↳ Drop-off in surveys can be high. People may do so before reaching the halfway point. Put the most critical questions upfront. 9. Keep it short ↳ Long surveys lose respondents. Stick to the essentials—20 questions max. 10. Use conditional questions ↳ Only show relevant questions based on previous answers. Keep it concise for each user. 11. Be clear about requirements ↳ Label questions as “(Optional)” or “(Required)” to avoid confusion. 12. Simplify instructions ↳ Place directions on the left side of the screen and keep them brief. Most people scan instead of reading thoroughly. 13. Test for page breaks ↳ Sometimes, grouping questions together works better. Test to find the optimal layout. 14. Count what you can ↳ Even in qualitative surveys, look for ways to code and quantify responses. It helps in spotting trends and saves time in the analysis phase. Bonus tip: Show, don’t tell. Use graphs and charts to present your findings—people love visuals! Qualitative surveys can be powerful tools for gathering deep insights. But they require thoughtful design and testing. Use these tips to make sure your next survey hits the mark. What other tips or questions do you have when it comes to survey design? Let me know in the comments 👇

Before designing a single slide or storyboard… pause and ask: 👉 Do we actually know what the problem is? That exact question is at the heart of a solid learning needs analysis. It’s the process of identifying what people really need to learn — and aligning those needs with the organization’s goals. When done right, it saves time, money, and a whole lot of “meh” training. 💡 Example: An HR manager notices low engagement in performance reviews. The L&D team digs deeper through surveys and interviews — and discovers that managers struggle to give constructive feedback. The result? A targeted workshop on communication and feedback that actually moves the needle. 🙌 New to needs analysis? Try this: Conduct a short interview or survey with two colleagues to understand their learning needs for an upcoming project. Or, run a quick poll with your team to identify one learning gap — and brainstorm how L&D could help fill it. 📚 Want to go deeper? Explore our Learning Needs Analysis Mini Toolkit: https://lnkd.in/dTdhuaGw Read our article on “5 Most Important Learning Needs Assessment Questions to Ask": https://lnkd.in/d9ibbFxT #LearningAndDevelopment #LearningNeedsAnalysis #LnDSkills #TrainingDesign #InstructionalDesigners #TheLndAcademy #CorporateLearning #LearningStrategy

Wrapping up our #qualitative methods round up for my #needsassessment series is #surveys. Though they can be considered #quantitative depending on how you conduct them and the #questions you ask, I consider our needs assessment surveys to be qualitative. So what are surveys? ➡️ Community or participant surveys get #feedback from a potentially large group. ➡️ They can be done online with tools like SurveyMonkey or Qualtrics or on paper. ➡️ They can be circulated through many means like newsletters, websites, and with the help of #communitypartners. ➡️ And respondents can take them on their own time, or at specific locations like a library or a #healthcenter waiting room. ➡️ We generally like to make sure the survey takes no more than 30 minutes to take, ideally more like 10 minutes or people will drop off. ➡️ Surveys can accommodate a mix of open and closed ended question types, from Likert scale and agree/disagree type questions, to multiple choice, to open ended comment boxes.   What are the advantages of surveys? ✅ Surveys are probably the best way to reach TRULY large numbers of people. You can have 100 or 500 or 1000 respondents, depending on your population and distribution methods!   ✅ Surveys can be great for asking more sensitive opinion questions or questions about personal behaviors or individual needs, since they are #anonymous. People may feel comfortable sharing that they don’t have housing or are experiencing depression, because no one will know they answered that way.   ✅ Surveys require less coordination of things like food or space or schedules and can involve less of other types of resources like outside facilitators.   However, some disadvantages of surveys include: ❌ They are they are not #interactive so you can’t ask follow up questions to dig deeper into a topic. You also might miss emergent issues that you didn’t think to ask about in the survey that would have come out in other methods.   ❌ Surveys like this also usually are done with a self-selected convenience sample, meaning the people who took the survey are those who happened to have access to and choose to take the survey. For example, your survey respondents might be those who happen to read your newsletter, or to follow the partner who shared the survey on social media, or to have had a clinic appointment when the survey was open. Because of this, we know there can be differences between those who take and don’t take the survey and that we might not be able to generalize the results to the whole population or group or compare it to quantitative data in terms of its reliability about things like the percent of a population with a given condition.   ❌ Even though surveys don’t need a facilitator or space, they can require a LOT of effort to get distributed broadly, and they also require software and analysis time and expertise. Are you a survey taker - yea or nay?