Focus groups, interviews and surveys are referred to as primary research tools. They help you collect new or original information. The benefit of conducting your own research, rather than using secondary information (e.g. from internet sources and trade publications) is that you can tailor your questions specifically to your business and you can gather more in-depth information.
Surveys
Surveys are fixed sets of questions, which are usually used to collect quantifiable information (e.g. the percentage of people happy with a particular product). Questions in surveys are usually:
- multiple choice
- true/false or yes/no
- rankings or ratings (e.g. 1–5, or strongly agree/disagree scales).
You can also include open-ended questions that give people the chance to answer a question with a statement; however, these tend to be better suited to qualitative research methods such as focus groups and interviews where you can ask follow-up questions to get more information.
Surveys are usually most effective when carried out face-to-face, but can also be completed over the phone, online, or through the post. Postal surveys are generally better suited to existing customers as they have an affinity with your business and are more likely to respond.
Keep your surveys short by not asking too many questions. Make sure your questions are clear and easy to understand. This will help you get more useful information and reduce the chances of participants losing interest or giving misleading answers. Test your questions on friends or family to make sure they are easy to answer.
There are commercial software options (e.g. Surveymonkey, Google Forms) that can provide a wide range of survey design and analysis tools.
Focus groups and interviews
Focus groups and interviews are based on a set of questions or discussion points. Sometimes they might include visual concepts and even product samples to trial. They are most effective for qualitative research, as they let you explore people's opinions and attitudes (e.g. how they feel about your products and what improvements they would like to see in your business).
When preparing for focus groups and interviews, you need to develop a list of questions and key points so that you can have a productive conversation with your participants. To get the most out of a focus group or interview:
- ask open-ended questions – ones that can't be answered with 'yes', 'no' or another single word (e.g. rather than ask 'are you happy with our products?' ask 'which of our products are you happy with and why?')
- repeat participants' answers to make sure you understand what they are saying
- ask follow-up questions if you need more information about a participant's answer.
Plan where and when you will conduct focus groups or interviews and think about who will conduct them. You may decide to use a professional market research company to help if you are unfamiliar with the process. Make sure you record the answers from the interview and conversations in the focus group. You might do this with a sound recorder or take written notes. Typically focus groups last 1–3 hours and focus group participants are usually paid to attend.
Selecting participants
The number of participants in your surveys, focus groups or interviews is called the sample size. A large sample size will give you a clearer picture of your customers than a small one. While there is no set method for deciding how large or small your sample should be, it will depend on what type of primary research you are conducting (focus groups, interviews or surveys) and the time and budget you can allocate to your research.
As focus groups and interviews are generally more in-depth than surveys, you may not need a large sample size to get useful information. A typical focus group may consist of 6–8 people but you may need to conduct a number of focus groups to get the ideal mix of information you are after. For surveys, a larger sample size will help you draw more reliable conclusions from the data you collect.
The participants you select for your research must be able to answer your questions. Make sure they are familiar with the topic you are discussing, as targeting the wrong population can result in inconclusive or misleading data. Usually you select focus group participants based on criteria relevant to your customer profile (e.g. women, aged 35–45, with children in primary school).
Your participants might be existing or potential customers, depending on what you are trying to find out with your research. Before you conduct any research with your participants, make sure they agree to participate and outline any potential issues, such as confidentiality. Explain to them how you will use their information, and give them the opportunity to opt out at any time if they want.
Also consider...
Here are six survey question examples that should be avoided for the best survey data:
Loaded question: Do you think there are more postgraduates (Master’s, PhD, MBA) because of the country’s weak economy?
The question also includes a false premise: the participant is required to agree that the economy is weak to answer. The question also imposes a causal relationship between the economy and postgraduate study that a person may not see. Loaded questions are inherently biased and push respondents into confirming a particular argument they may not agree with.
Double-barreled question: Would you like to be rich and famous?
Double-barreled questions are difficult for people to answer. A person might like to be rich but not famous and would thus have trouble responding to this question. Additionally, you don’t know whether they are responding to both parts of the question or just one.
Biased question: Do you agree that the President is doing a wonderful job on foreign policy?
Biased language that either triggers emotional responses or imposes your opinion can influence the results of your survey. Survey questions should be neutral, simple, and void of emotion.
Assumptive question: Do you have extra money after paying bills that you invest?
This question assumes that the participant has extra money after paying bills. When a person reads a question they feel is irrelevant to him or her, it can lead to attrition from the survey. This is why Logic Jump is useful—surveys should adapt to respondents’ answers so they can skip questions that don’t apply to them.
This question would be better asked in two parts: do you have extra money after paying bills? (If yes: Do you invest the extra money you have after paying bills?
Second-hand knowledge question: Does your community have a problem with crime?
Not only are ‘crime’ and ‘problem’ vague, it’s challenging for a layperson to report on something related to the community-at-large. The responses to the question wouldn’t be reliable. Stick to asking questions that cover people’s first-hand knowledge.
If you are trying to understand the prevalence of criminal acts, it would be better to ask: In the past 12 months, have you been the victim of a crime?
Hypothetical questions: If you received a $10,000 bonus at work, would you invest it?
People are terrible at predicting future behavior, particularly in situations they’ve never encountered. Behavior is deeply situational, so what a person might do upon receiving a bonus could depend on whether they had credit card debt, whether they needed to make an immediate purchase, the time of year, and so on.
- Identify the primary goal of an in-depth interview
- Describe the unique characteristics of qualitative interview techniques
- Define the term “interview guide” and describe how to construct one
- Outline the guidelines for constructing good qualitative interview questions
- Describe the function and purpose of field notes and journals in qualitative research
- Identify the strengths and weaknesses of interviews
Qualitative interviews are sometimes called intensive or in-depth interviews. These interviews are considered semi-structured because the researcher has a particular topic for the respondent, but questions are open-ended and may not be asked in the exact same way or order to each respondent. The primary goal of an in-depth interview is to hear what respondents think is important about the topic at hand and to hear it in their own words. In this section, we’ll look at how to conduct qualitative interviews, analyze interview data, and identify some of the strengths and weaknesses of this method.
Constructing an interview guide
Respondents might think that qualitative interviews feel more like a conversation than an interview, but the researcher is guiding the conversation with the goal of gathering information from a respondent. Qualitative interviews use open-ended questions, which are questions that a researcher poses but does not provide answer options for. Open-ended questions are more demanding of participants than closed-ended questions for they require participants to come up with their own words, phrases, or sentences to respond.
In a qualitative interview, the researcher usually develops a guide in advance that they can refer to during the interview or memorize the interview takes place. An interview guide is a list of topics or questions that the interviewer hopes to cover during the course of an interview. It is called a guide because it is simply that—it is used to guide the interviewer, but it is not set in stone. Think of an interview guide like your agenda for the day or your to-do list: Both probably contain all the items you hope to check off or accomplish, though it probably won’t be the end of the world if you don’t accomplish everything on the list or if you don’t accomplish it in the exact order that you have it written down. Perhaps new events will come up that cause you to rearrange your schedule just a bit, or perhaps you simply won’t get to everything on the list.
Interview guides should outline issues that a researcher feels are likely to be important. Participants are asked to provide answers in their own words and to raise points they believe are important, so each interview is likely to flow a little differently. While the opening question in an in-depth interview may be the same across all interviews, the information that each participant shared will shape how the interview proceeds. This is what makes in-depth interviewing so exciting and rather challenging. It takes a skilled interviewer to be able to ask questions, listen to respondents, and pick up on cues about when to follow up, move on, or simply let the participant speak without guidance or interruption.
Earlier, I mentioned that interview guides can list topics or questions. The specific format of an interview guide might depend on your style, experience, and comfort level as an interviewer or with your topic. Figure 13.1 provides an example of an interview guide for a study of how young people experience workplace sexual harassment. The guide is topic-based, rather than a list of specific questions. The listed order of the topics is important, however the order that each comes up during the interview may vary.
When I was interviewing state administrators of developmental disabilities departments, my interview guide contained 15 questions, all of which were asked to each participant. Sometimes, participants would cover the answer to one question before it was read. When I came to that question later on in the interview, I would acknowledge that they already addressed part of this question and ask them if they had anything to add to their response. Underneath some of the questions were more specific words or phrases for follow-up in case the participant did not mention those topics in their responses. These probes, as well as the questions, were based on our review of their department’s documentation about their programs. Our project was challenging because we were studying specific types of programs and the administrators may have thought we had an agenda to convince them to expand or better fund those programs. We had to be very objective in how we worded questions to avoid the appearance of bias. Some of these questions are depicted in Figure 13.2.
As you might have guessed, interview guides do not appear out of thin air. They are the result of thoughtful and careful work on the part of a researcher. As you can see in both of the preceding guides, the topics and questions have been organized thematically and in the order in which they are likely to proceed (though keep in mind that the flow of a qualitative interview is in part determined by what a respondent has to say). Sometimes qualitative interviewers may create two versions of the interview guide: one version contains a very brief outline of the interview, perhaps with just topic headings, and another version contains detailed questions underneath each topic heading. In this case, the researcher might use the detailed guide to prepare and practice before conducting interviews and then bring the brief outline to the interview. Bringing an outline to an interview encourages the researcher to actively listen to what a participant is telling them. An overly detailed interview guide will be difficult to navigate during an interview and could give respondents the misimpression the interviewer is more interested in their questions than in the participant’s answers.
Brainstorming is usually the first step in constructing an interview guide. There are no rules at the brainstorming stage—simply list all the topics and questions that come to mind when you think about your research question. Once you have a decent list, you can begin to cut questions and topics that seem redundant and group similar questions and topics together. If you haven’t done so yet, you may also want to come up with question and topic headings for your grouped categories. You should also consult the scholarly literature to find out what kinds of questions other interviewers have asked in studies of similar topics and what theory indicates might be important. As with quantitative survey research, avoid placing very sensitive or potentially controversial questions at the beginning of your qualitative interview guide. You need to give participants the opportunity to warm up to the interview and to feel comfortable talking with you. Finally, get some feedback on your interview guide. Ask your friends, other researchers, and your professors for some guidance and suggestions once you’ve come up with what you think is a strong guide. They may catch a few things that you hadn’t noticed. Once you begin conducting interviews, your participants may also suggest revisions or improvements.
There are a few noteworthy guidelines for the specific questions you should include in your guide. First, avoid questions that can be answered with a simple yes or no. Try to rephrase your questions in a way that invites longer responses from your interviewees. If you choose to include yes or no questions, be sure to include follow-up questions. Remember, one of the benefits of qualitative interviews is that you can ask participants for more information, so be sure to do so. While it is a good idea to ask follow-up questions, try to avoid asking “why,” as this can come off as unintentionally confrontational. Respondents often won’t know how to respond to this type of question, perhaps because they have not explored “why” themselves. Instead, I recommend using something like, “Could you tell me a little more about that?” This allows participants to explain themselves further without feeling that they’re being doubted or questioned in a hostile way.
Also, try to avoid phrasing your questions in a leading way. For example, rather than asking, “Don’t you think most people who don’t want kids are selfish?” you could ask, “What comes to mind for you when you hear someone doesn’t want kids?” Instead of asking “What do you think about juvenile offenders who drink and drive?” you could ask, “How do you feel about underage drinking?” or “What do you think about drinking and driving?” Finally, remember to keep most, if not all, of your questions open-ended. The key to a successful qualitative interview is giving participants the opportunity to share information in their own words and in their own way. Documenting your decisions regarding which questions are used, thrown out, or revised can help you remember the thought process behind the interview guide when you analyze your results. Additionally, documentation promotes the rigor of the qualitative project, ensuring the researcher is proceeding in a reflective and deliberate manner that can be checked by others reviewing their study.
Recording qualitative data
After the interview guide is constructed, the interviewer is not yet ready to begin conducting interviews. Next, the researcher must decide how to collect and maintain the information that is provided by participants. Researchers keep field notes or written recordings produced by the researcher during the data collection process, including before, during, and after interviews. Field notes help researchers to document their observations and they form the first draft of data analysis. Field notes may contain many things, including but not limited to observations of body language or environment, reflections on whether interview questions are working well, and connections between ideas that participants share.
Unfortunately, even the most diligent researcher cannot write down everything that is seen or heard during an interview. In particular, it is difficult for a researcher to be truly present and observant if they are also writing down everything the participant is saying. For this reason, it is quite common for interviewers to create audio recordings of the interviews they conduct. Recording interviews allows the researcher to focus on their interaction with the interview participant rather than being distracted by trying to write down every word that is said.
Of course, not all participants will feel comfortable being recorded and there may be situations in which the interviewer feels the subject is too sensitive to be recorded. In these cases, the researcher must balance excellent note-taking, exceptional question-asking, and even better listening. I don’t think I can understate the difficulty of managing all these feats simultaneously. It is crucial to practice the interview in advance whether you will be recording your interviews or not. Ideally, you’ll find a friend or two willing to participate in a couple of trial runs with you. Even better, you’ll find a friend or two who are similar in at least some ways to your sample. They can give you the best feedback on your questions and your interview demeanor.
Another issue interviewers face is documenting the decisions made during the data collection process. Qualitative research is open to new ideas that emerge through the data collection process. For example, a participant might suggest a new concept you hadn’t thought of before or define a concept in a new way. This may lead you to create new questions or ask questions in a different way to future participants. These processes should be documented in a process called journaling or memoing. Journal entries are notes to yourself about reflections or methodological decisions that emerge during the data collection process. Documenting these decisions is important, as you’d be surprised how quickly you can forget what happened. Journaling ensures that you remember, how, when, and why certain changes were made when it comes time to analyze your data. The discipline of journaling in qualitative research helps to ensure the rigor of the research process—that is its trustworthiness and authenticity. We covered these standards of qualitative rigor in Chapter 9.
Strengths and weaknesses of qualitative interviews
As we’ve mentioned in this section, qualitative interviews are an excellent way to gather detailed information. Researchers can explore topics in the most depth by using interviews compared to other methods. Qualitative interviewing allows participants the opportunity to elaborate in ways that are not possible with other methods like survey research. They are also able share information with researchers in their own words and from their own perspectives. Differently, quantitative research asks participants to fit their perspectives into the limited response options provided by the researcher. Qualitative interviews are designed to elicit detailed information, so they are especially useful when a researcher’s aim is to study social processes or the “how” of various phenomena. While it is often an overlooked benefit of qualitative interviewing, researchers can make observations beyond those that a respondent is orally reporting. A respondent’s body language, and even their choice of time and location for the interview, might provide a researcher with useful data.
Of course, all these benefits come with some drawbacks. As with quantitative survey research, qualitative interviews rely on respondents’ ability to accurately and honestly recall specific details about their lives, circumstances, thoughts, opinions, or behaviors. As Esterberg (2002) puts it, “If you want to know about what people actually do, rather than what they say they do, you should probably use observation [instead of interviews].” Further, as you may have already guessed, qualitative interviewing is time-intensive and can be quite expensive. Creating an interview guide, identifying a sample, and conducting interviews are just the beginning. Writing out what was said in interviews and analyzing the qualitative data are time consuming processes. Keep in mind you are also asking for more of participants’ time than if you’d simply mailed them a questionnaire containing closed-ended questions. Conducting qualitative interviews is not only labor-intensive but can also be emotionally taxing. Seeing and hearing the impact that social problems have on respondents is difficult. Researchers embarking on a qualitative interview project should keep in mind their own abilities to receive stories that may be difficult to hear.
- In-depth interviews are semi-structured interviews where the researcher has topics and questions in mind to ask, but questions are open-ended and flow according to how the participant responds to each.
- Interview guides can vary in format but should contain some outline of the topics you hope to cover during the course of an interview.
- Qualitative interviews allow respondents to share information in their own words and are useful for gathering detailed information and understanding social processes.
- Field notes and journal entries document the researcher’s decisions and thoughts that influence the research process.
- Drawbacks of qualitative interviews include reliance on respondents’ accuracy and their intensity in terms of time, expense, and possible emotional strain.
Field notes- written notes produced by the researcher during the data collection process
In-depth interviews- interviews in which researchers hear from respondents about what they think is important about the topic at hand in the respondent’s own words
Interview guide- a list of topics or questions that the interviewer hopes to cover during the course of an interview
Journaling- making notes of emerging issues and changes during the research process
Semi-structured interviews- questions are open ended and may not be asked in exactly the same way or in exactly the same order to each and every respondent
questions by geralt CC-0
writing by StockSnap CC-0