Qualitative Research: Characteristics, Design, Methods & Examples
Lauren McCall
MSc Health Psychology Graduate
MSc, Health Psychology, University of Nottingham
Lauren obtained an MSc in Health Psychology from The University of Nottingham with a distinction classification.
Learn about our Editorial Process
Saul McLeod, PhD
Editor-in-Chief for Simply Psychology
BSc (Hons) Psychology, MRes, PhD, University of Manchester
Saul McLeod, PhD., is a qualified psychology teacher with over 18 years of experience in further and higher education. He has been published in peer-reviewed journals, including the Journal of Clinical Psychology.
Olivia Guy-Evans, MSc
Associate Editor for Simply Psychology
BSc (Hons) Psychology, MSc Psychology of Education
Olivia Guy-Evans is a writer and associate editor for Simply Psychology. She has previously worked in healthcare and educational sectors.
On This Page:
Qualitative research is a type of research methodology that focuses on gathering and analyzing non-numerical data to gain a deeper understanding of human behavior, experiences, and perspectives.
It aims to explore the “why” and “how” of a phenomenon rather than the “what,” “where,” and “when” typically addressed by quantitative research.
Unlike quantitative research, which focuses on gathering and analyzing numerical data for statistical analysis, qualitative research involves researchers interpreting data to identify themes, patterns, and meanings.
Qualitative research can be used to:
- Gain deep contextual understandings of the subjective social reality of individuals
- To answer questions about experience and meaning from the participant’s perspective
- To design hypotheses, theory must be researched using qualitative methods to determine what is important before research can begin.
Examples of qualitative research questions include:
- How does stress influence young adults’ behavior?
- What factors influence students’ school attendance rates in developed countries?
- How do adults interpret binge drinking in the UK?
- What are the psychological impacts of cervical cancer screening in women?
- How can mental health lessons be integrated into the school curriculum?
Characteristics
Naturalistic setting.
Individuals are studied in their natural setting to gain a deeper understanding of how people experience the world. This enables the researcher to understand a phenomenon close to how participants experience it.
Naturalistic settings provide valuable contextual information to help researchers better understand and interpret the data they collect.
The environment, social interactions, and cultural factors can all influence behavior and experiences, and these elements are more easily observed in real-world settings.
Reality is socially constructed
Qualitative research aims to understand how participants make meaning of their experiences – individually or in social contexts. It assumes there is no objective reality and that the social world is interpreted (Yilmaz, 2013).
The primacy of subject matter
The primary aim of qualitative research is to understand the perspectives, experiences, and beliefs of individuals who have experienced the phenomenon selected for research rather than the average experiences of groups of people (Minichiello, 1990).
An in-depth understanding is attained since qualitative techniques allow participants to freely disclose their experiences, thoughts, and feelings without constraint (Tenny et al., 2022).
Variables are complex, interwoven, and difficult to measure
Factors such as experiences, behaviors, and attitudes are complex and interwoven, so they cannot be reduced to isolated variables , making them difficult to measure quantitatively.
However, a qualitative approach enables participants to describe what, why, or how they were thinking/ feeling during a phenomenon being studied (Yilmaz, 2013).
Emic (insider’s point of view)
The phenomenon being studied is centered on the participants’ point of view (Minichiello, 1990).
Emic is used to describe how participants interact, communicate, and behave in the research setting (Scarduzio, 2017).
Interpretive analysis
In qualitative research, interpretive analysis is crucial in making sense of the collected data.
This process involves examining the raw data, such as interview transcripts, field notes, or documents, and identifying the underlying themes, patterns, and meanings that emerge from the participants’ experiences and perspectives.
Collecting Qualitative Data
There are four main research design methods used to collect qualitative data: observations, interviews, focus groups, and ethnography.
Observations
This method involves watching and recording phenomena as they occur in nature. Observation can be divided into two types: participant and non-participant observation.
In participant observation, the researcher actively participates in the situation/events being observed.
In non-participant observation, the researcher is not an active part of the observation and tries not to influence the behaviors they are observing (Busetto et al., 2020).
Observations can be covert (participants are unaware that a researcher is observing them) or overt (participants are aware of the researcher’s presence and know they are being observed).
However, awareness of an observer’s presence may influence participants’ behavior.
Interviews give researchers a window into the world of a participant by seeking their account of an event, situation, or phenomenon. They are usually conducted on a one-to-one basis and can be distinguished according to the level at which they are structured (Punch, 2013).
Structured interviews involve predetermined questions and sequences to ensure replicability and comparability. However, they are unable to explore emerging issues.
Informal interviews consist of spontaneous, casual conversations which are closer to the truth of a phenomenon. However, information is gathered using quick notes made by the researcher and is therefore subject to recall bias.
Semi-structured interviews have a flexible structure, phrasing, and placement so emerging issues can be explored (Denny & Weckesser, 2022).
The use of probing questions and clarification can lead to a detailed understanding, but semi-structured interviews can be time-consuming and subject to interviewer bias.
Focus groups
Similar to interviews, focus groups elicit a rich and detailed account of an experience. However, focus groups are more dynamic since participants with shared characteristics construct this account together (Denny & Weckesser, 2022).
A shared narrative is built between participants to capture a group experience shaped by a shared context.
The researcher takes on the role of a moderator, who will establish ground rules and guide the discussion by following a topic guide to focus the group discussions.
Typically, focus groups have 4-10 participants as a discussion can be difficult to facilitate with more than this, and this number allows everyone the time to speak.
Ethnography
Ethnography is a methodology used to study a group of people’s behaviors and social interactions in their environment (Reeves et al., 2008).
Data are collected using methods such as observations, field notes, or structured/ unstructured interviews.
The aim of ethnography is to provide detailed, holistic insights into people’s behavior and perspectives within their natural setting. In order to achieve this, researchers immerse themselves in a community or organization.
Due to the flexibility and real-world focus of ethnography, researchers are able to gather an in-depth, nuanced understanding of people’s experiences, knowledge and perspectives that are influenced by culture and society.
In order to develop a representative picture of a particular culture/ context, researchers must conduct extensive field work.
This can be time-consuming as researchers may need to immerse themselves into a community/ culture for a few days, or possibly a few years.
Qualitative Data Analysis Methods
Different methods can be used for analyzing qualitative data. The researcher chooses based on the objectives of their study.
The researcher plays a key role in the interpretation of data, making decisions about the coding, theming, decontextualizing, and recontextualizing of data (Starks & Trinidad, 2007).
Grounded theory
Grounded theory is a qualitative method specifically designed to inductively generate theory from data. It was developed by Glaser and Strauss in 1967 (Glaser & Strauss, 2017).
This methodology aims to develop theories (rather than test hypotheses) that explain a social process, action, or interaction (Petty et al., 2012). To inform the developing theory, data collection and analysis run simultaneously.
There are three key types of coding used in grounded theory: initial (open), intermediate (axial), and advanced (selective) coding.
Throughout the analysis, memos should be created to document methodological and theoretical ideas about the data. Data should be collected and analyzed until data saturation is reached and a theory is developed.
Content analysis
Content analysis was first used in the early twentieth century to analyze textual materials such as newspapers and political speeches.
Content analysis is a research method used to identify and analyze the presence and patterns of themes, concepts, or words in data (Vaismoradi et al., 2013).
This research method can be used to analyze data in different formats, which can be written, oral, or visual.
The goal of content analysis is to develop themes that capture the underlying meanings of data (Schreier, 2012).
Qualitative content analysis can be used to validate existing theories, support the development of new models and theories, and provide in-depth descriptions of particular settings or experiences.
The following six steps provide a guideline for how to conduct qualitative content analysis.
- Define a Research Question : To start content analysis, a clear research question should be developed.
- Identify and Collect Data : Establish the inclusion criteria for your data. Find the relevant sources to analyze.
- Define the Unit or Theme of Analysis : Categorize the content into themes. Themes can be a word, phrase, or sentence.
- Develop Rules for Coding your Data : Define a set of coding rules to ensure that all data are coded consistently.
- Code the Data : Follow the coding rules to categorize data into themes.
- Analyze the Results and Draw Conclusions : Examine the data to identify patterns and draw conclusions in relation to your research question.
Discourse analysis
Discourse analysis is a research method used to study written/ spoken language in relation to its social context (Wood & Kroger, 2000).
In discourse analysis, the researcher interprets details of language materials and the context in which it is situated.
Discourse analysis aims to understand the functions of language (how language is used in real life) and how meaning is conveyed by language in different contexts. Researchers use discourse analysis to investigate social groups and how language is used to achieve specific communication goals.
Different methods of discourse analysis can be used depending on the aims and objectives of a study. However, the following steps provide a guideline on how to conduct discourse analysis.
- Define the Research Question : Develop a relevant research question to frame the analysis.
- Gather Data and Establish the Context : Collect research materials (e.g., interview transcripts, documents). Gather factual details and review the literature to construct a theory about the social and historical context of your study.
- Analyze the Content : Closely examine various components of the text, such as the vocabulary, sentences, paragraphs, and structure of the text. Identify patterns relevant to the research question to create codes, then group these into themes.
- Review the Results : Reflect on the findings to examine the function of the language, and the meaning and context of the discourse.
Thematic analysis
Thematic analysis is a method used to identify, interpret, and report patterns in data, such as commonalities or contrasts.
Although the origin of thematic analysis can be traced back to the early twentieth century, understanding and clarity of thematic analysis is attributed to Braun and Clarke (2006).
Thematic analysis aims to develop themes (patterns of meaning) across a dataset to address a research question.
In thematic analysis, qualitative data is gathered using techniques such as interviews, focus groups, and questionnaires. Audio recordings are transcribed. The dataset is then explored and interpreted by a researcher to identify patterns.
This occurs through the rigorous process of data familiarisation, coding, theme development, and revision. These identified patterns provide a summary of the dataset and can be used to address a research question.
Themes are developed by exploring the implicit and explicit meanings within the data. Two different approaches are used to generate themes: inductive and deductive.
An inductive approach allows themes to emerge from the data. In contrast, a deductive approach uses existing theories or knowledge to apply preconceived ideas to the data.
Phases of Thematic Analysis
Braun and Clarke (2006) provide a guide of the six phases of thematic analysis. These phases can be applied flexibly to fit research questions and data.
Template analysis
Template analysis refers to a specific method of thematic analysis which uses hierarchical coding (Brooks et al., 2014).
Template analysis is used to analyze textual data, for example, interview transcripts or open-ended responses on a written questionnaire.
To conduct template analysis, a coding template must be developed (usually from a subset of the data) and subsequently revised and refined. This template represents the themes identified by researchers as important in the dataset.
Codes are ordered hierarchically within the template, with the highest-level codes demonstrating overarching themes in the data and lower-level codes representing constituent themes with a narrower focus.
A guideline for the main procedural steps for conducting template analysis is outlined below.
- Familiarization with the Data : Read (and reread) the dataset in full. Engage, reflect, and take notes on data that may be relevant to the research question.
- Preliminary Coding : Identify initial codes using guidance from the a priori codes, identified before the analysis as likely to be beneficial and relevant to the analysis.
- Organize Themes : Organize themes into meaningful clusters. Consider the relationships between the themes both within and between clusters.
- Produce an Initial Template : Develop an initial template. This may be based on a subset of the data.
- Apply and Develop the Template : Apply the initial template to further data and make any necessary modifications. Refinements of the template may include adding themes, removing themes, or changing the scope/title of themes.
- Finalize Template : Finalize the template, then apply it to the entire dataset.
Frame analysis
Frame analysis is a comparative form of thematic analysis which systematically analyzes data using a matrix output.
Ritchie and Spencer (1994) developed this set of techniques to analyze qualitative data in applied policy research. Frame analysis aims to generate theory from data.
Frame analysis encourages researchers to organize and manage their data using summarization.
This results in a flexible and unique matrix output, in which individual participants (or cases) are represented by rows and themes are represented by columns.
Each intersecting cell is used to summarize findings relating to the corresponding participant and theme.
Frame analysis has five distinct phases which are interrelated, forming a methodical and rigorous framework.
- Familiarization with the Data : Familiarize yourself with all the transcripts. Immerse yourself in the details of each transcript and start to note recurring themes.
- Develop a Theoretical Framework : Identify recurrent/ important themes and add them to a chart. Provide a framework/ structure for the analysis.
- Indexing : Apply the framework systematically to the entire study data.
- Summarize Data in Analytical Framework : Reduce the data into brief summaries of participants’ accounts.
- Mapping and Interpretation : Compare themes and subthemes and check against the original transcripts. Group the data into categories and provide an explanation for them.
Preventing Bias in Qualitative Research
To evaluate qualitative studies, the CASP (Critical Appraisal Skills Programme) checklist for qualitative studies can be used to ensure all aspects of a study have been considered (CASP, 2018).
The quality of research can be enhanced and assessed using criteria such as checklists, reflexivity, co-coding, and member-checking.
Co-coding
Relying on only one researcher to interpret rich and complex data may risk key insights and alternative viewpoints being missed. Therefore, coding is often performed by multiple researchers.
A common strategy must be defined at the beginning of the coding process (Busetto et al., 2020). This includes establishing a useful coding list and finding a common definition of individual codes.
Transcripts are initially coded independently by researchers and then compared and consolidated to minimize error or bias and to bring confirmation of findings.
Member checking
Member checking (or respondent validation) involves checking back with participants to see if the research resonates with their experiences (Russell & Gregory, 2003).
Data can be returned to participants after data collection or when results are first available. For example, participants may be provided with their interview transcript and asked to verify whether this is a complete and accurate representation of their views.
Participants may then clarify or elaborate on their responses to ensure they align with their views (Shenton, 2004).
This feedback becomes part of data collection and ensures accurate descriptions/ interpretations of phenomena (Mays & Pope, 2000).
Reflexivity in qualitative research
Reflexivity typically involves examining your own judgments, practices, and belief systems during data collection and analysis. It aims to identify any personal beliefs which may affect the research.
Reflexivity is essential in qualitative research to ensure methodological transparency and complete reporting. This enables readers to understand how the interaction between the researcher and participant shapes the data.
Depending on the research question and population being researched, factors that need to be considered include the experience of the researcher, how the contact was established and maintained, age, gender, and ethnicity.
These details are important because, in qualitative research, the researcher is a dynamic part of the research process and actively influences the outcome of the research (Boeije, 2014).
Reflexivity Example
Who you are and your characteristics influence how you collect and analyze data. Here is an example of a reflexivity statement for research on smoking. I am a 30-year-old white female from a middle-class background. I live in the southwest of England and have been educated to master’s level. I have been involved in two research projects on oral health. I have never smoked, but I have witnessed how smoking can cause ill health from my volunteering in a smoking cessation clinic. My research aspirations are to help to develop interventions to help smokers quit.
Establishing Trustworthiness in Qualitative Research
Trustworthiness is a concept used to assess the quality and rigor of qualitative research. Four criteria are used to assess a study’s trustworthiness: credibility, transferability, dependability, and confirmability.
1. Credibility in Qualitative Research
Credibility refers to how accurately the results represent the reality and viewpoints of the participants.
To establish credibility in research, participants’ views and the researcher’s representation of their views need to align (Tobin & Begley, 2004).
To increase the credibility of findings, researchers may use data source triangulation, investigator triangulation, peer debriefing, or member checking (Lincoln & Guba, 1985).
2. Transferability in Qualitative Research
Transferability refers to how generalizable the findings are: whether the findings may be applied to another context, setting, or group (Tobin & Begley, 2004).
Transferability can be enhanced by giving thorough and in-depth descriptions of the research setting, sample, and methods (Nowell et al., 2017).
3. Dependability in Qualitative Research
Dependability is the extent to which the study could be replicated under similar conditions and the findings would be consistent.
Researchers can establish dependability using methods such as audit trails so readers can see the research process is logical and traceable (Koch, 1994).
4. Confirmability in Qualitative Research
Confirmability is concerned with establishing that there is a clear link between the researcher’s interpretations/ findings and the data.
Researchers can achieve confirmability by demonstrating how conclusions and interpretations were arrived at (Nowell et al., 2017).
This enables readers to understand the reasoning behind the decisions made.
Audit Trails in Qualitative Research
An audit trail provides evidence of the decisions made by the researcher regarding theory, research design, and data collection, as well as the steps they have chosen to manage, analyze, and report data.
The researcher must provide a clear rationale to demonstrate how conclusions were reached in their study.
A clear description of the research path must be provided to enable readers to trace through the researcher’s logic (Halpren, 1983).
Researchers should maintain records of the raw data, field notes, transcripts, and a reflective journal in order to provide a clear audit trail.
Discovery of unexpected data
Open-ended questions in qualitative research mean the researcher can probe an interview topic and enable the participant to elaborate on responses in an unrestricted manner.
This allows unexpected data to emerge, which can lead to further research into that topic.
The exploratory nature of qualitative research helps generate hypotheses that can be tested quantitatively (Busetto et al., 2020).
Flexibility
Data collection and analysis can be modified and adapted to take the research in a different direction if new ideas or patterns emerge in the data.
This enables researchers to investigate new opportunities while firmly maintaining their research goals.
Naturalistic settings
The behaviors of participants are recorded in real-world settings. Studies that use real-world settings have high ecological validity since participants behave more authentically.
Limitations
Time-consuming .
Qualitative research results in large amounts of data which often need to be transcribed and analyzed manually.
Even when software is used, transcription can be inaccurate, and using software for analysis can result in many codes which need to be condensed into themes.
Subjectivity
The researcher has an integral role in collecting and interpreting qualitative data. Therefore, the conclusions reached are from their perspective and experience.
Consequently, interpretations of data from another researcher may vary greatly.
Limited generalizability
The aim of qualitative research is to provide a detailed, contextualized understanding of an aspect of the human experience from a relatively small sample size.
Despite rigorous analysis procedures, conclusions drawn cannot be generalized to the wider population since data may be biased or unrepresentative.
Therefore, results are only applicable to a small group of the population.
While individual qualitative studies are often limited in their generalizability due to factors such as sample size and context, metasynthesis enables researchers to synthesize findings from multiple studies, potentially leading to more generalizable conclusions.
By integrating findings from studies conducted in diverse settings and with different populations, metasynthesis can provide broader insights into the phenomenon of interest.
Extraneous variables
Qualitative research is often conducted in real-world settings. This may cause results to be unreliable since extraneous variables may affect the data, for example:
- Situational variables : different environmental conditions may influence participants’ behavior in a study. The random variation in factors (such as noise or lighting) may be difficult to control in real-world settings.
- Participant characteristics : this includes any characteristics that may influence how a participant answers/ behaves in a study. This may include a participant’s mood, gender, age, ethnicity, sexual identity, IQ, etc.
- Experimenter effect : experimenter effect refers to how a researcher’s unintentional influence can change the outcome of a study. This occurs when (i) their interactions with participants unintentionally change participants’ behaviors or (ii) due to errors in observation, interpretation, or analysis.
What sample size should qualitative research be?
The sample size for qualitative studies has been recommended to include a minimum of 12 participants to reach data saturation (Braun, 2013).
Are surveys qualitative or quantitative?
Surveys can be used to gather information from a sample qualitatively or quantitatively. Qualitative surveys use open-ended questions to gather detailed information from a large sample using free text responses.
The use of open-ended questions allows for unrestricted responses where participants use their own words, enabling the collection of more in-depth information than closed-ended questions.
In contrast, quantitative surveys consist of closed-ended questions with multiple-choice answer options. Quantitative surveys are ideal to gather a statistical representation of a population.
What are the ethical considerations of qualitative research?
Before conducting a study, you must think about any risks that could occur and take steps to prevent them. Participant Protection : Researchers must protect participants from physical and mental harm. This means you must not embarrass, frighten, offend, or harm participants. Transparency : Researchers are obligated to clearly communicate how they will collect, store, analyze, use, and share the data. Confidentiality : You need to consider how to maintain the confidentiality and anonymity of participants’ data.
What is triangulation in qualitative research?
Triangulation refers to the use of several approaches in a study to comprehensively understand phenomena. This method helps to increase the validity and credibility of research findings.
Types of triangulation include method triangulation (using multiple methods to gather data); investigator triangulation (multiple researchers for collecting/ analyzing data), theory triangulation (comparing several theoretical perspectives to explain a phenomenon), and data source triangulation (using data from various times, locations, and people; Carter et al., 2014).
Why is qualitative research important?
Qualitative research allows researchers to describe and explain the social world. The exploratory nature of qualitative research helps to generate hypotheses that can then be tested quantitatively.
In qualitative research, participants are able to express their thoughts, experiences, and feelings without constraint.
Additionally, researchers are able to follow up on participants’ answers in real-time, generating valuable discussion around a topic. This enables researchers to gain a nuanced understanding of phenomena which is difficult to attain using quantitative methods.
What is coding data in qualitative research?
Coding data is a qualitative data analysis strategy in which a section of text is assigned with a label that describes its content.
These labels may be words or phrases which represent important (and recurring) patterns in the data.
This process enables researchers to identify related content across the dataset. Codes can then be used to group similar types of data to generate themes.
What is the difference between qualitative and quantitative research?
Qualitative research involves the collection and analysis of non-numerical data in order to understand experiences and meanings from the participant’s perspective.
This can provide rich, in-depth insights on complicated phenomena. Qualitative data may be collected using interviews, focus groups, or observations.
In contrast, quantitative research involves the collection and analysis of numerical data to measure the frequency, magnitude, or relationships of variables. This can provide objective and reliable evidence that can be generalized to the wider population.
Quantitative data may be collected using closed-ended questionnaires or experiments.
What is trustworthiness in qualitative research?
Trustworthiness is a concept used to assess the quality and rigor of qualitative research. Four criteria are used to assess a study’s trustworthiness: credibility, transferability, dependability, and confirmability.
Credibility refers to how accurately the results represent the reality and viewpoints of the participants. Transferability refers to whether the findings may be applied to another context, setting, or group.
Dependability is the extent to which the findings are consistent and reliable. Confirmability refers to the objectivity of findings (not influenced by the bias or assumptions of researchers).
What is data saturation in qualitative research?
Data saturation is a methodological principle used to guide the sample size of a qualitative research study.
Data saturation is proposed as a necessary methodological component in qualitative research (Saunders et al., 2018) as it is a vital criterion for discontinuing data collection and/or analysis.
The intention of data saturation is to find “no new data, no new themes, no new coding, and ability to replicate the study” (Guest et al., 2006). Therefore, enough data has been gathered to make conclusions.
Why is sampling in qualitative research important?
In quantitative research, large sample sizes are used to provide statistically significant quantitative estimates.
This is because quantitative research aims to provide generalizable conclusions that represent populations.
However, the aim of sampling in qualitative research is to gather data that will help the researcher understand the depth, complexity, variation, or context of a phenomenon. The small sample sizes in qualitative studies support the depth of case-oriented analysis.
What is narrative analysis?
Narrative analysis is a qualitative research method used to understand how individuals create stories from their personal experiences.
There is an emphasis on understanding the context in which a narrative is constructed, recognizing the influence of historical, cultural, and social factors on storytelling.
Researchers can use different methods together to explore a research question.
Some narrative researchers focus on the content of what is said, using thematic narrative analysis, while others focus on the structure, such as holistic-form or categorical-form structural narrative analysis. Others focus on how the narrative is produced and performed.
Boeije, H. (2014). Analysis in qualitative research. Sage.
Braun, V., & Clarke, V. (2006). Using thematic analysis in psychology. Qualitative research in psychology , 3 (2), 77-101. https://doi.org/10.1191/1478088706qp063oa
Brooks, J., McCluskey, S., Turley, E., & King, N. (2014). The utility of template analysis in qualitative psychology research. Qualitative Research in Psychology , 12 (2), 202–222. https://doi.org/10.1080/14780887.2014.955224
Busetto, L., Wick, W., & Gumbinger, C. (2020). How to use and assess qualitative research methods. Neurological research and practice , 2 (1), 14-14. https://doi.org/10.1186/s42466-020-00059-z
Carter, N., Bryant-Lukosius, D., DiCenso, A., Blythe, J., & Neville, A. J. (2014). The use of triangulation in qualitative research. Oncology nursing forum , 41 (5), 545–547. https://doi.org/10.1188/14.ONF.545-547
Critical Appraisal Skills Programme. (2018). CASP Checklist: 10 questions to help you make sense of a Qualitative research. https://casp-uk.net/images/checklist/documents/CASP-Qualitative-Studies-Checklist/CASP-Qualitative-Checklist-2018_fillable_form.pdf Accessed: March 15 2023
Clarke, V., & Braun, V. (2013). Successful qualitative research: A practical guide for beginners. Successful Qualitative Research , 1-400.
Denny, E., & Weckesser, A. (2022). How to do qualitative research?: Qualitative research methods. BJOG : an international journal of obstetrics and gynaecology , 129 (7), 1166-1167. https://doi.org/10.1111/1471-0528.17150
Glaser, B. G., & Strauss, A. L. (2017). The discovery of grounded theory. The Discovery of Grounded Theory , 1–18. https://doi.org/10.4324/9780203793206-1
Guest, G., Bunce, A., & Johnson, L. (2006). How many interviews are enough? An experiment with data saturation and variability. Field Methods, 18 (1), 59-82. doi:10.1177/1525822X05279903
Halpren, E. S. (1983). Auditing naturalistic inquiries: The development and application of a model (Unpublished doctoral dissertation). Indiana University, Bloomington.
Hammarberg, K., Kirkman, M., & de Lacey, S. (2016). Qualitative research methods: When to use them and how to judge them. Human Reproduction , 31 (3), 498–501. https://doi.org/10.1093/humrep/dev334
Koch, T. (1994). Establishing rigour in qualitative research: The decision trail. Journal of Advanced Nursing, 19, 976–986. doi:10.1111/ j.1365-2648.1994.tb01177.x
Lincoln, Y., & Guba, E. G. (1985). Naturalistic inquiry. Newbury Park, CA: Sage.
Mays, N., & Pope, C. (2000). Assessing quality in qualitative research. BMJ, 320(7226), 50–52.
Minichiello, V. (1990). In-Depth Interviewing: Researching People. Longman Cheshire.
Nowell, L. S., Norris, J. M., White, D. E., & Moules, N. J. (2017). Thematic Analysis: Striving to Meet the Trustworthiness Criteria. International Journal of Qualitative Methods, 16 (1). https://doi.org/10.1177/1609406917733847
Petty, N. J., Thomson, O. P., & Stew, G. (2012). Ready for a paradigm shift? part 2: Introducing qualitative research methodologies and methods. Manual Therapy , 17 (5), 378–384. https://doi.org/10.1016/j.math.2012.03.004
Punch, K. F. (2013). Introduction to social research: Quantitative and qualitative approaches. London: Sage
Reeves, S., Kuper, A., & Hodges, B. D. (2008). Qualitative research methodologies: Ethnography. BMJ , 337 (aug07 3). https://doi.org/10.1136/bmj.a1020
Russell, C. K., & Gregory, D. M. (2003). Evaluation of qualitative research studies. Evidence Based Nursing, 6 (2), 36–40.
Saunders, B., Sim, J., Kingstone, T., Baker, S., Waterfield, J., Bartlam, B., Burroughs, H., & Jinks, C. (2018). Saturation in qualitative research: exploring its conceptualization and operationalization. Quality & quantity , 52 (4), 1893–1907. https://doi.org/10.1007/s11135-017-0574-8
Scarduzio, J. A. (2017). Emic approach to qualitative research. The International Encyclopedia of Communication Research Methods, 1–2 . https://doi.org/10.1002/9781118901731.iecrm0082
Schreier, M. (2012). Qualitative content analysis in practice / Margrit Schreier.
Shenton, A. K. (2004). Strategies for ensuring trustworthiness in qualitative research projects. Education for Information, 22 , 63–75.
Starks, H., & Trinidad, S. B. (2007). Choose your method: a comparison of phenomenology, discourse analysis, and grounded theory. Qualitative health research , 17 (10), 1372–1380. https://doi.org/10.1177/1049732307307031
Tenny, S., Brannan, J. M., & Brannan, G. D. (2022). Qualitative Study. In StatPearls. StatPearls Publishing.
Tobin, G. A., & Begley, C. M. (2004). Methodological rigour within a qualitative framework. Journal of Advanced Nursing, 48, 388–396. doi:10.1111/j.1365-2648.2004.03207.x
Vaismoradi, M., Turunen, H., & Bondas, T. (2013). Content analysis and thematic analysis: Implications for conducting a qualitative descriptive study. Nursing & health sciences , 15 (3), 398-405. https://doi.org/10.1111/nhs.12048
Wood L. A., Kroger R. O. (2000). Doing discourse analysis: Methods for studying action in talk and text. Sage.
Yilmaz, K. (2013). Comparison of Quantitative and Qualitative Research Traditions: epistemological, theoretical, and methodological differences. European journal of education , 48 (2), 311-325. https://doi.org/10.1111/ejed.12014
An official website of the United States government
Official websites use .gov A .gov website belongs to an official government organization in the United States.
Secure .gov websites use HTTPS A lock ( Lock Locked padlock icon ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.
- Publications
- Account settings
- Advanced Search
- Journal List
How to use and assess qualitative research methods
Loraine busetto, wolfgang wick, christoph gumbinger.
- Author information
- Article notes
- Copyright and License information
Corresponding author.
Received 2020 Jan 30; Accepted 2020 Apr 22; Collection date 2020.
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/ .
This paper aims to provide an overview of the use and assessment of qualitative research methods in the health sciences. Qualitative research can be defined as the study of the nature of phenomena and is especially appropriate for answering questions of why something is (not) observed, assessing complex multi-component interventions, and focussing on intervention improvement. The most common methods of data collection are document study, (non-) participant observations, semi-structured interviews and focus groups. For data analysis, field-notes and audio-recordings are transcribed into protocols and transcripts, and coded using qualitative data management software. Criteria such as checklists, reflexivity, sampling strategies, piloting, co-coding, member-checking and stakeholder involvement can be used to enhance and assess the quality of the research conducted. Using qualitative in addition to quantitative designs will equip us with better tools to address a greater range of research problems, and to fill in blind spots in current neurological research and practice.
Keywords: Qualitative research, Mixed methods, Quality assessment
The aim of this paper is to provide an overview of qualitative research methods, including hands-on information on how they can be used, reported and assessed. This article is intended for beginning qualitative researchers in the health sciences as well as experienced quantitative researchers who wish to broaden their understanding of qualitative research.
What is qualitative research?
Qualitative research is defined as “the study of the nature of phenomena”, including “their quality, different manifestations, the context in which they appear or the perspectives from which they can be perceived” , but excluding “their range, frequency and place in an objectively determined chain of cause and effect” [ 1 ]. This formal definition can be complemented with a more pragmatic rule of thumb: qualitative research generally includes data in form of words rather than numbers [ 2 ].
Why conduct qualitative research?
Because some research questions cannot be answered using (only) quantitative methods. For example, one Australian study addressed the issue of why patients from Aboriginal communities often present late or not at all to specialist services offered by tertiary care hospitals. Using qualitative interviews with patients and staff, it found one of the most significant access barriers to be transportation problems, including some towns and communities simply not having a bus service to the hospital [ 3 ]. A quantitative study could have measured the number of patients over time or even looked at possible explanatory factors – but only those previously known or suspected to be of relevance. To discover reasons for observed patterns, especially the invisible or surprising ones, qualitative designs are needed.
While qualitative research is common in other fields, it is still relatively underrepresented in health services research. The latter field is more traditionally rooted in the evidence-based-medicine paradigm, as seen in " research that involves testing the effectiveness of various strategies to achieve changes in clinical practice, preferably applying randomised controlled trial study designs (...) " [ 4 ]. This focus on quantitative research and specifically randomised controlled trials (RCT) is visible in the idea of a hierarchy of research evidence which assumes that some research designs are objectively better than others, and that choosing a "lesser" design is only acceptable when the better ones are not practically or ethically feasible [ 5 , 6 ]. Others, however, argue that an objective hierarchy does not exist, and that, instead, the research design and methods should be chosen to fit the specific research question at hand – "questions before methods" [ 2 , 7 – 9 ]. This means that even when an RCT is possible, some research problems require a different design that is better suited to addressing them. Arguing in JAMA, Berwick uses the example of rapid response teams in hospitals, which he describes as " a complex, multicomponent intervention – essentially a process of social change" susceptible to a range of different context factors including leadership or organisation history. According to him, "[in] such complex terrain, the RCT is an impoverished way to learn. Critics who use it as a truth standard in this context are incorrect" [ 8 ] . Instead of limiting oneself to RCTs, Berwick recommends embracing a wider range of methods , including qualitative ones, which for "these specific applications, (...) are not compromises in learning how to improve; they are superior" [ 8 ].
Research problems that can be approached particularly well using qualitative methods include assessing complex multi-component interventions or systems (of change), addressing questions beyond “what works”, towards “what works for whom when, how and why”, and focussing on intervention improvement rather than accreditation [ 7 , 9 – 12 ]. Using qualitative methods can also help shed light on the “softer” side of medical treatment. For example, while quantitative trials can measure the costs and benefits of neuro-oncological treatment in terms of survival rates or adverse effects, qualitative research can help provide a better understanding of patient or caregiver stress, visibility of illness or out-of-pocket expenses.
How to conduct qualitative research?
Given that qualitative research is characterised by flexibility, openness and responsivity to context, the steps of data collection and analysis are not as separate and consecutive as they tend to be in quantitative research [ 13 , 14 ]. As Fossey puts it : “sampling, data collection, analysis and interpretation are related to each other in a cyclical (iterative) manner, rather than following one after another in a stepwise approach” [ 15 ]. The researcher can make educated decisions with regard to the choice of method, how they are implemented, and to which and how many units they are applied [ 13 ]. As shown in Fig. 1 , this can involve several back-and-forth steps between data collection and analysis where new insights and experiences can lead to adaption and expansion of the original plan. Some insights may also necessitate a revision of the research question and/or the research design as a whole. The process ends when saturation is achieved, i.e. when no relevant new information can be found (see also below: sampling and saturation). For reasons of transparency, it is essential for all decisions as well as the underlying reasoning to be well-documented.
Iterative research process
While it is not always explicitly addressed, qualitative methods reflect a different underlying research paradigm than quantitative research (e.g. constructivism or interpretivism as opposed to positivism). The choice of methods can be based on the respective underlying substantive theory or theoretical framework used by the researcher [ 2 ].
Data collection
The methods of qualitative data collection most commonly used in health research are document study, observations, semi-structured interviews and focus groups [ 1 , 14 , 16 , 17 ].
Document study
Document study (also called document analysis) refers to the review by the researcher of written materials [ 14 ]. These can include personal and non-personal documents such as archives, annual reports, guidelines, policy documents, diaries or letters.
Observations
Observations are particularly useful to gain insights into a certain setting and actual behaviour – as opposed to reported behaviour or opinions [ 13 ]. Qualitative observations can be either participant or non-participant in nature. In participant observations, the observer is part of the observed setting, for example a nurse working in an intensive care unit [ 18 ]. In non-participant observations, the observer is “on the outside looking in”, i.e. present in but not part of the situation, trying not to influence the setting by their presence. Observations can be planned (e.g. for 3 h during the day or night shift) or ad hoc (e.g. as soon as a stroke patient arrives at the emergency room). During the observation, the observer takes notes on everything or certain pre-determined parts of what is happening around them, for example focusing on physician-patient interactions or communication between different professional groups. Written notes can be taken during or after the observations, depending on feasibility (which is usually lower during participant observations) and acceptability (e.g. when the observer is perceived to be judging the observed). Afterwards, these field notes are transcribed into observation protocols. If more than one observer was involved, field notes are taken independently, but notes can be consolidated into one protocol after discussions. Advantages of conducting observations include minimising the distance between the researcher and the researched, the potential discovery of topics that the researcher did not realise were relevant and gaining deeper insights into the real-world dimensions of the research problem at hand [ 18 ].
Semi-structured interviews
Hijmans & Kuyper describe qualitative interviews as “an exchange with an informal character, a conversation with a goal” [ 19 ]. Interviews are used to gain insights into a person’s subjective experiences, opinions and motivations – as opposed to facts or behaviours [ 13 ]. Interviews can be distinguished by the degree to which they are structured (i.e. a questionnaire), open (e.g. free conversation or autobiographical interviews) or semi-structured [ 2 , 13 ]. Semi-structured interviews are characterized by open-ended questions and the use of an interview guide (or topic guide/list) in which the broad areas of interest, sometimes including sub-questions, are defined [ 19 ]. The pre-defined topics in the interview guide can be derived from the literature, previous research or a preliminary method of data collection, e.g. document study or observations. The topic list is usually adapted and improved at the start of the data collection process as the interviewer learns more about the field [ 20 ]. Across interviews the focus on the different (blocks of) questions may differ and some questions may be skipped altogether (e.g. if the interviewee is not able or willing to answer the questions or for concerns about the total length of the interview) [ 20 ]. Qualitative interviews are usually not conducted in written format as it impedes on the interactive component of the method [ 20 ]. In comparison to written surveys, qualitative interviews have the advantage of being interactive and allowing for unexpected topics to emerge and to be taken up by the researcher. This can also help overcome a provider or researcher-centred bias often found in written surveys, which by nature, can only measure what is already known or expected to be of relevance to the researcher. Interviews can be audio- or video-taped; but sometimes it is only feasible or acceptable for the interviewer to take written notes [ 14 , 16 , 20 ].
Focus groups
Focus groups are group interviews to explore participants’ expertise and experiences, including explorations of how and why people behave in certain ways [ 1 ]. Focus groups usually consist of 6–8 people and are led by an experienced moderator following a topic guide or “script” [ 21 ]. They can involve an observer who takes note of the non-verbal aspects of the situation, possibly using an observation guide [ 21 ]. Depending on researchers’ and participants’ preferences, the discussions can be audio- or video-taped and transcribed afterwards [ 21 ]. Focus groups are useful for bringing together homogeneous (to a lesser extent heterogeneous) groups of participants with relevant expertise and experience on a given topic on which they can share detailed information [ 21 ]. Focus groups are a relatively easy, fast and inexpensive method to gain access to information on interactions in a given group, i.e. “the sharing and comparing” among participants [ 21 ]. Disadvantages include less control over the process and a lesser extent to which each individual may participate. Moreover, focus group moderators need experience, as do those tasked with the analysis of the resulting data. Focus groups can be less appropriate for discussing sensitive topics that participants might be reluctant to disclose in a group setting [ 13 ]. Moreover, attention must be paid to the emergence of “groupthink” as well as possible power dynamics within the group, e.g. when patients are awed or intimidated by health professionals.
Choosing the “right” method
As explained above, the school of thought underlying qualitative research assumes no objective hierarchy of evidence and methods. This means that each choice of single or combined methods has to be based on the research question that needs to be answered and a critical assessment with regard to whether or to what extent the chosen method can accomplish this – i.e. the “fit” between question and method [ 14 ]. It is necessary for these decisions to be documented when they are being made, and to be critically discussed when reporting methods and results.
Let us assume that our research aim is to examine the (clinical) processes around acute endovascular treatment (EVT), from the patient’s arrival at the emergency room to recanalization, with the aim to identify possible causes for delay and/or other causes for sub-optimal treatment outcome. As a first step, we could conduct a document study of the relevant standard operating procedures (SOPs) for this phase of care – are they up-to-date and in line with current guidelines? Do they contain any mistakes, irregularities or uncertainties that could cause delays or other problems? Regardless of the answers to these questions, the results have to be interpreted based on what they are: a written outline of what care processes in this hospital should look like. If we want to know what they actually look like in practice, we can conduct observations of the processes described in the SOPs. These results can (and should) be analysed in themselves, but also in comparison to the results of the document analysis, especially as regards relevant discrepancies. Do the SOPs outline specific tests for which no equipment can be observed or tasks to be performed by specialized nurses who are not present during the observation? It might also be possible that the written SOP is outdated, but the actual care provided is in line with current best practice. In order to find out why these discrepancies exist, it can be useful to conduct interviews. Are the physicians simply not aware of the SOPs (because their existence is limited to the hospital’s intranet) or do they actively disagree with them or does the infrastructure make it impossible to provide the care as described? Another rationale for adding interviews is that some situations (or all of their possible variations for different patient groups or the day, night or weekend shift) cannot practically or ethically be observed. In this case, it is possible to ask those involved to report on their actions – being aware that this is not the same as the actual observation. A senior physician’s or hospital manager’s description of certain situations might differ from a nurse’s or junior physician’s one, maybe because they intentionally misrepresent facts or maybe because different aspects of the process are visible or important to them. In some cases, it can also be relevant to consider to whom the interviewee is disclosing this information – someone they trust, someone they are otherwise not connected to, or someone they suspect or are aware of being in a potentially “dangerous” power relationship to them. Lastly, a focus group could be conducted with representatives of the relevant professional groups to explore how and why exactly they provide care around EVT. The discussion might reveal discrepancies (between SOPs and actual care or between different physicians) and motivations to the researchers as well as to the focus group members that they might not have been aware of themselves. For the focus group to deliver relevant information, attention has to be paid to its composition and conduct, for example, to make sure that all participants feel safe to disclose sensitive or potentially problematic information or that the discussion is not dominated by (senior) physicians only. The resulting combination of data collection methods is shown in Fig. 2 .
Possible combination of data collection methods
Attributions for icons: “Book” by Serhii Smirnov, “Interview” by Adrien Coquet, FR, “Magnifying Glass” by anggun, ID, “Business communication” by Vectors Market; all from the Noun Project
The combination of multiple data source as described for this example can be referred to as “triangulation”, in which multiple measurements are carried out from different angles to achieve a more comprehensive understanding of the phenomenon under study [ 22 , 23 ].
Data analysis
To analyse the data collected through observations, interviews and focus groups these need to be transcribed into protocols and transcripts (see Fig. 3 ). Interviews and focus groups can be transcribed verbatim , with or without annotations for behaviour (e.g. laughing, crying, pausing) and with or without phonetic transcription of dialects and filler words, depending on what is expected or known to be relevant for the analysis. In the next step, the protocols and transcripts are coded , that is, marked (or tagged, labelled) with one or more short descriptors of the content of a sentence or paragraph [ 2 , 15 , 23 ]. Jansen describes coding as “connecting the raw data with “theoretical” terms” [ 20 ]. In a more practical sense, coding makes raw data sortable. This makes it possible to extract and examine all segments describing, say, a tele-neurology consultation from multiple data sources (e.g. SOPs, emergency room observations, staff and patient interview). In a process of synthesis and abstraction, the codes are then grouped, summarised and/or categorised [ 15 , 20 ]. The end product of the coding or analysis process is a descriptive theory of the behavioural pattern under investigation [ 20 ]. The coding process is performed using qualitative data management software, the most common ones being InVivo, MaxQDA and Atlas.ti. It should be noted that these are data management tools which support the analysis performed by the researcher(s) [ 14 ].
From data collection to data analysis
Attributions for icons: see Fig. 2 , also “Speech to text” by Trevor Dsouza, “Field Notes” by Mike O’Brien, US, “Voice Record” by ProSymbols, US, “Inspection” by Made, AU, and “Cloud” by Graphic Tigers; all from the Noun Project
How to report qualitative research?
Protocols of qualitative research can be published separately and in advance of the study results. However, the aim is not the same as in RCT protocols, i.e. to pre-define and set in stone the research questions and primary or secondary endpoints. Rather, it is a way to describe the research methods in detail, which might not be possible in the results paper given journals’ word limits. Qualitative research papers are usually longer than their quantitative counterparts to allow for deep understanding and so-called “thick description”. In the methods section, the focus is on transparency of the methods used, including why, how and by whom they were implemented in the specific study setting, so as to enable a discussion of whether and how this may have influenced data collection, analysis and interpretation. The results section usually starts with a paragraph outlining the main findings, followed by more detailed descriptions of, for example, the commonalities, discrepancies or exceptions per category [ 20 ]. Here it is important to support main findings by relevant quotations, which may add information, context, emphasis or real-life examples [ 20 , 23 ]. It is subject to debate in the field whether it is relevant to state the exact number or percentage of respondents supporting a certain statement (e.g. “Five interviewees expressed negative feelings towards XYZ”) [ 21 ].
How to combine qualitative with quantitative research?
Qualitative methods can be combined with other methods in multi- or mixed methods designs, which “[employ] two or more different methods [ …] within the same study or research program rather than confining the research to one single method” [ 24 ]. Reasons for combining methods can be diverse, including triangulation for corroboration of findings, complementarity for illustration and clarification of results, expansion to extend the breadth and range of the study, explanation of (unexpected) results generated with one method with the help of another, or offsetting the weakness of one method with the strength of another [ 1 , 17 , 24 – 26 ]. The resulting designs can be classified according to when, why and how the different quantitative and/or qualitative data strands are combined. The three most common types of mixed method designs are the convergent parallel design , the explanatory sequential design and the exploratory sequential design. The designs with examples are shown in Fig. 4 .
Three common mixed methods designs
In the convergent parallel design, a qualitative study is conducted in parallel to and independently of a quantitative study, and the results of both studies are compared and combined at the stage of interpretation of results. Using the above example of EVT provision, this could entail setting up a quantitative EVT registry to measure process times and patient outcomes in parallel to conducting the qualitative research outlined above, and then comparing results. Amongst other things, this would make it possible to assess whether interview respondents’ subjective impressions of patients receiving good care match modified Rankin Scores at follow-up, or whether observed delays in care provision are exceptions or the rule when compared to door-to-needle times as documented in the registry. In the explanatory sequential design, a quantitative study is carried out first, followed by a qualitative study to help explain the results from the quantitative study. This would be an appropriate design if the registry alone had revealed relevant delays in door-to-needle times and the qualitative study would be used to understand where and why these occurred, and how they could be improved. In the exploratory design, the qualitative study is carried out first and its results help informing and building the quantitative study in the next step [ 26 ]. If the qualitative study around EVT provision had shown a high level of dissatisfaction among the staff members involved, a quantitative questionnaire investigating staff satisfaction could be set up in the next step, informed by the qualitative study on which topics dissatisfaction had been expressed. Amongst other things, the questionnaire design would make it possible to widen the reach of the research to more respondents from different (types of) hospitals, regions, countries or settings, and to conduct sub-group analyses for different professional groups.
How to assess qualitative research?
A variety of assessment criteria and lists have been developed for qualitative research, ranging in their focus and comprehensiveness [ 14 , 17 , 27 ]. However, none of these has been elevated to the “gold standard” in the field. In the following, we therefore focus on a set of commonly used assessment criteria that, from a practical standpoint, a researcher can look for when assessing a qualitative research report or paper.
Assessors should check the authors’ use of and adherence to the relevant reporting checklists (e.g. Standards for Reporting Qualitative Research (SRQR)) to make sure all items that are relevant for this type of research are addressed [ 23 , 28 ]. Discussions of quantitative measures in addition to or instead of these qualitative measures can be a sign of lower quality of the research (paper). Providing and adhering to a checklist for qualitative research contributes to an important quality criterion for qualitative research, namely transparency [ 15 , 17 , 23 ].
Reflexivity
While methodological transparency and complete reporting is relevant for all types of research, some additional criteria must be taken into account for qualitative research. This includes what is called reflexivity, i.e. sensitivity to the relationship between the researcher and the researched, including how contact was established and maintained, or the background and experience of the researcher(s) involved in data collection and analysis. Depending on the research question and population to be researched this can be limited to professional experience, but it may also include gender, age or ethnicity [ 17 , 27 ]. These details are relevant because in qualitative research, as opposed to quantitative research, the researcher as a person cannot be isolated from the research process [ 23 ]. It may influence the conversation when an interviewed patient speaks to an interviewer who is a physician, or when an interviewee is asked to discuss a gynaecological procedure with a male interviewer, and therefore the reader must be made aware of these details [ 19 ].
Sampling and saturation
The aim of qualitative sampling is for all variants of the objects of observation that are deemed relevant for the study to be present in the sample “ to see the issue and its meanings from as many angles as possible” [ 1 , 16 , 19 , 20 , 27 ] , and to ensure “information-richness [ 15 ]. An iterative sampling approach is advised, in which data collection (e.g. five interviews) is followed by data analysis, followed by more data collection to find variants that are lacking in the current sample. This process continues until no new (relevant) information can be found and further sampling becomes redundant – which is called saturation [ 1 , 15 ] . In other words: qualitative data collection finds its end point not a priori , but when the research team determines that saturation has been reached [ 29 , 30 ].
This is also the reason why most qualitative studies use deliberate instead of random sampling strategies. This is generally referred to as “ purposive sampling” , in which researchers pre-define which types of participants or cases they need to include so as to cover all variations that are expected to be of relevance, based on the literature, previous experience or theory (i.e. theoretical sampling) [ 14 , 20 ]. Other types of purposive sampling include (but are not limited to) maximum variation sampling, critical case sampling or extreme or deviant case sampling [ 2 ]. In the above EVT example, a purposive sample could include all relevant professional groups and/or all relevant stakeholders (patients, relatives) and/or all relevant times of observation (day, night and weekend shift).
Assessors of qualitative research should check whether the considerations underlying the sampling strategy were sound and whether or how researchers tried to adapt and improve their strategies in stepwise or cyclical approaches between data collection and analysis to achieve saturation [ 14 ].
Good qualitative research is iterative in nature, i.e. it goes back and forth between data collection and analysis, revising and improving the approach where necessary. One example of this are pilot interviews, where different aspects of the interview (especially the interview guide, but also, for example, the site of the interview or whether the interview can be audio-recorded) are tested with a small number of respondents, evaluated and revised [ 19 ]. In doing so, the interviewer learns which wording or types of questions work best, or which is the best length of an interview with patients who have trouble concentrating for an extended time. Of course, the same reasoning applies to observations or focus groups which can also be piloted.
Ideally, coding should be performed by at least two researchers, especially at the beginning of the coding process when a common approach must be defined, including the establishment of a useful coding list (or tree), and when a common meaning of individual codes must be established [ 23 ]. An initial sub-set or all transcripts can be coded independently by the coders and then compared and consolidated after regular discussions in the research team. This is to make sure that codes are applied consistently to the research data.
Member checking
Member checking, also called respondent validation , refers to the practice of checking back with study respondents to see if the research is in line with their views [ 14 , 27 ]. This can happen after data collection or analysis or when first results are available [ 23 ]. For example, interviewees can be provided with (summaries of) their transcripts and asked whether they believe this to be a complete representation of their views or whether they would like to clarify or elaborate on their responses [ 17 ]. Respondents’ feedback on these issues then becomes part of the data collection and analysis [ 27 ].
Stakeholder involvement
In those niches where qualitative approaches have been able to evolve and grow, a new trend has seen the inclusion of patients and their representatives not only as study participants (i.e. “members”, see above) but as consultants to and active participants in the broader research process [ 31 – 33 ]. The underlying assumption is that patients and other stakeholders hold unique perspectives and experiences that add value beyond their own single story, making the research more relevant and beneficial to researchers, study participants and (future) patients alike [ 34 , 35 ]. Using the example of patients on or nearing dialysis, a recent scoping review found that 80% of clinical research did not address the top 10 research priorities identified by patients and caregivers [ 32 , 36 ]. In this sense, the involvement of the relevant stakeholders, especially patients and relatives, is increasingly being seen as a quality indicator in and of itself.
How not to assess qualitative research
The above overview does not include certain items that are routine in assessments of quantitative research. What follows is a non-exhaustive, non-representative, experience-based list of the quantitative criteria often applied to the assessment of qualitative research, as well as an explanation of the limited usefulness of these endeavours.
Protocol adherence
Given the openness and flexibility of qualitative research, it should not be assessed by how well it adheres to pre-determined and fixed strategies – in other words: its rigidity. Instead, the assessor should look for signs of adaptation and refinement based on lessons learned from earlier steps in the research process.
Sample size
For the reasons explained above, qualitative research does not require specific sample sizes, nor does it require that the sample size be determined a priori [ 1 , 14 , 27 , 37 – 39 ]. Sample size can only be a useful quality indicator when related to the research purpose, the chosen methodology and the composition of the sample, i.e. who was included and why.
Randomisation
While some authors argue that randomisation can be used in qualitative research, this is not commonly the case, as neither its feasibility nor its necessity or usefulness has been convincingly established for qualitative research [ 13 , 27 ]. Relevant disadvantages include the negative impact of a too large sample size as well as the possibility (or probability) of selecting “ quiet, uncooperative or inarticulate individuals ” [ 17 ]. Qualitative studies do not use control groups, either.
Interrater reliability, variability and other “objectivity checks”
The concept of “interrater reliability” is sometimes used in qualitative research to assess to which extent the coding approach overlaps between the two co-coders. However, it is not clear what this measure tells us about the quality of the analysis [ 23 ]. This means that these scores can be included in qualitative research reports, preferably with some additional information on what the score means for the analysis, but it is not a requirement. Relatedly, it is not relevant for the quality or “objectivity” of qualitative research to separate those who recruited the study participants and collected and analysed the data. Experiences even show that it might be better to have the same person or team perform all of these tasks [ 20 ]. First, when researchers introduce themselves during recruitment this can enhance trust when the interview takes place days or weeks later with the same researcher. Second, when the audio-recording is transcribed for analysis, the researcher conducting the interviews will usually remember the interviewee and the specific interview situation during data analysis. This might be helpful in providing additional context information for interpretation of data, e.g. on whether something might have been meant as a joke [ 18 ].
Not being quantitative research
Being qualitative research instead of quantitative research should not be used as an assessment criterion if it is used irrespectively of the research problem at hand. Similarly, qualitative research should not be required to be combined with quantitative research per se – unless mixed methods research is judged as inherently better than single-method research. In this case, the same criterion should be applied for quantitative studies without a qualitative component.
The main take-away points of this paper are summarised in Table 1 . We aimed to show that, if conducted well, qualitative research can answer specific research questions that cannot to be adequately answered using (only) quantitative designs. Seeing qualitative and quantitative methods as equal will help us become more aware and critical of the “fit” between the research problem and our chosen methods: I can conduct an RCT to determine the reasons for transportation delays of acute stroke patients – but should I? It also provides us with a greater range of tools to tackle a greater range of research problems more appropriately and successfully, filling in the blind spots on one half of the methodological spectrum to better address the whole complexity of neurological research and practice.
Take-away-points
Acknowledgements
Abbreviations.
Endovascular treatment
Randomised Controlled Trial
Standard Operating Procedure
Standards for Reporting Qualitative Research
Authors’ contributions
LB drafted the manuscript; WW and CG revised the manuscript; all authors approved the final versions.
no external funding.
Availability of data and materials
Not applicable.
Ethics approval and consent to participate
Consent for publication, competing interests.
The authors declare no competing interests.
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
- 1. Philipsen H, Vernooij-Dassen M. Kwalitatief onderzoek: nuttig, onmisbaar en uitdagend. In: PLBJ L, TCo H, editors. Kwalitatief onderzoek: Praktische methoden voor de medische praktijk. Houten: Bohn Stafleu van Loghum; 2007. pp. 5–12. [ Google Scholar ]
- 2. Punch, K. F. (2013). Introduction to social research: Quantitative and qualitative approaches . London: Sage.
- 3. Kelly J, Dwyer J, Willis E, Pekarsky B. Travelling to the city for hospital care: Access factors in country aboriginal patient journeys. Australian Journal of Rural Health. 2014;22(3):109–113. doi: 10.1111/ajr.12094. [ DOI ] [ PubMed ] [ Google Scholar ]
- 4. Nilsen P, Ståhl C, Roback K, Cairney P. Never the twain shall meet? - a comparison of implementation science and policy implementation research. Implementation Science. 2013;8(1):1–12. doi: 10.1186/1748-5908-8-63. [ DOI ] [ PMC free article ] [ PubMed ] [ Google Scholar ]
- 5. Howick J, Chalmers I, Glasziou, P., Greenhalgh, T., Heneghan, C., Liberati, A., Moschetti, I., Phillips, B., & Thornton, H. (2011). The 2011 Oxford CEBM evidence levels of evidence (introductory document) . Oxford Center for Evidence Based Medicine. https://www.cebm.net/2011/06/2011-oxford-cebm-levels-evidence-introductory-document/ .
- 6. Eakin JM. Educating critical qualitative health researchers in the land of the randomized controlled trial. Qualitative Inquiry. 2016;22(2):107–118. doi: 10.1177/1077800415617207. [ DOI ] [ Google Scholar ]
- 7. May A, Mathijssen J. Alternatives for RCTs in the evaluation of effectiveness of interventions!? Final report. 2015. Alternatieven voor RCT bij de evaluatie van effectiviteit van interventies!? Eindrapportage. [ Google Scholar ]
- 8. Berwick DM. The science of improvement. Journal of the American Medical Association. 2008;299(10):1182–1184. doi: 10.1001/jama.299.10.1182. [ DOI ] [ PubMed ] [ Google Scholar ]
- 9. Christ TW. Scientific-based research and randomized controlled trials, the “gold” standard? Alternative paradigms and mixed methodologies. Qualitative Inquiry. 2014;20(1):72–80. doi: 10.1177/1077800413508523. [ DOI ] [ Google Scholar ]
- 10. Lamont, T., Barber, N., Jd, P., Fulop, N., Garfield-Birkbeck, S., Lilford, R., Mear, L., Raine, R., & Fitzpatrick, R. (2016). New approaches to evaluating complex health and care systems. BMJ, 352:i154. [ DOI ] [ PubMed ]
- 11. Drabble SJ, O’Cathain A. Moving from Randomized Controlled Trials to Mixed Methods Intervention Evaluation. In: Hesse-Biber S, Johnson RB, editors. The Oxford Handbook of Multimethod and Mixed Methods Research Inquiry. London: Oxford University Press; 2015. pp. 406–425. [ Google Scholar ]
- 12. Chambers DA, Glasgow RE, Stange KC. The dynamic sustainability framework: Addressing the paradox of sustainment amid ongoing change. Implementation Science : IS. 2013;8:117. doi: 10.1186/1748-5908-8-117. [ DOI ] [ PMC free article ] [ PubMed ] [ Google Scholar ]
- 13. Hak T. Waarnemingsmethoden in kwalitatief onderzoek. In: PLBJ L, TCo H, editors. Kwalitatief onderzoek: Praktische methoden voor de medische praktijk. Houten: Bohn Stafleu van Loghum; 2007. pp. 13–25. [ Google Scholar ]
- 14. Russell CK, Gregory DM. Evaluation of qualitative research studies. Evidence Based Nursing. 2003;6(2):36–40. doi: 10.1136/ebn.6.2.36. [ DOI ] [ PubMed ] [ Google Scholar ]
- 15. Fossey E, Harvey C, McDermott F, Davidson L. Understanding and evaluating qualitative research. Australian and New Zealand Journal of Psychiatry. 2002;36:717–732. doi: 10.1046/j.1440-1614.2002.01100.x. [ DOI ] [ PubMed ] [ Google Scholar ]
- 16. Yanow, D. (2000). Conducting interpretive policy analysis (Vol. 47). Thousand Oaks: Sage University Papers Series on Qualitative Research Methods.
- 17. Shenton AK. Strategies for ensuring trustworthiness in qualitative research projects. Education for Information. 2004;22:63–75. doi: 10.3233/EFI-2004-22201. [ DOI ] [ Google Scholar ]
- 18. van der Geest S. Participeren in ziekte en zorg: meer over kwalitatief onderzoek. Huisarts en Wetenschap. 2006;49(4):283–287. doi: 10.1007/BF03084704. [ DOI ] [ Google Scholar ]
- 19. Hijmans E, Kuyper M. Het halfopen interview als onderzoeksmethode. In: PLBJ L, TCo H, editors. Kwalitatief onderzoek: Praktische methoden voor de medische praktijk. Houten: Bohn Stafleu van Loghum; 2007. pp. 43–51. [ Google Scholar ]
- 20. Jansen H. Systematiek en toepassing van de kwalitatieve survey. In: PLBJ L, TCo H, editors. Kwalitatief onderzoek: Praktische methoden voor de medische praktijk. Houten: Bohn Stafleu van Loghum; 2007. pp. 27–41. [ Google Scholar ]
- 21. Pv R, Peremans L. Exploreren met focusgroepgesprekken: de ‘stem’ van de groep onder de loep. In: PLBJ L, TCo H, editors. Kwalitatief onderzoek: Praktische methoden voor de medische praktijk. Houten: Bohn Stafleu van Loghum; 2007. pp. 53–64. [ Google Scholar ]
- 22. Carter N, Bryant-Lukosius D, DiCenso A, Blythe J, Neville AJ. The use of triangulation in qualitative research. Oncology Nursing Forum. 2014;41(5):545–547. doi: 10.1188/14.ONF.545-547. [ DOI ] [ PubMed ] [ Google Scholar ]
- 23. Boeije H. Analyseren in kwalitatief onderzoek: Denken en doen. 2012. [ Google Scholar ]
- 24. Hunter A, Brewer J. Designing Multimethod Research. In: Hesse-Biber S, Johnson RB, editors. The Oxford Handbook of Multimethod and Mixed Methods Research Inquiry. London: Oxford University Press; 2015. pp. 185–205. [ Google Scholar ]
- 25. Archibald MM, Radil AI, Zhang X, Hanson WE. Current mixed methods practices in qualitative research: A content analysis of leading journals. International Journal of Qualitative Methods. 2015;14(2):5–33. doi: 10.1177/160940691501400205. [ DOI ] [ Google Scholar ]
- 26. Creswell, J. W., & Plano Clark, V. L. (2011). Choosing a Mixed Methods Design. In Designing and Conducting Mixed Methods Research . Thousand Oaks: SAGE Publications.
- 27. Mays N, Pope C. Assessing quality in qualitative research. BMJ. 2000;320(7226):50–52. doi: 10.1136/bmj.320.7226.50. [ DOI ] [ PMC free article ] [ PubMed ] [ Google Scholar ]
- 28. O'Brien BC, Harris IB, Beckman TJ, Reed DA, Cook DA. Standards for reporting qualitative research: A synthesis of recommendations. Academic Medicine : Journal of the Association of American Medical Colleges. 2014;89(9):1245–1251. doi: 10.1097/ACM.0000000000000388. [ DOI ] [ PubMed ] [ Google Scholar ]
- 29. Saunders B, Sim J, Kingstone T, Baker S, Waterfield J, Bartlam B, Burroughs H, Jinks C. Saturation in qualitative research: Exploring its conceptualization and operationalization. Quality and Quantity. 2018;52(4):1893–1907. doi: 10.1007/s11135-017-0574-8. [ DOI ] [ PMC free article ] [ PubMed ] [ Google Scholar ]
- 30. Moser A, Korstjens I. Series: Practical guidance to qualitative research. Part 3: Sampling, data collection and analysis. European Journal of General Practice. 2018;24(1):9–18. doi: 10.1080/13814788.2017.1375091. [ DOI ] [ PMC free article ] [ PubMed ] [ Google Scholar ]
- 31. Marlett N, Shklarov S, Marshall D, Santana MJ, Wasylak T. Building new roles and relationships in research: A model of patient engagement research. Quality of Life Research : an international journal of quality of life aspects of treatment, care and rehabilitation. 2015;24(5):1057–1067. doi: 10.1007/s11136-014-0845-y. [ DOI ] [ PubMed ] [ Google Scholar ]
- 32. Demian MN, Lam NN, Mac-Way F, Sapir-Pichhadze R, Fernandez N. Opportunities for engaging patients in kidney research. Canadian Journal of Kidney Health and Disease. 2017;4:2054358117703070–2054358117703070. doi: 10.1177/2054358117703070. [ DOI ] [ PMC free article ] [ PubMed ] [ Google Scholar ]
- 33. Noyes Jane, Mclaughlin Leah, Morgan Karen, Roberts Abigail, Stephens Michael, Bourne Janette, Houlston Michael, Houlston Jessica, Thomas Sarah, Rhys Revd Gethin, Moss Bethan, Duncalf Sue, Lee Dawn, Curtis Rebecca, Madden Susanna, Walton Phillip. Designing a co‐productive study to overcome known methodological challenges in organ donation research with bereaved family members. Health Expectations. 2019;22(4):824–835. doi: 10.1111/hex.12894. [ DOI ] [ PMC free article ] [ PubMed ] [ Google Scholar ]
- 34. Piil K, Jarden M, Pii KH. Research agenda for life-threatening cancer. European Journal Cancer Care (Engl) 2019;28(1):e12935. doi: 10.1111/ecc.12935. [ DOI ] [ PubMed ] [ Google Scholar ]
- 35. Hofmann D, Ibrahim F, Rose D, Scott DL, Cope A, Wykes T, Lempp H. Expectations of new treatment in rheumatoid arthritis: Developing a patient-generated questionnaire. Health Expectations : an international journal of public participation in health care and health policy. 2015;18(5):995–1008. doi: 10.1111/hex.12073. [ DOI ] [ PMC free article ] [ PubMed ] [ Google Scholar ]
- 36. Jun M, Manns B, Laupacis A, Manns L, Rehal B, Crowe S, Hemmelgarn BR. Assessing the extent to which current clinical research is consistent with patient priorities: A scoping review using a case study in patients on or nearing dialysis. Canadian Journal of Kidney Health and Disease. 2015;2:35. doi: 10.1186/s40697-015-0035-z. [ DOI ] [ PMC free article ] [ PubMed ] [ Google Scholar ]
- 37. Elsie Baker, S., & Edwards, R. (2012). How many qualitative interviews is enough? In National Centre for Research Methods Review Paper . National Centre for Research Methods. http://eprints.ncrm.ac.uk/2273/4/how_many_interviews.pdf .
- 38. Sandelowski M. Sample size in qualitative research. Research in Nursing & Health. 1995;18(2):179–183. doi: 10.1002/nur.4770180211. [ DOI ] [ PubMed ] [ Google Scholar ]
- 39. Sim J, Saunders B, Waterfield J, Kingstone T. Can sample size in qualitative research be determined a priori? International Journal of Social Research Methodology. 2018;21(5):619–634. doi: 10.1080/13645579.2018.1454643. [ DOI ] [ Google Scholar ]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Data Availability Statement
- View on publisher site
- PDF (904.5 KB)
- Collections
Similar articles
Cited by other articles, links to ncbi databases.
- Download .nbib .nbib
- Format: AMA APA MLA NLM
Add to Collections
Chapter 1. Introduction
“Science is in danger, and for that reason it is becoming dangerous” -Pierre Bourdieu, Science of Science and Reflexivity
Why an Open Access Textbook on Qualitative Research Methods?
I have been teaching qualitative research methods to both undergraduates and graduate students for many years. Although there are some excellent textbooks out there, they are often costly, and none of them, to my mind, properly introduces qualitative research methods to the beginning student (whether undergraduate or graduate student). In contrast, this open-access textbook is designed as a (free) true introduction to the subject, with helpful, practical pointers on how to conduct research and how to access more advanced instruction.
Textbooks are typically arranged in one of two ways: (1) by technique (each chapter covers one method used in qualitative research); or (2) by process (chapters advance from research design through publication). But both of these approaches are necessary for the beginner student. This textbook will have sections dedicated to the process as well as the techniques of qualitative research. This is a true “comprehensive” book for the beginning student. In addition to covering techniques of data collection and data analysis, it provides a road map of how to get started and how to keep going and where to go for advanced instruction. It covers aspects of research design and research communication as well as methods employed. Along the way, it includes examples from many different disciplines in the social sciences.
The primary goal has been to create a useful, accessible, engaging textbook for use across many disciplines. And, let’s face it. Textbooks can be boring. I hope readers find this to be a little different. I have tried to write in a practical and forthright manner, with many lively examples and references to good and intellectually creative qualitative research. Woven throughout the text are short textual asides (in colored textboxes) by professional (academic) qualitative researchers in various disciplines. These short accounts by practitioners should help inspire students. So, let’s begin!
What is Research?
When we use the word research , what exactly do we mean by that? This is one of those words that everyone thinks they understand, but it is worth beginning this textbook with a short explanation. We use the term to refer to “empirical research,” which is actually a historically specific approach to understanding the world around us. Think about how you know things about the world. [1] You might know your mother loves you because she’s told you she does. Or because that is what “mothers” do by tradition. Or you might know because you’ve looked for evidence that she does, like taking care of you when you are sick or reading to you in bed or working two jobs so you can have the things you need to do OK in life. Maybe it seems churlish to look for evidence; you just take it “on faith” that you are loved.
Only one of the above comes close to what we mean by research. Empirical research is research (investigation) based on evidence. Conclusions can then be drawn from observable data. This observable data can also be “tested” or checked. If the data cannot be tested, that is a good indication that we are not doing research. Note that we can never “prove” conclusively, through observable data, that our mothers love us. We might have some “disconfirming evidence” (that time she didn’t show up to your graduation, for example) that could push you to question an original hypothesis , but no amount of “confirming evidence” will ever allow us to say with 100% certainty, “my mother loves me.” Faith and tradition and authority work differently. Our knowledge can be 100% certain using each of those alternative methods of knowledge, but our certainty in those cases will not be based on facts or evidence.
For many periods of history, those in power have been nervous about “science” because it uses evidence and facts as the primary source of understanding the world, and facts can be at odds with what power or authority or tradition want you to believe. That is why I say that scientific empirical research is a historically specific approach to understand the world. You are in college or university now partly to learn how to engage in this historically specific approach.
In the sixteenth and seventeenth centuries in Europe, there was a newfound respect for empirical research, some of which was seriously challenging to the established church. Using observations and testing them, scientists found that the earth was not at the center of the universe, for example, but rather that it was but one planet of many which circled the sun. [2] For the next two centuries, the science of astronomy, physics, biology, and chemistry emerged and became disciplines taught in universities. All used the scientific method of observation and testing to advance knowledge. Knowledge about people , however, and social institutions, however, was still left to faith, tradition, and authority. Historians and philosophers and poets wrote about the human condition, but none of them used research to do so. [3]
It was not until the nineteenth century that “social science” really emerged, using the scientific method (empirical observation) to understand people and social institutions. New fields of sociology, economics, political science, and anthropology emerged. The first sociologists, people like Auguste Comte and Karl Marx, sought specifically to apply the scientific method of research to understand society, Engels famously claiming that Marx had done for the social world what Darwin did for the natural world, tracings its laws of development. Today we tend to take for granted the naturalness of science here, but it is actually a pretty recent and radical development.
To return to the question, “does your mother love you?” Well, this is actually not really how a researcher would frame the question, as it is too specific to your case. It doesn’t tell us much about the world at large, even if it does tell us something about you and your relationship with your mother. A social science researcher might ask, “do mothers love their children?” Or maybe they would be more interested in how this loving relationship might change over time (e.g., “do mothers love their children more now than they did in the 18th century when so many children died before reaching adulthood?”) or perhaps they might be interested in measuring quality of love across cultures or time periods, or even establishing “what love looks like” using the mother/child relationship as a site of exploration. All of these make good research questions because we can use observable data to answer them.
What is Qualitative Research?
“All we know is how to learn. How to study, how to listen, how to talk, how to tell. If we don’t tell the world, we don’t know the world. We’re lost in it, we die.” -Ursula LeGuin, The Telling
At its simplest, qualitative research is research about the social world that does not use numbers in its analyses. All those who fear statistics can breathe a sigh of relief – there are no mathematical formulae or regression models in this book! But this definition is less about what qualitative research can be and more about what it is not. To be honest, any simple statement will fail to capture the power and depth of qualitative research. One way of contrasting qualitative research to quantitative research is to note that the focus of qualitative research is less about explaining and predicting relationships between variables and more about understanding the social world. To use our mother love example, the question about “what love looks like” is a good question for the qualitative researcher while all questions measuring love or comparing incidences of love (both of which require measurement) are good questions for quantitative researchers. Patton writes,
Qualitative data describe. They take us, as readers, into the time and place of the observation so that we know what it was like to have been there. They capture and communicate someone else’s experience of the world in his or her own words. Qualitative data tell a story. ( Patton 2002:47 )
Qualitative researchers are asking different questions about the world than their quantitative colleagues. Even when researchers are employed in “mixed methods” research ( both quantitative and qualitative), they are using different methods to address different questions of the study. I do a lot of research about first-generation and working-college college students. Where a quantitative researcher might ask, how many first-generation college students graduate from college within four years? Or does first-generation college status predict high student debt loads? A qualitative researcher might ask, how does the college experience differ for first-generation college students? What is it like to carry a lot of debt, and how does this impact the ability to complete college on time? Both sets of questions are important, but they can only be answered using specific tools tailored to those questions. For the former, you need large numbers to make adequate comparisons. For the latter, you need to talk to people, find out what they are thinking and feeling, and try to inhabit their shoes for a little while so you can make sense of their experiences and beliefs.
Examples of Qualitative Research
You have probably seen examples of qualitative research before, but you might not have paid particular attention to how they were produced or realized that the accounts you were reading were the result of hours, months, even years of research “in the field.” A good qualitative researcher will present the product of their hours of work in such a way that it seems natural, even obvious, to the reader. Because we are trying to convey what it is like answers, qualitative research is often presented as stories – stories about how people live their lives, go to work, raise their children, interact with one another. In some ways, this can seem like reading particularly insightful novels. But, unlike novels, there are very specific rules and guidelines that qualitative researchers follow to ensure that the “story” they are telling is accurate , a truthful rendition of what life is like for the people being studied. Most of this textbook will be spent conveying those rules and guidelines. Let’s take a look, first, however, at three examples of what the end product looks like. I have chosen these three examples to showcase very different approaches to qualitative research, and I will return to these five examples throughout the book. They were all published as whole books (not chapters or articles), and they are worth the long read, if you have the time. I will also provide some information on how these books came to be and the length of time it takes to get them into book version. It is important you know about this process, and the rest of this textbook will help explain why it takes so long to conduct good qualitative research!
Example 1 : The End Game (ethnography + interviews)
Corey Abramson is a sociologist who teaches at the University of Arizona. In 2015 he published The End Game: How Inequality Shapes our Final Years ( 2015 ). This book was based on the research he did for his dissertation at the University of California-Berkeley in 2012. Actually, the dissertation was completed in 2012 but the work that was produced that took several years. The dissertation was entitled, “This is How We Live, This is How We Die: Social Stratification, Aging, and Health in Urban America” ( 2012 ). You can see how the book version, which was written for a more general audience, has a more engaging sound to it, but that the dissertation version, which is what academic faculty read and evaluate, has a more descriptive title. You can read the title and know that this is a study about aging and health and that the focus is going to be inequality and that the context (place) is going to be “urban America.” It’s a study about “how” people do something – in this case, how they deal with aging and death. This is the very first sentence of the dissertation, “From our first breath in the hospital to the day we die, we live in a society characterized by unequal opportunities for maintaining health and taking care of ourselves when ill. These disparities reflect persistent racial, socio-economic, and gender-based inequalities and contribute to their persistence over time” ( 1 ). What follows is a truthful account of how that is so.
Cory Abramson spent three years conducting his research in four different urban neighborhoods. We call the type of research he conducted “comparative ethnographic” because he designed his study to compare groups of seniors as they went about their everyday business. It’s comparative because he is comparing different groups (based on race, class, gender) and ethnographic because he is studying the culture/way of life of a group. [4] He had an educated guess, rooted in what previous research had shown and what social theory would suggest, that people’s experiences of aging differ by race, class, and gender. So, he set up a research design that would allow him to observe differences. He chose two primarily middle-class (one was racially diverse and the other was predominantly White) and two primarily poor neighborhoods (one was racially diverse and the other was predominantly African American). He hung out in senior centers and other places seniors congregated, watched them as they took the bus to get prescriptions filled, sat in doctor’s offices with them, and listened to their conversations with each other. He also conducted more formal conversations, what we call in-depth interviews, with sixty seniors from each of the four neighborhoods. As with a lot of fieldwork , as he got closer to the people involved, he both expanded and deepened his reach –
By the end of the project, I expanded my pool of general observations to include various settings frequented by seniors: apartment building common rooms, doctors’ offices, emergency rooms, pharmacies, senior centers, bars, parks, corner stores, shopping centers, pool halls, hair salons, coffee shops, and discount stores. Over the course of the three years of fieldwork, I observed hundreds of elders, and developed close relationships with a number of them. ( 2012:10 )
When Abramson rewrote the dissertation for a general audience and published his book in 2015, it got a lot of attention. It is a beautifully written book and it provided insight into a common human experience that we surprisingly know very little about. It won the Outstanding Publication Award by the American Sociological Association Section on Aging and the Life Course and was featured in the New York Times . The book was about aging, and specifically how inequality shapes the aging process, but it was also about much more than that. It helped show how inequality affects people’s everyday lives. For example, by observing the difficulties the poor had in setting up appointments and getting to them using public transportation and then being made to wait to see a doctor, sometimes in standing-room-only situations, when they are unwell, and then being treated dismissively by hospital staff, Abramson allowed readers to feel the material reality of being poor in the US. Comparing these examples with seniors with adequate supplemental insurance who have the resources to hire car services or have others assist them in arranging care when they need it, jolts the reader to understand and appreciate the difference money makes in the lives and circumstances of us all, and in a way that is different than simply reading a statistic (“80% of the poor do not keep regular doctor’s appointments”) does. Qualitative research can reach into spaces and places that often go unexamined and then reports back to the rest of us what it is like in those spaces and places.
Example 2: Racing for Innocence (Interviews + Content Analysis + Fictional Stories)
Jennifer Pierce is a Professor of American Studies at the University of Minnesota. Trained as a sociologist, she has written a number of books about gender, race, and power. Her very first book, Gender Trials: Emotional Lives in Contemporary Law Firms, published in 1995, is a brilliant look at gender dynamics within two law firms. Pierce was a participant observer, working as a paralegal, and she observed how female lawyers and female paralegals struggled to obtain parity with their male colleagues.
Fifteen years later, she reexamined the context of the law firm to include an examination of racial dynamics, particularly how elite white men working in these spaces created and maintained a culture that made it difficult for both female attorneys and attorneys of color to thrive. Her book, Racing for Innocence: Whiteness, Gender, and the Backlash Against Affirmative Action , published in 2012, is an interesting and creative blending of interviews with attorneys, content analyses of popular films during this period, and fictional accounts of racial discrimination and sexual harassment. The law firm she chose to study had come under an affirmative action order and was in the process of implementing equitable policies and programs. She wanted to understand how recipients of white privilege (the elite white male attorneys) come to deny the role they play in reproducing inequality. Through interviews with attorneys who were present both before and during the affirmative action order, she creates a historical record of the “bad behavior” that necessitated new policies and procedures, but also, and more importantly , probed the participants ’ understanding of this behavior. It should come as no surprise that most (but not all) of the white male attorneys saw little need for change, and that almost everyone else had accounts that were different if not sometimes downright harrowing.
I’ve used Pierce’s book in my qualitative research methods courses as an example of an interesting blend of techniques and presentation styles. My students often have a very difficult time with the fictional accounts she includes. But they serve an important communicative purpose here. They are her attempts at presenting “both sides” to an objective reality – something happens (Pierce writes this something so it is very clear what it is), and the two participants to the thing that happened have very different understandings of what this means. By including these stories, Pierce presents one of her key findings – people remember things differently and these different memories tend to support their own ideological positions. I wonder what Pierce would have written had she studied the murder of George Floyd or the storming of the US Capitol on January 6 or any number of other historic events whose observers and participants record very different happenings.
This is not to say that qualitative researchers write fictional accounts. In fact, the use of fiction in our work remains controversial. When used, it must be clearly identified as a presentation device, as Pierce did. I include Racing for Innocence here as an example of the multiple uses of methods and techniques and the way that these work together to produce better understandings by us, the readers, of what Pierce studied. We readers come away with a better grasp of how and why advantaged people understate their own involvement in situations and structures that advantage them. This is normal human behavior , in other words. This case may have been about elite white men in law firms, but the general insights here can be transposed to other settings. Indeed, Pierce argues that more research needs to be done about the role elites play in the reproduction of inequality in the workplace in general.
Example 3: Amplified Advantage (Mixed Methods: Survey Interviews + Focus Groups + Archives)
The final example comes from my own work with college students, particularly the ways in which class background affects the experience of college and outcomes for graduates. I include it here as an example of mixed methods, and for the use of supplementary archival research. I’ve done a lot of research over the years on first-generation, low-income, and working-class college students. I am curious (and skeptical) about the possibility of social mobility today, particularly with the rising cost of college and growing inequality in general. As one of the few people in my family to go to college, I didn’t grow up with a lot of examples of what college was like or how to make the most of it. And when I entered graduate school, I realized with dismay that there were very few people like me there. I worried about becoming too different from my family and friends back home. And I wasn’t at all sure that I would ever be able to pay back the huge load of debt I was taking on. And so I wrote my dissertation and first two books about working-class college students. These books focused on experiences in college and the difficulties of navigating between family and school ( Hurst 2010a, 2012 ). But even after all that research, I kept coming back to wondering if working-class students who made it through college had an equal chance at finding good jobs and happy lives,
What happens to students after college? Do working-class students fare as well as their peers? I knew from my own experience that barriers continued through graduate school and beyond, and that my debtload was higher than that of my peers, constraining some of the choices I made when I graduated. To answer these questions, I designed a study of students attending small liberal arts colleges, the type of college that tried to equalize the experience of students by requiring all students to live on campus and offering small classes with lots of interaction with faculty. These private colleges tend to have more money and resources so they can provide financial aid to low-income students. They also attract some very wealthy students. Because they enroll students across the class spectrum, I would be able to draw comparisons. I ended up spending about four years collecting data, both a survey of more than 2000 students (which formed the basis for quantitative analyses) and qualitative data collection (interviews, focus groups, archival research, and participant observation). This is what we call a “mixed methods” approach because we use both quantitative and qualitative data. The survey gave me a large enough number of students that I could make comparisons of the how many kind, and to be able to say with some authority that there were in fact significant differences in experience and outcome by class (e.g., wealthier students earned more money and had little debt; working-class students often found jobs that were not in their chosen careers and were very affected by debt, upper-middle-class students were more likely to go to graduate school). But the survey analyses could not explain why these differences existed. For that, I needed to talk to people and ask them about their motivations and aspirations. I needed to understand their perceptions of the world, and it is very hard to do this through a survey.
By interviewing students and recent graduates, I was able to discern particular patterns and pathways through college and beyond. Specifically, I identified three versions of gameplay. Upper-middle-class students, whose parents were themselves professionals (academics, lawyers, managers of non-profits), saw college as the first stage of their education and took classes and declared majors that would prepare them for graduate school. They also spent a lot of time building their resumes, taking advantage of opportunities to help professors with their research, or study abroad. This helped them gain admission to highly-ranked graduate schools and interesting jobs in the public sector. In contrast, upper-class students, whose parents were wealthy and more likely to be engaged in business (as CEOs or other high-level directors), prioritized building social capital. They did this by joining fraternities and sororities and playing club sports. This helped them when they graduated as they called on friends and parents of friends to find them well-paying jobs. Finally, low-income, first-generation, and working-class students were often adrift. They took the classes that were recommended to them but without the knowledge of how to connect them to life beyond college. They spent time working and studying rather than partying or building their resumes. All three sets of students thought they were “doing college” the right way, the way that one was supposed to do college. But these three versions of gameplay led to distinct outcomes that advantaged some students over others. I titled my work “Amplified Advantage” to highlight this process.
These three examples, Cory Abramson’s The End Game , Jennifer Peirce’s Racing for Innocence, and my own Amplified Advantage, demonstrate the range of approaches and tools available to the qualitative researcher. They also help explain why qualitative research is so important. Numbers can tell us some things about the world, but they cannot get at the hearts and minds, motivations and beliefs of the people who make up the social worlds we inhabit. For that, we need tools that allow us to listen and make sense of what people tell us and show us. That is what good qualitative research offers us.
How Is This Book Organized?
This textbook is organized as a comprehensive introduction to the use of qualitative research methods. The first half covers general topics (e.g., approaches to qualitative research, ethics) and research design (necessary steps for building a successful qualitative research study). The second half reviews various data collection and data analysis techniques. Of course, building a successful qualitative research study requires some knowledge of data collection and data analysis so the chapters in the first half and the chapters in the second half should be read in conversation with each other. That said, each chapter can be read on its own for assistance with a particular narrow topic. In addition to the chapters, a helpful glossary can be found in the back of the book. Rummage around in the text as needed.
Chapter Descriptions
Chapter 2 provides an overview of the Research Design Process. How does one begin a study? What is an appropriate research question? How is the study to be done – with what methods ? Involving what people and sites? Although qualitative research studies can and often do change and develop over the course of data collection, it is important to have a good idea of what the aims and goals of your study are at the outset and a good plan of how to achieve those aims and goals. Chapter 2 provides a road map of the process.
Chapter 3 describes and explains various ways of knowing the (social) world. What is it possible for us to know about how other people think or why they behave the way they do? What does it mean to say something is a “fact” or that it is “well-known” and understood? Qualitative researchers are particularly interested in these questions because of the types of research questions we are interested in answering (the how questions rather than the how many questions of quantitative research). Qualitative researchers have adopted various epistemological approaches. Chapter 3 will explore these approaches, highlighting interpretivist approaches that acknowledge the subjective aspect of reality – in other words, reality and knowledge are not objective but rather influenced by (interpreted through) people.
Chapter 4 focuses on the practical matter of developing a research question and finding the right approach to data collection. In any given study (think of Cory Abramson’s study of aging, for example), there may be years of collected data, thousands of observations , hundreds of pages of notes to read and review and make sense of. If all you had was a general interest area (“aging”), it would be very difficult, nearly impossible, to make sense of all of that data. The research question provides a helpful lens to refine and clarify (and simplify) everything you find and collect. For that reason, it is important to pull out that lens (articulate the research question) before you get started. In the case of the aging study, Cory Abramson was interested in how inequalities affected understandings and responses to aging. It is for this reason he designed a study that would allow him to compare different groups of seniors (some middle-class, some poor). Inevitably, he saw much more in the three years in the field than what made it into his book (or dissertation), but he was able to narrow down the complexity of the social world to provide us with this rich account linked to the original research question. Developing a good research question is thus crucial to effective design and a successful outcome. Chapter 4 will provide pointers on how to do this. Chapter 4 also provides an overview of general approaches taken to doing qualitative research and various “traditions of inquiry.”
Chapter 5 explores sampling . After you have developed a research question and have a general idea of how you will collect data (Observations? Interviews?), how do you go about actually finding people and sites to study? Although there is no “correct number” of people to interview , the sample should follow the research question and research design. Unlike quantitative research, qualitative research involves nonprobability sampling. Chapter 5 explains why this is so and what qualities instead make a good sample for qualitative research.
Chapter 6 addresses the importance of reflexivity in qualitative research. Related to epistemological issues of how we know anything about the social world, qualitative researchers understand that we the researchers can never be truly neutral or outside the study we are conducting. As observers, we see things that make sense to us and may entirely miss what is either too obvious to note or too different to comprehend. As interviewers, as much as we would like to ask questions neutrally and remain in the background, interviews are a form of conversation, and the persons we interview are responding to us . Therefore, it is important to reflect upon our social positions and the knowledges and expectations we bring to our work and to work through any blind spots that we may have. Chapter 6 provides some examples of reflexivity in practice and exercises for thinking through one’s own biases.
Chapter 7 is a very important chapter and should not be overlooked. As a practical matter, it should also be read closely with chapters 6 and 8. Because qualitative researchers deal with people and the social world, it is imperative they develop and adhere to a strong ethical code for conducting research in a way that does not harm. There are legal requirements and guidelines for doing so (see chapter 8), but these requirements should not be considered synonymous with the ethical code required of us. Each researcher must constantly interrogate every aspect of their research, from research question to design to sample through analysis and presentation, to ensure that a minimum of harm (ideally, zero harm) is caused. Because each research project is unique, the standards of care for each study are unique. Part of being a professional researcher is carrying this code in one’s heart, being constantly attentive to what is required under particular circumstances. Chapter 7 provides various research scenarios and asks readers to weigh in on the suitability and appropriateness of the research. If done in a class setting, it will become obvious fairly quickly that there are often no absolutely correct answers, as different people find different aspects of the scenarios of greatest importance. Minimizing the harm in one area may require possible harm in another. Being attentive to all the ethical aspects of one’s research and making the best judgments one can, clearly and consciously, is an integral part of being a good researcher.
Chapter 8 , best to be read in conjunction with chapter 7, explains the role and importance of Institutional Review Boards (IRBs) . Under federal guidelines, an IRB is an appropriately constituted group that has been formally designated to review and monitor research involving human subjects . Every institution that receives funding from the federal government has an IRB. IRBs have the authority to approve, require modifications to (to secure approval), or disapprove research. This group review serves an important role in the protection of the rights and welfare of human research subjects. Chapter 8 reviews the history of IRBs and the work they do but also argues that IRBs’ review of qualitative research is often both over-inclusive and under-inclusive. Some aspects of qualitative research are not well understood by IRBs, given that they were developed to prevent abuses in biomedical research. Thus, it is important not to rely on IRBs to identify all the potential ethical issues that emerge in our research (see chapter 7).
Chapter 9 provides help for getting started on formulating a research question based on gaps in the pre-existing literature. Research is conducted as part of a community, even if particular studies are done by single individuals (or small teams). What any of us finds and reports back becomes part of a much larger body of knowledge. Thus, it is important that we look at the larger body of knowledge before we actually start our bit to see how we can best contribute. When I first began interviewing working-class college students, there was only one other similar study I could find, and it hadn’t been published (it was a dissertation of students from poor backgrounds). But there had been a lot published by professors who had grown up working class and made it through college despite the odds. These accounts by “working-class academics” became an important inspiration for my study and helped me frame the questions I asked the students I interviewed. Chapter 9 will provide some pointers on how to search for relevant literature and how to use this to refine your research question.
Chapter 10 serves as a bridge between the two parts of the textbook, by introducing techniques of data collection. Qualitative research is often characterized by the form of data collection – for example, an ethnographic study is one that employs primarily observational data collection for the purpose of documenting and presenting a particular culture or ethnos. Techniques can be effectively combined, depending on the research question and the aims and goals of the study. Chapter 10 provides a general overview of all the various techniques and how they can be combined.
The second part of the textbook moves into the doing part of qualitative research once the research question has been articulated and the study designed. Chapters 11 through 17 cover various data collection techniques and approaches. Chapters 18 and 19 provide a very simple overview of basic data analysis. Chapter 20 covers communication of the data to various audiences, and in various formats.
Chapter 11 begins our overview of data collection techniques with a focus on interviewing , the true heart of qualitative research. This technique can serve as the primary and exclusive form of data collection, or it can be used to supplement other forms (observation, archival). An interview is distinct from a survey, where questions are asked in a specific order and often with a range of predetermined responses available. Interviews can be conversational and unstructured or, more conventionally, semistructured , where a general set of interview questions “guides” the conversation. Chapter 11 covers the basics of interviews: how to create interview guides, how many people to interview, where to conduct the interview, what to watch out for (how to prepare against things going wrong), and how to get the most out of your interviews.
Chapter 12 covers an important variant of interviewing, the focus group. Focus groups are semistructured interviews with a group of people moderated by a facilitator (the researcher or researcher’s assistant). Focus groups explicitly use group interaction to assist in the data collection. They are best used to collect data on a specific topic that is non-personal and shared among the group. For example, asking a group of college students about a common experience such as taking classes by remote delivery during the pandemic year of 2020. Chapter 12 covers the basics of focus groups: when to use them, how to create interview guides for them, and how to run them effectively.
Chapter 13 moves away from interviewing to the second major form of data collection unique to qualitative researchers – observation . Qualitative research that employs observation can best be understood as falling on a continuum of “fly on the wall” observation (e.g., observing how strangers interact in a doctor’s waiting room) to “participant” observation, where the researcher is also an active participant of the activity being observed. For example, an activist in the Black Lives Matter movement might want to study the movement, using her inside position to gain access to observe key meetings and interactions. Chapter 13 covers the basics of participant observation studies: advantages and disadvantages, gaining access, ethical concerns related to insider/outsider status and entanglement, and recording techniques.
Chapter 14 takes a closer look at “deep ethnography” – immersion in the field of a particularly long duration for the purpose of gaining a deeper understanding and appreciation of a particular culture or social world. Clifford Geertz called this “deep hanging out.” Whereas participant observation is often combined with semistructured interview techniques, deep ethnography’s commitment to “living the life” or experiencing the situation as it really is demands more conversational and natural interactions with people. These interactions and conversations may take place over months or even years. As can be expected, there are some costs to this technique, as well as some very large rewards when done competently. Chapter 14 provides some examples of deep ethnographies that will inspire some beginning researchers and intimidate others.
Chapter 15 moves in the opposite direction of deep ethnography, a technique that is the least positivist of all those discussed here, to mixed methods , a set of techniques that is arguably the most positivist . A mixed methods approach combines both qualitative data collection and quantitative data collection, commonly by combining a survey that is analyzed statistically (e.g., cross-tabs or regression analyses of large number probability samples) with semi-structured interviews. Although it is somewhat unconventional to discuss mixed methods in textbooks on qualitative research, I think it is important to recognize this often-employed approach here. There are several advantages and some disadvantages to taking this route. Chapter 16 will describe those advantages and disadvantages and provide some particular guidance on how to design a mixed methods study for maximum effectiveness.
Chapter 16 covers data collection that does not involve live human subjects at all – archival and historical research (chapter 17 will also cover data that does not involve interacting with human subjects). Sometimes people are unavailable to us, either because they do not wish to be interviewed or observed (as is the case with many “elites”) or because they are too far away, in both place and time. Fortunately, humans leave many traces and we can often answer questions we have by examining those traces. Special collections and archives can be goldmines for social science research. This chapter will explain how to access these places, for what purposes, and how to begin to make sense of what you find.
Chapter 17 covers another data collection area that does not involve face-to-face interaction with humans: content analysis . Although content analysis may be understood more properly as a data analysis technique, the term is often used for the entire approach, which will be the case here. Content analysis involves interpreting meaning from a body of text. This body of text might be something found in historical records (see chapter 16) or something collected by the researcher, as in the case of comment posts on a popular blog post. I once used the stories told by student loan debtors on the website studentloanjustice.org as the content I analyzed. Content analysis is particularly useful when attempting to define and understand prevalent stories or communication about a topic of interest. In other words, when we are less interested in what particular people (our defined sample) are doing or believing and more interested in what general narratives exist about a particular topic or issue. This chapter will explore different approaches to content analysis and provide helpful tips on how to collect data, how to turn that data into codes for analysis, and how to go about presenting what is found through analysis.
Where chapter 17 has pushed us towards data analysis, chapters 18 and 19 are all about what to do with the data collected, whether that data be in the form of interview transcripts or fieldnotes from observations. Chapter 18 introduces the basics of coding , the iterative process of assigning meaning to the data in order to both simplify and identify patterns. What is a code and how does it work? What are the different ways of coding data, and when should you use them? What is a codebook, and why do you need one? What does the process of data analysis look like?
Chapter 19 goes further into detail on codes and how to use them, particularly the later stages of coding in which our codes are refined, simplified, combined, and organized. These later rounds of coding are essential to getting the most out of the data we’ve collected. As students are often overwhelmed with the amount of data (a corpus of interview transcripts typically runs into the hundreds of pages; fieldnotes can easily top that), this chapter will also address time management and provide suggestions for dealing with chaos and reminders that feeling overwhelmed at the analysis stage is part of the process. By the end of the chapter, you should understand how “findings” are actually found.
The book concludes with a chapter dedicated to the effective presentation of data results. Chapter 20 covers the many ways that researchers communicate their studies to various audiences (academic, personal, political), what elements must be included in these various publications, and the hallmarks of excellent qualitative research that various audiences will be expecting. Because qualitative researchers are motivated by understanding and conveying meaning , effective communication is not only an essential skill but a fundamental facet of the entire research project. Ethnographers must be able to convey a certain sense of verisimilitude , the appearance of true reality. Those employing interviews must faithfully depict the key meanings of the people they interviewed in a way that rings true to those people, even if the end result surprises them. And all researchers must strive for clarity in their publications so that various audiences can understand what was found and why it is important.
The book concludes with a short chapter ( chapter 21 ) discussing the value of qualitative research. At the very end of this book, you will find a glossary of terms. I recommend you make frequent use of the glossary and add to each entry as you find examples. Although the entries are meant to be simple and clear, you may also want to paraphrase the definition—make it “make sense” to you, in other words. In addition to the standard reference list (all works cited here), you will find various recommendations for further reading at the end of many chapters. Some of these recommendations will be examples of excellent qualitative research, indicated with an asterisk (*) at the end of the entry. As they say, a picture is worth a thousand words. A good example of qualitative research can teach you more about conducting research than any textbook can (this one included). I highly recommend you select one to three examples from these lists and read them along with the textbook.
A final note on the choice of examples – you will note that many of the examples used in the text come from research on college students. This is for two reasons. First, as most of my research falls in this area, I am most familiar with this literature and have contacts with those who do research here and can call upon them to share their stories with you. Second, and more importantly, my hope is that this textbook reaches a wide audience of beginning researchers who study widely and deeply across the range of what can be known about the social world (from marine resources management to public policy to nursing to political science to sexuality studies and beyond). It is sometimes difficult to find examples that speak to all those research interests, however. A focus on college students is something that all readers can understand and, hopefully, appreciate, as we are all now or have been at some point a college student.
Recommended Reading: Other Qualitative Research Textbooks
I’ve included a brief list of some of my favorite qualitative research textbooks and guidebooks if you need more than what you will find in this introductory text. For each, I’ve also indicated if these are for “beginning” or “advanced” (graduate-level) readers. Many of these books have several editions that do not significantly vary; the edition recommended is merely the edition I have used in teaching and to whose page numbers any specific references made in the text agree.
Barbour, Rosaline. 2014. Introducing Qualitative Research: A Student’s Guide. Thousand Oaks, CA: SAGE. A good introduction to qualitative research, with abundant examples (often from the discipline of health care) and clear definitions. Includes quick summaries at the ends of each chapter. However, some US students might find the British context distracting and can be a bit advanced in some places. Beginning .
Bloomberg, Linda Dale, and Marie F. Volpe. 2012. Completing Your Qualitative Dissertation . 2nd ed. Thousand Oaks, CA: SAGE. Specifically designed to guide graduate students through the research process. Advanced .
Creswell, John W., and Cheryl Poth. 2018 Qualitative Inquiry and Research Design: Choosing among Five Traditions . 4th ed. Thousand Oaks, CA: SAGE. This is a classic and one of the go-to books I used myself as a graduate student. One of the best things about this text is its clear presentation of five distinct traditions in qualitative research. Despite the title, this reasonably sized book is about more than research design, including both data analysis and how to write about qualitative research. Advanced .
Lareau, Annette. 2021. Listening to People: A Practical Guide to Interviewing, Participant Observation, Data Analysis, and Writing It All Up . Chicago: University of Chicago Press. A readable and personal account of conducting qualitative research by an eminent sociologist, with a heavy emphasis on the kinds of participant-observation research conducted by the author. Despite its reader-friendliness, this is really a book targeted to graduate students learning the craft. Advanced .
Lune, Howard, and Bruce L. Berg. 2018. 9th edition. Qualitative Research Methods for the Social Sciences. Pearson . Although a good introduction to qualitative methods, the authors favor symbolic interactionist and dramaturgical approaches, which limits the appeal primarily to sociologists. Beginning .
Marshall, Catherine, and Gretchen B. Rossman. 2016. 6th edition. Designing Qualitative Research. Thousand Oaks, CA: SAGE. Very readable and accessible guide to research design by two educational scholars. Although the presentation is sometimes fairly dry, personal vignettes and illustrations enliven the text. Beginning .
Maxwell, Joseph A. 2013. Qualitative Research Design: An Interactive Approach . 3rd ed. Thousand Oaks, CA: SAGE. A short and accessible introduction to qualitative research design, particularly helpful for graduate students contemplating theses and dissertations. This has been a standard textbook in my graduate-level courses for years. Advanced .
Patton, Michael Quinn. 2002. Qualitative Research and Evaluation Methods . Thousand Oaks, CA: SAGE. This is a comprehensive text that served as my “go-to” reference when I was a graduate student. It is particularly helpful for those involved in program evaluation and other forms of evaluation studies and uses examples from a wide range of disciplines. Advanced .
Rubin, Ashley T. 2021. Rocking Qualitative Social Science: An Irreverent Guide to Rigorous Research. Stanford : Stanford University Press. A delightful and personal read. Rubin uses rock climbing as an extended metaphor for learning how to conduct qualitative research. A bit slanted toward ethnographic and archival methods of data collection, with frequent examples from her own studies in criminology. Beginning .
Weis, Lois, and Michelle Fine. 2000. Speed Bumps: A Student-Friendly Guide to Qualitative Research . New York: Teachers College Press. Readable and accessibly written in a quasi-conversational style. Particularly strong in its discussion of ethical issues throughout the qualitative research process. Not comprehensive, however, and very much tied to ethnographic research. Although designed for graduate students, this is a recommended read for students of all levels. Beginning .
Patton’s Ten Suggestions for Doing Qualitative Research
The following ten suggestions were made by Michael Quinn Patton in his massive textbooks Qualitative Research and Evaluations Methods . This book is highly recommended for those of you who want more than an introduction to qualitative methods. It is the book I relied on heavily when I was a graduate student, although it is much easier to “dip into” when necessary than to read through as a whole. Patton is asked for “just one bit of advice” for a graduate student considering using qualitative research methods for their dissertation. Here are his top ten responses, in short form, heavily paraphrased, and with additional comments and emphases from me:
- Make sure that a qualitative approach fits the research question. The following are the kinds of questions that call out for qualitative methods or where qualitative methods are particularly appropriate: questions about people’s experiences or how they make sense of those experiences; studying a person in their natural environment; researching a phenomenon so unknown that it would be impossible to study it with standardized instruments or other forms of quantitative data collection.
- Study qualitative research by going to the original sources for the design and analysis appropriate to the particular approach you want to take (e.g., read Glaser and Straus if you are using grounded theory )
- Find a dissertation adviser who understands or at least who will support your use of qualitative research methods. You are asking for trouble if your entire committee is populated by quantitative researchers, even if they are all very knowledgeable about the subject or focus of your study (maybe even more so if they are!)
- Really work on design. Doing qualitative research effectively takes a lot of planning. Even if things are more flexible than in quantitative research, a good design is absolutely essential when starting out.
- Practice data collection techniques, particularly interviewing and observing. There is definitely a set of learned skills here! Do not expect your first interview to be perfect. You will continue to grow as a researcher the more interviews you conduct, and you will probably come to understand yourself a bit more in the process, too. This is not easy, despite what others who don’t work with qualitative methods may assume (and tell you!)
- Have a plan for analysis before you begin data collection. This is often a requirement in IRB protocols , although you can get away with writing something fairly simple. And even if you are taking an approach, such as grounded theory, that pushes you to remain fairly open-minded during the data collection process, you still want to know what you will be doing with all the data collected – creating a codebook? Writing analytical memos? Comparing cases? Having a plan in hand will also help prevent you from collecting too much extraneous data.
- Be prepared to confront controversies both within the qualitative research community and between qualitative research and quantitative research. Don’t be naïve about this – qualitative research, particularly some approaches, will be derided by many more “positivist” researchers and audiences. For example, is an “n” of 1 really sufficient? Yes! But not everyone will agree.
- Do not make the mistake of using qualitative research methods because someone told you it was easier, or because you are intimidated by the math required of statistical analyses. Qualitative research is difficult in its own way (and many would claim much more time-consuming than quantitative research). Do it because you are convinced it is right for your goals, aims, and research questions.
- Find a good support network. This could be a research mentor, or it could be a group of friends or colleagues who are also using qualitative research, or it could be just someone who will listen to you work through all of the issues you will confront out in the field and during the writing process. Even though qualitative research often involves human subjects, it can be pretty lonely. A lot of times you will feel like you are working without a net. You have to create one for yourself. Take care of yourself.
- And, finally, in the words of Patton, “Prepare to be changed. Looking deeply at other people’s lives will force you to look deeply at yourself.”
- We will actually spend an entire chapter ( chapter 3 ) looking at this question in much more detail! ↵
- Note that this might have been news to Europeans at the time, but many other societies around the world had also come to this conclusion through observation. There is often a tendency to equate “the scientific revolution” with the European world in which it took place, but this is somewhat misleading. ↵
- Historians are a special case here. Historians have scrupulously and rigorously investigated the social world, but not for the purpose of understanding general laws about how things work, which is the point of scientific empirical research. History is often referred to as an idiographic field of study, meaning that it studies things that happened or are happening in themselves and not for general observations or conclusions. ↵
- Don’t worry, we’ll spend more time later in this book unpacking the meaning of ethnography and other terms that are important here. Note the available glossary ↵
An approach to research that is “multimethod in focus, involving an interpretative, naturalistic approach to its subject matter. This means that qualitative researchers study things in their natural settings, attempting to make sense of, or interpret, phenomena in terms of the meanings people bring to them. Qualitative research involves the studied use and collection of a variety of empirical materials – case study, personal experience, introspective, life story, interview, observational, historical, interactional, and visual texts – that describe routine and problematic moments and meanings in individuals’ lives." ( Denzin and Lincoln 2005:2 ). Contrast with quantitative research .
In contrast to methodology, methods are more simply the practices and tools used to collect and analyze data. Examples of common methods in qualitative research are interviews , observations , and documentary analysis . One’s methodology should connect to one’s choice of methods, of course, but they are distinguishable terms. See also methodology .
A proposed explanation for an observation, phenomenon, or scientific problem that can be tested by further investigation. The positing of a hypothesis is often the first step in quantitative research but not in qualitative research. Even when qualitative researchers offer possible explanations in advance of conducting research, they will tend to not use the word “hypothesis” as it conjures up the kind of positivist research they are not conducting.
The foundational question to be addressed by the research study. This will form the anchor of the research design, collection, and analysis. Note that in qualitative research, the research question may, and probably will, alter or develop during the course of the research.
An approach to research that collects and analyzes numerical data for the purpose of finding patterns and averages, making predictions, testing causal relationships, and generalizing results to wider populations. Contrast with qualitative research .
Data collection that takes place in real-world settings, referred to as “the field;” a key component of much Grounded Theory and ethnographic research. Patton ( 2002 ) calls fieldwork “the central activity of qualitative inquiry” where “‘going into the field’ means having direct and personal contact with people under study in their own environments – getting close to people and situations being studied to personally understand the realities of minutiae of daily life” (48).
The people who are the subjects of a qualitative study. In interview-based studies, they may be the respondents to the interviewer; for purposes of IRBs, they are often referred to as the human subjects of the research.
The branch of philosophy concerned with knowledge. For researchers, it is important to recognize and adopt one of the many distinguishing epistemological perspectives as part of our understanding of what questions research can address or fully answer. See, e.g., constructivism , subjectivism, and objectivism .
An approach that refutes the possibility of neutrality in social science research. All research is “guided by a set of beliefs and feelings about the world and how it should be understood and studied” (Denzin and Lincoln 2005: 13). In contrast to positivism , interpretivism recognizes the social constructedness of reality, and researchers adopting this approach focus on capturing interpretations and understandings people have about the world rather than “the world” as it is (which is a chimera).
The cluster of data-collection tools and techniques that involve observing interactions between people, the behaviors, and practices of individuals (sometimes in contrast to what they say about how they act and behave), and cultures in context. Observational methods are the key tools employed by ethnographers and Grounded Theory .
Research based on data collected and analyzed by the research (in contrast to secondary “library” research).
The process of selecting people or other units of analysis to represent a larger population. In quantitative research, this representation is taken quite literally, as statistically representative. In qualitative research, in contrast, sample selection is often made based on potential to generate insight about a particular topic or phenomenon.
A method of data collection in which the researcher asks the participant questions; the answers to these questions are often recorded and transcribed verbatim. There are many different kinds of interviews - see also semistructured interview , structured interview , and unstructured interview .
The specific group of individuals that you will collect data from. Contrast population.
The practice of being conscious of and reflective upon one’s own social location and presence when conducting research. Because qualitative research often requires interaction with live humans, failing to take into account how one’s presence and prior expectations and social location affect the data collected and how analyzed may limit the reliability of the findings. This remains true even when dealing with historical archives and other content. Who we are matters when asking questions about how people experience the world because we, too, are a part of that world.
The science and practice of right conduct; in research, it is also the delineation of moral obligations towards research participants, communities to which we belong, and communities in which we conduct our research.
An administrative body established to protect the rights and welfare of human research subjects recruited to participate in research activities conducted under the auspices of the institution with which it is affiliated. The IRB is charged with the responsibility of reviewing all research involving human participants. The IRB is concerned with protecting the welfare, rights, and privacy of human subjects. The IRB has the authority to approve, disapprove, monitor, and require modifications in all research activities that fall within its jurisdiction as specified by both the federal regulations and institutional policy.
Research, according to US federal guidelines, that involves “a living individual about whom an investigator (whether professional or student) conducting research: (1) Obtains information or biospecimens through intervention or interaction with the individual, and uses, studies, or analyzes the information or biospecimens; or (2) Obtains, uses, studies, analyzes, or generates identifiable private information or identifiable biospecimens.”
One of the primary methodological traditions of inquiry in qualitative research, ethnography is the study of a group or group culture, largely through observational fieldwork supplemented by interviews. It is a form of fieldwork that may include participant-observation data collection. See chapter 14 for a discussion of deep ethnography.
A form of interview that follows a standard guide of questions asked, although the order of the questions may change to match the particular needs of each individual interview subject, and probing “follow-up” questions are often added during the course of the interview. The semi-structured interview is the primary form of interviewing used by qualitative researchers in the social sciences. It is sometimes referred to as an “in-depth” interview. See also interview and interview guide .
A method of observational data collection taking place in a natural setting; a form of fieldwork . The term encompasses a continuum of relative participation by the researcher (from full participant to “fly-on-the-wall” observer). This is also sometimes referred to as ethnography , although the latter is characterized by a greater focus on the culture under observation.
A research design that employs both quantitative and qualitative methods, as in the case of a survey supplemented by interviews.
An epistemological perspective that posits the existence of reality through sensory experience similar to empiricism but goes further in denying any non-sensory basis of thought or consciousness. In the social sciences, the term has roots in the proto-sociologist August Comte, who believed he could discern “laws” of society similar to the laws of natural science (e.g., gravity). The term has come to mean the kinds of measurable and verifiable science conducted by quantitative researchers and is thus used pejoratively by some qualitative researchers interested in interpretation, consciousness, and human understanding. Calling someone a “positivist” is often intended as an insult. See also empiricism and objectivism.
A place or collection containing records, documents, or other materials of historical interest; most universities have an archive of material related to the university’s history, as well as other “special collections” that may be of interest to members of the community.
A method of both data collection and data analysis in which a given content (textual, visual, graphic) is examined systematically and rigorously to identify meanings, themes, patterns and assumptions. Qualitative content analysis (QCA) is concerned with gathering and interpreting an existing body of material.
A word or short phrase that symbolically assigns a summative, salient, essence-capturing, and/or evocative attribute for a portion of language-based or visual data (Saldaña 2021:5).
Usually a verbatim written record of an interview or focus group discussion.
The primary form of data for fieldwork , participant observation , and ethnography . These notes, taken by the researcher either during the course of fieldwork or at day’s end, should include as many details as possible on what was observed and what was said. They should include clear identifiers of date, time, setting, and names (or identifying characteristics) of participants.
The process of labeling and organizing qualitative data to identify different themes and the relationships between them; a way of simplifying data to allow better management and retrieval of key themes and illustrative passages. See coding frame and codebook.
A methodological tradition of inquiry and approach to analyzing qualitative data in which theories emerge from a rigorous and systematic process of induction. This approach was pioneered by the sociologists Glaser and Strauss (1967). The elements of theory generated from comparative analysis of data are, first, conceptual categories and their properties and, second, hypotheses or generalized relations among the categories and their properties – “The constant comparing of many groups draws the [researcher’s] attention to their many similarities and differences. Considering these leads [the researcher] to generate abstract categories and their properties, which, since they emerge from the data, will clearly be important to a theory explaining the kind of behavior under observation.” (36).
A detailed description of any proposed research that involves human subjects for review by IRB. The protocol serves as the recipe for the conduct of the research activity. It includes the scientific rationale to justify the conduct of the study, the information necessary to conduct the study, the plan for managing and analyzing the data, and a discussion of the research ethical issues relevant to the research. Protocols for qualitative research often include interview guides, all documents related to recruitment, informed consent forms, very clear guidelines on the safekeeping of materials collected, and plans for de-identifying transcripts or other data that include personal identifying information.
Introduction to Qualitative Research Methods Copyright © 2023 by Allison Hurst is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License , except where otherwise noted.
IMAGES
COMMENTS
Questions should be sequenced to follow a natural, conversational flow, adapting to the direction of the discussion. ... Credibility in qualitative research is akin to the concept of internal validity in quantitative research, ... Thick description entails a detail description about the setting of the research, for example, portraying the ...
In quantitative studies, the sampling plan, including sample size, is determined in detail in beforehand but qualitative research projects start with a broadly defined sampling plan. This plan enables you to include a variety of settings and situations and a variety of participants, including negative cases or extreme cases to obtain rich data.
While many books and articles guide various qualitative research methods and analyses, there is currently no concise resource that explains and differentiates among the most common qualitative approaches. We believe novice qualitative researchers, students planning the design of a qualitative study or taking an introductory qualitative research course, and faculty teaching such courses can ...
Qualitative research is a method of inquiry used in various disciplines, including social sciences, education, and health, to explore and understand human behavior, experiences, and social phenomena. It focuses on collecting non-numerical data, such as words, images, or objects, to gain in-depth insights into people's thoughts, feelings, motivations, and perspectives.
For the reasons explained above, qualitative research does not require specific sample sizes, nor does it require that the sample size be determined a priori [1, 14, 27, 37-39]. Sample size can only be a useful quality indicator when related to the research purpose, the chosen methodology and the composition of the sample, i.e. who was ...
Although there is no "correct number" of people to interview, the sample should follow the research question and research design. Unlike quantitative research, qualitative research involves nonprobability sampling. Chapter 5 explains why this is so and what qualities instead make a good sample for qualitative research.
of qualitative research can seem imprecise. Common criticisms include: samples are small and not necessarily representative of the broader population, so it is difficult to know how far we can generalise the results; the findings lack rigour; it is difficult to tell how far the findings are biased by the researcher's own opinions.
quantitative research design (Creswell, 1994, pp. 1-2, own emphasis). This study uses the "extended-case studies" approach (Babbie, 2007, p. 298) that seeks to investigate, analyse, and interpret contingency relationships. 1. Qualitative research presents a complex set of issues (and key variables or themes, or both) and seeks to draw ...
Qualitative research is a type of research that explores and provides deeper insights into real-world problems.[1] Instead of collecting numerical data points or intervening or introducing treatments just like in quantitative research, qualitative research helps generate hypothenar to further investigate and understand quantitative data. Qualitative research gathers participants' experiences ...
Given that the claims that qualitative researchers want to make are routinely based on working closely with relatively small numbers of people, interactions, situations or spaces, it is central that these are chosen for good analytic reasons. Above all, sampling should never be the product of ad hoc decisions or left solely to chance.