what is a comparative research question

A Short Introduction to Comparative Research

• Allameh Tabataba'i University

Discover the world's research

• 25+ million members
• 160+ million publication pages
• 2.3+ billion citations

• Radhakrishna Batule

• Ph.D Mixo Swetness Sithole

• Nik Muhammad Azimuddin bin Aziz
• Syafitri Syifa
• Muhammad Syahzan bin Johari
• Margaret N. Munywoki

• MULTIMED TOOLS APPL
• Thomas Bohné

• BUSSINESS ETHICS ANALYSIS
• ANALISIS PT TIMAH Tbk
• Catur Widayati
• Nicole Jeanine Wuisan
• Debora Chaterin Simanjuntak

• Claudius Wagemann

• Michael Stausberg
• Guy E. Swanson

• JONATHAN Z. SMITH
• Oliver Freiberger

• Recruit researchers
• Join for free
• Login Email Tip: Most researchers use their institutional email address as their ResearchGate login Password Forgot password? Keep me logged in Log in or Continue with Google Welcome back! Please log in. Email · Hint Tip: Most researchers use their institutional email address as their ResearchGate login Password Forgot password? Keep me logged in Log in or Continue with Google No account? Sign up

Research Question 101 📖

Everything you need to know to write a high-quality research question

By: Derek Jansen (MBA) | Reviewed By: Dr. Eunice Rautenbach | October 2023

If you’ve landed on this page, you’re probably asking yourself, “ What is a research question? ”. Well, you’ve come to the right place. In this post, we’ll explain what a research question is , how it’s differen t from a research aim, and how to craft a high-quality research question that sets you up for success.

Research Question 101

What is a research question.

• Research questions vs research aims
• The 4 types of research questions
• How to write a research question
• Frequently asked questions
• Examples of research questions

As the name suggests, the research question is the core question (or set of questions) that your study will (attempt to) answer .

In many ways, a research question is akin to a target in archery . Without a clear target, you won’t know where to concentrate your efforts and focus. Essentially, your research question acts as the guiding light throughout your project and informs every choice you make along the way.

Let’s look at some examples:

What impact does social media usage have on the mental health of teenagers in New York?

How does the introduction of a minimum wage affect employment levels in small businesses in outer London?

How does the portrayal of women in 19th-century American literature reflect the societal attitudes of the time?

What are the long-term effects of intermittent fasting on heart health in adults?

As you can see in these examples, research questions are clear, specific questions that can be feasibly answered within a study. These are important attributes and we’ll discuss each of them in more detail a little later . If you’d like to see more examples of research questions, you can find our RQ mega-list here .

Research Questions vs Research Aims

At this point, you might be asking yourself, “ How is a research question different from a research aim? ”. Within any given study, the research aim and research question (or questions) are tightly intertwined , but they are separate things . Let’s unpack that a little.

A research aim is typically broader in nature and outlines what you hope to achieve with your research. It doesn’t ask a specific question but rather gives a summary of what you intend to explore.

The research question, on the other hand, is much more focused . It’s the specific query you’re setting out to answer. It narrows down the research aim into a detailed, researchable question that will guide your study’s methods and analysis.

Let’s look at an example:

Research Aim: To explore the effects of climate change on marine life in Southern Africa.

Research Question: How does ocean acidification caused by climate change affect the reproduction rates of coral reefs?

As you can see, the research aim gives you a general focus , while the research question details exactly what you want to find out.

Need a helping hand?

Types of research questions

Now that we’ve defined what a research question is, let’s look at the different types of research questions that you might come across. Broadly speaking, there are (at least) four different types of research questions – descriptive , comparative , relational , and explanatory . 

Descriptive questions ask what is happening. In other words, they seek to describe a phenomena or situation . An example of a descriptive research question could be something like “What types of exercise do high-performing UK executives engage in?”. This would likely be a bit too basic to form an interesting study, but as you can see, the research question is just focused on the what – in other words, it just describes the situation.

Comparative research questions , on the other hand, look to understand the way in which two or more things differ , or how they’re similar. An example of a comparative research question might be something like “How do exercise preferences vary between middle-aged men across three American cities?”. As you can see, this question seeks to compare the differences (or similarities) in behaviour between different groups.

Next up, we’ve got exploratory research questions , which ask why or how is something happening. While the other types of questions we looked at focused on the what, exploratory research questions are interested in the why and how . As an example, an exploratory research question might ask something like “Why have bee populations declined in Germany over the last 5 years?”. As you can, this question is aimed squarely at the why, rather than the what.

Last but not least, we have relational research questions . As the name suggests, these types of research questions seek to explore the relationships between variables . Here, an example could be something like “What is the relationship between X and Y” or “Does A have an impact on B”. As you can see, these types of research questions are interested in understanding how constructs or variables are connected , and perhaps, whether one thing causes another.

Of course, depending on how fine-grained you want to get, you can argue that there are many more types of research questions , but these four categories give you a broad idea of the different flavours that exist out there. It’s also worth pointing out that a research question doesn’t need to fit perfectly into one category – in many cases, a research question might overlap into more than just one category and that’s okay.

The key takeaway here is that research questions can take many different forms , and it’s useful to understand the nature of your research question so that you can align your research methodology accordingly.

How To Write A Research Question

As we alluded earlier, a well-crafted research question needs to possess very specific attributes, including focus , clarity and feasibility . But that’s not all – a rock-solid research question also needs to be rooted and aligned . Let’s look at each of these.

A strong research question typically has a single focus. So, don’t try to cram multiple questions into one research question; rather split them up into separate questions (or even subquestions), each with their own specific focus. As a rule of thumb, narrow beats broad when it comes to research questions.

Clear and specific

A good research question is clear and specific, not vague and broad. State clearly exactly what you want to find out so that any reader can quickly understand what you’re looking to achieve with your study. Along the same vein, try to avoid using bulky language and jargon – aim for clarity.

Unfortunately, even a super tantalising and thought-provoking research question has little value if you cannot feasibly answer it. So, think about the methodological implications of your research question while you’re crafting it. Most importantly, make sure that you know exactly what data you’ll need (primary or secondary) and how you’ll analyse that data.

A good research question (and a research topic, more broadly) should be rooted in a clear research gap and research problem . Without a well-defined research gap, you risk wasting your effort pursuing a question that’s already been adequately answered (and agreed upon) by the research community. A well-argued research gap lays at the heart of a valuable study, so make sure you have your gap clearly articulated and that your research question directly links to it.

As we mentioned earlier, your research aim and research question are (or at least, should be) tightly linked. So, make sure that your research question (or set of questions) aligns with your research aim . If not, you’ll need to revise one of the two to achieve this.

FAQ: Research Questions

Research question faqs, how many research questions should i have, what should i avoid when writing a research question, can a research question be a statement.

Typically, a research question is phrased as a question, not a statement. A question clearly indicates what you’re setting out to discover.

Can a research question be too broad or too narrow?

Yes. A question that’s too broad makes your research unfocused, while a question that’s too narrow limits the scope of your study.

Here’s an example of a research question that’s too broad:

“Why is mental health important?”

Conversely, here’s an example of a research question that’s likely too narrow:

“What is the impact of sleep deprivation on the exam scores of 19-year-old males in London studying maths at The Open University?”

Can I change my research question during the research process?

How do i know if my research question is good.

A good research question is focused, specific, practical, rooted in a research gap, and aligned with the research aim. If your question meets these criteria, it’s likely a strong question.

Is a research question similar to a hypothesis?

Not quite. A hypothesis is a testable statement that predicts an outcome, while a research question is a query that you’re trying to answer through your study. Naturally, there can be linkages between a study’s research questions and hypothesis, but they serve different functions.

How are research questions and research objectives related?

The research question is a focused and specific query that your study aims to answer. It’s the central issue you’re investigating. The research objective, on the other hand, outlines the steps you’ll take to answer your research question. Research objectives are often more action-oriented and can be broken down into smaller tasks that guide your research process. In a sense, they’re something of a roadmap that helps you answer your research question.

Need some inspiration?

If you’d like to see more examples of research questions, check out our research question mega list here .  Alternatively, if you’d like 1-on-1 help developing a high-quality research question, consider our private coaching service .

Psst... there’s more!

This post was based on one of our popular Research Bootcamps . If you're working on a research project, you'll definitely want to check this out ...

Submit a Comment Cancel reply

Your email address will not be published. Required fields are marked *

Save my name, email, and website in this browser for the next time I comment.

• Print Friendly

• Cookies & Privacy
• GETTING STARTED
• Introduction
• FUNDAMENTALS
• Acknowledgements
• Research questions & hypotheses
• Concepts, constructs & variables
• Research limitations
• Getting started
• Sampling Strategy
• Research Quality
• Research Ethics
• Data Analysis

Types of quantitative research question

Dissertations that are based on a quantitative research design attempt to answer at least one quantitative research question . In some cases, these quantitative research questions will be followed by either research hypotheses or null hypotheses . However, this article focuses solely on quantitative research questions. Furthermore, since there is more than one type of quantitative research question that you can attempt to answer in a dissertation (i.e., descriptive research questions, comparative research questions and relationship-based research questions), we discuss each of these in this article. If you do not know much about quantitative research and quantitative research questions at this stage, we would recommend that you first read the article, Quantitative research questions: What do I have to think about , as well as an overview article on types of variables , which will help to familiarise you with terms such as dependent and independent variable , as well as categorical and continuous variables [see the article: Types of variables ]. The purpose of this article is to introduce you to the three different types of quantitative research question (i.e., descriptive, comparative and relationship-based research questions) so that you can understand what type(s) of quantitative research question you want to create in your dissertation. Each of these types of quantitative research question is discussed in turn:

Descriptive research questions

Comparative research questions.

• Relationship-based research questions

Descriptive research questions simply aim to describe the variables you are measuring. When we use the word describe , we mean that these research questions aim to quantify the variables you are interested in. Think of research questions that start with words such as "How much?" , "How often?" , "What percentage?" , and "What proportion?" , but also sometimes questions starting "What is?" and "What are?" . Often, descriptive research questions focus on only one variable and one group, but they can include multiple variables and groups. We provide some examples below:

In each of these example descriptive research questions, we are quantifying the variables we are interested in. However, the units that we used to quantify these variables will differ depending on what is being measured. For example, in the questions above, we are interested in frequencies (also known as counts ), such as the number of calories, photos uploaded, or comments on other users? photos. In the case of the final question, What are the most important factors that influence the career choices of Australian university students? , we are interested in the number of times each factor (e.g., salary and benefits, career prospects, physical working conditions, etc.) was ranked on a scale of 1 to 10 (with 1 = least important and 10 = most important). We may then choose to examine this data by presenting the frequencies , as well as using a measure of central tendency and a measure of spread [see the section on Data Analysis to learn more about these and other statistical tests].

However, it is also common when using descriptive research questions to measure percentages and proportions , so we have included some example descriptive research questions below that illustrate this.

In terms of the first descriptive research question about daily calorific intake , we are not necessarily interested in frequencies , or using a measure of central tendency or measure of spread , but instead want understand what percentage of American men and women exceed their daily calorific allowance . In this respect, this descriptive research question differs from the earlier question that asked: How many calories do American men and women consume per day? Whilst this question simply wants to measure the total number of calories (i.e., the How many calories part that starts the question); in this case, the question aims to measure excess ; that is, what percentage of these two groups (i.e., American men and American women) exceed their daily calorific allowance, which is different for males (around 2500 calories per day) and females (around 2000 calories per day).

If you are performing a piece of descriptive , quantitative research for your dissertation, you are likely to need to set quite a number of descriptive research questions . However, if you are using an experimental or quasi-experimental research design , or a more involved relationship-based research design , you are more likely to use just one or two descriptive research questions as a means to providing background to the topic you are studying, helping to give additional context for comparative research questions and/or relationship-based research questions that follow.

Comparative research questions aim to examine the differences between two or more groups on one or more dependent variables (although often just a single dependent variable). Such questions typically start by asking "What is the difference in?" a particular dependent variable (e.g., daily calorific intake) between two or more groups (e.g., American men and American women). Examples of comparative research questions include:

Groups reflect different categories of the independent variable you are measuring (e.g., American men and women = "gender"; Australian undergraduate and graduate students = "educational level"; pirated music that is freely distributed and pirated music that is purchased = "method of illegal music acquisition").

Comparative research questions also differ in terms of their relative complexity , by which we are referring to how many items/measures make up the dependent variable or how many dependent variables are investigated. Indeed, the examples highlight the difference between very simple comparative research questions where the dependent variable involves just a single measure/item (e.g., daily calorific intake) and potentially more complex questions where the dependent variable is made up of multiple items (e.g., Facebook usage behaviour including a wide range of items, such as logins, weekly photo uploads, status changes, etc.); or where each of these items should be written out as dependent variables.

Overall, whilst the dependent variable(s) highlight what you are interested in studying (e.g., attitudes towards music piracy, perceptions towards Internet banking security), comparative research questions are particularly appropriate if your dissertation aims to examine the differences between two or more groups (e.g., men and women, adolescents and pensioners, managers and non-managers, etc.).

Relationship research questions

Whilst we refer to this type of quantitative research question as a relationship-based research question, the word relationship should be treated simply as a useful way of describing the fact that these types of quantitative research question are interested in the causal relationships , associations , trends and/or interactions amongst two or more variables on one or more groups. We have to be careful when using the word relationship because in statistics, it refers to a particular type of research design, namely experimental research designs where it is possible to measure the cause and effect between two or more variables; that is, it is possible to say that variable A (e.g., study time) was responsible for an increase in variable B (e.g., exam scores). However, at the undergraduate and even master's level, dissertations rarely involve experimental research designs , but rather quasi-experimental and relationship-based research designs [see the section on Quantitative research designs ]. This means that you cannot often find causal relationships between variables, but only associations or trends .

However, when we write a relationship-based research question , we do not have to make this distinction between causal relationships, associations, trends and interactions (i.e., it is just something that you should keep in the back of your mind). Instead, we typically start a relationship-based quantitative research question, "What is the relationship?" , usually followed by the words, "between or amongst" , then list the independent variables (e.g., gender) and dependent variables (e.g., attitudes towards music piracy), "amongst or between" the group(s) you are focusing on. Examples of relationship-based research questions are:

As the examples above highlight, relationship-based research questions are appropriate to set when we are interested in the relationship, association, trend, or interaction between one or more dependent (e.g., exam scores) and independent (e.g., study time) variables, whether on one or more groups (e.g., university students).

The quantitative research design that we select subsequently determines whether we look for relationships , associations , trends or interactions . To learn how to structure (i.e., write out) each of these three types of quantitative research question (i.e., descriptive, comparative, relationship-based research questions), see the article: How to structure quantitative research questions .

How to Write a Research Question: Types and Examples 

The first step in any research project is framing the research question. It can be considered the core of any systematic investigation as the research outcomes are tied to asking the right questions. Thus, this primary interrogation point sets the pace for your research as it helps collect relevant and insightful information that ultimately influences your work.   

Typically, the research question guides the stages of inquiry, analysis, and reporting. Depending on the use of quantifiable or quantitative data, research questions are broadly categorized into quantitative or qualitative research questions. Both types of research questions can be used independently or together, considering the overall focus and objectives of your research.  

What is a research question?

A research question is a clear, focused, concise, and arguable question on which your research and writing are centered. 1 It states various aspects of the study, including the population and variables to be studied and the problem the study addresses. These questions also set the boundaries of the study, ensuring cohesion. 

Designing the research question is a dynamic process where the researcher can change or refine the research question as they review related literature and develop a framework for the study. Depending on the scale of your research, the study can include single or multiple research questions. 

A good research question has the following features: 

• It is relevant to the chosen field of study. 
• The question posed is arguable and open for debate, requiring synthesizing and analysis of ideas. 
• It is focused and concisely framed. 
• A feasible solution is possible within the given practical constraint and timeframe. 

A poorly formulated research question poses several risks. 1   

• Researchers can adopt an erroneous design. 
• It can create confusion and hinder the thought process, including developing a clear protocol.  
• It can jeopardize publication efforts.  
• It causes difficulty in determining the relevance of the study findings.  
• It causes difficulty in whether the study fulfils the inclusion criteria for systematic review and meta-analysis. This creates challenges in determining whether additional studies or data collection is needed to answer the question.  
• Readers may fail to understand the objective of the study. This reduces the likelihood of the study being cited by others. 

Now that you know “What is a research question?”, let’s look at the different types of research questions. 

Types of research questions

Depending on the type of research to be done, research questions can be classified broadly into quantitative, qualitative, or mixed-methods studies. Knowing the type of research helps determine the best type of research question that reflects the direction and epistemological underpinnings of your research. 

The structure and wording of quantitative 2 and qualitative research 3 questions differ significantly. The quantitative study looks at causal relationships, whereas the qualitative study aims at exploring a phenomenon. 

• Quantitative research questions:  
• Seeks to investigate social, familial, or educational experiences or processes in a particular context and/or location.  
• Answers ‘how,’ ‘what,’ or ‘why’ questions. 
• Investigates connections, relations, or comparisons between independent and dependent variables. 

Quantitative research questions can be further categorized into descriptive, comparative, and relationship, as explained in the Table below. 

• Qualitative research questions  

Qualitative research questions are adaptable, non-directional, and more flexible. It concerns broad areas of research or more specific areas of study to discover, explain, or explore a phenomenon. These are further classified as follows: 

• Mixed-methods studies  

Mixed-methods studies use both quantitative and qualitative research questions to answer your research question. Mixed methods provide a complete picture than standalone quantitative or qualitative research, as it integrates the benefits of both methods. Mixed methods research is often used in multidisciplinary settings and complex situational or societal research, especially in the behavioral, health, and social science fields. 

What makes a good research question

A good research question should be clear and focused to guide your research. It should synthesize multiple sources to present your unique argument, and should ideally be something that you are interested in. But avoid questions that can be answered in a few factual statements. The following are the main attributes of a good research question. 

• Specific: The research question should not be a fishing expedition performed in the hopes that some new information will be found that will benefit the researcher. The central research question should work with your research problem to keep your work focused. If using multiple questions, they should all tie back to the central aim. 
• Measurable: The research question must be answerable using quantitative and/or qualitative data or from scholarly sources to develop your research question. If such data is impossible to access, it is better to rethink your question. 
• Attainable: Ensure you have enough time and resources to do all research required to answer your question. If it seems you will not be able to gain access to the data you need, consider narrowing down your question to be more specific. 
• You have the expertise 
• You have the equipment and resources 
• Realistic: Developing your research question should be based on initial reading about your topic. It should focus on addressing a problem or gap in the existing knowledge in your field or discipline. 
• Based on some sort of rational physics 
• Can be done in a reasonable time frame 
• Timely: The research question should contribute to an existing and current debate in your field or in society at large. It should produce knowledge that future researchers or practitioners can later build on. 
• Novel 
• Based on current technologies. 
• Important to answer current problems or concerns. 
• Lead to new directions. 
• Important: Your question should have some aspect of originality. Incremental research is as important as exploring disruptive technologies. For example, you can focus on a specific location or explore a new angle. 
• Meaningful whether the answer is “Yes” or “No.” Closed-ended, yes/no questions are too simple to work as good research questions. Such questions do not provide enough scope for robust investigation and discussion. A good research question requires original data, synthesis of multiple sources, and original interpretation and argumentation before providing an answer. 

Steps for developing a good research question

The importance of research questions cannot be understated. When drafting a research question, use the following frameworks to guide the components of your question to ease the process. 4  

• Determine the requirements: Before constructing a good research question, set your research requirements. What is the purpose? Is it descriptive, comparative, or explorative research? Determining the research aim will help you choose the most appropriate topic and word your question appropriately. 
• Select a broad research topic: Identify a broader subject area of interest that requires investigation. Techniques such as brainstorming or concept mapping can help identify relevant connections and themes within a broad research topic. For example, how to learn and help students learn. 
• Perform preliminary investigation: Preliminary research is needed to obtain up-to-date and relevant knowledge on your topic. It also helps identify issues currently being discussed from which information gaps can be identified. 
• Narrow your focus: Narrow the scope and focus of your research to a specific niche. This involves focusing on gaps in existing knowledge or recent literature or extending or complementing the findings of existing literature. Another approach involves constructing strong research questions that challenge your views or knowledge of the area of study (Example: Is learning consistent with the existing learning theory and research). 
• Identify the research problem: Once the research question has been framed, one should evaluate it. This is to realize the importance of the research questions and if there is a need for more revising (Example: How do your beliefs on learning theory and research impact your instructional practices). 

How to write a research question

Those struggling to understand how to write a research question, these simple steps can help you simplify the process of writing a research question. 

Sample Research Questions

The following are some bad and good research question examples 

• Example 1 

• Example 2 

References:  

• Thabane, L., Thomas, T., Ye, C., & Paul, J. (2009). Posing the research question: not so simple.  Canadian Journal of Anesthesia/Journal canadien d’anesthésie ,  56 (1), 71-79. 
• Rutberg, S., & Bouikidis, C. D. (2018). Focusing on the fundamentals: A simplistic differentiation between qualitative and quantitative research.  Nephrology Nursing Journal ,  45 (2), 209-213. 
• Kyngäs, H. (2020). Qualitative research and content analysis.  The application of content analysis in nursing science research , 3-11. 
• Mattick, K., Johnston, J., & de la Croix, A. (2018). How to… write a good research question.  The clinical teacher ,  15 (2), 104-108. 
• Fandino, W. (2019). Formulating a good research question: Pearls and pitfalls.  Indian Journal of Anaesthesia ,  63 (8), 611. 
• Richardson, W. S., Wilson, M. C., Nishikawa, J., & Hayward, R. S. (1995). The well-built clinical question: a key to evidence-based decisions.  ACP journal club ,  123 (3), A12-A13 

Paperpal is a comprehensive AI writing toolkit that helps students and researchers achieve 2x the writing in half the time. It leverages 21+ years of STM experience and insights from millions of research articles to provide in-depth academic writing, language editing, and submission readiness support to help you write better, faster.  

Get accurate academic translations, rewriting support, grammar checks, vocabulary suggestions, and generative AI assistance that delivers human precision at machine speed. Try for free or upgrade to Paperpal Prime starting at US$19 a month to access premium features, including consistency, plagiarism, and 30+ submission readiness checks to help you succeed.  

Experience the future of academic writing – Sign up to Paperpal and start writing for free!  

Related Reads:

• Scientific Writing Style Guides Explained
• Ethical Research Practices For Research with Human Subjects
• 8 Most Effective Ways to Increase Motivation for Thesis Writing 
• 6 Tips for Post-Doc Researchers to Take Their Career to the Next Level

Transitive and Intransitive Verbs in the World of Research

Language and grammar rules for academic writing, you may also like, how to write your research paper in apa..., how to choose a dissertation topic, how to write a phd research proposal, how to write an academic paragraph (step-by-step guide), research funding basics: what should a grant proposal..., how to write the first draft of a..., mla works cited page: format, template & examples, academic editing: how to self-edit academic text with..., measuring academic success: definition & strategies for excellence, phd qualifying exam: tips for success .

Literature Searching

Types of Research Questions

Research questions can be categorized into different types, depending on the type of research to be undertaken.

Qualitative questions concern broad areas or more specific areas of research and focus on discovering, explaining and exploring.  Types of qualitative questions include:

• Exploratory Questions, which seeks to understand without influencing the results.  The objective is to learn more about a topic without bias or preconceived notions.
• Predictive Questions, which seek to understand the intent or future outcome around a topic.
• Interpretive Questions, which tries to understand people’s behavior in a natural setting.  The objective is to understand how a group makes sense of shared experiences with regards to various phenomena.

Quantitative questions prove or disprove a  researcher’s hypothesis and are constructed to express the relationship between variables  and whether this relationship is significant.  Types of quantitative questions include:

• Descriptive questions , which are the most basic type of quantitative research question and seeks to explain the when, where, why or how something occurred. 
• Comparative questions are helpful when studying groups with dependent variables where one variable is compared with another.
• Relationship-based questions try to answer whether or not one variable has an influence on another.  These types of question are generally used in experimental research questions.

References/Additional Resources

Lipowski, E. E. (2008). Developing great research questions . American Journal of Health-System Pharmacy, 65(17), 1667–1670.

Ratan, S. K., Anand, T., & Ratan, J. (2019). Formulation of Research Question - Stepwise Approach .  Journal of Indian Association of Pediatric Surgeons ,  24 (1), 15–20.

Fandino W.(2019). Formulating a good research question: Pearls and pitfalls . I ndian J Anaesth. 63(8) :611-616. 

Beck, L. L. (2023). The question: types of research questions and how to develop them . In Translational Surgery: Handbook for Designing and Conducting Clinical and Translational Research (pp. 111-120). Academic Press. 

Doody, O., & Bailey, M. E. (2016). Setting a research question, aim and objective. Nurse Researcher, 23(4), 19–23.

Plano Clark, V., & Badiee, M. (2010). Research questions in mixed methods research . In: SAGE Handbook of Mixed Methods in Social & Behavioral Research .  SAGE Publications, Inc.,

Agee, J. (2009). Developing qualitative research questions: A reflective process .  International journal of qualitative studies in education ,  22 (4), 431-447. 

Flemming, K., & Noyes, J. (2021). Qualitative Evidence Synthesis: Where Are We at? I nternational Journal of Qualitative Methods, 20.  

Research Question Frameworks

Research question frameworks have been designed to help structure research questions and clarify the main concepts. Not every question can fit perfectly into a framework, but using even just parts of a framework can help develop a well-defined research question. The framework to use depends on the type of question to be researched.   There are over 25 research question frameworks available.  The University of Maryland has a nice table listing out several of these research question frameworks, along with what the acronyms mean and what types of questions/disciplines that may be used for.

The process of developing a good research question involves taking your topic and breaking each aspect of it down into its component parts.

Booth, A., Noyes, J., Flemming, K., Moore, G., Tunçalp, Ö., & Shakibazadeh, E. (2019). Formulating questions to explore complex interventions within qualitative evidence synthesis.   BMJ global health ,  4 (Suppl 1), e001107. (See supplementary data#1)

The "Well-Built Clinical Question“: PICO(T)

One well-established framework that can be used both for refining questions and developing strategies is known as PICO(T). The PICO framework was designed primarily for questions that include interventions and comparisons, however other types of questions may also be able to follow its principles.  If the PICO(T) framework does not precisely fit your question, using its principles (see alternative component suggestions) can help you to think about what you want to explore even if you do not end up with a true PICO question.

A PICO(T) question has the following components:

• P : The patient’s disorder or disease or problem of interest / research object
• I: The intervention, exposure or finding under review / Application of a theory or method
• C: A comparison intervention or control (if applicable- not always present)/ Alternative theories or methods (or, in their absence, the null hypothesis)
• O : The outcome(s) (desired or of interest) / Knowledge generation
• T : (The time factor or period)

Keep in mind that solely using a tool will not enable you to design a good question. What is required is for you to think, carefully, about exactly what you want to study and precisely what you mean by each of the things that you think you want to study.

Rzany, & Bigby, M. (n.d.). Formulating Well-Built Clinical Questions. In Evidence-based dermatology / (pp. 27–30). Blackwell Pub/BMJ Books.  

Nishikawa-Pacher, A. (2022). Research questions with PICO: a universal mnemonic.   Publications ,  10 (3), 21.

• << Previous: Characteristics of a good research question
• Next: Choosing the Search Terms >>

• (855) 776-7763

Training Maker

All Products

Qualaroo Insights

ProProfs.com

• Get Started Free

FREE. All Features. FOREVER!

Try our Forever FREE account with all premium features!

How to Write Quantitative Research Questions: Types With Examples

Market Research Specialist

Emma David, a seasoned market research professional, specializes in employee engagement, survey administration, and data management. Her expertise in leveraging data for informed decisions has positively impacted several brands, enhancing their market position.

Has it ever happened that you conducted a quantitative research study and found out the results you were expecting are quite different from the actual results?

This could happen due to many factors like the unpredictable nature of respondents, errors in calculation, research bias, etc. However, your quantitative research usually does not provide reliable results when questions are not written correctly.

We get it! Structuring the quantitative research questions can be a difficult task.

Hence, in this blog, we will share a few bits of advice on how to write good quantitative research questions. We will also look at different types of quantitative research questions along with their examples.

Let’s start:

How to Write Quantitative Research Questions?

When you want to obtain actionable insight into the trends and patterns of the research topic to make sense of it, quantitative research questions are your best bet.

Being objective in nature, these questions provide you with detailed information about the research topic and help in collecting quantifiable data that can be easily analyzed. This data can be generalized to the entire population and help make data-driven and sound decisions.

Respondents find it easier to answer quantitative survey questions than qualitative questions. At the same time, researchers can also analyze them quickly using various statistical models.

However, when it comes to writing the quantitative research questions, one can get a little overwhelmed as the entire study depends on the types of questions used.

There is no “one good way” to prepare these questions. However, to design well-structured quantitative research questions, you can follow the 4-steps approach given below:

1. Select the Type of Quantitative Question

The first step is to determine which type of quantitative question you want to add to your study. There are three types of quantitative questions:

• Descriptive
• Comparative 
• Relationship-based

This will help you choose the correct words and phrases while constructing the question. At the same time, it will also assist readers in understanding the question correctly.

2. Identify the Type of Variable

The second step involves identifying the type of variable you are trying to measure, manipulate, or control. Basically, there are two types of variables:

• Independent variable (a variable that is being manipulated)
• Dependent variable (outcome variable)

If you plan to use descriptive research questions, you have to deal with a number of dependent variables. However, where you plan to create comparative or relationship research questions, you will deal with both dependent and independent variables.

3. Select the Suitable Structure

The next step is determining the structure of the research question. It involves:

• Identifying the components of the question. It involves the type of dependent or independent variable and a group of interest (the group from which the researcher tries to conclude the population).
• The number of different components used. Like, as to how many variables and groups are being examined.
• Order in which these are presented. For example, the independent variable before the dependent variable or vice versa.

4. Draft the Complete Research Question

The last step involves identifying the problem or issue that you are trying to address in the form of complete quantitative survey questions . Also, make sure to build an exhaustive list of response options to make sure your respondents select the correct response. If you miss adding important answer options, then the ones chosen by respondents may not be entirely true.

Want to create a quantitative research survey hassle-free? Explore our library of 1,000,000+ readymade questions.

Types of Quantitative Research Questions With Examples

Quantitative research questions are generally used to answer the “who” and “what” of the research topic. For quantitative research to be effective, it is crucial that the respondents are able to answer your questions concisely and precisely. With that in mind, let’s look in greater detail at the three types of formats you can use when preparing quantitative market research questions.

1. Descriptive 

Descriptive research questions are used to collect participants’ opinions about the variable that you want to quantify. It is the most effortless way to measure the particular variable (single or multiple variables) you are interested in on a large scale. Usually, descriptive research questions begin with “ how much,” “how often,” “what percentage,” “what proportion,” etc.

Examples of descriptive research questions include:

2. Comparative

Comparative research questions help you identify the difference between two or more groups based on one or more variables. In general, a comparative research question is used to quantify one variable; however, you can use two or more variables depending on your market research objectives.

Comparative research questions examples include:

3. Relationship-based

Relationship research questions are used to identify trends, causal relationships, or associations between two or more variables. It is not vital to distinguish between causal relationships, trends, or associations while using these types of questions. These questions begin with “What is the relationship” between independent and dependent variables, amongst or between two or more groups.

Relationship-based quantitative questions examples include:

Ready to Write Your Quantitative Research Questions?

So, there you have it. It was all about quantitative research question types and their examples. By now, you must have figured out a way to write quantitative research questions for your survey to collect actionable customer feedback.

Now, the only thing you need is a good survey maker tool , like ProProfs Survey Maker , that will glide your process of designing and conducting your surveys . You also get access to various survey question types, both qualitative and quantitative, that you can add to any kind of survey along with professionally-designed survey templates .

About the author

Emma David is a seasoned market research professional with 8+ years of experience. Having kick-started her journey in research, she has developed rich expertise in employee engagement, survey creation and administration, and data management. Emma believes in the power of data to shape business performance positively. She continues to help brands and businesses make strategic decisions and improve their market standing through her understanding of research methodologies.

Related Posts

Employee Pulse Surveys: Everything You Need To Know

55+ Brand Awareness Survey Questions to Ask in 2024

What is Diversity, Equity, and Inclusion (DEI)? 25+ Survey Questions to Ask

How Demographics Surveys Make Marketing Metrics Stand-Out

Data Collection Methods: Definition, Types & Examples

Qualitative Research Methods: Types, Examples, and Analysis

Ohio State nav bar

The Ohio State University

• BuckeyeLink
• Find People
• Search Ohio State

Research Questions & Hypotheses

Generally, in quantitative studies, reviewers expect hypotheses rather than research questions. However, both research questions and hypotheses serve different purposes and can be beneficial when used together.

Research Questions

Clarify the research’s aim (farrugia et al., 2010).

• Research often begins with an interest in a topic, but a deep understanding of the subject is crucial to formulate an appropriate research question.
• Descriptive: “What factors most influence the academic achievement of senior high school students?”
• Comparative: “What is the performance difference between teaching methods A and B?”
• Relationship-based: “What is the relationship between self-efficacy and academic achievement?”
• Increasing knowledge about a subject can be achieved through systematic literature reviews, in-depth interviews with patients (and proxies), focus groups, and consultations with field experts.
• Some funding bodies, like the Canadian Institute for Health Research, recommend conducting a systematic review or a pilot study before seeking grants for full trials.
• The presence of multiple research questions in a study can complicate the design, statistical analysis, and feasibility.
• It’s advisable to focus on a single primary research question for the study.
• The primary question, clearly stated at the end of a grant proposal’s introduction, usually specifies the study population, intervention, and other relevant factors.
• The FINER criteria underscore aspects that can enhance the chances of a successful research project, including specifying the population of interest, aligning with scientific and public interest, clinical relevance, and contribution to the field, while complying with ethical and national research standards.

• The P ICOT approach is crucial in developing the study’s framework and protocol, influencing inclusion and exclusion criteria and identifying patient groups for inclusion.

• Defining the specific population, intervention, comparator, and outcome helps in selecting the right outcome measurement tool.
• The more precise the population definition and stricter the inclusion and exclusion criteria, the more significant the impact on the interpretation, applicability, and generalizability of the research findings.
• A restricted study population enhances internal validity but may limit the study’s external validity and generalizability to clinical practice.
• A broadly defined study population may better reflect clinical practice but could increase bias and reduce internal validity.
• An inadequately formulated research question can negatively impact study design, potentially leading to ineffective outcomes and affecting publication prospects.

Checklist: Good research questions for social science projects (Panke, 2018)

Research Hypotheses

Present the researcher’s predictions based on specific statements.

• These statements define the research problem or issue and indicate the direction of the researcher’s predictions.
• Formulating the research question and hypothesis from existing data (e.g., a database) can lead to multiple statistical comparisons and potentially spurious findings due to chance.
• The research or clinical hypothesis, derived from the research question, shapes the study’s key elements: sampling strategy, intervention, comparison, and outcome variables.
• Hypotheses can express a single outcome or multiple outcomes.
• After statistical testing, the null hypothesis is either rejected or not rejected based on whether the study’s findings are statistically significant.
• Hypothesis testing helps determine if observed findings are due to true differences and not chance.
• Hypotheses can be 1-sided (specific direction of difference) or 2-sided (presence of a difference without specifying direction).
• 2-sided hypotheses are generally preferred unless there’s a strong justification for a 1-sided hypothesis.
• A solid research hypothesis, informed by a good research question, influences the research design and paves the way for defining clear research objectives.

Types of Research Hypothesis

• In a Y-centered research design, the focus is on the dependent variable (DV) which is specified in the research question. Theories are then used to identify independent variables (IV) and explain their causal relationship with the DV.
• Example: “An increase in teacher-led instructional time (IV) is likely to improve student reading comprehension scores (DV), because extensive guided practice under expert supervision enhances learning retention and skill mastery.”
• Hypothesis Explanation: The dependent variable (student reading comprehension scores) is the focus, and the hypothesis explores how changes in the independent variable (teacher-led instructional time) affect it.
• In X-centered research designs, the independent variable is specified in the research question. Theories are used to determine potential dependent variables and the causal mechanisms at play.
• Example: “Implementing technology-based learning tools (IV) is likely to enhance student engagement in the classroom (DV), because interactive and multimedia content increases student interest and participation.”
• Hypothesis Explanation: The independent variable (technology-based learning tools) is the focus, with the hypothesis exploring its impact on a potential dependent variable (student engagement).
• Probabilistic hypotheses suggest that changes in the independent variable are likely to lead to changes in the dependent variable in a predictable manner, but not with absolute certainty.
• Example: “The more teachers engage in professional development programs (IV), the more their teaching effectiveness (DV) is likely to improve, because continuous training updates pedagogical skills and knowledge.”
• Hypothesis Explanation: This hypothesis implies a probable relationship between the extent of professional development (IV) and teaching effectiveness (DV).
• Deterministic hypotheses state that a specific change in the independent variable will lead to a specific change in the dependent variable, implying a more direct and certain relationship.
• Example: “If the school curriculum changes from traditional lecture-based methods to project-based learning (IV), then student collaboration skills (DV) are expected to improve because project-based learning inherently requires teamwork and peer interaction.”
• Hypothesis Explanation: This hypothesis presumes a direct and definite outcome (improvement in collaboration skills) resulting from a specific change in the teaching method.
• Example : “Students who identify as visual learners will score higher on tests that are presented in a visually rich format compared to tests presented in a text-only format.”
• Explanation : This hypothesis aims to describe the potential difference in test scores between visual learners taking visually rich tests and text-only tests, without implying a direct cause-and-effect relationship.
• Example : “Teaching method A will improve student performance more than method B.”
• Explanation : This hypothesis compares the effectiveness of two different teaching methods, suggesting that one will lead to better student performance than the other. It implies a direct comparison but does not necessarily establish a causal mechanism.
• Example : “Students with higher self-efficacy will show higher levels of academic achievement.”
• Explanation : This hypothesis predicts a relationship between the variable of self-efficacy and academic achievement. Unlike a causal hypothesis, it does not necessarily suggest that one variable causes changes in the other, but rather that they are related in some way.

Tips for developing research questions and hypotheses for research studies

• Perform a systematic literature review (if one has not been done) to increase knowledge and familiarity with the topic and to assist with research development.
• Learn about current trends and technological advances on the topic.
• Seek careful input from experts, mentors, colleagues, and collaborators to refine your research question as this will aid in developing the research question and guide the research study.
• Use the FINER criteria in the development of the research question.
• Ensure that the research question follows PICOT format.
• Develop a research hypothesis from the research question.
• Ensure that the research question and objectives are answerable, feasible, and clinically relevant.

If your research hypotheses are derived from your research questions, particularly when multiple hypotheses address a single question, it’s recommended to use both research questions and hypotheses. However, if this isn’t the case, using hypotheses over research questions is advised. It’s important to note these are general guidelines, not strict rules. If you opt not to use hypotheses, consult with your supervisor for the best approach.

Farrugia, P., Petrisor, B. A., Farrokhyar, F., & Bhandari, M. (2010). Practical tips for surgical research: Research questions, hypotheses and objectives.  Canadian journal of surgery. Journal canadien de chirurgie ,  53 (4), 278–281.

Hulley, S. B., Cummings, S. R., Browner, W. S., Grady, D., & Newman, T. B. (2007). Designing clinical research. Philadelphia.

Panke, D. (2018). Research design & method selection: Making good choices in the social sciences.  Research Design & Method Selection , 1-368.

What is comparative analysis? A complete guide

Last updated

18 April 2023

Reviewed by

Jean Kaluza

Short on time? Get an AI generated summary of this article instead

Comparative analysis is a valuable tool for acquiring deep insights into your organization’s processes, products, and services so you can continuously improve them. 

Similarly, if you want to streamline, price appropriately, and ultimately be a market leader, you’ll likely need to draw on comparative analyses quite often.

When faced with multiple options or solutions to a given problem, a thorough comparative analysis can help you compare and contrast your options and make a clear, informed decision.

If you want to get up to speed on conducting a comparative analysis or need a refresher, here’s your guide.

Make comparative analysis less tedious

Dovetail streamlines comparative analysis to help you uncover and share actionable insights

• What exactly is comparative analysis?

A comparative analysis is a side-by-side comparison that systematically compares two or more things to pinpoint their similarities and differences. The focus of the investigation might be conceptual—a particular problem, idea, or theory—or perhaps something more tangible, like two different data sets.

For instance, you could use comparative analysis to investigate how your product features measure up to the competition.

After a successful comparative analysis, you should be able to identify strengths and weaknesses and clearly understand which product is more effective.

You could also use comparative analysis to examine different methods of producing that product and determine which way is most efficient and profitable.

The potential applications for using comparative analysis in everyday business are almost unlimited. That said, a comparative analysis is most commonly used to examine

Emerging trends and opportunities (new technologies, marketing)

Competitor strategies

Financial health

Effects of trends on a target audience

Free AI content analysis generator

Make sense of your research by automatically summarizing key takeaways through our free content analysis tool.

• Why is comparative analysis so important? 

Comparative analysis can help narrow your focus so your business pursues the most meaningful opportunities rather than attempting dozens of improvements simultaneously.

A comparative approach also helps frame up data to illuminate interrelationships. For example, comparative research might reveal nuanced relationships or critical contexts behind specific processes or dependencies that wouldn’t be well-understood without the research.

For instance, if your business compares the cost of producing several existing products relative to which ones have historically sold well, that should provide helpful information once you’re ready to look at developing new products or features.

• Comparative vs. competitive analysis—what’s the difference?

Comparative analysis is generally divided into three subtypes, using quantitative or qualitative data and then extending the findings to a larger group. These include

Pattern analysis —identifying patterns or recurrences of trends and behavior across large data sets.

Data filtering —analyzing large data sets to extract an underlying subset of information. It may involve rearranging, excluding, and apportioning comparative data to fit different criteria. 

Decision tree —flowcharting to visually map and assess potential outcomes, costs, and consequences.

In contrast, competitive analysis is a type of comparative analysis in which you deeply research one or more of your industry competitors. In this case, you’re using qualitative research to explore what the competition is up to across one or more dimensions.

For example

Service delivery —metrics like the Net Promoter Scores indicate customer satisfaction levels.

Market position — the share of the market that the competition has captured.

Brand reputation —how well-known or recognized your competitors are within their target market.

• Tips for optimizing your comparative analysis

Conduct original research

Thorough, independent research is a significant asset when doing comparative analysis. It provides evidence to support your findings and may present a perspective or angle not considered previously. 

Make analysis routine

To get the maximum benefit from comparative research, make it a regular practice, and establish a cadence you can realistically stick to. Some business areas you could plan to analyze regularly include:

Profitability

Competition

Experiment with controlled and uncontrolled variables

In addition to simply comparing and contrasting, explore how different variables might affect your outcomes.

For example, a controllable variable would be offering a seasonal feature like a shopping bot to assist in holiday shopping or raising or lowering the selling price of a product.

Uncontrollable variables include weather, changing regulations, the current political climate, or global pandemics.

Put equal effort into each point of comparison

Most people enter into comparative research with a particular idea or hypothesis already in mind to validate. For instance, you might try to prove the worthwhileness of launching a new service. So, you may be disappointed if your analysis results don’t support your plan.

However, in any comparative analysis, try to maintain an unbiased approach by spending equal time debating the merits and drawbacks of any decision. Ultimately, this will be a practical, more long-term sustainable approach for your business than focusing only on the evidence that favors pursuing your argument or strategy.

Writing a comparative analysis in five steps

To put together a coherent, insightful analysis that goes beyond a list of pros and cons or similarities and differences, try organizing the information into these five components:

1. Frame of reference

Here is where you provide context. First, what driving idea or problem is your research anchored in? Then, for added substance, cite existing research or insights from a subject matter expert, such as a thought leader in marketing, startup growth, or investment

2. Grounds for comparison Why have you chosen to examine the two things you’re analyzing instead of focusing on two entirely different things? What are you hoping to accomplish?

3. Thesis What argument or choice are you advocating for? What will be the before and after effects of going with either decision? What do you anticipate happening with and without this approach?

For example, “If we release an AI feature for our shopping cart, we will have an edge over the rest of the market before the holiday season.” The finished comparative analysis will weigh all the pros and cons of choosing to build the new expensive AI feature including variables like how “intelligent” it will be, what it “pushes” customers to use, how much it takes off the plates of customer service etc.

Ultimately, you will gauge whether building an AI feature is the right plan for your e-commerce shop.

4. Organize the scheme Typically, there are two ways to organize a comparative analysis report. First, you can discuss everything about comparison point “A” and then go into everything about aspect “B.” Or, you alternate back and forth between points “A” and “B,” sometimes referred to as point-by-point analysis.

Using the AI feature as an example again, you could cover all the pros and cons of building the AI feature, then discuss the benefits and drawbacks of building and maintaining the feature. Or you could compare and contrast each aspect of the AI feature, one at a time. For example, a side-by-side comparison of the AI feature to shopping without it, then proceeding to another point of differentiation.

5. Connect the dots Tie it all together in a way that either confirms or disproves your hypothesis.

For instance, “Building the AI bot would allow our customer service team to save 12% on returns in Q3 while offering optimizations and savings in future strategies. However, it would also increase the product development budget by 43% in both Q1 and Q2. Our budget for product development won’t increase again until series 3 of funding is reached, so despite its potential, we will hold off building the bot until funding is secured and more opportunities and benefits can be proved effective.”

Should you be using a customer insights hub?

Do you want to discover previous research faster?

Do you share your research findings with others?

Do you analyze research data?

Start for free today, add your research, and get to key insights faster

Editor’s picks

Last updated: 18 April 2023

Last updated: 27 February 2023

Last updated: 5 February 2023

Last updated: 16 April 2023

Last updated: 16 August 2024

Last updated: 9 March 2023

Last updated: 30 April 2024

Last updated: 12 December 2023

Last updated: 11 March 2024

Last updated: 4 July 2024

Last updated: 6 March 2024

Last updated: 5 March 2024

Last updated: 13 May 2024

Latest articles

Related topics, .css-je19u9{-webkit-align-items:flex-end;-webkit-box-align:flex-end;-ms-flex-align:flex-end;align-items:flex-end;display:-webkit-box;display:-webkit-flex;display:-ms-flexbox;display:flex;-webkit-flex-direction:row;-ms-flex-direction:row;flex-direction:row;-webkit-box-flex-wrap:wrap;-webkit-flex-wrap:wrap;-ms-flex-wrap:wrap;flex-wrap:wrap;-webkit-box-pack:center;-ms-flex-pack:center;-webkit-justify-content:center;justify-content:center;row-gap:0;text-align:center;max-width:671px;}@media (max-width: 1079px){.css-je19u9{max-width:400px;}.css-je19u9>span{white-space:pre;}}@media (max-width: 799px){.css-je19u9{max-width:400px;}.css-je19u9>span{white-space:pre;}} decide what to .css-1kiodld{max-height:56px;display:-webkit-box;display:-webkit-flex;display:-ms-flexbox;display:flex;-webkit-align-items:center;-webkit-box-align:center;-ms-flex-align:center;align-items:center;}@media (max-width: 1079px){.css-1kiodld{display:none;}} build next, decide what to build next, log in or sign up.

Get started for free

An official website of the United States government

The .gov means it’s official. Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

The site is secure. The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

• Publications
• Account settings

Preview improvements coming to the PMC website in October 2024. Learn More or Try it out now .

• Advanced Search
• Journal List
• J Korean Med Sci
• v.37(16); 2022 Apr 25

A Practical Guide to Writing Quantitative and Qualitative Research Questions and Hypotheses in Scholarly Articles

Edward barroga.

1 Department of General Education, Graduate School of Nursing Science, St. Luke’s International University, Tokyo, Japan.

Glafera Janet Matanguihan

2 Department of Biological Sciences, Messiah University, Mechanicsburg, PA, USA.

The development of research questions and the subsequent hypotheses are prerequisites to defining the main research purpose and specific objectives of a study. Consequently, these objectives determine the study design and research outcome. The development of research questions is a process based on knowledge of current trends, cutting-edge studies, and technological advances in the research field. Excellent research questions are focused and require a comprehensive literature search and in-depth understanding of the problem being investigated. Initially, research questions may be written as descriptive questions which could be developed into inferential questions. These questions must be specific and concise to provide a clear foundation for developing hypotheses. Hypotheses are more formal predictions about the research outcomes. These specify the possible results that may or may not be expected regarding the relationship between groups. Thus, research questions and hypotheses clarify the main purpose and specific objectives of the study, which in turn dictate the design of the study, its direction, and outcome. Studies developed from good research questions and hypotheses will have trustworthy outcomes with wide-ranging social and health implications.

INTRODUCTION

Scientific research is usually initiated by posing evidenced-based research questions which are then explicitly restated as hypotheses. 1 , 2 The hypotheses provide directions to guide the study, solutions, explanations, and expected results. 3 , 4 Both research questions and hypotheses are essentially formulated based on conventional theories and real-world processes, which allow the inception of novel studies and the ethical testing of ideas. 5 , 6

It is crucial to have knowledge of both quantitative and qualitative research 2 as both types of research involve writing research questions and hypotheses. 7 However, these crucial elements of research are sometimes overlooked; if not overlooked, then framed without the forethought and meticulous attention it needs. Planning and careful consideration are needed when developing quantitative or qualitative research, particularly when conceptualizing research questions and hypotheses. 4

There is a continuing need to support researchers in the creation of innovative research questions and hypotheses, as well as for journal articles that carefully review these elements. 1 When research questions and hypotheses are not carefully thought of, unethical studies and poor outcomes usually ensue. Carefully formulated research questions and hypotheses define well-founded objectives, which in turn determine the appropriate design, course, and outcome of the study. This article then aims to discuss in detail the various aspects of crafting research questions and hypotheses, with the goal of guiding researchers as they develop their own. Examples from the authors and peer-reviewed scientific articles in the healthcare field are provided to illustrate key points.

DEFINITIONS AND RELATIONSHIP OF RESEARCH QUESTIONS AND HYPOTHESES

A research question is what a study aims to answer after data analysis and interpretation. The answer is written in length in the discussion section of the paper. Thus, the research question gives a preview of the different parts and variables of the study meant to address the problem posed in the research question. 1 An excellent research question clarifies the research writing while facilitating understanding of the research topic, objective, scope, and limitations of the study. 5

On the other hand, a research hypothesis is an educated statement of an expected outcome. This statement is based on background research and current knowledge. 8 , 9 The research hypothesis makes a specific prediction about a new phenomenon 10 or a formal statement on the expected relationship between an independent variable and a dependent variable. 3 , 11 It provides a tentative answer to the research question to be tested or explored. 4

Hypotheses employ reasoning to predict a theory-based outcome. 10 These can also be developed from theories by focusing on components of theories that have not yet been observed. 10 The validity of hypotheses is often based on the testability of the prediction made in a reproducible experiment. 8

Conversely, hypotheses can also be rephrased as research questions. Several hypotheses based on existing theories and knowledge may be needed to answer a research question. Developing ethical research questions and hypotheses creates a research design that has logical relationships among variables. These relationships serve as a solid foundation for the conduct of the study. 4 , 11 Haphazardly constructed research questions can result in poorly formulated hypotheses and improper study designs, leading to unreliable results. Thus, the formulations of relevant research questions and verifiable hypotheses are crucial when beginning research. 12

CHARACTERISTICS OF GOOD RESEARCH QUESTIONS AND HYPOTHESES

Excellent research questions are specific and focused. These integrate collective data and observations to confirm or refute the subsequent hypotheses. Well-constructed hypotheses are based on previous reports and verify the research context. These are realistic, in-depth, sufficiently complex, and reproducible. More importantly, these hypotheses can be addressed and tested. 13

There are several characteristics of well-developed hypotheses. Good hypotheses are 1) empirically testable 7 , 10 , 11 , 13 ; 2) backed by preliminary evidence 9 ; 3) testable by ethical research 7 , 9 ; 4) based on original ideas 9 ; 5) have evidenced-based logical reasoning 10 ; and 6) can be predicted. 11 Good hypotheses can infer ethical and positive implications, indicating the presence of a relationship or effect relevant to the research theme. 7 , 11 These are initially developed from a general theory and branch into specific hypotheses by deductive reasoning. In the absence of a theory to base the hypotheses, inductive reasoning based on specific observations or findings form more general hypotheses. 10

TYPES OF RESEARCH QUESTIONS AND HYPOTHESES

Research questions and hypotheses are developed according to the type of research, which can be broadly classified into quantitative and qualitative research. We provide a summary of the types of research questions and hypotheses under quantitative and qualitative research categories in Table 1 .

Research questions in quantitative research

In quantitative research, research questions inquire about the relationships among variables being investigated and are usually framed at the start of the study. These are precise and typically linked to the subject population, dependent and independent variables, and research design. 1 Research questions may also attempt to describe the behavior of a population in relation to one or more variables, or describe the characteristics of variables to be measured ( descriptive research questions ). 1 , 5 , 14 These questions may also aim to discover differences between groups within the context of an outcome variable ( comparative research questions ), 1 , 5 , 14 or elucidate trends and interactions among variables ( relationship research questions ). 1 , 5 We provide examples of descriptive, comparative, and relationship research questions in quantitative research in Table 2 .

Hypotheses in quantitative research

In quantitative research, hypotheses predict the expected relationships among variables. 15 Relationships among variables that can be predicted include 1) between a single dependent variable and a single independent variable ( simple hypothesis ) or 2) between two or more independent and dependent variables ( complex hypothesis ). 4 , 11 Hypotheses may also specify the expected direction to be followed and imply an intellectual commitment to a particular outcome ( directional hypothesis ) 4 . On the other hand, hypotheses may not predict the exact direction and are used in the absence of a theory, or when findings contradict previous studies ( non-directional hypothesis ). 4 In addition, hypotheses can 1) define interdependency between variables ( associative hypothesis ), 4 2) propose an effect on the dependent variable from manipulation of the independent variable ( causal hypothesis ), 4 3) state a negative relationship between two variables ( null hypothesis ), 4 , 11 , 15 4) replace the working hypothesis if rejected ( alternative hypothesis ), 15 explain the relationship of phenomena to possibly generate a theory ( working hypothesis ), 11 5) involve quantifiable variables that can be tested statistically ( statistical hypothesis ), 11 6) or express a relationship whose interlinks can be verified logically ( logical hypothesis ). 11 We provide examples of simple, complex, directional, non-directional, associative, causal, null, alternative, working, statistical, and logical hypotheses in quantitative research, as well as the definition of quantitative hypothesis-testing research in Table 3 .

Research questions in qualitative research

Unlike research questions in quantitative research, research questions in qualitative research are usually continuously reviewed and reformulated. The central question and associated subquestions are stated more than the hypotheses. 15 The central question broadly explores a complex set of factors surrounding the central phenomenon, aiming to present the varied perspectives of participants. 15

There are varied goals for which qualitative research questions are developed. These questions can function in several ways, such as to 1) identify and describe existing conditions ( contextual research question s); 2) describe a phenomenon ( descriptive research questions ); 3) assess the effectiveness of existing methods, protocols, theories, or procedures ( evaluation research questions ); 4) examine a phenomenon or analyze the reasons or relationships between subjects or phenomena ( explanatory research questions ); or 5) focus on unknown aspects of a particular topic ( exploratory research questions ). 5 In addition, some qualitative research questions provide new ideas for the development of theories and actions ( generative research questions ) or advance specific ideologies of a position ( ideological research questions ). 1 Other qualitative research questions may build on a body of existing literature and become working guidelines ( ethnographic research questions ). Research questions may also be broadly stated without specific reference to the existing literature or a typology of questions ( phenomenological research questions ), may be directed towards generating a theory of some process ( grounded theory questions ), or may address a description of the case and the emerging themes ( qualitative case study questions ). 15 We provide examples of contextual, descriptive, evaluation, explanatory, exploratory, generative, ideological, ethnographic, phenomenological, grounded theory, and qualitative case study research questions in qualitative research in Table 4 , and the definition of qualitative hypothesis-generating research in Table 5 .

Qualitative studies usually pose at least one central research question and several subquestions starting with How or What . These research questions use exploratory verbs such as explore or describe . These also focus on one central phenomenon of interest, and may mention the participants and research site. 15

Hypotheses in qualitative research

Hypotheses in qualitative research are stated in the form of a clear statement concerning the problem to be investigated. Unlike in quantitative research where hypotheses are usually developed to be tested, qualitative research can lead to both hypothesis-testing and hypothesis-generating outcomes. 2 When studies require both quantitative and qualitative research questions, this suggests an integrative process between both research methods wherein a single mixed-methods research question can be developed. 1

FRAMEWORKS FOR DEVELOPING RESEARCH QUESTIONS AND HYPOTHESES

Research questions followed by hypotheses should be developed before the start of the study. 1 , 12 , 14 It is crucial to develop feasible research questions on a topic that is interesting to both the researcher and the scientific community. This can be achieved by a meticulous review of previous and current studies to establish a novel topic. Specific areas are subsequently focused on to generate ethical research questions. The relevance of the research questions is evaluated in terms of clarity of the resulting data, specificity of the methodology, objectivity of the outcome, depth of the research, and impact of the study. 1 , 5 These aspects constitute the FINER criteria (i.e., Feasible, Interesting, Novel, Ethical, and Relevant). 1 Clarity and effectiveness are achieved if research questions meet the FINER criteria. In addition to the FINER criteria, Ratan et al. described focus, complexity, novelty, feasibility, and measurability for evaluating the effectiveness of research questions. 14

The PICOT and PEO frameworks are also used when developing research questions. 1 The following elements are addressed in these frameworks, PICOT: P-population/patients/problem, I-intervention or indicator being studied, C-comparison group, O-outcome of interest, and T-timeframe of the study; PEO: P-population being studied, E-exposure to preexisting conditions, and O-outcome of interest. 1 Research questions are also considered good if these meet the “FINERMAPS” framework: Feasible, Interesting, Novel, Ethical, Relevant, Manageable, Appropriate, Potential value/publishable, and Systematic. 14

As we indicated earlier, research questions and hypotheses that are not carefully formulated result in unethical studies or poor outcomes. To illustrate this, we provide some examples of ambiguous research question and hypotheses that result in unclear and weak research objectives in quantitative research ( Table 6 ) 16 and qualitative research ( Table 7 ) 17 , and how to transform these ambiguous research question(s) and hypothesis(es) into clear and good statements.

a These statements were composed for comparison and illustrative purposes only.

b These statements are direct quotes from Higashihara and Horiuchi. 16

a This statement is a direct quote from Shimoda et al. 17

The other statements were composed for comparison and illustrative purposes only.

CONSTRUCTING RESEARCH QUESTIONS AND HYPOTHESES

To construct effective research questions and hypotheses, it is very important to 1) clarify the background and 2) identify the research problem at the outset of the research, within a specific timeframe. 9 Then, 3) review or conduct preliminary research to collect all available knowledge about the possible research questions by studying theories and previous studies. 18 Afterwards, 4) construct research questions to investigate the research problem. Identify variables to be accessed from the research questions 4 and make operational definitions of constructs from the research problem and questions. Thereafter, 5) construct specific deductive or inductive predictions in the form of hypotheses. 4 Finally, 6) state the study aims . This general flow for constructing effective research questions and hypotheses prior to conducting research is shown in Fig. 1 .

Research questions are used more frequently in qualitative research than objectives or hypotheses. 3 These questions seek to discover, understand, explore or describe experiences by asking “What” or “How.” The questions are open-ended to elicit a description rather than to relate variables or compare groups. The questions are continually reviewed, reformulated, and changed during the qualitative study. 3 Research questions are also used more frequently in survey projects than hypotheses in experiments in quantitative research to compare variables and their relationships.

Hypotheses are constructed based on the variables identified and as an if-then statement, following the template, ‘If a specific action is taken, then a certain outcome is expected.’ At this stage, some ideas regarding expectations from the research to be conducted must be drawn. 18 Then, the variables to be manipulated (independent) and influenced (dependent) are defined. 4 Thereafter, the hypothesis is stated and refined, and reproducible data tailored to the hypothesis are identified, collected, and analyzed. 4 The hypotheses must be testable and specific, 18 and should describe the variables and their relationships, the specific group being studied, and the predicted research outcome. 18 Hypotheses construction involves a testable proposition to be deduced from theory, and independent and dependent variables to be separated and measured separately. 3 Therefore, good hypotheses must be based on good research questions constructed at the start of a study or trial. 12

In summary, research questions are constructed after establishing the background of the study. Hypotheses are then developed based on the research questions. Thus, it is crucial to have excellent research questions to generate superior hypotheses. In turn, these would determine the research objectives and the design of the study, and ultimately, the outcome of the research. 12 Algorithms for building research questions and hypotheses are shown in Fig. 2 for quantitative research and in Fig. 3 for qualitative research.

EXAMPLES OF RESEARCH QUESTIONS FROM PUBLISHED ARTICLES

• EXAMPLE 1. Descriptive research question (quantitative research)
• - Presents research variables to be assessed (distinct phenotypes and subphenotypes)
• “BACKGROUND: Since COVID-19 was identified, its clinical and biological heterogeneity has been recognized. Identifying COVID-19 phenotypes might help guide basic, clinical, and translational research efforts.
• RESEARCH QUESTION: Does the clinical spectrum of patients with COVID-19 contain distinct phenotypes and subphenotypes? ” 19
• EXAMPLE 2. Relationship research question (quantitative research)
• - Shows interactions between dependent variable (static postural control) and independent variable (peripheral visual field loss)
• “Background: Integration of visual, vestibular, and proprioceptive sensations contributes to postural control. People with peripheral visual field loss have serious postural instability. However, the directional specificity of postural stability and sensory reweighting caused by gradual peripheral visual field loss remain unclear.
• Research question: What are the effects of peripheral visual field loss on static postural control ?” 20
• EXAMPLE 3. Comparative research question (quantitative research)
• - Clarifies the difference among groups with an outcome variable (patients enrolled in COMPERA with moderate PH or severe PH in COPD) and another group without the outcome variable (patients with idiopathic pulmonary arterial hypertension (IPAH))
• “BACKGROUND: Pulmonary hypertension (PH) in COPD is a poorly investigated clinical condition.
• RESEARCH QUESTION: Which factors determine the outcome of PH in COPD?
• STUDY DESIGN AND METHODS: We analyzed the characteristics and outcome of patients enrolled in the Comparative, Prospective Registry of Newly Initiated Therapies for Pulmonary Hypertension (COMPERA) with moderate or severe PH in COPD as defined during the 6th PH World Symposium who received medical therapy for PH and compared them with patients with idiopathic pulmonary arterial hypertension (IPAH) .” 21
• EXAMPLE 4. Exploratory research question (qualitative research)
• - Explores areas that have not been fully investigated (perspectives of families and children who receive care in clinic-based child obesity treatment) to have a deeper understanding of the research problem
• “Problem: Interventions for children with obesity lead to only modest improvements in BMI and long-term outcomes, and data are limited on the perspectives of families of children with obesity in clinic-based treatment. This scoping review seeks to answer the question: What is known about the perspectives of families and children who receive care in clinic-based child obesity treatment? This review aims to explore the scope of perspectives reported by families of children with obesity who have received individualized outpatient clinic-based obesity treatment.” 22
• EXAMPLE 5. Relationship research question (quantitative research)
• - Defines interactions between dependent variable (use of ankle strategies) and independent variable (changes in muscle tone)
• “Background: To maintain an upright standing posture against external disturbances, the human body mainly employs two types of postural control strategies: “ankle strategy” and “hip strategy.” While it has been reported that the magnitude of the disturbance alters the use of postural control strategies, it has not been elucidated how the level of muscle tone, one of the crucial parameters of bodily function, determines the use of each strategy. We have previously confirmed using forward dynamics simulations of human musculoskeletal models that an increased muscle tone promotes the use of ankle strategies. The objective of the present study was to experimentally evaluate a hypothesis: an increased muscle tone promotes the use of ankle strategies. Research question: Do changes in the muscle tone affect the use of ankle strategies ?” 23

EXAMPLES OF HYPOTHESES IN PUBLISHED ARTICLES

• EXAMPLE 1. Working hypothesis (quantitative research)
• - A hypothesis that is initially accepted for further research to produce a feasible theory
• “As fever may have benefit in shortening the duration of viral illness, it is plausible to hypothesize that the antipyretic efficacy of ibuprofen may be hindering the benefits of a fever response when taken during the early stages of COVID-19 illness .” 24
• “In conclusion, it is plausible to hypothesize that the antipyretic efficacy of ibuprofen may be hindering the benefits of a fever response . The difference in perceived safety of these agents in COVID-19 illness could be related to the more potent efficacy to reduce fever with ibuprofen compared to acetaminophen. Compelling data on the benefit of fever warrant further research and review to determine when to treat or withhold ibuprofen for early stage fever for COVID-19 and other related viral illnesses .” 24
• EXAMPLE 2. Exploratory hypothesis (qualitative research)
• - Explores particular areas deeper to clarify subjective experience and develop a formal hypothesis potentially testable in a future quantitative approach
• “We hypothesized that when thinking about a past experience of help-seeking, a self distancing prompt would cause increased help-seeking intentions and more favorable help-seeking outcome expectations .” 25
• “Conclusion
• Although a priori hypotheses were not supported, further research is warranted as results indicate the potential for using self-distancing approaches to increasing help-seeking among some people with depressive symptomatology.” 25
• EXAMPLE 3. Hypothesis-generating research to establish a framework for hypothesis testing (qualitative research)
• “We hypothesize that compassionate care is beneficial for patients (better outcomes), healthcare systems and payers (lower costs), and healthcare providers (lower burnout). ” 26
• Compassionomics is the branch of knowledge and scientific study of the effects of compassionate healthcare. Our main hypotheses are that compassionate healthcare is beneficial for (1) patients, by improving clinical outcomes, (2) healthcare systems and payers, by supporting financial sustainability, and (3) HCPs, by lowering burnout and promoting resilience and well-being. The purpose of this paper is to establish a scientific framework for testing the hypotheses above . If these hypotheses are confirmed through rigorous research, compassionomics will belong in the science of evidence-based medicine, with major implications for all healthcare domains.” 26
• EXAMPLE 4. Statistical hypothesis (quantitative research)
• - An assumption is made about the relationship among several population characteristics ( gender differences in sociodemographic and clinical characteristics of adults with ADHD ). Validity is tested by statistical experiment or analysis ( chi-square test, Students t-test, and logistic regression analysis)
• “Our research investigated gender differences in sociodemographic and clinical characteristics of adults with ADHD in a Japanese clinical sample. Due to unique Japanese cultural ideals and expectations of women's behavior that are in opposition to ADHD symptoms, we hypothesized that women with ADHD experience more difficulties and present more dysfunctions than men . We tested the following hypotheses: first, women with ADHD have more comorbidities than men with ADHD; second, women with ADHD experience more social hardships than men, such as having less full-time employment and being more likely to be divorced.” 27
• “Statistical Analysis
• ( text omitted ) Between-gender comparisons were made using the chi-squared test for categorical variables and Students t-test for continuous variables…( text omitted ). A logistic regression analysis was performed for employment status, marital status, and comorbidity to evaluate the independent effects of gender on these dependent variables.” 27

EXAMPLES OF HYPOTHESIS AS WRITTEN IN PUBLISHED ARTICLES IN RELATION TO OTHER PARTS

• EXAMPLE 1. Background, hypotheses, and aims are provided
• “Pregnant women need skilled care during pregnancy and childbirth, but that skilled care is often delayed in some countries …( text omitted ). The focused antenatal care (FANC) model of WHO recommends that nurses provide information or counseling to all pregnant women …( text omitted ). Job aids are visual support materials that provide the right kind of information using graphics and words in a simple and yet effective manner. When nurses are not highly trained or have many work details to attend to, these job aids can serve as a content reminder for the nurses and can be used for educating their patients (Jennings, Yebadokpo, Affo, & Agbogbe, 2010) ( text omitted ). Importantly, additional evidence is needed to confirm how job aids can further improve the quality of ANC counseling by health workers in maternal care …( text omitted )” 28
• “ This has led us to hypothesize that the quality of ANC counseling would be better if supported by job aids. Consequently, a better quality of ANC counseling is expected to produce higher levels of awareness concerning the danger signs of pregnancy and a more favorable impression of the caring behavior of nurses .” 28
• “This study aimed to examine the differences in the responses of pregnant women to a job aid-supported intervention during ANC visit in terms of 1) their understanding of the danger signs of pregnancy and 2) their impression of the caring behaviors of nurses to pregnant women in rural Tanzania.” 28
• EXAMPLE 2. Background, hypotheses, and aims are provided
• “We conducted a two-arm randomized controlled trial (RCT) to evaluate and compare changes in salivary cortisol and oxytocin levels of first-time pregnant women between experimental and control groups. The women in the experimental group touched and held an infant for 30 min (experimental intervention protocol), whereas those in the control group watched a DVD movie of an infant (control intervention protocol). The primary outcome was salivary cortisol level and the secondary outcome was salivary oxytocin level.” 29
• “ We hypothesize that at 30 min after touching and holding an infant, the salivary cortisol level will significantly decrease and the salivary oxytocin level will increase in the experimental group compared with the control group .” 29
• EXAMPLE 3. Background, aim, and hypothesis are provided
• “In countries where the maternal mortality ratio remains high, antenatal education to increase Birth Preparedness and Complication Readiness (BPCR) is considered one of the top priorities [1]. BPCR includes birth plans during the antenatal period, such as the birthplace, birth attendant, transportation, health facility for complications, expenses, and birth materials, as well as family coordination to achieve such birth plans. In Tanzania, although increasing, only about half of all pregnant women attend an antenatal clinic more than four times [4]. Moreover, the information provided during antenatal care (ANC) is insufficient. In the resource-poor settings, antenatal group education is a potential approach because of the limited time for individual counseling at antenatal clinics.” 30
• “This study aimed to evaluate an antenatal group education program among pregnant women and their families with respect to birth-preparedness and maternal and infant outcomes in rural villages of Tanzania.” 30
• “ The study hypothesis was if Tanzanian pregnant women and their families received a family-oriented antenatal group education, they would (1) have a higher level of BPCR, (2) attend antenatal clinic four or more times, (3) give birth in a health facility, (4) have less complications of women at birth, and (5) have less complications and deaths of infants than those who did not receive the education .” 30

Research questions and hypotheses are crucial components to any type of research, whether quantitative or qualitative. These questions should be developed at the very beginning of the study. Excellent research questions lead to superior hypotheses, which, like a compass, set the direction of research, and can often determine the successful conduct of the study. Many research studies have floundered because the development of research questions and subsequent hypotheses was not given the thought and meticulous attention needed. The development of research questions and hypotheses is an iterative process based on extensive knowledge of the literature and insightful grasp of the knowledge gap. Focused, concise, and specific research questions provide a strong foundation for constructing hypotheses which serve as formal predictions about the research outcomes. Research questions and hypotheses are crucial elements of research that should not be overlooked. They should be carefully thought of and constructed when planning research. This avoids unethical studies and poor outcomes by defining well-founded objectives that determine the design, course, and outcome of the study.

Disclosure: The authors have no potential conflicts of interest to disclose.

Author Contributions:

• Conceptualization: Barroga E, Matanguihan GJ.
• Methodology: Barroga E, Matanguihan GJ.
• Writing - original draft: Barroga E, Matanguihan GJ.
• Writing - review & editing: Barroga E, Matanguihan GJ.

• AI Content Shield
• AI KW Research
• AI Assistant
• SEO Optimizer
• AI KW Clustering
• Customer reviews
• The NLO Revolution
• Press Center
• Help Center
• Content Resources
• Facebook Group

An Effective Guide to Comparative Research Questions

Table of Contents

Comparative research questions are a type of quantitative research question. It aims to gather information on the differences between two or more research objects based on different variables. 

These kinds of questions assist the researcher in identifying distinctive characteristics that distinguish one research subject from another.

A systematic investigation is built around research questions. Therefore, asking the right quantitative questions is key to gathering relevant and valuable information that will positively impact your work.

This article discusses the types of quantitative research questions with a particular focus on comparative questions.

What Are Quantitative Research Questions?

Quantitative research questions are unbiased queries that offer thorough information regarding a study topic . You can statistically analyze numerical data yielded from quantitative research questions.

This type of research question aids in understanding the research issue by examining trends and patterns. The data collected can be generalized to the overall population and help make informed decisions. 

Types of Quantitative Research Questions

Quantitative research questions can be divided into three types which are explained below:

Descriptive Research Questions

Researchers use descriptive research questions to collect numerical data about the traits and characteristics of study subjects. These questions mainly look for responses that bring into light the characteristic pattern of the existing research subjects.

However, note that the descriptive questions are not concerned with the causes of the observed traits and features. Instead, they focus on the “what,” i.e., explaining the topic of the research without taking into account its reasons.

Examples of Descriptive research questions:

• How often do you use our keto diet app?
• What price range are you ready to accept for this product?

Comparative Research Questions

Comparative research questions seek to identify differences between two or more distinct groups based on one or more dependent variables. These research questions aim to identify features that differ one research subject from another while emphasizing their apparent similarities.

In market research surveys, asking comparative questions can reveal how your product or service compares to its competitors. It can also help you determine your product’s benefits and drawbacks to gain a competitive edge.

The steps in formulating comparative questions are as follows:

• Choose the right starting phrase
• Specify the dependent variable
• Choose the groups that interest you
• Identify the relevant adjoining text
• Compose the comparative research question

Relationship-Based Research Questions

A relationship-based research question refers to the nature of the association between research subjects of the same category. These kinds of research question assist you in learning more about the type of relationship between two study variables.

Because they aim to distinctly define the connection between two variables, relationship-based research questions are also known as correlational research questions.

Examples of Comparative Research Questions

• What is the difference between men’s and women’s daily caloric intake in London?
• What is the difference in the shopping attitude of millennial adults and those born in 1980?
• What is the difference in time spent on video games between people of the age group 15-17 and 18-21?
• What is the difference in political views of Mexicans and Americans in the US?
• What are the differences between Snapchat usage of American male and female university students?
• What is the difference in views towards the security of online banking between the youth and the seniors?
• What is the difference in attitude between Gen-Z and Millennial toward rock music?
• What are the differences between online and offline classes?
• What are the differences between on-site and remote work?
• What is the difference between weekly Facebook photo uploads between American male and female college students?
• What are the differences between an Android and an Apple phone?

Comparative research questions are a great way to identify the difference between two study subjects of the same group.

Asking the right questions will help you gain effective and insightful data to conduct your research better . This article discusses the various aspects of quantitative research questions and their types to help you make data-driven and informed decisions when needed.

Abir Ghenaiet

Abir is a data analyst and researcher. Among her interests are artificial intelligence, machine learning, and natural language processing. As a humanitarian and educator, she actively supports women in tech and promotes diversity.

Explore All Engaging Questions Tool Articles

Consider these fun questions about spring.

Spring is a season in the Earth’s yearly cycle after Winter and before Summer. It is the time life and…

• Engaging Questions Tool

Fun Spouse Game Questions For Couples

Answering spouse game questions together can be fun. It’ll help begin conversations and further explore preferences, history, and interests. The…

Best Snap Game Questions to Play on Snapchat

Are you out to get a fun way to connect with your friends on Snapchat? Look no further than snap…

How to Prepare for Short Response Questions in Tests

When it comes to acing tests, there are a few things that will help you more than anything else. Good…

Top 20 Reflective Questions for Students

As students, we are constantly learning new things. Every day, we are presented with further information and ideas we need…

Random History Questions For History Games

A great icebreaker game is playing trivia even though you don’t know the answer. It is always fun to guess…

Have a language expert improve your writing

Run a free plagiarism check in 10 minutes, generate accurate citations for free.

• Knowledge Base

Methodology

• Types of Research Designs Compared | Guide & Examples

Types of Research Designs Compared | Guide & Examples

Published on June 20, 2019 by Shona McCombes . Revised on June 22, 2023.

When you start planning a research project, developing research questions and creating a  research design , you will have to make various decisions about the type of research you want to do.

There are many ways to categorize different types of research. The words you use to describe your research depend on your discipline and field. In general, though, the form your research design takes will be shaped by:

• The type of knowledge you aim to produce
• The type of data you will collect and analyze
• The sampling methods , timescale and location of the research

This article takes a look at some common distinctions made between different types of research and outlines the key differences between them.

Table of contents

Types of research aims, types of research data, types of sampling, timescale, and location, other interesting articles.

The first thing to consider is what kind of knowledge your research aims to contribute.

Here's why students love Scribbr's proofreading services

Discover proofreading & editing

The next thing to consider is what type of data you will collect. Each kind of data is associated with a range of specific research methods and procedures.

Finally, you have to consider three closely related questions: how will you select the subjects or participants of the research? When and how often will you collect data from your subjects? And where will the research take place?

Keep in mind that the methods that you choose bring with them different risk factors and types of research bias . Biases aren’t completely avoidable, but can heavily impact the validity and reliability of your findings if left unchecked.

Choosing between all these different research types is part of the process of creating your research design , which determines exactly how your research will be conducted. But the type of research is only the first step: next, you have to make more concrete decisions about your research methods and the details of the study.

Read more about creating a research design

If you want to know more about statistics , methodology , or research bias , make sure to check out some of our other articles with explanations and examples.

• Normal distribution
• Degrees of freedom
• Null hypothesis
• Discourse analysis
• Control groups
• Mixed methods research
• Non-probability sampling
• Quantitative research
• Ecological validity

Research bias

• Rosenthal effect
• Implicit bias
• Cognitive bias
• Selection bias
• Negativity bias
• Status quo bias

Cite this Scribbr article

If you want to cite this source, you can copy and paste the citation or click the “Cite this Scribbr article” button to automatically add the citation to our free Citation Generator.

McCombes, S. (2023, June 22). Types of Research Designs Compared | Guide & Examples. Scribbr. Retrieved August 19, 2024, from https://www.scribbr.com/methodology/types-of-research/

Is this article helpful?

Shona McCombes

Other students also liked, what is a research design | types, guide & examples, qualitative vs. quantitative research | differences, examples & methods, what is a research methodology | steps & tips, "i thought ai proofreading was useless but..".

I've been using Scribbr for years now and I know it's a service that won't disappoint. It does a good job spotting mistakes”

• Skip to main content
• Skip to primary sidebar
• Skip to footer
• QuestionPro

• Solutions Industries Gaming Automotive Sports and events Education Government Travel & Hospitality Financial Services Healthcare Cannabis Technology Use Case AskWhy Communities Audience Contactless surveys Mobile LivePolls Member Experience GDPR Positive People Science 360 Feedback Surveys
• Resources Blog eBooks Survey Templates Case Studies Training Help center

Home Market Research Research Tools and Apps

Causal Comparative Research: Definition, Types & Benefits

Within the field of research, there are multiple methodologies and ways to find answers to your needs, in this article we will address everything you need to know about Causal Comparative Research, a methodology with many advantages and applications.

What Is Causal Comparative Research?

Causal-comparative research is a methodology used to identify cause-effect relationships between independent and dependent variables.

Researchers can study cause and effect in retrospect. This can help determine the consequences or causes of differences already existing among or between different groups of people.

When you think of Casual Comparative Research, it will almost always consist of the following:

• A method or set of methods to identify cause/effect relationships
• A set of individuals (or entities) that are NOT selected randomly – they were intended to participate in this specific study
• Variables are represented in two or more groups (cannot be less than two, otherwise there is no differentiation between them)
• Non-manipulated independent variables – *typically, it’s a suggested relationship (since we can’t control the independent variable completely)

Types of Casual Comparative Research

Casual Comparative Research is broken down into two types:

• Retrospective Comparative Research
• Prospective Comparative Research

Retrospective Comparative Research: Involves investigating a particular question…. after the effects have occurred. As an attempt to see if a specific variable does influence another variable.

Prospective Comparative Research: This type of Casual Comparative Research is characterized by being initiated by the researcher and starting with the causes and determined to analyze the effects of a given condition. This type of investigation is much less common than the Retrospective type of investigation.

LEARN ABOUT: Quasi-experimental Research

Causal Comparative Research vs Correlation Research

The universal rule of statistics… correlation is NOT causation! 

Casual Comparative Research does not rely on relationships. Instead, they’re comparing two groups to find out whether the independent variable affected the outcome of the dependent variable

When running a Causal Comparative Research, none of the variables can be influenced, and a cause-effect relationship has to be established with a persuasive, logical argument; otherwise, it’s a correlation.

Another significant difference between both methodologies is their analysis of the data collected. In the case of Causal Comparative Research, the results are usually analyzed using cross-break tables and comparing the averages obtained. At the same time, in Causal Comparative Research, Correlation Analysis typically uses scatter charts and correlation coefficients.

Advantages and Disadvantages of Causal Comparative Research

Like any research methodology, causal comparative research has a specific use and limitations to consider when considering them in your next project. Below we list some of the main advantages and disadvantages.

• It is more efficient since it allows you to save human and economic resources and to do it relatively quickly.
• Identifying causes of certain occurrences (or non-occurrences)
• Thus, descriptive analysis rather than experimental

Disadvantages

• You’re not fully able to manipulate/control an independent variable as well as the lack of randomization
• Like other methodologies, it tends to be prone to some research bias , the most common type of research is subject- selection bias , so special care must be taken to avoid it so as not to compromise the validity of this type of research.
• The loss of subjects/location influences / poor attitude of subjects/testing threats….are always a possibility

Finally, it is important to remember that the results of this type of causal research should be interpreted with caution since a common mistake is to think that although there is a relationship between the two variables analyzed, this does not necessarily guarantee that the variable influences or is the main factor to influence in the second variable.

LEARN ABOUT: ANOVA testing

QuestionPro can be your ally in your next Causal Comparative Research

QuestionPro is one of the platforms most used by the world’s leading research agencies, thanks to its diverse functions and versatility when collecting and analyzing data.

With QuestionPro you will not only be able to collect the necessary data to carry out your causal comparative research, you will also have access to a series of advanced reports and analyses to obtain valuable insights for your research project.

We invite you to learn more about our Research Suite, schedule a free demo of our main features today, and clarify all your doubts about our solutions.

LEARN MORE         SIGN UP FREE

Author : John Oppenhimer

MORE LIKE THIS

Jotform vs SurveyMonkey: Which Is Best in 2024

Aug 15, 2024

360 Degree Feedback Spider Chart is Back!

Aug 14, 2024

Jotform vs Wufoo: Comparison of Features and Prices

Aug 13, 2024

Product or Service: Which is More Important? — Tuesday CX Thoughts

Other categories.

• Academic Research
• Artificial Intelligence
• Assessments
• Brand Awareness
• Case Studies
• Communities
• Consumer Insights
• Customer effort score
• Customer Engagement
• Customer Experience
• Customer Loyalty
• Customer Research
• Customer Satisfaction
• Employee Benefits
• Employee Engagement
• Employee Retention
• Friday Five
• General Data Protection Regulation
• Insights Hub
• Life@QuestionPro
• Market Research
• Mobile diaries
• Mobile Surveys
• New Features
• Online Communities
• Question Types
• Questionnaire
• QuestionPro Products
• Release Notes
• Research Tools and Apps
• Revenue at Risk
• Survey Templates
• Training Tips
• Tuesday CX Thoughts (TCXT)
• Uncategorized
• What’s Coming Up
• Workforce Intelligence

Comparative Research

Ai generator.

Although not everyone would agree, comparing is not always bad. Comparing things can also give you a handful of benefits. For instance, there are times in our life where we feel lost. You may not be getting the job that you want or have the sexy body that you have been aiming for a long time now. Then, you happen to cross path with an old friend of yours, who happened to get the job that you always wanted. This scenario may put your self-esteem down, knowing that this friend got what you want, while you didn’t. Or you can choose to look at your friend as an example that your desire is actually attainable. Come up with a plan to achieve your  personal development goal . Perhaps, ask for tips from this person or from the people who inspire you. According to the article posted in  brit.co , licensed master social worker and therapist Kimberly Hershenson said that comparing yourself to someone successful can be an excellent self-motivation to work on your goals.

Aside from self-improvement, as a researcher, you should know that comparison is an essential method in scientific studies, such as experimental research and descriptive research . Through this method, you can uncover the relationship between two or more variables of your project in the form of comparative analysis .

What is Comparative Research?

Aiming to compare two or more variables of an experiment project, experts usually apply comparative research examples in social sciences to compare countries and cultures across a particular area or the entire world. Despite its proven effectiveness, you should keep it in mind that some states have different disciplines in sharing data. Thus, it would help if you consider the affecting factors in gathering specific information.

Quantitative and Qualitative Research Methods in Comparative Studies

In comparing variables, the statistical and mathematical data collection, and analysis that quantitative research methodology naturally uses to uncover the correlational connection of the variables, can be essential. Additionally, since quantitative research requires a specific research question, this method can help you can quickly come up with one particular comparative research question.

The goal of comparative research is drawing a solution out of the similarities and differences between the focused variables. Through non-experimental or qualitative research , you can include this type of research method in your comparative research design.

13+ Comparative Research Examples

Know more about comparative research by going over the following examples. You can download these zipped documents in PDF and MS Word formats.

1. Comparative Research Report Template

• Google Docs

Size: 113 KB

2. Business Comparative Research Template

Size: 69 KB

3. Comparative Market Research Template

Size: 172 KB

4. Comparative Research Strategies Example

5. Comparative Research in Anthropology Example

Size: 192 KB

6. Sample Comparative Research Example

Size: 516 KB

7. Comparative Area Research Example

8. Comparative Research on Women’s Emplyment Example

Size: 290 KB

9. Basic Comparative Research Example

Size: 19 KB

10. Comparative Research in Medical Treatments Example

11. Comparative Research in Education Example

Size: 455 KB

12. Formal Comparative Research Example

Size: 244 KB

13. Comparative Research Designs Example

Size: 259 KB

14. Casual Comparative Research in DOC

Best Practices in Writing an Essay for Comparative Research in Visual Arts

If you are going to write an essay for a comparative research examples paper, this section is for you. You must know that there are inevitable mistakes that students do in essay writing . To avoid those mistakes, follow the following pointers.

1. Compare the Artworks Not the Artists

One of the mistakes that students do when writing a comparative essay is comparing the artists instead of artworks. Unless your instructor asked you to write a biographical essay, focus your writing on the works of the artists that you choose.

2. Consult to Your Instructor

There is broad coverage of information that you can find on the internet for your project. Some students, however, prefer choosing the images randomly. In doing so, you may not create a successful comparative study. Therefore, we recommend you to discuss your selections with your teacher.

3. Avoid Redundancy

It is common for the students to repeat the ideas that they have listed in the comparison part. Keep it in mind that the spaces for this activity have limitations. Thus, it is crucial to reserve each space for more thoroughly debated ideas.

4. Be Minimal

Unless instructed, it would be practical if you only include a few items(artworks). In this way, you can focus on developing well-argued information for your study.

5. Master the Assessment Method and the Goals of the Project

We get it. You are doing this project because your instructor told you so. However, you can make your study more valuable by understanding the goals of doing the project. Know how you can apply this new learning. You should also know the criteria that your teachers use to assess your output. It will give you a chance to maximize the grade that you can get from this project.

Comparing things is one way to know what to improve in various aspects. Whether you are aiming to attain a personal goal or attempting to find a solution to a certain task, you can accomplish it by knowing how to conduct a comparative study. Use this content as a tool to expand your knowledge about this research methodology .

Text prompt

• Instructive
• Professional

10 Examples of Public speaking

20 Examples of Gas lighting

PCORI announces $165 million in new funding for comparative clinical effectiveness research

• Download PDF Copy

The Patient-Centered Outcomes Research Institute (PCORI) today announced the approval of funding awards totaling more than $165 million for new patient-centered comparative clinical effectiveness research (CER), as well as research to improve methods and strengthen the science of engagement in patient-centered CER. Among the 10 CER studies awarded, three will evaluate the effectiveness of telehealth interventions to treat Type 2 diabetes, chronic low back pain and opioid use disorder.

PCORI will fund two large, multiphase CER studies, expanding its growing portfolio of PCORI-funded research on care approaches for patients with heart conditions, including heart rhythm disorders. In one study, researchers will compare two commonly prescribed beta blockers in patients with heart failure and implantable cardioverter defibrillators (ICDs). In the second study, researchers will compare different methods for monitoring pacemakers and ICDs that use wireless remote monitoring.

These latest PCORI-funded comparative clinical effectiveness research studies will generate evidence for various care approaches, including virtual delivery methods, when managing conditions such as diabetes, heart conditions and other health concerns affecting patients across the nation. Through research approaches that will engender trust and trustworthiness, the findings of these studies will offer valuable insights for patients and those who care for them to make better-informed healthcare decisions." Nakela L. Cook, M.D., MPH, PCORI's executive director

PCORI also approved awards for three CER studies comparing the timing of care delivery and its effect on patient outcomes. Among these, one is a large, multiphase CER study of in vitro fertilization; another study focuses on antibiotics for young children with mild pneumonia and a third on treatment for inflammatory myelitis and optic neuritis.

Two other CER funding awards are for studies comparing strategies to treat urinary incontinence during vaginal prolapse repair procedures and approaches to address the social needs of patients managing multiple chronic conditions.

Related Stories

• Sapio Sciences launches partner program to accelerate research and diagnostics
• Can odors help fight infection? Nematode research suggests so
• Why do we blush, and what are the underlying mechanisms of blushing? Research aims to find out

"At the center of comparative clinical effectiveness research is a recognition that patients' needs are diverse and not all treatments or interventions have the same effects for everyone," said Harv Feldman, M.D., MSCE, PCORI's deputy executive director for patient-centered research programs. "These CER studies will generate evidence about how different approaches to care may work better for some patients for health concerns facing different people every day."

PCORI also supports efforts to promote the uptake of PCORI-funded CER findings in clinical practice. A new award funds a project to disseminate results of a study that evaluated outcomes for tubal ligation and intrauterine devices.

In addition, PCORI approved $4 million to fund four studies to improve methods for conducting CER and more than $5 million for three studies that will strengthen the evidence base on how research teams can optimize engagement of patients and other health care decision makers throughout the design and conduct of patient-centered CER.

Details of these newly funded studies and projects are available on PCORI website. All award funding has been approved pending final PCORI contractual considerations. Since 2010, PCORI has awarded more than $4.5 billion to fund patient-centered CER and research-related projects.

Patient-Centered Outcomes Research Institute

Posted in: Medical Research News | Healthcare News

Tags: Back Pain , Children , Chronic , Diabetes , Fertilization , Health Care , Healthcare , Heart , Heart Failure , in vitro , Incontinence , Ligation , Myelitis , Optic Neuritis , Pain , Pneumonia , Prolapse , Research , Tubal Ligation , Type 2 Diabetes , Urinary Incontinence , Vaginal

Suggested Reading

Cancel reply to comment

• Trending Stories
• Latest Interviews
• Top Health Articles

Addressing Important Cardiac Biology Questions with Shotgun Top-Down Proteomics

In this interview conducted at Pittcon 2024, we spoke to Professor John Yates about capturing cardiomyocyte cell-to-cell heterogeneity via shotgun top-down proteomics.

A Discussion with Hologic’s Tim Simpson on the Future of Cervical Cancer Screening

Tim Simpson

Hologic’s Tim Simpson Discusses the Future of Cervical Cancer Screening.

From Waste to Taste: The Transformative Power of Fermented Foods

Maria Marco

In this interview conducted at Pittcon 2024 in San Diego, Maria Marco discusses her research on the health benefits, safety, and waste reduction potential of fermented foods, and the microbial processes involved in their production.

Latest News

Newsletters you may be interested in

Your AI Powered Scientific Assistant

Hi, I'm Azthena, you can trust me to find commercial scientific answers from News-Medical.net.

A few things you need to know before we start. Please read and accept to continue.

• Use of “Azthena” is subject to the terms and conditions of use as set out by OpenAI .
• Content provided on any AZoNetwork sites are subject to the site Terms & Conditions and Privacy Policy .
• Large Language Models can make mistakes. Consider checking important information.

Great. Ask your question.

Azthena may occasionally provide inaccurate responses. Read the full terms .

While we only use edited and approved content for Azthena answers, it may on occasions provide incorrect responses. Please confirm any data provided with the related suppliers or authors. We do not provide medical advice, if you search for medical information you must always consult a medical professional before acting on any information provided.

Your questions, but not your email details will be shared with OpenAI and retained for 30 days in accordance with their privacy principles.

Please do not ask questions that use sensitive or confidential information.

Read the full Terms & Conditions .

Provide Feedback

Comparative lifespan and healthspan of nonhuman primate species common to biomedical research

• Find this author on Google Scholar
• Find this author on PubMed
• Search for this author on this site
• ORCID record for Hillary F Huber
• For correspondence: [email protected]
• ORCID record for Hannah C Ainsworth
• ORCID record for Ellen Quillen
• ORCID record for Adam Salmon
• ORCID record for Kris Coleman
• ORCID record for Ricki Colman
• ORCID record for Huda S Darusman
• ORCID record for Matt Jorgensen
• ORCID record for Kylie Kavanagh
• ORCID record for Julie A Mattison
• ORCID record for Suryo Saputro
• ORCID record for Caroline Zeiss
• ORCID record for Laura A Cox
• Info/History
• Supplementary material
• Preview PDF

There is a critical need to generate age– and sex-specific survival curves to characterize chronological aging consistently across nonhuman primates (NHP) used in biomedical research. Accurate measures of chronological aging are essential for inferences into genetic, demographic, and physiological variables driving differences in NHP lifespan within and between species. Understanding NHP lifespans is relevant to public health because unraveling the demographic, molecular, and clinical bases of health across the life course in translationally relevant NHP species is fundamentally important to the study of human aging. Data from more than 110,000 captive individual NHP were contributed by 15 major research institutions to generate sex-specific Kaplan-Meier survival curves using uniform methods in 12 translational aging models: Callithrix jacchus (common marmoset), Chlorocebus aethiops sabaeus (vervet/African green), Macaca fascicularis (cynomolgus macaque), M. fuscata (Japanese macaque), M. mulatta (rhesus macaque), M. nemestrina (pigtail macaque), M. radiata (bonnet macaque), Pan troglodytes spp. (chimpanzee), Papio hamadryas spp. (baboon), Plecturocebus cupreus (coppery titi monkey), Saguinus oedipus (cotton-top tamarin), and Saimiri spp. (squirrel monkey). After employing strict inclusion criteria, primary analysis results are based on 12,269 NHP that survived to adulthood and died of natural/health-related causes. A secondary analysis was completed for 32,616 NHP that died of any cause. For the primary analyses, we report ages of 25 th , 50 th , 75 th , and 85 th percentiles of survival, maximum observed ages, rates of survivorship, and sex-based differences captured by quantile regression models and Kolmogorov-Smirnov tests. Our findings show a pattern of reduced male survival among catarrhines (African and Asian primates), especially macaques, but not platyrrhines (Central and South American primates). For many species, median lifespans were lower than previously reported. An important consideration is that these analyses may offer a better reflection of healthspan than lifespan. Captive NHP used in research are typically euthanized for humane welfare reasons before their natural end of life, often after diagnosis of their first major disease requiring long-term treatment with reduced quality of life (e.g., endometriosis, cancer, osteoarthritis).

Supporting the idea that these data are capturing healthspan, for several species typical age at onset of chronic disease is similar to the median lifespan estimates. This data resource represents the most comprehensive characterization of sex-specific lifespan and age-at-death distributions for 12 biomedically relevant species, to date. The results clarify the relationships among NHP ages and will provide a valuable resource for the aging research community, improving human-NHP age equivalencies, informing investigators of the expected survival rates of NHP assigned to studies, providing a metric for comparisons in future studies, and contributing to our understanding of the factors that drive lifespan differences within and among species.

Competing Interest Statement

The authors have declared no competing interest.

Code availability statement added to main file; custom code added to Supplementary document.

View the discussion thread.

Supplementary Material

Thank you for your interest in spreading the word about bioRxiv.

NOTE: Your email address is requested solely to identify you as the sender of this article.

Citation Manager Formats

• EndNote (tagged)
• EndNote 8 (xml)
• RefWorks Tagged
• Ref Manager
• Tweet Widget
• Facebook Like
• Google Plus One

Subject Area

• Animal Behavior and Cognition (5526)
• Biochemistry (12575)
• Bioengineering (9444)
• Bioinformatics (30842)
• Biophysics (15864)
• Cancer Biology (12930)
• Cell Biology (18537)
• Clinical Trials (138)
• Developmental Biology (10005)
• Ecology (14979)
• Epidemiology (2067)
• Evolutionary Biology (19169)
• Genetics (12748)
• Genomics (17554)
• Immunology (12685)
• Microbiology (29741)
• Molecular Biology (12381)
• Neuroscience (64766)
• Paleontology (479)
• Pathology (2002)
• Pharmacology and Toxicology (3459)
• Physiology (5334)
• Plant Biology (11092)
• Scientific Communication and Education (1728)
• Synthetic Biology (3064)
• Systems Biology (7689)
• Zoology (1731)

Thank you for visiting nature.com. You are using a browser version with limited support for CSS. To obtain the best experience, we recommend you use a more up to date browser (or turn off compatibility mode in Internet Explorer). In the meantime, to ensure continued support, we are displaying the site without styles and JavaScript.

• View all journals
• Explore content
• About the journal
• Publish with us
• Sign up for alerts
• Open access
• Published: 14 August 2024

AI chatbots show promise but limitations on UK medical exam questions: a comparative performance study

• Mohammed Ahmed Sadeq 1 , 2 , 13 ,
• Reem Mohamed Farouk Ghorab 1 , 2 , 13 ,
• Mohamed Hady Ashry 2 , 3 ,
• Ahmed Mohamed Abozaid 2 , 4 ,
• Haneen A. Banihani 2 , 5 ,
• Moustafa Salem 2 , 6 ,
• Mohammed Tawfiq Abu Aisheh 2 , 7 ,
• Saad Abuzahra 2 , 7 ,
• Marina Ramzy Mourid 2 , 8 ,
• Mohamad Monif Assker 2 , 9 ,
• Mohammed Ayyad 2 , 10 &
• Mostafa Hossam El Din Moawad 2 , 11 , 12  

Scientific Reports volume  14 , Article number:  18859 ( 2024 ) Cite this article

321 Accesses

1 Altmetric

Metrics details

• Health care
• Information technology

Large language models (LLMs) like ChatGPT have potential applications in medical education such as helping students study for their licensing exams by discussing unclear questions with them. However, they require evaluation on these complex tasks. The purpose of this study was to evaluate how well publicly accessible LLMs performed on simulated UK medical board exam questions. 423 board-style questions from 9 UK exams (MRCS, MRCP, etc.) were answered by seven LLMs (ChatGPT-3.5, ChatGPT-4, Bard, Perplexity, Claude, Bing, Claude Instant). There were 406 multiple-choice, 13 true/false, and 4 "choose N" questions covering topics in surgery, pediatrics, and other disciplines. The accuracy of the output was graded. Statistics were used to analyze differences among LLMs. Leaked questions were excluded from the primary analysis. ChatGPT 4.0 scored (78.2%), Bing (67.2%), Claude (64.4%), and Claude Instant (62.9%). Perplexity scored the lowest (56.1%). Scores differed significantly between LLMs overall ( p  < 0.001) and in pairwise comparisons. All LLMs scored higher on multiple-choice vs true/false or “choose N” questions. LLMs demonstrated limitations in answering certain questions, indicating refinements needed before primary reliance in medical education. However, their expanding capabilities suggest a potential to improve training if thoughtfully implemented. Further research should explore specialty specific LLMs and optimal integration into medical curricula.

Similar content being viewed by others

Comparing ChatGPT and GPT-4 performance in USMLE soft skill assessments

Harnessing ChatGPT and GPT-4 for evaluating the rheumatology questions of the Spanish access exam to specialized medical training

Google Gemini and Bard artificial intelligence chatbot performance in ophthalmology knowledge assessment

Artificial intelligence (AI) is a multidisciplinary field focused on developing machines and programs capable of replicating intelligent behavior 1 . Such machines are intended to perform tasks that require human intelligence. These tasks may vary depending on the industry; however, they usually revolve around the ability to learn, rationalize, and comprehend abstract concepts 1 .

AI was first established as a scientific discipline at the Dartmouth Summer Research Project in 1955 2 . However, over the past decade, the study of AI has experienced exponential growth and advances 3 . This was observed in different industries that integrated AI into their scope of work 3 . Despite the huge impact of these technologies in various industries, their application in medical field remains limited 3 .

In November 2022, a new AI model called ChatGPT was launched by OpenAI. ChatGPT, also known as Chat Generative Pre-trained Transformer, is a Large language model (LLM) with a trained parameter count of 175 billion 4 . This AI model gained significant attention because of its remarkable capability to carry out complex natural language tasks 4 . It was developed using deep learning algorithms, which are designed to learn and recognize patterns in data, to respond in a human-like manner to the user’s prompts 4 . Nevertheless, this technology is not exclusive to OpenAI, similar LLMs such as Bard, Google and Bing AI, and Microsoft have been recently launched to public use 5 , 6 .

The recent development and launch of multiple advanced LLMs has raised the question about their impact on medical education. Integration of advanced LLM may offer great opportunities to enhance the process of medical education such as improving teaching methodologies, personal studying, and the evaluation of one’s performance 7 . LLMs could play a huge role in curriculum development, personalized study plans and learning materials, and medical writing assistance 7 . Moreover, such advances may greatly benefit academics, especially when it comes to generating high-quality exams. 8 However, blindly adopting such measures may present serious problems such as bias, misinformation, and overreliance—which may manifest as cheating in cases where exams are held online—that may hinder the development of medical students 7 , 9 . Recent studies have been conducted to assess the performance of AI chatbots on various board examinations. Lauren et al. explored the performance of ChatGPT on dermatology Specialty Certificate Examination (SCE) and found that ChatGPT-4 was capable of passing the exam with a score of 90.5% 10 . Furthermore, a similar study conducted on the United States Medical Licensing Examination (USMLE) found that ChatGPT was able to achieve a score similar to that of a third year medical student and provide a logical explanation for each answer 11 . Despite these impressive results, LLMs were still shown to perform poorly in questions that are ranked as high-order thinking questions 11 , 12 . This highlights the importance of further assessing the capabilities of such LLMs on different medical exam databases.

In this study, we evaluate the performance and clinical reasoning ability of various chatbots, including ChatGPT, on questions from the medical board examinations of the United Kingdom (such as MRCP, MRCS, RCOG, etc.). This article aims to assess the ability to use AI chatbots as a reliable medical educational tool for students undertaking medical board examinations.

Artificial intelligence

Various AI chatbots including ChatGPT 3.5, ChatGPT 4.0, Bard, Bing, Perplexity, Claude, and Claude-instant (accessed through Poe) have been used to generate natural linguistic responses to text inputs in a conversational manner. These AI modules are based on large databases that are used to train and lead to the generation of coherent and logical conversations that are appropriate to the context of the specified input.

Input source and data abstraction

In this prospective study that was carried out from July 1st to July 31st, 2023, 440 multidisciplinary board-style test questions with public access from various sample questions provided by official sites of board exams were used to assess the performance of multiple artificial intelligence language modules with access to large datasets. Included sample questions were retrieved from board examination websites including MRCS, MRCP, RCPCH, RCOG, RCOopth, MRCPsych, FRCR (physics), FRCA, and MCEM in addition to sample obstetrics and gynecology questions provided by BMJ. Moreover, all inputs used were a true representation of real-exam scenarios assessing the performance of these AI models in a wide range of advanced medical disciplines. The inputs were further evaluated by being systematically assessed to ensure that none of the test answers, explanations, or exam-related content were recorded on the chatbots’ databases. Two researchers independently assessed each question for leakage by searching for both a sentence and a full question on Google and the C4 database 13 , which is included in most chatbots. 14 The Google search was modified by the date filter “before:2022,1,1”—which represents the latest date accessible to the training of ChatGPT—and quotation marks for a sentence of the question and the full question. All questions that were leaked to Google, whether before or after 2022, or C4 database were excluded from the primary analysis. Furthermore, all sample test questions were screened to ensure the removal of questions containing visual or audiological inputs such as clinical images, graphs, and clinical audio inputs. After screening and excluding 17 questions containing images (all from pediatrics section), 423 board-style items involving multiple medical disciplines were advanced to data extraction and analysis. While using ChatGPT-4 and Bard, we made sure to not activate the web-search feature in these chatbots.

Statistical analysis

The extracted data was then clustered into two categories, with the output = 1 representing that the AI module answered the question correctly, and an output = 0 representing a false or no answer. Subsequently, the data was analyzed using Cochran’s Q test and assessed for difference between chatbots with a significance level of p = 0.05. Further pairwise analysis was conducted using Bonferroni Correction with a significance level of p = 0.002. Statistical analysis was carried out using Jamovi 15 , and SPSS 16 . Whenever chatbots refused to answer on account of not giving medical advice, we considered this datum missing.

In this study, we assessed the performance of various AI modules in solving board-style questions including the MRCS, MRCP, RCPCH, RCOG, RCOopth, MRCPsych, FRCR (physics), FRCA, and MCEM. A total of 423 questions were included in the final analysis, the chatbot output was recorded and compared to the standardized question answer.

Assessment of test set leakage

We found 7 questions leaked to the C4 database all of which are from the obstetrics and gynecology specialty and came from the MRCOG website. We found 18 MCQ questions leaked to Google while filtering by date, and an additional 51 leaked questions if filtering was off (present on Google after 1st January 2022). Of the 18 questions found on Google pre-2022, 12 were from the ophthalmology specialty, three from internal medicine, and three from pediatrics. All leaked questions from the mentioned sources totaled 97 questions. (Table 1 ).

Assessment results

Out of 333 questions that were not leaked, 310 questions were MCQ, 13 were true/false, and three were choose (n) from many. The highest number of questions that were not leaked were from the internal medicine Sect. (127), followed by pediatrics (93), ophthalmology (36), surgery (25), obstetrics and gynecology (11), emergency medicine (10), radiology physics (10), anaesthesia (9), and psychiatry (5) (Tables 1 , 2 ).

On Average, ChatGPT 4.0 scored the highest with an average of 78.2% in answering questions that were neither leaked in Google before or after 2022, or in C4 database, followed by Bing (67.2%), Claude (64.4%), and Claude Instant (62.9%). On the other hand, Perplexity scored the lowest (56.1%). (Table 3 ; Fig.  1 ).

Frequencies of wrong (0) and correct (1) answers by chatbot.

All chatbots scored higher in MCQ questions (mean = 0.663) than choose (n) from many questions (mean = 0.381) while they scored lowest in true/false questions (mean = 0.187). All chatbots scored highest in emergency medicine (mean = 0.829), followed by psychiatry (mean = 0.771), anaesthesia (0.619), and internal medicine (0.677). However, they scored lowest in radiology physics questions (0.214) and surgery (0.543) (Tables 4 , 5 ).

A Cochran's Q test was conducted to assess whether there were differences in performance between the seven samples: Perplexity, GPT3.5, Bard, Claude Instant, Claude, Bing, and GPT4. The results of the Cochran's Q test were statistically significant, χ2(6) = 68.640238, p  < 0.001, indicating significant differences in performance between the samples overall. (Table 6 ).

Further pairwise comparisons were conducted with a Bonferroni correction to pinpoint where the differences existed between pairs of samples. Analysis revealed that ChatGPT4 significantly outperformed all other samples, scoring higher than Perplexity ( p  < 0.001), ChatGPT 3.5 ( p  < 0.001), Bard ( p  < 0.001), Claude Instant ( p  < 0.001), Claude ( p  < 0.001), and Bing ( p  < 0.001), suggesting that ChatGPT 4 was superior to all other models tested. Moreover, Perplexity scored significantly lower than several other models, it performed worse than ChatGPT4 ( p  < 0.001), and Bing ( p  < 0.001). A summary of pairwise comparisons are presented in Table 7 in addition to Figs. 2 and 3 .

Pairwise comparison between chatbots.

Related-samples Cochran Q Test.

Assessment results for leaked questions

All chatbots scored higher on questions leaked to the C4 database except for ClaudeInstant which performed worse on the seven questions leaked to the common crawl database (0.571 ± 0.535) than other questions (0.631 ± 0.483). Bard got all questions leaked to the C4 database correctly compared to a lower score of 0.585 ± 0.493 for other questions. Questions leaked to Google before the predetermined date of 1/1/2022, however, did not show any correlation with chatbot performance. In fact, all chatbots performed worse on these questions than on other questions. The breakdown of the results of the assessment of chatbots for leaked questions is presented in Table 8 .

In this study, we examined the performance of various publicly available LLMs on questions derived from standardized United Kingdom medical board examinations. This was done to explore their potential use as educational and test preparation tools for medical students/doctors in the United Kingdom. The Seven AI models used in the study were ChatGPT-3.5, ChatGPT-4, Bard, Perplexity, Claude, Bing, and Claude Instant. Three formats of questions were given to the AI models: multiple choice, true/false, and “choose N from many” questions.

Our results showed statistically significant variations in the average scores for each AI model. We found that ChatGPT-4 had the best performance and overall scores. Meanwhile, Perplexity and Bard had the worst performance among the seven AI models. The remaining four AI models performed averagely, with no significant difference in performance between them. Despite ChatGPT-4 scoring the highest average across multiple-choice and true/false questions, it scored the lowest on “Choose N from many” questions (25%). In terms of average scores based on question format, the multiple-choice questions yielded the highest scores overall, with the different LLMs averaging between 60 and 81% correct (overall average 66%). In comparison, performance was lower for true/false and “Choose N from many” formats. The true/false questions proved to be the most challenging—LLMs scored between 0 and 31% correct, with Perplexity unable to answer any question correctly. On the “Choose N from many” questions, performance was better than true/false, but worse than multiple choices. LLMs averaged 25–50% correct, with Claude Instant and Bing scoring 50%, the highest of any model in this format. These results highlight the differences in how well LLMs can handle various question types. Even an LLM that scores highly on one format, like GPT-4 on multiple choice, does not necessarily perform as well on other formats like “Choose N from many.” This suggests that the models have strengths and weaknesses based on their prompt structure. Overall, their ability to reason through and answer medical exam questions accurately across different formats remains limited compared to that of human experts. However, performance is steadily improving, underscoring the importance of continued research on refining LLM skills for complex tasks.

Similar to our study, many other papers have shown the remarkable ability of LLMs to pass reputable exams. Antaki et al. demonstrated the ability of ChatGPT to pass ophthalmology examinations at the level of a first-year resident 17 . Furthermore, it was found to pass the United States Medical Licensing exam with a score equal to that of an average third-year medical student 11 . However, most of these studies were limited to OpenAI’s ChatGPT alone. In contrast, our study explored seven LLMs including ChatGPT. This allowed for a more comprehensive performance analysis of currently available LLMs. Moreover, this is the first study to explore the performance of LLMs in various United Kingdom medical board examinations. Our findings can be summarized into three major themes: 17 ChatGPT-4 remains the best average performer among AI models (2). The performance of AI models may differ depending on the formulation of the prompt question (3). The use of AI models as a secondary educational tool is propitious; however, using such models as a primary source is not recommended before further refining.

Recent advancements in LLMs, specifically ChatGPT, seem to disrupt current medical education and assessment models. Trends in AI improvement indicate that the implementation of this technology in all fields, including medicine, is inevitable. The notion of continuous improvement in these models can be seen by the documented increase in ChatGPT performance on the Medical Licensing Exam of the United States of 60% when compared with previous studies that found a much lower accuracy rate on comparable tests 11 , 18 . Additionally, in our study, ChatGPT-4 scored 78% correct overall which is 18% higher than the previously reported score on the USMLE examinations. Considering that these exams are intended to test medical personnel at a similar level, it would be reasonable to assume that this may indicate the continuous improvement of such models. Therefore, such models must be treated as opportunities to improve all aspects of medical education in an ethical and responsible manner. Efforts must be directed at exploring further methods to enhance the ability of LLMs to answer prompts with higher accuracy. Currently, the performance of LLMs suggests that their use as an educational tool must be as an adjuvant source in a comprehensive educational approach rather than as the primary source 19 . This takes into consideration the current limitations of such LLMs in scientific and mathematical knowledge and applications 19 .

An important aspect to consider with the rise of these models is the ethical concern of potential misuse of malicious intent, such as cheating. The risk of such misuse should be weighed against the expected gains from this technology. Therefore, educational institutions must work to counteract the misuse and prevent the unethical exploitation of this technology. If implemented correctly, this technology may lead to substantial improvements in medical education. Further studies must be conducted to continuously monitor this improvement and explore other ways to improve medical education through these advanced LLMs.

Factors affecting chatbot accuracy

The varying accuracy of chatbot answers can be attributed to the low sample size of questions we were able to acquire. For instance, all chatbots performed worse on the 13 true/false (0.187 ± 0.392) and in four choose (n) from many (0.286 ± 0.46) questions than 406 MCQs (0.664 ± 0.473). This unbalanced sample may hinder the generalizability of our results in questions other than MCQs. As for the leaked questions on Google, the websites that hosted them varied, as some were locked behind a paywall, such as on Scribd website 20 , others were in a PDF format, as a part of questions samples 20 , 21 , while others were on flashcards on websites such as Quizlet. 22 Investigating leakage of exam questions to databases included in publicly available LLMs can be very advantageous for academic or research purposes. It can be done, akin to our approach, by search the C4 database or by implementing guided prompting to answer medical questions from a specific dataset. 23

As mentioned previously, the disparity between the percentage of correct answers in MCQ questions and true/false questions can be explained by multiple factors. The first factor is prompting. Prompt engineering refer to the practice of carefully designing and optimizing the prompts or instruction given to AI systems (such as ChatGPT) to improve their performance on specific tasks. This can help communicate user intent and desired outputs to LLMs. It also improves performance, provides customizable interaction, allow incorporation of external knowledge, control output features, and mitigate biases. The published research on prompt engineering for medical users is scarce. However, many preprints 24 , 25 , 26 , 27 suggested some practices for good prompt engineering. Firstly, it is advised to provide clear specific instructions as ambiguous prompts can lead to unclear or irrelevant responses. Moreover, users are encouraged to continuously test and tweak prompts based on model responses to improve responses. 24 , 25 , 26 , 27

Specialization of chatbosts

While all chatbots included in this study can be described as LLMs which provide text generation based on user-developed prompt, it is better to deal with available options as specialized tools for different tasks. While more research is needed with future development of medically oriented LLMs, we can deduce from each chatbot descriptions and characteristics the different uses in which each chatbot may excel its peers. For instance, from included chatbots, only Perplexity and Bing AI provide sources, with Perplexity being able to refine sources more-accurately to academic ones. Moreover, Perplexity has a GPT-4 co-pilot which may enhance results of answering medical questions, but we did not assess it. On the other hand, only ChatGPT 4.0 (paid version) and Claude has file analysis features which make them able to summarize texts and analyze sheets and codes. Claude, ChatGPT (both free and paid versions) are not currently available in some regions which may encumber users (both researchers, medical practitioners, and medical students) from numerous countries from accessing them. It is interesting to see how the current AI-revolution folds out and what new tools can contribute to medical education and medical decision making.

Data leakage significantly impacts the accuracy of chatbots, particularly in the domain of medical question answering. Data leakage occurs when the training data of a model inadvertently includes information from the test set, leading to an overestimation of the model's true performance. Brookshire et al. 28 explored this effect by studying the effect of data leakage on the neural networks’ ability to correctly identify a range of disorders using EEG. In this example, the leakage of EEG segments to the training set and its reappearance in the test set leads to inflated model accuracy. Leakage can create a false sense of reliability and even an inflated accuracy 29 . A model trained on leaked data may appear to perform exceptionally well during testing, but this performance does not translate to real-world scenarios where the model must answer previously unseen questions. This discrepancy is particularly concerning for medical students who rely on the chatbot for studying and acquiring accurate medical knowledge. Misleading performance metrics can lead to overconfidence in the chatbot's responses, potentially spreading incorrect or incomplete medical information.

Limitations

This study had several limitations. First, due to financial limitations, we were limited to the sample questions provided free of cost on each respective board examination website. This resulted in a lower number of question prompts used than originally intended. Second, LLMs available to the public are continuously trained with new data over time. This may affect the applicability of these findings to the updated versions of each LLM. Furthermore, All chatbots displayed limitations when it came to true–false and "choose N" questions which may be explained by the small sample of these questions included in our study. The high number of MCQ-type questions may also lead to LLM performance inflation. However, despite these limitations, our study provides comprehensive analysis and insights into the strengths and limitations of the seven LLMs as an educational tool for the preparation of United Kingdom medical board examinations.

Conclusions

This study offers fresh perspectives on how various publicly accessible AI chatbots performed when faced with UK medical board exam questions. The accuracy of the chatbots varied significantly, with ChatGPT-4 doing the best overall. According to our research, these AI models could be beneficial for medical students as secondary learning resources, but they still need to be improved before they can be used as main teaching tools. Prompt engineering and developing specialized medical LLMs could help improve performance. Overall, as LLMs develop, they provide promising chances to change medical education.

Data availability

The data used or generated during this study are presented in this publication. They can be found in the accompanying supplementary information files.

Ramesh, A., Kambhampati, C., Monson, J. & Drew, P. Artificial intelligence in medicine. Ann. R. Coll. Surg. Engl. 86 (5), 334–338. https://doi.org/10.1308/147870804290 (2004).

Article   CAS   PubMed   PubMed Central   Google Scholar  

McCarthy, J., Minsky, M. L., Rochester, N. & Shannon, C. E. A proposal for the dartmouth summer research project on artificial intelligence, August 31, 1955. AIMag 27 (4), 12. https://doi.org/10.1609/aimag.v27i4.1904 (2006).

Article   Google Scholar  

Mbakwe, A. B., Lourentzou, I., Celi, L. A., Mechanic, O. J. & Dagan, A. ChatGPT passing USMLE shines a spotlight on the flaws of medical education. PLOS Digit Health 2 (2), e0000205. https://doi.org/10.1371/journal.pdig.0000205 (2023).

Article   PubMed   PubMed Central   Google Scholar  

Dave, T., Athaluri, S. A. & Singh, S. ChatGPT in medicine: An overview of its applications, advantages, limitations, future prospects, and ethical considerations. Front. Artif. Intell. 6 , 1169595. https://doi.org/10.3389/frai.2023.1169595 (2023).

Kelly, S. Microsoft opens up its AI-powered Bing to all users. CNN. [Online]. Available: https://edition.cnn.com/2023/05/04/tech/microsoft-bing-updates/index.html#:~:text=Bing%20now%20gets%20more%20than,features%20to%20its%20search%20engine .

Thorbecke, C. Google unveils its ChatGPT rival. CNN. [Online]. Available: https://edition.cnn.com/2023/02/06/tech/google-bard-chatgpt-rival/index.html

Abd-alrazaq, A. et al. Large language models in medical education: Opportunities, challenges, and future directions. JMIR Med Educ 9 , e48291. https://doi.org/10.2196/48291 (2023).

Lu, K. Can ChatGPT help college instructors generate high-quality quiz questions?, in Human Interaction and Emerging Technologies (IHIET-AI 2023): Artificial Intelligence and Future Applications , AHFE Open Acces, 2023. https://doi.org/10.54941/ahfe1002957 .

Hisan, U. K. & Amri, M. M. ChatGPT and medical education: A double-edged sword. J. Pedagogy Educ. Sci. 2 (1), 71–89. https://doi.org/10.56741/jpes.v2i01.302 (2023).

Passby, L., Jenko, N. & Wernham, A. Performance of ChatGPT on dermatology specialty certificate examination multiple choice questions. Clin. Exp. Dermatol. 49 , 722–727. https://doi.org/10.1093/ced/llad197 (2023).

Gilson, A. et al. How does ChatGPT perform on the united states medical licensing examination? The implications of large language models for medical education and knowledge assessment. JMIR Med. Educ. 9 , e45312. https://doi.org/10.2196/45312 (2023).

Bhayana, R., Krishna, S. & Bleakney, R. R. Performance of ChatGPT on a radiology board-style examination: Insights into current strengths and limitations. Radiology 307 (5), e230582. https://doi.org/10.1148/radiol.230582 (2023).

Article   PubMed   Google Scholar  

C4 Search by AI2. Accessed: Dec. 04, 2023. [Online]. Available: https://c4-search.apps.allenai.org/

Brown, T. et al. Language models are few-shot learners. Adv. Neural Inf. Process. Syst. 2020 , 1877–1901 (2020).

Google Scholar  

jamovi. The jamovi project, 2023. Accessed: Jul. 31, 2023. [Online]. Available: https://www.jamovi.org

IBM SPSS Statistics for Windows. IBM Corp, Armonk, NY, 2022.

Antaki, F., Touma, S., Milad, D., El-Khoury, J. & Duval, R. Evaluating the performance of ChatGPT in ophthalmology: An analysis of its successes and shortcomings. Ophthalmol. Sci. 3 (4), 100324. https://doi.org/10.1016/j.xops.2023.100324 (2023).

Jin, D., Pan, E., Oufattole, N., Weng, W.-H., Fang, H. & Szolovits, P. What disease does this patient have? A large-scale open domain question answering dataset from medical exams. arXiv, Sep. 28, 2020. https://doi.org/10.48550/arXiv.2009.13081 .

Giannos, P. & Delardas, O. Performance of ChatGPT on UK standardized admission tests: Insights from the BMAT, TMUA, LNAT, and TSA examinations. JMIR Med Educ 9 , e47737. https://doi.org/10.2196/47737 (2023).

4TH YEAR BCQS Mbbs | PDF | Glaucoma | Retina. Scribd. Accessed: Dec. 08, 2023. [Online]. Available: https://www.scribd.com/document/488662391/4TH-YEAR-BCQS-mbbs

foundation_of_practice_specimen_exam_0.pdf. Accessed: Dec. 08, 2023. [Online]. Available: https://www.rcpch.ac.uk/sites/default/files/2021-01/foundation_of_practice_specimen_exam_0.pdf

MRCP Official Sample Questions Flashcards | Quizlet. Accessed: Dec. 08, 2023. [Online]. Available: https://quizlet.com/de/481098567/mrcp-official-sample-questions-flash-cards/

Golchin, S. & Surdeanu, M. Time travel in LLMs: Tracing data contamination in large language models. arXiv (2023). https://doi.org/10.48550/arXiv.2308.08493 .

Ekin, S. Prompt engineering for ChatGPT: A quick guide to techniques, tips, and best practices.” TechRxiv (2023). https://doi.org/10.36227/techrxiv.22683919.v2 .

Heston, T. F. & Khun, C. Prompt engineering in medical education. Int. Med. Educ. 2 (3), 198–205 (2023).

Wang, J. et al. Prompt engineering for healthcare: Methodologies and applications. arXiv, Apr. 28, 2023. https://doi.org/10.48550/arXiv.2304.14670 .

White, J. et al. A prompt pattern catalog to enhance prompt engineering with ChatGPT. arXiv, Feb. 21, 2023. https://doi.org/10.48550/arXiv.2302.11382 .

Brookshire, G. et al. Data leakage in deep learning studies of translational EEG. Front. Neurosci. 18 , 1373515. https://doi.org/10.3389/fnins.2024.1373515 (2024).

Tampu, I. E., Eklund, A. & Haj-Hosseini, N. Inflation of test accuracy due to data leakage in deep learning-based classification of OCT images. Sci. Data 9 (1), 580. https://doi.org/10.1038/s41597-022-01618-6 (2022).

Download references

Open access funding provided by The Science, Technology & Innovation Funding Authority (STDF) in cooperation with The Egyptian Knowledge Bank (EKB). The authors confirm that they have no conflicts of interest to disclose, either with regards to organizations or entities with a financial or non-financial stake in the subject matter of this manuscript, or with regards to funding sources for this research. The authors and this research received no funding for this work.

Author information

Authors and affiliations.

Misr University for Science and Technology, 6th of October, Egypt

Mohammed Ahmed Sadeq & Reem Mohamed Farouk Ghorab

Medical Research Platform (MRP), Giza, Egypt

Mohammed Ahmed Sadeq, Reem Mohamed Farouk Ghorab, Mohamed Hady Ashry, Ahmed Mohamed Abozaid, Haneen A. Banihani, Moustafa Salem, Mohammed Tawfiq Abu Aisheh, Saad Abuzahra, Marina Ramzy Mourid, Mohamad Monif Assker, Mohammed Ayyad & Mostafa Hossam El Din Moawad

School of Medicine, New Giza University (NGU), Giza, Egypt

Mohamed Hady Ashry

Faculty of Medicine, Tanta University, Tanta, Egypt

Ahmed Mohamed Abozaid

Faculty of Medicine, University of Jordan, Amman, Jordan

Haneen A. Banihani

Faculty of Medicine, Mansoura University, Mansoura, Egypt

Moustafa Salem

Department of Medicine, College of Medicine and Health Sciences, An-Najah National University, Nablus, 44839, Palestine

Mohammed Tawfiq Abu Aisheh & Saad Abuzahra

Faculty of Medicine, Alexandria University, Alexandria, Egypt

Marina Ramzy Mourid

Sheikh Khalifa Medical City, Abu Dhabi, UAE

Mohamad Monif Assker

Faculty of Medicine, Al-Quds University, Jerusalem, Palestine

Mohammed Ayyad

Faculty of Pharmacy Clinical Department, Alexandria University, Alexandria, Egypt

Mostafa Hossam El Din Moawad

Faculty of Medicine, Suez Canal University, Ismailia, Egypt

Emergency Medicine Department, Elsheikh Zayed Specialized Hospital, Elsheikh Zayed City, Egypt

You can also search for this author in PubMed   Google Scholar

Contributions

M.A.S., R.M.F.G., M.A., S.A., and M.H.E.M. wrote the manuscript. M.A.S. performed the statistical analysis and prepared figures and tables. M.H.A., R.M.F.G., A.M.A., H.A.B., M.S., M.T.A.A., S.A., M.R.M., M.M.A., M.A., and M.H.E.M. extracted the data. All authors reviewed the manuscript

Corresponding author

Correspondence to Mohammed Ahmed Sadeq .

Ethics declarations

Competing interests.

The authors declare no competing interests.

Additional information

Publisher's note.

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

Supplementary information 1., supplementary information 2., supplementary information 3., rights and permissions.

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/ .

Reprints and permissions

About this article

Cite this article.

Sadeq, M.A., Ghorab, R.M.F., Ashry, M.H. et al. AI chatbots show promise but limitations on UK medical exam questions: a comparative performance study. Sci Rep 14 , 18859 (2024). https://doi.org/10.1038/s41598-024-68996-2

Download citation

Received : 11 September 2023

Accepted : 30 July 2024

Published : 14 August 2024

DOI : https://doi.org/10.1038/s41598-024-68996-2

Share this article

Anyone you share the following link with will be able to read this content:

Sorry, a shareable link is not currently available for this article.

Provided by the Springer Nature SharedIt content-sharing initiative

By submitting a comment you agree to abide by our Terms and Community Guidelines . If you find something abusive or that does not comply with our terms or guidelines please flag it as inappropriate.

Quick links

• Explore articles by subject
• Guide to authors
• Editorial policies

Sign up for the Nature Briefing: AI and Robotics newsletter — what matters in AI and robotics research, free to your inbox weekly.