279 (60.92%) cited an SR in the Introduction
SR: systematic review; MA: meta–analysis; RCT: randomized controlled trial.
Overall, most studies were determined to exhibit a low risk of bias in the majority of items, and all of the included meta-research studies reported an unambiguous aim and a match between aim and methods. However, only a few studies provided argumentation for their choice of data source [ 17 , 20 , 24 , 30 ], and only two of the 21 studies referred to an available a-priori protocol [ 16 , 21 ]. Finally, seven studies provided poor or no discussion of the limitations of their study [ 10 , 19 , 22 , 26 – 28 , 34 ]. The risk-of-bias assessments are shown in Table 3 .
Study | 1. Clear and focused aim | 2. Match between aim and method(s) | 3 The best data source(s) chosen | 4. All important variables considered | 5. The same variables considered in all data sources | 6. Data collection transparent and data unambiguously identified | 7. Classification of the variables unaffected of prior knowledge about the results | 8. Appropriate analysis method | 9. Systematic error(s) or bias taken into consideration | 10. Conclusion supported by data |
---|---|---|---|---|---|---|---|---|---|---|
Bolland et al. (2018) | Low risk | Low risk | Unclear | Unclear | Low risk | Low risk | High risk | Low risk | High risk | Low risk |
Chapman et al. (2019) | Low risk | Low risk | Low risk | Low risk | Low risk | Low risk | High risk | Low risk | Low risk | Low risk |
Chow et al. (2017) | Low risk | Low risk | Unclear risk | Low risk | Low risk | Low risk | High risk | High risk | Low risk | Low risk |
Clarke & Hopewell (2013) | Low risk | Low risk | Unclear risk | Low risk | Low risk | Low risk | High risk | Low risk | High risk | Low risk |
Clarke et al. (2007) | Low risk | Low risk | Unclear risk | Unclear risk | Low risk | Low risk | High risk | Low risk | High risk | Low risk |
Clarke et al. (2010) | Low risk | Low risk | Unclear risk | Low risk | Low risk | Low risk | High risk | Low risk | High risk | Low risk |
Clayton et al. (2017) (survey) | Low risk | Low risk | High risk | Low risk | Low risk | Not applicable | High risk | Low risk | Low risk | High risk |
De Meulemeester et al. (2018) | Low risk | Low risk | Unclear risk | Low risk | Low risk | Low risk | High risk | Low risk | Low risk | Low risk |
Engelking et al. (2018) | Low risk | Low risk | Unclear risk | Low risk | Low risk | Unclear | High risk | Low risk | Low risk | Low risk |
Goudie et al. (2010) | Low risk | Low risk | Unclear risk | Low risk | Low risk | Unclear | High risk | Low risk | Low risk | Low risk |
Helfer et al. (2015) | Low risk | Low risk | Unclear risk | Low risk | Low risk | Low risk | High risk | Low risk | Low risk | Low risk |
Hoderlein et al. (2017) | Low risk | Low risk | Low risk | Low risk | Low risk | Low risk | High risk | Low risk | Low risk | Low risk |
Johnson et al. (2020) | Low risk | Low risk | Unclear risk | Low risk | Low risk | Low risk | Low risk | Low risk | Low risk | Low risk |
Joseph et al. (2018) | Low risk | Low risk | Low risk | Low risk | Low risk | Unclear | High risk | Low risk | Low risk | Low risk |
Ker K & Roberts I. (2015) | Low risk | Low risk | Unclear risk | Low risk | Low risk | High risk | Low risk | Low risk | Low risk | Low risk |
Rauh et al. (2020) | Low risk | Low risk | Unclear risk | Unclear risk | Low risk | Low risk | High risk | Low risk | High risk | Low risk |
Rosenthal et al. (2017) | Low risk | Low risk | Unclear risk | Unclear | Low risk | Low risk | High risk | Low risk | High risk | Low risk |
Seehra et al. (2021) | Low risk | Low risk | Unclear risk | Low risk | Low risk | Low risk | High risk | Low risk | Low risk | Low risk |
Shepard et al. (2021) | Low risk | Low risk | Low risk | Low risk | Low risk | Low risk | High risk | Low risk | Low risk | Low risk |
Torgeson et al. (2020) | Low risk | Low risk | Unclear risk | Low risk | Low risk | Low risk | High risk | Low risk | Low risk | Low risk |
Walters et al. (2019) | Low risk | Low risk | Unclear risk | Low risk | Low risk | Low risk | High risk | Low risk | High risk | Low risk |
Of the included 21 studies, a total of 18 studies were included in the meta-analysis. Two studies included two cohorts each, and both cohorts in each of these studies were included in our meta-analysis [ 21 , 30 ]. The survey by Clayton and colleagues, with a response rate of 17%, was not included in the meta-analysis as the survey did not provide data to identify the use of systematic reviews to justify specific studies. However, their results showed that 42 of 84 respondents (50%) reported using a systematic review for justification [ 29 ]. The study by Chow, which was also not included in the meta-analysis, showed that justification varied largely within and between specialties. However, only relative numbers were provided, and, therefore, no overall percentage could be extracted [ 11 ]. The study by Seehra et al. counted the SR citations in RCTs and not the number of RCTs citing SRs and is therefore not included in the meta-analysis either [ 23 ].
The percentage of original studies that justified a new study with a systematic review within each meta-research study ranged from 16% to 87%. The pooled percentage of original studies using systematic reviews to justify their research question was 42% (95% CI: 36% to 48%) as shown in Fig 2 . Where the confidence interval showed the precision of the pooled estimate in a meta-analysis, the prediction interval showed the distribution of the individual studies. The heterogeneity in the meta-analysis assessed by I 2 was 94%. The clinical interpretation of this large heterogeneity is seen in a the very broad prediction interval ranging from 16 to 71%, meaning that based on these studies there is 95% chance that the results of the next study will show a prevalence between 16 to 71%.
Forest plot prevalence and 95% confidence intervals for the percentage of studies using an SR to justify the study.
Further, we conducted an explorative subgroup analysis of the study of Helfer et al. and the study of Joseph et al. as these two studies were on meta-analyses and protocols and therefore differ from the other included studies. This analysis did only marginally change the pooled percentage to 39% (95% CI; 33% to 46%) and the between-study variance (tau 2 ) was reduced with 23%.
The 21 included studies varied greatly in their approach and in their description of how systematic reviews were used, i.e., if the original studies referred and whether the used systematic reviews in the original studies were relevant and/or of high-quality. Nine studies assessed, to varying degrees, whether the used systematic reviews were relevant for the justification of the research [ 16 – 20 , 25 , 30 , 32 , 34 ]. Overall, the information reported by the meta-research studies was not sufficient to report the percentage of primary studies referring to relevant systematic reviews. No details were provided regarding the methodological quality of the systematic reviews used to justify the research question or if they were recently published reviews, except for Hoderlein et al., who reported that the mean number of years from publication of the cited systematic review and the trial report was four years [ 30 ].
We identified 21 meta-research studies, spanning 15 publication years and 12 medical disciplines. The findings showed substantial variability in the use of systematic reviews when justifying new clinical studies, with the incidence of use ranging from 16% to 87%. However, fewer than half of the 19 meta-analysis-eligible studies used a systematic review to justify their new study. There was wide variability, and a general lack of information, about how systematic reviews were used within many of the original studies. Our systematic review found that the proportion of original studies justifying their new research using evidence syntheses is sub-optimal and, thus, the potential for research redundancy continues to be a challenge. This study corroborates the serious possible consequences regarding research redundancy previously problematized by Chalmers et al. and Glasziou et al. [ 35 , 36 ].
Systematic reviews are considered crucial when justifying a new study, as is emphasized in reporting guidelines such as the CONSORT statement [ 37 ]. However, there are challenges involved in implementing an evidence-based research approach. The authors of the included meta-research study reporting the highest use of systematic reviews to justify a new systematic review study point out that even though the authors of the original studies refer to some of the published systematic reviews, they neglect others on the same topic, which may be problematic and result in a biased approach [ 33 ]. Other issues that have been identified are the risk of research waste when a systematic review may not be methodologically sound [ 12 , 38 ] and that there is also redundancy in the conduct of systematic reviews, with many overlapping systematic reviews existing on the same topic [ 39 – 41 ]. In the original studies within the meta-research studies, the use of systematic reviews was not consistent and, further, it was not explicated whether the systematic reviews used were the most recent and/or of high methodological quality. These issues speak to the need for refinement in the area of systematic review development, such as mandatory registration in prospective registries. Only two out of the included 21 studies in this study referred to an available a-priori protocol [ 16 , 21 ]. General recommendations in the use of systematic reviews as justification for a new study are difficult as these will be topic specific, however researchers should be aware to use the most robust and methodologically sound of recently published reviews, preferably with á priori published protocols.
Efforts must continue in promoting the use of evidence-based research approaches among clinical health researchers and other important stakeholders, such as funders. Collaborations such as the Ensuring Value in Research Funders Forum, and changes in funding review criteria mandating reference to previously published systematic reviews when justifying the research question within funding proposals, are examples of how stakeholders can promote research that is evidence-based [ 8 , 41 ].
We conducted a comprehensive and systematic search. The lack of standard terminology for meta-research studies resulted in search strategies that retrieved thousands of citations. We also relied on snowballing efforts to identify relevant studies, such as by contacting experts and scanning the reference lists of relevant studies.
There is also a lack of tools to assess risk of bias for meta-research studies, so a specific risk-of bias tool for the five conducted reviews was created. The tool was discussed and revised continuously throughout the research process; however, we acknowledge that the checklist is not yet optimal and a validated risk-of-bias tool for meta-research studies is needed.
Many of the included meta-research studies did not provide details as to whether the systematic reviews used to justify the included studies were relevant, high-quality and/or recently published. This may raise questions as to the validity of our findings, as the majority of the meta-research studies only provide an indication of the citation of systematic reviews to justify new studies, not whether the systematic review cited was relevant, recent and of high-quality, or even how the systematic review was used. We did not assess this further either. Nonetheless, even if we assumed that these elements were provided for every original study included in the included meta-research studies (i.e. taking a conservative approach), fewer than half used systematic reviews to justify their research questions. The conservative approach used in this study therefore does not underestimate, and perhaps rather overestimates, the actual use of relevant systematic reviews to justify studies in clinical health science across disciplines.
Different study designs were included in the meta-analysis, which may have contributed to the high degree of heterogeneity observed. Therefore, the presented results should be interpreted with caution due to the high heterogeneity. Not only were there differences in the methods of the included meta-research studies, but there was also heterogeneity in the medical specialties evaluated [ 42 , 43 ].
In conclusion, justification of research questions in clinical health research with systematic reviews continues to be inconsistent; fewer than half of the primary studies within the included meta-research studies in this systematic review were found to have used a systematic review to justify their research question. This indicates that the risk of redundant research is still high when new studies across disciplines and professions in clinical health are initiated, thereby indicating that evidence-based research has not yet been successfully implemented in the clinical health sciences. Efforts to raise awareness and to ensure an evidence-based research approach continue to be necessary, and such efforts should involve clinical health researchers themselves as well as important stakeholders such as funders.
S1 checklist, s1 protocol, acknowledgments.
This work has been prepared as part of the Evidence-Based Research Network ( ebrnetwork.org ). The Evidence-Based Research Network is an international network that promotes the use of systematic reviews when justifying, designing, and interpreting research. The authors thank the Section for Evidence-Based Practice, Department for Health and Function, Western Norway University of Applied Sciences for their generous support of the EBRNetwork. Further, thanks to COST Association for supporting the COST Action “EVBRES” (CA 17117, evbres.eu) and thereby the preparation of this study. Thanks to Gunhild Austrheim, Head of Unit, Library at Western Norway University of Applied Sciences, Norway, for helping with the second search. Thanks to those helping with the screening: Durita Gunnarsson, Gorm Høj Jensen, Line Sjodsholm, Signe Versterre, Linda Baumbach, Karina Johansen, Rune Martens Andersen, and Thomas Aagaard.
We gratefully acknowledge the contribution from the EVBRES (COST ACTION CA 17117) Core Group, including Anne Gjerland (AG) and her specific contribution to the search and screening process.
The authors received no specific funding for this work.
Transfer alert.
This paper was transferred from another journal. As a result, its full editorial history (including decision letters, peer reviews and author responses) may not be present.
PONE-D-22-02383Justification of research using systematic reviews continues to be inconsistent in clinical health science - a systematic review and meta-analysis of meta-research studiesPLOS ONE
Dear Dr. Andreasen,
Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.
Please submit your revised manuscript by May 17 2022 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at gro.solp@enosolp . When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.
Please include the following items when submitting your revised manuscript:
If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.
If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: https://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols . Additionally, PLOS ONE offers an option for publishing peer-reviewed Lab Protocol articles, which describe protocols hosted on protocols.io. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols .
We look forward to receiving your revised manuscript.
Kind regards,
Andrzej Grzybowski
Academic Editor
Journal Requirements:
When submitting your revision, we need you to address these additional requirements.
1. Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at
https://journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf and
https://journals.plos.org/plosone/s/file?id=ba62/PLOSOne_formatting_sample_title_authors_affiliations.pdf
2. We noticed you have some minor occurrence of overlapping text with the following previous publication(s), which needs to be addressed:
- https://www.jclinepi.com/article/S0895-4356 (22)00016-6/fulltext
In your revision ensure you cite all your sources (including your own works), and quote or rephrase any duplicated text outside the methods section. Further consideration is dependent on these concerns being addressed.
3. We note that you have indicated that data from this study are available upon request. PLOS only allows data to be available upon request if there are legal or ethical restrictions on sharing data publicly. For more information on unacceptable data access restrictions, please see http://journals.plos.org/plosone/s/data-availability#loc-unacceptable-data-access-restrictions .
In your revised cover letter, please address the following prompts:
a) If there are ethical or legal restrictions on sharing a de-identified data set, please explain them in detail (e.g., data contain potentially sensitive information, data are owned by a third-party organization, etc.) and who has imposed them (e.g., an ethics committee). Please also provide contact information for a data access committee, ethics committee, or other institutional body to which data requests may be sent.
b) If there are no restrictions, please upload the minimal anonymized data set necessary to replicate your study findings as either Supporting Information files or to a stable, public repository and provide us with the relevant URLs, DOIs, or accession numbers. For a list of acceptable repositories, please see http://journals.plos.org/plosone/s/data-availability#loc-recommended-repositories .
We will update your Data Availability statement on your behalf to reflect the information you provide.
4. We note that you have stated that you will provide repository information for your data at acceptance. Should your manuscript be accepted for publication, we will hold it until you provide the relevant accession numbers or DOIs necessary to access your data. If you wish to make changes to your Data Availability statement, please describe these changes in your cover letter and we will update your Data Availability statement to reflect the information you provide.
[Note: HTML markup is below. Please do not edit.]
Reviewers' comments:
Reviewer's Responses to Questions
Comments to the Author
1. Is the manuscript technically sound, and do the data support the conclusions?
The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.
Reviewer #1: Yes
Reviewer #2: Yes
2. Has the statistical analysis been performed appropriately and rigorously?
3. Have the authors made all data underlying the findings in their manuscript fully available?
The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.
4. Is the manuscript presented in an intelligible fashion and written in standard English?
PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.
5. Review Comments to the Author
Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)
Reviewer #1: Thank you for the opportunity to review this interesting meta-research paper, which is part of a series of papers.
Basing new research on systematic reviews is clearly important and has been the subject of a number of reviews. This paper essentially reviews the meta-research in this area, to give a global assessment of the issue taking into account all of the evidence
The content of the rest of the series was not made clear, but a decision has been made to publish them singly. I think the short description of the rest of the programme could be expanded a little to put the work in context and help the reader understand how the work fits together. How do the different studies relate, and are other papers needed to put the current work in context?
The introduction defines meta-research in broad terms, but it is not until the results that the reader is given a sense of the actual designs included and of relevance to the research question. Were these defined a priori, or were these study designs that fit the broad definition which happened to be found in the search? Are there meta-research designs of relevance to the research question which were not found in the searches?
Personally, I would bring a description of the range of study design forward into the introduction, as getting a sense of the sorts of approaches to meta-research of relevance will help non-specialists in this area. I was not clear of the likely designs until quite late in the paper
The review methods seemed very rigorous, and I had no major comments on those beyond one clarification. When they said, ‘No study was excluded on the grounds of low quality’, did they mean that no studies were considered so bad, or that as a rule no studies were every going to be excluded on that basis?
As noted above, there were a number of study designs included, and all were assessed using the generic risk of bias tool. Presumably some designs are just stronger than others? The survey must be considered a weaker design that the others. Again, this links to the earlier comment about the need for more detail on design of the meta research, which I felt was lost in the use of a generic risk of bias assessment.
I did not understand the statement ‘The clinical interpretation of the large heterogeneity is seen in a broad prediction interval with a range from 16 to 71%’ and that needs clarification
The discussion is balanced, but there are a few significant issues that are given a fairly cursory consideration and would benefit from greater detail
I was interested in the issue of the ‘quality’ of the reviews used. I accept that the data here was not enough for analysis, but felt that the authors (as experts in this area) could be pushed to provide a stronger statement about what criteria should be used by further studies (for example, how do we judge if a review used as the basis for research is a strong basis. How long before a quoted review is too ‘old’?)
They acknowledge that ‘the checklist is not yet optimal and a validated risk-of-bias tool for meta-research studies is needed’. Given their experience and expertise, what would that look like, and how would it be best developed and tested? How would it take into account the role of different designs noted above, given variation in the approaches to meta-research they found?
I appreciate the simple and elegant assessment of the main findings, but they present only vague statement on the role of design and medical specialities. Is it not possible for them to say more on this, or explore the data more fully? What about change over time, which seems very relevant. I did feel the authors could be pushed a little more here, given that they have a programme of work and must be in a position to present more substantive statements. I think that would add to the contribution of the paper
Reviewer #2: The article is on interesting topic but several points needs emphasis:
the inclusion criteria should be defined more clearly in the text
Systematiic review and meta analysis are relatively new and first papers go to late seventies in previous century.
This should be considered when reviewing papers.
The risk of redundancy could not be well defined from the meta search papers rather it should be from the original articles . This would not be possible unless a focused issue is chosen as an example.
The different disciplines have different research out puts as the basis for systematic reviews which makes the comparison difficult .
I realize some studies are based on the disclosure of the authors whether they have used the previous systematic reviews or not . This should be confirmed by evidence .
These should be mentioned as the limitations of this work .
6. PLOS authors have the option to publish the peer review history of their article ( what does this mean? ). If published, this will include your full peer review and any attached files.
If you choose “no”, your identity will remain anonymous but your review may still be made public.
Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy .
Reviewer #1: Yes: Peter Bower
Reviewer #2: No
[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.]
While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/ . PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at gro.solp@serugif . Please note that Supporting Information files do not need this step.
25 Apr 2022
Response letter to the editor and reviewers,
Thank you for the opportunity to revise the manuscript. Thank you to the reviewers for the positive and constructive comments concerning the manuscript. We have now revised the manuscript in accordance with these comments by addressing all issues from the editor and from the reviewers below.
Answer: we have addressed the requirements, see our answers below.
Answer: We believe we meet the style requirements, including correct file naming.
Answer: We agree that there are overlap in parts of the methods section with the mentioned publication. The paper was published in the period of this manuscript being in review, we have therefore now referred to the publication in this manuscript. This manuscript and the publication are both part of a series of papers assessing the global status of evidence-based research in clinical health research and therefore the overlap in the methods section was expected. We have thoroughly scrutinized the full manuscript and found no full sentences that are overlapping, except for the methods section. To be sure of this, we further have conducted a legal comparison in MS Words with the mentioned publication and again found no full sentences except in the methods section. This is to our sincere knowledge only in the methods section, please let us know if we are mistaken.
Answer: We have uploaded the data set necessary to replicate our study findings in a supplementary file and described the changes to the “Data Availability statement” in the cover letter.
Reviewer comments Reviewer #1:
1. Thank you for the opportunity to review this interesting meta-research paper, which is part of a series of papers.
Response: Thank you for this response and that is exactly the purpose.
2. The content of the rest of the series was not made clear, but a decision has been made to publish them singly. I think the short description of the rest of the program could be expanded a little to put the work in context and help the reader understand how the work fits together. How do the different studies relate, and are other papers needed to put the current work in context?
Response: We have expanded the text and especially regarding how the work fits together and shows our purpose of taking a global assessment of the on evidence-based research in the following six papers:
1. Meta-research evaluating redundancy and use of systematic reviews when planning new studies in health research – a scoping review
2. A Systematic Review on the Use of Prior Research in Reports of Randomized Clinical Trials
3. Justification
6. The problem of citation bias – a scoping review
We do not have other papers in pipeline at the moment, but we are currently working on a Handbook for Evidence-Based Research to provide tools and models to make it easier for researchers to work evidence- based in their research.
Changes to text: This study is one of six ongoing meta-syntheses (four systematic reviews and two scoping reviews) planned to assess the global state of evidence-based research in clinical health research. These are; a scoping review mapping the area broadly to describe current practice and identify knowledge gaps, a systematic review on the use of prior research in reports of randomized controlled trials specifically, three systematic reviews assessing the use of systematic reviews when justifying, designing [14] or putting results of a new study in context, and finally a scoping review uncovering the breadth and characteristics of the available, empirical evidence on the topic of citation bias . Further, the research group is working with colleagues on a Handbook for Evidence-based Research in health sciences.
3. The introduction defines meta-research in broad terms, but it is not until the results that the reader is given a sense of the actual designs included and of relevance to the research question. Were these defined a priori, or were these study designs that fit the broad definition which happened to be found in the search? Are there meta-research designs of relevance to the research question which were not found in the searches?
Response: We get your point. A very broad and inclusive definition was defined a priori in the published protocol: “Types of study to be included: We will include meta-research studies (or studies performing research on research)” in order not to miss out on relevant studies, because the research field was quite new and further, we did not identify other meta-research studies to guide our process. Due to our very broad and sensitive search strategy we believe we identified all relevant meta-research studies.
Only data regarding justification from original papers were included in our meta-analysis as the study design of a survey of delegates use of systematic reviews to justify their studies, was assessed as seriously subjected to a social desirability bias.
Changes to text:
Introduction: The present systematic review aimed to identify and synthesize results from meta-research studies, regardless study type, evaluating if and how authors of clinical health research studies use systematic reviews to justify a new study.
Methods section, eligibility criteria: Studies were eligible for inclusion if they were original meta-research studies, regardless study type, that evaluated if and how authors of clinical health studies used systematic reviews to justify new clinical health studies.
4. Personally, I would bring a description of the range of study design forward into the introduction, as getting a sense of the sorts of approaches to meta-research of relevance will help non-specialists in this area. I was not clear of the likely designs until quite late in the paper
Response: We agree and have made it clear that all meta-research studies regardless design was included.
Changes to text: see above.
5. The review methods seemed very rigorous, and I had no major comments on those beyond one clarification. When they said, ‘No study was excluded on the grounds of low quality’, did they mean that no studies were considered so bad, or that as a rule no studies were every going to be excluded on that basis?
Response: The latter, as a rule no studies were excluded, as our intention was not to guide clinical practice. This is stated in the manuscript as the last sentence in the Risk-of-Bias Assessment section. No changes are therefore made.
6. As noted above, there were a number of study designs included, and all were assessed using the generic risk of bias tool. Presumably some designs are just stronger than others? The survey must be considered a weaker design that the others. Again, this links to the earlier comment about the need for more detail on design of the meta research, which I felt was lost in the use of a generic risk of bias assessment.
Response: We agree on this point, but we did take a very open approach to monitor the field of justification. And we did not range the study designs in a hierarchical order in our “premature” Risk of Bias tool, as we aimed to assess the area and not to provide any clinical recommendations. However, the author group and colleagues are currently working on an improved checklist tool.
No further changes to text.
7. I did not understand the statement ‘The clinical interpretation of the large heterogeneity is seen in a broad prediction interval with a range from 16 to 71%’ and that needs clarification
Response: We agree that an explanation is appropriate.
Changes to text: The clinical interpretation of the large heterogeneity is seen in a broad prediction interval with a range from 16 to 71%, meaning that there is 95% confidence that the results of the next study will be between a prevalence of 16 to 71%.
8. The discussion is balanced, but there are a few significant issues that are given a fairly cursory consideration and would benefit from greater detail
Response: We have addressed the issues mentioned below and provided more detail
9. I was interested in the issue of the ‘quality’ of the reviews used. I accept that the data here was not enough for analysis, but felt that the authors (as experts in this area) could be pushed to provide a stronger statement about what criteria should be used by further studies (for example, how do we judge if a review used as the basis for research is a strong basis. How long before a quoted review is too ‘old’?)
Response: Very interesting topic to address further, which we have continuously discussed in the author group, but this is both complex and context dependent in specific topics. Therefore, we have chosen not to elaborate further on the topic in the manuscript, to give an appropriate consideration more space is needed.
Instead, we have mentioned these considerations as important to address further in future publications as to guide researchers when using systematic reviews to justify. As mentioned earlier, the research group is working with colleagues on a Handbook for Evidence-based Research in health sciences, which will elaborate on the topics in detail.
Changes to text in Discussion section:
General recommendations in the use of systematic reviews as justification for a new study are difficult as these will be topic specific, however researchers should be aware to use the most robust and methodologically sound of recently published reviews, preferably with á priori published protocols.
10. They acknowledge that ‘the checklist is not yet optimal and a validated risk-of-bias tool for meta-research studies is needed’. Given their experience and expertise, what would that look like, and how would it be best developed and tested? How would it take into account the role of different designs noted above, given variation in the approaches to meta-research they found?
Response: We fully agree with you on this topic and the author group and colleagues are currently working on an improved checklist tool. Your suggestion about ranging the study designs is very relevant and will be considered in the author group in this thorough work that we expect to publish in the near future. We find the work requires space and thorough analysis and we therefore have decided this should be published in an independent paper.
11. I appreciate the simple and elegant assessment of the main findings, but they present only vague statement on the role of design and medical specialities. Is it not possible for them to say more on this, or explore the data more fully? What about change over time, which seems very relevant. I did feel the authors could be pushed a little more here, given that they have a programme of work and must be in a position to present more substantive statements. I think that would add to the contribution of the paper
Response: The role of design is only considered in relation to that the studies has done meta - research on the topic “justification”. We do not find it was appropriate to explicate more about the roles of medical specialties as the approach in the different studies were very diverse ranging from participants in the survey, to specialties or to specific journals (mostly high ranking) or more broad aimed journals or databases.
Change over time is an important and relevant question. We did not address the issue for two reasons. Firstly, most of the papers are published after 2012 and it would be a short timeline to assess. But most importantly, as most of the included studies in our meta-research study were cross-sectional, we would not be able to validly assess change over time with the data at hand.
Reviewer comments Reviewer #2 :
1. The article is on interesting topic but several points needs emphasis
Response: Thank you. We have answered each point above.
2. The inclusion criteria should be defined more clearly in the text
Response: Methods section: we have clarified the inclusion criteria in the methods section.
3. Systematic review and meta analysis are relatively new and first papers go to late seventies in previous century. This should be considered when reviewing papers.
Response: Yes, it is a fairly new discipline, however it has been recommended to be evidence-based by the use of systematic reviews and meta-analyses for many years. Our aim was therefore to look at meta-research in a broad sense by using previously published studies investigating how large a percentage are using systematic reviews as justification when initiating new health science.
4. The risk of redundancy could not be well defined from the meta search papers rather it should be from the original articles . This would not be possible unless a focused issue is chosen as an example.
Response: Risk of redundancy can, in our perspective, be thoroughly assessed by the use of systematic reviews with meta-analyses included, and especially cumulative meta-analyses can pinpoint this in a specific research topic. Therefore, we agree that we cannot point it to a specific field but have taken this meta-research perspective to provide a more global status on the topic.
We hope you can follow our reasoning.
5. The different disciplines have different research out puts as the basis for systematic reviews which makes the comparison difficult
Response: In this paper, we did not look for the output, but the “input” so to speak, as we assess whether the authors have used justification by using systematic reviews, when initiating a new study in health science. We agree, it is important to define the aim and approach and the outcomes more specifically, if you look into a specific topic.
No changes to text.
6. I realize some studies are based on the disclosure of the authors whether they have used the previous systematic reviews or not. This should be confirmed by evidence.
These should be mentioned as the limitations of this work.
Response: We agree on this point and have clarified in the limitations that we have taken “the face value” reported by the authors in the included studies.
Changes to text: Discussion, Strengths and Limitations section:
This may raise questions as to the validity of our findings, as the majority of the meta-research studies only provide an indication of the citation of systematic reviews to justify new studies, not whether the systematic review was relevant, recent or of high-quality, or even how the systematic review was used. We did not assess this further either.
Submitted filename: Response letter_25042022.docx
19 Sep 2022
PONE-D-22-02383R1Justification of research using systematic reviews continues to be inconsistent in clinical health science - a systematic review and meta-analysis of meta-research studiesPLOS ONE
Please submit your revised manuscript by Nov 03 2022 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at gro.solp@enosolp . When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.
Please review your reference list to ensure that it is complete and correct. If you have cited papers that have been retracted, please include the rationale for doing so in the manuscript text, or remove these references and replace them with relevant current references. Any changes to the reference list should be mentioned in the rebuttal letter that accompanies your revised manuscript. If you need to cite a retracted article, indicate the article’s retracted status in the References list and also include a citation and full reference for the retraction notice.
1. If the authors have adequately addressed your comments raised in a previous round of review and you feel that this manuscript is now acceptable for publication, you may indicate that here to bypass the “Comments to the Author” section, enter your conflict of interest statement in the “Confidential to Editor” section, and submit your "Accept" recommendation.
Reviewer #1: All comments have been addressed
2. Is the manuscript technically sound, and do the data support the conclusions?
3. Has the statistical analysis been performed appropriately and rigorously?
4. Have the authors made all data underlying the findings in their manuscript fully available?
5. Is the manuscript presented in an intelligible fashion and written in standard English?
6. Review Comments to the Author
Reviewer #1: I am happy with the responses and thank the authors for their detailed replies, but just had 2 minor issues
This probably reflects my ignorance so apologies to the authors, but I still do not understand the relationship between the 95% CI around the pooled percentage, and the 'broad prediction interval' which follows it. Could they add a line to explain?
There are some typos remaining. The phrase 'regardless study type' should read 'regardless of study type'. There are some rogue apostrophes in the tables (SR's, RCT's) which need to be edited
7. PLOS authors have the option to publish the peer review history of their article ( what does this mean? ). If published, this will include your full peer review and any attached files.
Reviewer #1: No
21 Sep 2022
Response letter
Thank you for the opportunity to revise the manuscript. Thank you to the reviewer for the relevant comments concerning the manuscript. We have revised the manuscript in accordance with these comments by addressing all issues from the editor and from the reviewers below.
Reviewer #1: I am happy with the responses and thank the authors for their detailed replies, but just had 2 minor issues
Response: Thank you very much.
Response: We have revised and explained more in detail and hope the revised text explains this more clearly.
Where the confidence interval showed the precision of the pooled estimate in a meta-analysis, the prediction interval showed the distribution of the individual studies. The heterogeneity in the meta-analysis assessed by I2 was 94%. The clinical interpretation of this large heterogeneity is seen in a the very broad prediction interval ranging from 16 to 71%, meaning that based on these studies there is 95% chance that the results of the next study will show a prevalence between 16 to 71%.
There are some typos remaining. The phrase 'regardless study type' should read 'regardless of study type'.
Response: Thank you, we have revised as suggested.
There are some rogue apostrophes in the tables (SR's, RCT's) which need to be edited
Response: Thank you for pointing this out. We have edited this now.
On behalf of the author group,
Submitted filename: Response letter 20092022.docx
18 Oct 2022
Justification of research using systematic reviews continues to be inconsistent in clinical health science - a systematic review and meta-analysis of meta-research studies
PONE-D-22-02383R2
We’re pleased to inform you that your manuscript has been judged scientifically suitable for publication and will be formally accepted for publication once it meets all outstanding technical requirements.
Within one week, you’ll receive an e-mail detailing the required amendments. When these have been addressed, you’ll receive a formal acceptance letter and your manuscript will be scheduled for publication.
An invoice for payment will follow shortly after the formal acceptance. To ensure an efficient process, please log into Editorial Manager at http://www.editorialmanager.com/pone/ , click the 'Update My Information' link at the top of the page, and double check that your user information is up-to-date. If you have any billing related questions, please contact our Author Billing department directly at gro.solp@gnillibrohtua .
If your institution or institutions have a press office, please notify them about your upcoming paper to help maximize its impact. If they’ll be preparing press materials, please inform our press team as soon as possible -- no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact gro.solp@sserpeno .
Additional Editor Comments (optional):
Reviewer #1: (No Response)
21 Oct 2022
Dear Dr. Andreasen:
I'm pleased to inform you that your manuscript has been deemed suitable for publication in PLOS ONE. Congratulations! Your manuscript is now with our production department.
If your institution or institutions have a press office, please let them know about your upcoming paper now to help maximize its impact. If they'll be preparing press materials, please inform our press team within the next 48 hours. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information please contact gro.solp@sserpeno .
If we can help with anything else, please email us at gro.solp@enosolp .
Thank you for submitting your work to PLOS ONE and supporting open access.
PLOS ONE Editorial Office Staff
on behalf of
Dr. Andrzej Grzybowski
Research is a process, an exhaustive and meticulous process to find answers. It is the in-depth and systematic investigation into and study of materials and sources to establish facts and reach new conclusions. The goal of professional research is to create new knowledge about a topic or explain an old idea in new ways.
The goal of research is to find something new or different about a subject. The Justification is the " WHY " of your research topic or the " RATIONALE" . The Justification comes as you are doing your in-depth analysis of the topic, as you begin your literature review. With the beginning steps into research, you should begin to see what others were asking as their Research Question, and begin to recognize gaps in other articles that may be where you want to take your research. The justification may also come from a new perspective on an old trope or idea that is outdated.
This portion of your research process is just the beginning it is where you do enough research to know that there is a problem that you find interesting and others have researched the topic too. At this point in the process you should have already:
NOTE: The justification portion of your paper and your thesis question may change over the process of writing a paper. As you gain insight into the deeper elements of the topic you may find the need to reconnoiter (rework, requestion, reframe) your ideas.
Keep up-to-date on postgraduate related issues with our quick reads written by students, postdocs, professors and industry leaders.
The term rationale of research means the reason for performing the research study in question. In writing your rational you should able to convey why there was a need for your study to be carried out. It’s an important part of your research paper that should explain how your research was novel and explain why it was significant; this helps the reader understand why your research question needed to be addressed in your research paper, term paper or other research report.
The rationale for research is also sometimes referred to as the justification for the study. When writing your rational, first begin by introducing and explaining what other researchers have published on within your research field.
Having explained the work of previous literature and prior research, include discussion about where the gaps in knowledge are in your field. Use these to define potential research questions that need answering and explain the importance of addressing these unanswered questions.
The rationale conveys to the reader of your publication exactly why your research topic was needed and why it was significant . Having defined your research rationale, you would then go on to define your hypothesis and your research objectives.
Defining the rationale research, is a key part of the research process and academic writing in any research project. You use this in your research paper to firstly explain the research problem within your dissertation topic. This gives you the research justification you need to define your research question and what the expected outcomes may be.
Tenure is a permanent position awarded to professors showing excellence in research and teaching. Find out more about the competitive position!
In the UK, a dissertation, usually around 20,000 words is written by undergraduate and Master’s students, whilst a thesis, around 80,000 words, is written as part of a PhD.
The scope and delimitations of a thesis, dissertation or paper define the topic and boundaries of a research problem – learn how to form them.
Join thousands of other students and stay up to date with the latest PhD programmes, funding opportunities and advice.
This post gives you the best questions to ask at a PhD interview, to help you work out if your potential supervisor and lab is a good fit for you.
Need to write a list of abbreviations for a thesis or dissertation? Read our post to find out where they go, what to include and how to format them.
Gareth is getting ready for his PhD viva at Aberystwyth University and has been researching bacteria living inside coastal plants that can help other plants grow in salt contaminated soils.
Dr Pathak gained her PhD in Molecular Genetics from the University of North Texas Health Science Center in 2019. She is now a Postdoctoral Associate training in psychiatric genetics at the Yale School of Medicine.
The methods section describes actions taken to investigate a research problem and the rationale for the application of specific procedures or techniques used to identify, select, process, and analyze information applied to understanding the problem, thereby, allowing the reader to critically evaluate a study’s overall validity and reliability. The methodology section of a research paper answers two main questions: How was the data collected or generated? And, how was it analyzed? The writing should be direct and precise and always written in the past tense.
Kallet, Richard H. "How to Write the Methods Section of a Research Paper." Respiratory Care 49 (October 2004): 1229-1232.
You must explain how you obtained and analyzed your results for the following reasons:
Bem, Daryl J. Writing the Empirical Journal Article. Psychology Writing Center. University of Washington; Denscombe, Martyn. The Good Research Guide: For Small-Scale Social Research Projects . 5th edition. Buckingham, UK: Open University Press, 2014; Lunenburg, Frederick C. Writing a Successful Thesis or Dissertation: Tips and Strategies for Students in the Social and Behavioral Sciences . Thousand Oaks, CA: Corwin Press, 2008.
I. Groups of Research Methods
There are two main groups of research methods in the social sciences:
II. Content
The introduction to your methodology section should begin by restating the research problem and underlying assumptions underpinning your study. This is followed by situating the methods you used to gather, analyze, and process information within the overall “tradition” of your field of study and within the particular research design you have chosen to study the problem. If the method you choose lies outside of the tradition of your field [i.e., your review of the literature demonstrates that the method is not commonly used], provide a justification for how your choice of methods specifically addresses the research problem in ways that have not been utilized in prior studies.
The remainder of your methodology section should describe the following:
In addition, an effectively written methodology section should:
NOTE: Once you have written all of the elements of the methods section, subsequent revisions should focus on how to present those elements as clearly and as logically as possibly. The description of how you prepared to study the research problem, how you gathered the data, and the protocol for analyzing the data should be organized chronologically. For clarity, when a large amount of detail must be presented, information should be presented in sub-sections according to topic. If necessary, consider using appendices for raw data.
ANOTHER NOTE: If you are conducting a qualitative analysis of a research problem , the methodology section generally requires a more elaborate description of the methods used as well as an explanation of the processes applied to gathering and analyzing of data than is generally required for studies using quantitative methods. Because you are the primary instrument for generating the data [e.g., through interviews or observations], the process for collecting that data has a significantly greater impact on producing the findings. Therefore, qualitative research requires a more detailed description of the methods used.
YET ANOTHER NOTE: If your study involves interviews, observations, or other qualitative techniques involving human subjects , you may be required to obtain approval from the university's Office for the Protection of Research Subjects before beginning your research. This is not a common procedure for most undergraduate level student research assignments. However, i f your professor states you need approval, you must include a statement in your methods section that you received official endorsement and adequate informed consent from the office and that there was a clear assessment and minimization of risks to participants and to the university. This statement informs the reader that your study was conducted in an ethical and responsible manner. In some cases, the approval notice is included as an appendix to your paper.
III. Problems to Avoid
Irrelevant Detail The methodology section of your paper should be thorough but concise. Do not provide any background information that does not directly help the reader understand why a particular method was chosen, how the data was gathered or obtained, and how the data was analyzed in relation to the research problem [note: analyzed, not interpreted! Save how you interpreted the findings for the discussion section]. With this in mind, the page length of your methods section will generally be less than any other section of your paper except the conclusion.
Unnecessary Explanation of Basic Procedures Remember that you are not writing a how-to guide about a particular method. You should make the assumption that readers possess a basic understanding of how to investigate the research problem on their own and, therefore, you do not have to go into great detail about specific methodological procedures. The focus should be on how you applied a method , not on the mechanics of doing a method. An exception to this rule is if you select an unconventional methodological approach; if this is the case, be sure to explain why this approach was chosen and how it enhances the overall process of discovery.
Problem Blindness It is almost a given that you will encounter problems when collecting or generating your data, or, gaps will exist in existing data or archival materials. Do not ignore these problems or pretend they did not occur. Often, documenting how you overcame obstacles can form an interesting part of the methodology. It demonstrates to the reader that you can provide a cogent rationale for the decisions you made to minimize the impact of any problems that arose.
Literature Review Just as the literature review section of your paper provides an overview of sources you have examined while researching a particular topic, the methodology section should cite any sources that informed your choice and application of a particular method [i.e., the choice of a survey should include any citations to the works you used to help construct the survey].
It’s More than Sources of Information! A description of a research study's method should not be confused with a description of the sources of information. Such a list of sources is useful in and of itself, especially if it is accompanied by an explanation about the selection and use of the sources. The description of the project's methodology complements a list of sources in that it sets forth the organization and interpretation of information emanating from those sources.
Azevedo, L.F. et al. "How to Write a Scientific Paper: Writing the Methods Section." Revista Portuguesa de Pneumologia 17 (2011): 232-238; Blair Lorrie. “Choosing a Methodology.” In Writing a Graduate Thesis or Dissertation , Teaching Writing Series. (Rotterdam: Sense Publishers 2016), pp. 49-72; Butin, Dan W. The Education Dissertation A Guide for Practitioner Scholars . Thousand Oaks, CA: Corwin, 2010; Carter, Susan. Structuring Your Research Thesis . New York: Palgrave Macmillan, 2012; Kallet, Richard H. “How to Write the Methods Section of a Research Paper.” Respiratory Care 49 (October 2004):1229-1232; Lunenburg, Frederick C. Writing a Successful Thesis or Dissertation: Tips and Strategies for Students in the Social and Behavioral Sciences . Thousand Oaks, CA: Corwin Press, 2008. Methods Section. The Writer’s Handbook. Writing Center. University of Wisconsin, Madison; Rudestam, Kjell Erik and Rae R. Newton. “The Method Chapter: Describing Your Research Plan.” In Surviving Your Dissertation: A Comprehensive Guide to Content and Process . (Thousand Oaks, Sage Publications, 2015), pp. 87-115; What is Interpretive Research. Institute of Public and International Affairs, University of Utah; Writing the Experimental Report: Methods, Results, and Discussion. The Writing Lab and The OWL. Purdue University; Methods and Materials. The Structure, Format, Content, and Style of a Journal-Style Scientific Paper. Department of Biology. Bates College.
Statistical Designs and Tests? Do Not Fear Them!
Don't avoid using a quantitative approach to analyzing your research problem just because you fear the idea of applying statistical designs and tests. A qualitative approach, such as conducting interviews or content analysis of archival texts, can yield exciting new insights about a research problem, but it should not be undertaken simply because you have a disdain for running a simple regression. A well designed quantitative research study can often be accomplished in very clear and direct ways, whereas, a similar study of a qualitative nature usually requires considerable time to analyze large volumes of data and a tremendous burden to create new paths for analysis where previously no path associated with your research problem had existed.
To locate data and statistics, GO HERE .
Knowing the Relationship Between Theories and Methods
There can be multiple meaning associated with the term "theories" and the term "methods" in social sciences research. A helpful way to delineate between them is to understand "theories" as representing different ways of characterizing the social world when you research it and "methods" as representing different ways of generating and analyzing data about that social world. Framed in this way, all empirical social sciences research involves theories and methods, whether they are stated explicitly or not. However, while theories and methods are often related, it is important that, as a researcher, you deliberately separate them in order to avoid your theories playing a disproportionate role in shaping what outcomes your chosen methods produce.
Introspectively engage in an ongoing dialectic between the application of theories and methods to help enable you to use the outcomes from your methods to interrogate and develop new theories, or ways of framing conceptually the research problem. This is how scholarship grows and branches out into new intellectual territory.
Reynolds, R. Larry. Ways of Knowing. Alternative Microeconomics . Part 1, Chapter 3. Boise State University; The Theory-Method Relationship. S-Cool Revision. United Kingdom.
Methods and the Methodology
Do not confuse the terms "methods" and "methodology." As Schneider notes, a method refers to the technical steps taken to do research . Descriptions of methods usually include defining and stating why you have chosen specific techniques to investigate a research problem, followed by an outline of the procedures you used to systematically select, gather, and process the data [remember to always save the interpretation of data for the discussion section of your paper].
The methodology refers to a discussion of the underlying reasoning why particular methods were used . This discussion includes describing the theoretical concepts that inform the choice of methods to be applied, placing the choice of methods within the more general nature of academic work, and reviewing its relevance to examining the research problem. The methodology section also includes a thorough review of the methods other scholars have used to study the topic.
Bryman, Alan. "Of Methods and Methodology." Qualitative Research in Organizations and Management: An International Journal 3 (2008): 159-168; Schneider, Florian. “What's in a Methodology: The Difference between Method, Methodology, and Theory…and How to Get the Balance Right?” PoliticsEastAsia.com. Chinese Department, University of Leiden, Netherlands.
By charlesworth author services.
The rationale for one’s research is the justification for undertaking a given study. It states the reason(s) why a researcher chooses to focus on the topic in question, including what the significance is and what gaps the research intends to fill. In short, it is an explanation that rationalises the need for the study. The rationale is typically followed by a hypothesis/ research question (s) and the study objectives.
The rationale of a study can be presented both before and after the research is conducted.
The study rationale is predominantly based on preliminary data . A literature review will help you identify gaps in the current knowledge base and also ensure that you avoid duplicating what has already been done. You can then formulate the justification for your study from the existing literature on the subject and the perceived outcomes of the proposed study.
In a research proposal or research article, the rationale would not take up more than a few sentences . A thesis or dissertation would allow for a longer description, which could even run into a couple of paragraphs . The length might even depend on the field of study or nature of the experiment. For instance, a completely novel or unconventional approach might warrant a longer and more detailed justification.
Every research rationale should include some mention or discussion of the following:
Note: This uses a fictional study.
Abc xyz is a newly identified microalgal species isolated from fish tanks. While Abc xyz algal blooms have been seen as a threat to pisciculture, some studies have hinted at their unusually high carotenoid content and unique carotenoid profile. Carotenoid profiling has been carried out only in a handful of microalgal species from this genus, and the search for microalgae rich in bioactive carotenoids has not yielded promising candidates so far. This in-depth examination of the carotenoid profile of Abc xyz will help identify and quantify novel and potentially useful carotenoids from an untapped aquaculture resource .
It is important to describe the rationale of your research in order to put the significance and novelty of your specific research project into perspective. Once you have successfully articulated the reason(s) for your research, you will have convinced readers of the importance of your work!
Maximise your publication success with Charlesworth Author Services.
Charlesworth Author Services , a trusted brand supporting the world’s leading academic publishers, institutions and authors since 1928.
To know more about our services, visit: Our Services
Sign up – stay updated.
We use cookies to offer you a personalized experience. By continuing to use this website, you consent to the use of cookies in accordance with our Cookie Policy.
You have full access to this open access article
286k Accesses
17 Citations
709 Altmetric
Explore all metrics
Communicating research findings is an essential step in the research process. Often, peer-reviewed journals are the forum for such communication, yet many researchers are never taught how to write a publishable scientific paper. In this article, we explain the basic structure of a scientific paper and describe the information that should be included in each section. We also identify common pitfalls for each section and recommend strategies to avoid them. Further, we give advice about target journal selection and authorship. In the online resource 1 , we provide an example of a high-quality scientific paper, with annotations identifying the elements we describe in this article.
Explore related subjects.
Avoid common mistakes on your manuscript.
Writing a scientific paper is an important component of the research process, yet researchers often receive little formal training in scientific writing. This is especially true in low-resource settings. In this article, we explain why choosing a target journal is important, give advice about authorship, provide a basic structure for writing each section of a scientific paper, and describe common pitfalls and recommendations for each section. In the online resource 1 , we also include an annotated journal article that identifies the key elements and writing approaches that we detail here. Before you begin your research, make sure you have ethical clearance from all relevant ethical review boards.
We recommend that you select a “target journal” early in the writing process; a “target journal” is the journal to which you plan to submit your paper. Each journal has a set of core readers and you should tailor your writing to this readership. For example, if you plan to submit a manuscript about vaping during pregnancy to a pregnancy-focused journal, you will need to explain what vaping is because readers of this journal may not have a background in this topic. However, if you were to submit that same article to a tobacco journal, you would not need to provide as much background information about vaping.
Information about a journal’s core readership can be found on its website, usually in a section called “About this journal” or something similar. For example, the Journal of Cancer Education presents such information on the “Aims and Scope” page of its website, which can be found here: https://www.springer.com/journal/13187/aims-and-scope .
Peer reviewer guidelines from your target journal are an additional resource that can help you tailor your writing to the journal and provide additional advice about crafting an effective article [ 1 ]. These are not always available, but it is worth a quick web search to find out.
Early in the writing process, identify authors, determine the order of authors, and discuss the responsibilities of each author. Standard author responsibilities have been identified by The International Committee of Medical Journal Editors (ICMJE) [ 2 ]. To set clear expectations about each team member’s responsibilities and prevent errors in communication, we also suggest outlining more detailed roles, such as who will draft each section of the manuscript, write the abstract, submit the paper electronically, serve as corresponding author, and write the cover letter. It is best to formalize this agreement in writing after discussing it, circulating the document to the author team for approval. We suggest creating a title page on which all authors are listed in the agreed-upon order. It may be necessary to adjust authorship roles and order during the development of the paper. If a new author order is agreed upon, be sure to update the title page in the manuscript draft.
In the case where multiple papers will result from a single study, authors should discuss who will author each paper. Additionally, authors should agree on a deadline for each paper and the lead author should take responsibility for producing an initial draft by this deadline.
The introduction section should be approximately three to five paragraphs in length. Look at examples from your target journal to decide the appropriate length. This section should include the elements shown in Fig. 1 . Begin with a general context, narrowing to the specific focus of the paper. Include five main elements: why your research is important, what is already known about the topic, the “gap” or what is not yet known about the topic, why it is important to learn the new information that your research adds, and the specific research aim(s) that your paper addresses. Your research aim should address the gap you identified. Be sure to add enough background information to enable readers to understand your study. Table 1 provides common introduction section pitfalls and recommendations for addressing them.
The main elements of the introduction section of an original research article. Often, the elements overlap
The purpose of the methods section is twofold: to explain how the study was done in enough detail to enable its replication and to provide enough contextual detail to enable readers to understand and interpret the results. In general, the essential elements of a methods section are the following: a description of the setting and participants, the study design and timing, the recruitment and sampling, the data collection process, the dataset, the dependent and independent variables, the covariates, the analytic approach for each research objective, and the ethical approval. The hallmark of an exemplary methods section is the justification of why each method was used. Table 2 provides common methods section pitfalls and recommendations for addressing them.
The focus of the results section should be associations, or lack thereof, rather than statistical tests. Two considerations should guide your writing here. First, the results should present answers to each part of the research aim. Second, return to the methods section to ensure that the analysis and variables for each result have been explained.
Begin the results section by describing the number of participants in the final sample and details such as the number who were approached to participate, the proportion who were eligible and who enrolled, and the number of participants who dropped out. The next part of the results should describe the participant characteristics. After that, you may organize your results by the aim or by putting the most exciting results first. Do not forget to report your non-significant associations. These are still findings.
Tables and figures capture the reader’s attention and efficiently communicate your main findings [ 3 ]. Each table and figure should have a clear message and should complement, rather than repeat, the text. Tables and figures should communicate all salient details necessary for a reader to understand the findings without consulting the text. Include information on comparisons and tests, as well as information about the sample and timing of the study in the title, legend, or in a footnote. Note that figures are often more visually interesting than tables, so if it is feasible to make a figure, make a figure. To avoid confusing the reader, either avoid abbreviations in tables and figures, or define them in a footnote. Note that there should not be citations in the results section and you should not interpret results here. Table 3 provides common results section pitfalls and recommendations for addressing them.
Opposite the introduction section, the discussion should take the form of a right-side-up triangle beginning with interpretation of your results and moving to general implications (Fig. 2 ). This section typically begins with a restatement of the main findings, which can usually be accomplished with a few carefully-crafted sentences.
Major elements of the discussion section of an original research article. Often, the elements overlap
Next, interpret the meaning or explain the significance of your results, lifting the reader’s gaze from the study’s specific findings to more general applications. Then, compare these study findings with other research. Are these findings in agreement or disagreement with those from other studies? Does this study impart additional nuance to well-accepted theories? Situate your findings within the broader context of scientific literature, then explain the pathways or mechanisms that might give rise to, or explain, the results.
Journals vary in their approach to strengths and limitations sections: some are embedded paragraphs within the discussion section, while some mandate separate section headings. Keep in mind that every study has strengths and limitations. Candidly reporting yours helps readers to correctly interpret your research findings.
The next element of the discussion is a summary of the potential impacts and applications of the research. Should these results be used to optimally design an intervention? Does the work have implications for clinical protocols or public policy? These considerations will help the reader to further grasp the possible impacts of the presented work.
Finally, the discussion should conclude with specific suggestions for future work. Here, you have an opportunity to illuminate specific gaps in the literature that compel further study. Avoid the phrase “future research is necessary” because the recommendation is too general to be helpful to readers. Instead, provide substantive and specific recommendations for future studies. Table 4 provides common discussion section pitfalls and recommendations for addressing them.
After you select a target journal, identify the journal’s author guidelines to guide the formatting of your manuscript and references. Author guidelines will often (but not always) include instructions for titles, cover letters, and other components of a manuscript submission. Read the guidelines carefully. If you do not follow the guidelines, your article will be sent back to you.
Finally, do not submit your paper to more than one journal at a time. Even if this is not explicitly stated in the author guidelines of your target journal, it is considered inappropriate and unprofessional.
Your title should invite readers to continue reading beyond the first page [ 4 , 5 ]. It should be informative and interesting. Consider describing the independent and dependent variables, the population and setting, the study design, the timing, and even the main result in your title. Because the focus of the paper can change as you write and revise, we recommend you wait until you have finished writing your paper before composing the title.
Be sure that the title is useful for potential readers searching for your topic. The keywords you select should complement those in your title to maximize the likelihood that a researcher will find your paper through a database search. Avoid using abbreviations in your title unless they are very well known, such as SNP, because it is more likely that someone will use a complete word rather than an abbreviation as a search term to help readers find your paper.
After you have written a complete draft, use the checklist (Fig. 3 ) below to guide your revisions and editing. Additional resources are available on writing the abstract and citing references [ 5 ]. When you feel that your work is ready, ask a trusted colleague or two to read the work and provide informal feedback. The box below provides a checklist that summarizes the key points offered in this article.
Checklist for manuscript quality
Michalek AM (2014) Down the rabbit hole…advice to reviewers. J Cancer Educ 29:4–5
Article Google Scholar
International Committee of Medical Journal Editors. Defining the role of authors and contributors: who is an author? http://www.icmje.org/recommendations/browse/roles-and-responsibilities/defining-the-role-of-authosrs-and-contributors.html . Accessed 15 January, 2020
Vetto JT (2014) Short and sweet: a short course on concise medical writing. J Cancer Educ 29(1):194–195
Brett M, Kording K (2017) Ten simple rules for structuring papers. PLoS ComputBiol. https://doi.org/10.1371/journal.pcbi.1005619
Lang TA (2017) Writing a better research article. J Public Health Emerg. https://doi.org/10.21037/jphe.2017.11.06
Download references
Ella August is grateful to the Sustainable Sciences Institute for mentoring her in training researchers on writing and publishing their research.
Not applicable.
Authors and affiliations.
Department of Maternal and Child Health, University of North Carolina Gillings School of Global Public Health, 135 Dauer Dr, 27599, Chapel Hill, NC, USA
Clara Busse & Ella August
Department of Epidemiology, University of Michigan School of Public Health, 1415 Washington Heights, Ann Arbor, MI, 48109-2029, USA
Ella August
You can also search for this author in PubMed Google Scholar
Correspondence to Ella August .
Conflicts of interests.
The authors declare that they have no conflict of interest.
Publisher’s note.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
(PDF 362 kb)
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/ .
Reprints and permissions
Busse, C., August, E. How to Write and Publish a Research Paper for a Peer-Reviewed Journal. J Canc Educ 36 , 909–913 (2021). https://doi.org/10.1007/s13187-020-01751-z
Download citation
Published : 30 April 2020
Issue Date : October 2021
DOI : https://doi.org/10.1007/s13187-020-01751-z
Anyone you share the following link with will be able to read this content:
Sorry, a shareable link is not currently available for this article.
Provided by the Springer Nature SharedIt content-sharing initiative
The justification to the part of a research project that sets out the reasons that motivated the research. The justification is the section that explains the importance and the reasons that led the researcher to carry out the work.
The justification explains to the reader why and why the chosen topic was investigated. In general, the reasons that the researcher can give in a justification may be that his work allows to build or refute theories; bring a new approach or perspective on the subject; contribute to the solution of a specific problem (social, economic, environmental, etc.) that affects certain people; generate meaningful and reusable empirical data; clarify the causes and consequences of a specific phenomenon of interest; among other.
Among the criteria used to write a justification, the usefulness of the research for other academics or for other social sectors (public officials, companies, sectors of civil society), the significance in time that it may have, the contribution of new research tools or techniques, updating of existing knowledge, among others. Also, the language should be formal and descriptive.
Cookie | Duration | Description |
---|---|---|
cookielawinfo-checkbox-analytics | 11 months | This cookie is set by GDPR Cookie Consent plugin. The cookie is used to store the user consent for the cookies in the category "Analytics". |
cookielawinfo-checkbox-functional | 11 months | The cookie is set by GDPR cookie consent to record the user consent for the cookies in the category "Functional". |
cookielawinfo-checkbox-necessary | 11 months | This cookie is set by GDPR Cookie Consent plugin. The cookies is used to store the user consent for the cookies in the category "Necessary". |
cookielawinfo-checkbox-others | 11 months | This cookie is set by GDPR Cookie Consent plugin. The cookie is used to store the user consent for the cookies in the category "Other. |
cookielawinfo-checkbox-performance | 11 months | This cookie is set by GDPR Cookie Consent plugin. The cookie is used to store the user consent for the cookies in the category "Performance". |
viewed_cookie_policy | 11 months | The cookie is set by the GDPR Cookie Consent plugin and is used to store whether or not user has consented to the use of cookies. It does not store any personal data. |
Run a free plagiarism check in 10 minutes, generate accurate citations for free.
Published on August 25, 2022 by Shona McCombes and Tegan George. Revised on September 5, 2024.
Your research methodology discusses and explains the data collection and analysis methods you used in your research. A key part of your thesis, dissertation , or research paper , the methodology chapter explains what you did and how you did it, allowing readers to evaluate the reliability and validity of your research and your dissertation topic .
It should include:
Upload your document to correct all your mistakes in minutes
How to write a research methodology, why is a methods section important, step 1: explain your methodological approach, step 2: describe your data collection methods, step 3: describe your analysis method, step 4: evaluate and justify the methodological choices you made, tips for writing a strong methodology chapter, other interesting articles, frequently asked questions about methodology.
Professional editors proofread and edit your paper by focusing on:
See an example
Your methods section is your opportunity to share how you conducted your research and why you chose the methods you chose. It’s also the place to show that your research was rigorously conducted and can be replicated .
It gives your research legitimacy and situates it within your field, and also gives your readers a place to refer to if they have any questions or critiques in other sections.
You can start by introducing your overall approach to your research. You have two options here.
What research problem or question did you investigate?
And what type of data did you need to achieve this aim?
Depending on your discipline, you can also start with a discussion of the rationale and assumptions underpinning your methodology. In other words, why did you choose these methods for your study?
Once you have introduced your reader to your methodological approach, you should share full details about your data collection methods .
In order to be considered generalizable, you should describe quantitative research methods in enough detail for another researcher to replicate your study.
Here, explain how you operationalized your concepts and measured your variables. Discuss your sampling method or inclusion and exclusion criteria , as well as any tools, procedures, and materials you used to gather your data.
Surveys Describe where, when, and how the survey was conducted.
Experiments Share full details of the tools, techniques, and procedures you used to conduct your experiment.
Existing data Explain how you gathered and selected the material (such as datasets or archival data) that you used in your analysis.
The survey consisted of 5 multiple-choice questions and 10 questions measured on a 7-point Likert scale.
The goal was to collect survey responses from 350 customers visiting the fitness apparel company’s brick-and-mortar location in Boston on July 4–8, 2022, between 11:00 and 15:00.
Here, a customer was defined as a person who had purchased a product from the company on the day they took the survey. Participants were given 5 minutes to fill in the survey anonymously. In total, 408 customers responded, but not all surveys were fully completed. Due to this, 371 survey results were included in the analysis.
In qualitative research , methods are often more flexible and subjective. For this reason, it’s crucial to robustly explain the methodology choices you made.
Be sure to discuss the criteria you used to select your data, the context in which your research was conducted, and the role you played in collecting your data (e.g., were you an active participant, or a passive observer?)
Interviews or focus groups Describe where, when, and how the interviews were conducted.
Participant observation Describe where, when, and how you conducted the observation or ethnography .
Existing data Explain how you selected case study materials for your analysis.
In order to gain better insight into possibilities for future improvement of the fitness store’s product range, semi-structured interviews were conducted with 8 returning customers.
Here, a returning customer was defined as someone who usually bought products at least twice a week from the store.
Surveys were used to select participants. Interviews were conducted in a small office next to the cash register and lasted approximately 20 minutes each. Answers were recorded by note-taking, and seven interviews were also filmed with consent. One interviewee preferred not to be filmed.
Mixed methods research combines quantitative and qualitative approaches. If a standalone quantitative or qualitative study is insufficient to answer your research question, mixed methods may be a good fit for you.
Mixed methods are less common than standalone analyses, largely because they require a great deal of effort to pull off successfully. If you choose to pursue mixed methods, it’s especially important to robustly justify your methods.
Discover proofreading & editing
Next, you should indicate how you processed and analyzed your data. Avoid going into too much detail: you should not start introducing or discussing any of your results at this stage.
In quantitative research , your analysis will be based on numbers. In your methods section, you can include:
In qualitative research, your analysis will be based on language, images, and observations (often involving some form of textual analysis ).
Specific methods might include:
Mixed methods combine the above two research methods, integrating both qualitative and quantitative approaches into one coherent analytical process.
Above all, your methodology section should clearly make the case for why you chose the methods you did. This is especially true if you did not take the most standard approach to your topic. In this case, discuss why other methods were not suitable for your objectives, and show how this approach contributes new knowledge or understanding.
In any case, it should be overwhelmingly clear to your reader that you set yourself up for success in terms of your methodology’s design. Show how your methods should lead to results that are valid and reliable, while leaving the analysis of the meaning, importance, and relevance of your results for your discussion section .
Remember that your aim is not just to describe your methods, but to show how and why you applied them. Again, it’s critical to demonstrate that your research was rigorously conducted and can be replicated.
The methodology section should clearly show why your methods suit your objectives and convince the reader that you chose the best possible approach to answering your problem statement and research questions .
Your methodology can be strengthened by referencing existing research in your field. This can help you to:
Consider how much information you need to give, and avoid getting too lengthy. If you are using methods that are standard for your discipline, you probably don’t need to give a lot of background or justification.
Regardless, your methodology should be a clear, well-structured text that makes an argument for your approach, not just a list of technical details and procedures.
If you want to know more about statistics , methodology , or research bias , make sure to check out some of our other articles with explanations and examples.
Methodology
Research bias
Methodology refers to the overarching strategy and rationale of your research project . It involves studying the methods used in your field and the theories or principles behind them, in order to develop an approach that matches your objectives.
Methods are the specific tools and procedures you use to collect and analyze data (for example, experiments, surveys , and statistical tests ).
In shorter scientific papers, where the aim is to report the findings of a specific study, you might simply describe what you did in a methods section .
In a longer or more complex research project, such as a thesis or dissertation , you will probably include a methodology section , where you explain your approach to answering the research questions and cite relevant sources to support your choice of methods.
In a scientific paper, the methodology always comes after the introduction and before the results , discussion and conclusion . The same basic structure also applies to a thesis, dissertation , or research proposal .
Depending on the length and type of document, you might also include a literature review or theoretical framework before the methodology.
Quantitative research deals with numbers and statistics, while qualitative research deals with words and meanings.
Quantitative methods allow you to systematically measure variables and test hypotheses . Qualitative methods allow you to explore concepts and experiences in more detail.
Reliability and validity are both about how well a method measures something:
If you are doing experimental research, you also have to consider the internal and external validity of your experiment.
A sample is a subset of individuals from a larger population . Sampling means selecting the group that you will actually collect data from in your research. For example, if you are researching the opinions of students in your university, you could survey a sample of 100 students.
In statistics, sampling allows you to test a hypothesis about the characteristics of a population.
If you want to cite this source, you can copy and paste the citation or click the “Cite this Scribbr article” button to automatically add the citation to our free Citation Generator.
McCombes, S. & George, T. (2024, September 05). What Is a Research Methodology? | Steps & Tips. Scribbr. Retrieved September 18, 2024, from https://www.scribbr.com/dissertation/methodology/
Other students also liked, what is a theoretical framework | guide to organizing, what is a research design | types, guide & examples, qualitative vs. quantitative research | differences, examples & methods, "i thought ai proofreading was useless but..".
I've been using Scribbr for years now and I know it's a service that won't disappoint. It does a good job spotting mistakes”
Israel Journal of Health Policy Research volume 13 , Article number: 49 ( 2024 ) Cite this article
Metrics details
The Original Article was published on 01 April 2024
The appropriate use of diagnostic imaging, particularly MRI, is a critical concern in modern healthcare. This paper examines the current state of MRI utilization in Israel, drawing on a recent study by Kaim et al. that surveyed 557 Israeli adults who underwent MRI in the public health system. The study revealed that 60% of participants had undergone other imaging tests before their MRI, with 23% having more than one prior examination. While these findings highlight potential inefficiencies in the diagnostic pathway, they also underscore the complexity of medical decision-making in imaging.
The paper discusses various factors influencing MRI utilization, including regulatory pressures, healthcare system structure, and the need for evidence-based guidelines. It explores potential strategies for optimizing MRI justification and scheduling, such as implementing clinical decision support systems, enhancing interdisciplinary communication, and leveraging artificial intelligence (AI) for predictive analytics and resource optimization.
The need for comprehensive research into MRI justification and scheduling optimization is presented. Key areas for investigation include the effectiveness of decision support tools, patient outcomes, economic analyses, and the application of quality improvement methodologies.
Ensuring the appropriate use of diagnostic imaging, is a critical concern in modern healthcare. There is growing recognition of the need to justify each exam based on clinical necessity. Retrospective studies have found inappropriate CT and MRI use rates ranging from 10 to 39% when referrals are assessed against clinical guidelines [ 1 , 2 , 3 , 4 , 5 ]. As overall imaging utilization continues to rise rapidly due to technological advancements, increasing population and expanding indications, optimizing the appropriateness of each exam becomes increasingly vital.
The justification and optimization of medical imaging is crucial for patient safety while delivering clinical benefits. Ensuring each exam is truly medically indicated based on presenting symptoms or diagnostic questions is paramount at the population level.
In this issue Kaim et al. [ 6 ] conducted an online survey of patient experience of scheduling an MRI among 557 Israeli adults, that underwent an MRI in the public health system within the past year. They have shown that that 60% of participants underwent other imaging tests before their MRI scan. Of those, computed tomography (CT) scans (43%), X-rays (39%), and ultrasounds (32%) were the most common additional imaging procedures. In addition, of the 60% of participants, 23% had undergone more than one prior imaging examination.
The cascade in which imaging studies are performed is complex. A patient may present with signs and symptoms that highlight a need for further imaging. It may start with indicationX-Rays or ultrasound such as in the case of orthopedic trauma and based on the findings such as suspected meniscal injury further require advanced studies such as an MRI. Another possibility is directly performing an MRI study when there is clear indication such as acute neurological symptoms with suspected spinal injury.
The results by Kaim et al. represent the current situation in Israel but does not enable at this stage analysis of the reasons for this phenomenon. On one hand it may be possible that too many patients underwent prior non-MRI imaging studies because of difficulties in getting an approval or scheduling an appointment for an MRI study. In this scenario direct referral for an MRI may have been more beneficial. Another possibility is that prior studies results indicated the need for further evaluation with MRI and from a medical perspective this was the correct process to arrive at a diagnosis. A patient with undetermined liver lesion on CT or US may necessitate an MRI for diagnosis but this should only be performed as a problem-solving study. Follow-up of prior medical conditions such as multiple sclerosis necessitates serial MRI studies and the lack of separation of initial diagnostic and follow-up studies further complicates the analysis on the appropriateness of MRI studies. The study by Kaim et al. did not analyze the details of the referrals and the diagnoses of the MRI studies and therefore did not do a root cause analysis of the possible reasons.
The health system in Israel is under pressure in recent decades to increase its efficiency and to use its resources in an optimized way in order to promote health. Our system is heavily regulated and centralized with only four HMO’s with each one with its own approval pathway for advanced imaging studies. Imaging equipment is also regulated with the need for a Certificate of Need approval for each MRI and CT scanner.
The study by Kaim et al. raises insightful observations about a potentially significant issue in healthcare resource allocation and diagnostic practices. If there’s a shortage of MRI scanners, healthcare providers might indeed resort to CT scans as an interim measure. This could lead to increased radiation exposure for patients, as CT scans use ionizing radiation while MRI does not. It may also lead to potential misdiagnosis or delayed diagnosis, as MRI is superior for certain conditions, especially soft tissue injuries. Cost implications are also an issue as CT scans are generally less expensive than MRIs, but multiple CT scans while waiting for an MRI could end up being more costly overall. Workflow inefficiencies may also occur as performing CT scans as a stopgap measure could create duplicate work and strain radiology departments.
Patient experience might be affected as multiple imaging tests could lead to patient frustration, anxiety, and inconvenience.
Taking into account all these considerations might have long-term health policy implications which could drive investments in increased MRI scanners and training of specialists.
The means to improve justification of MRI studies include evidence-based guidelines such as the American College of Radiology or iGuide which is a Europeanized version of these guidelines. This can be achieved with implementing electronic systems that guide clinicians in selecting appropriate imaging studies. Education and training are extremely important in optimizing the process. These may include regular updates for referring physicians on appropriate use criteria and training on risks and benefits of different imaging modalities [ 7 , 8 , 9 ]. Alternatives assessment is always an issue. Should the referring physician consider less expensive (CT) or non-radiation alternatives (MRI) when appropriate. Assessment of previous imaging results could suffice is also an important solution. In some patients assessed by Kaim et al. this could have been the case for prior imaging studies.
Collaborative decision-making can make the medical system more efficient. Direct communication between referring physicians and radiologists may optimize the selection and timing of the needed imaging studies. Involving patients in the decision-making process can also be beneficial.
Regulatory bodies may use audit and feedback for regular reviews of imaging referral patterns and provide feedback to clinicians on their referral appropriateness. Cost-effectiveness considerations should evaluate the potential clinical impact versus the cost of the study as well as societal and healthcare system resource allocation.
AI can play a significant role in optimizing the justification of MRI studies for patients. Some key applications may include AI-powered systems that can analyze patient data, symptoms, and medical history to suggest appropriate imaging studies. These systems can provide real-time guidance to clinicians, helping them make more informed decisions about ordering MRI scans. AI algorithms can predict the likelihood of an MRI study yielding clinically significant results based on patient characteristics and symptoms. This can help prioritize patients who are most likely to benefit from an MRI.
Using natural language processing (NLP) AI can analyze unstructured clinical notes and radiology reports to extract relevant information. This can help in assessing the appropriateness of previous imaging studies and avoiding unnecessary repeat scans. Outcome prediction is also of interest as AI models can predict the potential impact of an MRI study on patient management and outcomes. This can help in justifying the need for the study, especially in cases where the clinical benefit is not immediately apparent.
Resource optimization is also needed and can be achieved with AI. AI can analyze scheduling patterns and patient flow to optimize MRI utilization and reduce wait times. This can help in justifying urgent studies and managing resource allocation more effectively.
Justification and optimization of MRI scheduling for patients is a crucial area with significant potential for improving healthcare delivery, patient outcomes, and resource utilization. Some key areas where research could be valuable include effectiveness of decision support tools, patient outcomes, economic analyses, predictive modeling and patient-centered scheduling. Quality improvement methodologies can help to study the effectiveness of various quality improvement approaches (e.g., Lean, Six Sigma) in optimizing MRI scheduling processes. Comparative effectiveness research is needed for comparing different MRI scheduling and justification strategies across various healthcare systems and patient populations and help identifying best practices that can be widely adopted.
One time point assessment is not sufficient. The study by Kaim et al. raises important issues and should be expanded to fully understand the use of MRI in Israel. Long-term impact assessment can be performed with longitudinal studies to evaluate the long-term effects of optimized MRI scheduling and patterns of use on healthcare system efficiency and patient outcomes. This is highly recommended on a nationwide basis.
Appropriate use of diagnostic imaging is crucial in modern healthcare. A survey in Israel revealed that 60% of patients underwent other imaging tests before their MRI, with CT scans, X-rays, and ultrasounds being the most common. The reasons for multiple imaging studies are complex and may include difficulties in scheduling MRI appointments, medical necessity, or follow-up requirements for specific conditions.
Further research is needed in areas such as the effectiveness of decision support tools, patient outcomes, economic analyses, and comparative effectiveness across healthcare systems.
Not applicable.
Artificial intelligence
Natural language processing
Computerized tomography
Magnetic resonance imaging
Howlett DC, Kumi P, Kloeckner R, et al. Clinical audit in European radiology: current status and recommendations for improvement endorsed by the European Society of Radiology (ESR). Insights Imaging. 2023;14(1):1–6.
Google Scholar
Oikarinen H, Karttunen A, Pääkkö E, Tervonen O. Survey of inappropriate use of magnetic resonance imaging. Insights Imaging. 2013;4(5):729–33.
Article PubMed PubMed Central Google Scholar
Vanderby S, Badea A, Peña Sánchez JN, Kalra N, Babyn P. A day in the life of MRI: the Variety and Appropriateness of exams being performed in Canada. Can Assoc Radiol J. 2018;69(2):151–61.
Article PubMed Google Scholar
Ståhlbrandt H, Björnfot I, Cederlund T, Almén A. CT and MRI imaging in Sweden: retrospective appropriateness analysis of large referral samples. Insights Imaging. 2023;14(1):134.
Bouëtté A, Karoussou-Schreiner A, Le Ducou H, et al. National audit on the appropriateness of CT and MRI examinations in Luxembourg. Insights Imaging. 2019;10(1):1–12. https://doi.org/10.1186/S13244-019-0731-9/FIGURES/6 .
Article Google Scholar
Kaim, A., Singer, C., Bergovoy-Yellin, L. et al. Exploring pre-MRI imaging tests: patient survey reveals potential implications for healthcare efficiency in Israel. Isr J Health Policy Res 13, 7 (2024). https://doi.org/10.1186/s13584-024-00593-0 .
Saban M, Sosna J, Singer C, Vaknin S, Myers V, Shaham D, Assaf J, Hershko A, Feder-Bubis P, Wilf-Miron R, Luxenburg O. Clinical decision support system recommendations: how often do radiologists and clinicians accept them? Eur Radiol. 2022;32(6):4218–24.
Markus T, Saban M, Sosna J, Assaf J, Cohen D, Vaknin S, Luxenburg O, Singer C, Shaham D. Does clinical decision support system promote expert consensus for appropriate imaging referrals? Chest-abdominal-pelvis CT as a case study. Insights Imaging. 2023;14(1):45.
Singer C, Luxenburg O, Rosen S, Vaknin S, Saban M. Advancing acceptance: assessing acceptance of the ESR iGuide clinical decision support system for improved computed tomography test justification. Front Med (Lausanne). 2023;10:1234597.
Download references
No external funding provided.
Authors and affiliations.
Department of Radiology, Faculty of Medicine, Hadassah Medical Center, Hebrew University of Jerusalem, Jerusalem, 91120, Israel
Jacob Sosna
You can also search for this author in PubMed Google Scholar
JS is the author of the manuscript.
Correspondence to Jacob Sosna .
Ethics approval and consent to participate, consent for publication, competing interests.
The author declares that he does not have competing interests.
Publisher’s note.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/ . The Creative Commons Public Domain Dedication waiver ( http://creativecommons.org/publicdomain/zero/1.0/ ) applies to the data made available in this article, unless otherwise stated in a credit line to the data.
Reprints and permissions
Cite this article.
Sosna, J. Insights from a web-based questionnaire: examining diagnostic procedures prior to magnetic resonance imaging. Isr J Health Policy Res 13 , 49 (2024). https://doi.org/10.1186/s13584-024-00636-6
Download citation
Received : 29 July 2024
Accepted : 06 September 2024
Published : 18 September 2024
DOI : https://doi.org/10.1186/s13584-024-00636-6
Anyone you share the following link with will be able to read this content:
Sorry, a shareable link is not currently available for this article.
Provided by the Springer Nature SharedIt content-sharing initiative
ISSN: 2045-4015
IMAGES
VIDEO
COMMENTS
Therefore, when undertaking new research, it is important to know and state why the research is being conducted, in other words, justify the research. The justification of a research is also known as the rationale. Writing the justification or rationale comes from an in-depth search and analysis of the existing literature around the topic.
Justification Statement. The justification statement should include 2 to 3 paragraphs that convey the relevance of the over-arching topic in which the proposed research study is grounded. The purpose of this project is to examine the personal perceptions and safety concerns of workers in assumed low-risk. organizations.
The rationale of the study is the justification for taking on a given study. It explains the reason the study was conducted or should be conducted. This means the study rationale should explain to the reader or examiner why the study is/was necessary. It is also sometimes called the "purpose" or "justification" of a study.
Two Final Tips: When you're writing your justification, write for your audience. Your purpose here is to provide more than a technical list of details and procedures. This section should focus more on the why and less on the how. Consider your methodology as you're conducting your research.
The rationale for your research is the reason why you decided to conduct the study in the first place. The motivation for asking the question. The knowledge gap. This is often the most significant part of your publication. It justifies the study's purpose, novelty, and significance for science or society.
The rationale or justification for doing any research must be gleaned from the existing literature on the subject. You will need to conduct a thorough literature survey and identify gaps in the current literature. The best way to write this is to introduce the current literature in the background/Introduction section and then highlight the gaps ...
Conclusion: Summarize the main points of your justification and reiterate the significance of your research. Emphasize why your work is unique and necessary to advance knowledge and address the problem of low proportion of uncontrolled hypertension. Remember, a compelling justification should be concise, persuasive, and grounded in evidence.
Research justification refers to the rationale for the research, or the reason why the research is being conducted, including an explanation for the design and methods employed in the research. Entry Researcher Sensitivity
Rationale for the study, also referred to as justification for the study, is reason why you have conducted your study in the first place. This part in your paper needs to explain uniqueness and importance of your research. Rationale for the study needs to be specific and ideally, it should relate to the following points: 1. The research needs ...
1. Thank you for the opportunity to review this interesting meta-research paper, which is part of a series of papers. Basing new research on systematic reviews is clearly important and has been the subject of a number of reviews. This paper essentially reviews the meta-research in this area, to give a global assessment of the issue taking into ...
The Justification is the "WHY" of your research topic or the "RATIONALE". The Justification comes as you are doing your in-depth analysis of the topic, as you begin your literature review. ... NOTE: The justification portion of your paper and your thesis question may change over the process of writing a paper. As you gain insight into the ...
Step 3: Set your aims and objectives. Finally, the problem statement should frame how you intend to address the problem. Your goal here should not be to find a conclusive solution, but rather to propose more effective approaches to tackling or understanding it. The research aim is the overall purpose of your research.
Defining the rationale research, is a key part of the research process and academic writing in any research project. You use this in your research paper to firstly explain the research problem within your dissertation topic. This gives you the research justification you need to define your research question and what the expected outcomes may be.
The methodology section of a research paper answers two main questions: How was the data collected or generated? ... If other data sources exist, explain why the data you chose is most appropriate to addressing the research problem. Provide a justification for case study selection. A common method of analyzing research problems in the social ...
19 November, 2021. The rationale for one's research is the justification for undertaking a given study. It states the reason (s) why a researcher chooses to focus on the topic in question, including what the significance is and what gaps the research intends to fill. In short, it is an explanation that rationalises the need for the study.
The justification is also known as the rationale and is written in the Introduction. You may thus refer to these resources for writing the justification of your research: How to write the rationale for research? Can you give an example of the "rationale of a study"? 4 Step approach to writing the Introduction section of a research paper.
Communicating research findings is an essential step in the research process. Often, peer-reviewed journals are the forum for such communication, yet many researchers are never taught how to write a publishable scientific paper. In this article, we explain the basic structure of a scientific paper and describe the information that should be included in each section. We also identify common ...
Such papers clearly fill a need, and are cited a lot, even when the advice in these articles is flawed. ... (e.g., based on informal communication before an interview). A good sample size justification in qualitative research is based on 1) an identification of the populations, including any sub-populations, 2) an estimate of the number of ...
In this paper we also argued for the importance of 'worthwhile gap statements' and provided a model for working towards this. All 124 papers analysed in this study were published in peer-reviewed top-ranked higher education journals. This means they were all evaluated and judged to make a worthy contribution.
The justification to the part of a research project that sets out the reasons that motivated the research. The justification is the section that explains the importance and the reasons that led the researcher to carry out the work. The justification explains to the reader why and why the chosen topic was investigated.
What Is a Research Methodology? | Steps & Tips. Published on August 25, 2022 by Shona McCombes and Tegan George. Revised on September 5, 2024. Your research methodology discusses and explains the data collection and analysis methods you used in your research. A key part of your thesis, dissertation, or research paper, the methodology chapter explains what you did and how you did it, allowing ...
Now, the justification or the rationale explains why the research is needed - what gaps it aims to fill in existing literature, how it aims to add to the existing body of knowledge, or what solutions it aims to provide. In the research paper, it is meant to set the context for the research, and is therefore, written in the introduction section.
Justification for a research study, simply put, is the reason why the research is being conducted, taking into consideration the methods of the study. It explains the rationale for the study. Cite
The paper discusses various factors influencing MRI utilization, including regulatory pressures, healthcare system structure, and the need for evidence-based guidelines. ... (AI) for predictive analytics and resource optimization. The need for comprehensive research into MRI justification and scheduling optimization is presented. Key areas for ...