2.1. Planning

Defining the problem to be addressed in a clear, precise, and detailed way is the first step in the planning phase. It is not easy to make the answering process functional without clarifying the question. On the other hand, a clear definition of the research question at the initial stage does not mean that the question cannot be changed. In some cases, the research question may need to be slightly revised after further reading (Gough & Richardson, 2018).

It can be challenging to identify a research topic. The first thing the researcher should do is conduct in-depth research on the topic of interest. Determining the need in the field of interest during the initial screening will facilitate the determination of the research question. A research question can be formulated after determining the need in the field. In a good research question, including the sample to be subject to the research and research designs is essential.

Some frameworks such as PICO, PICOS, and SPIDER have been created that can be utilized while determining the research question (Methley et al., 2014). Each of the initials of PICO, which is frequently used among these frameworks, refers to a component that should be included in the research question;

P: Population, participants, patient or problem

I: Intervention(s), therapy, treatment

C: Comparison, other intervention or treatment, control group

O: Outcomes

Sample research questions are presented below;

• “What types of grief interventions have been mentioned in the systematic reviews during the last two decades? What kinds of differences and similarities have the grief interventions had in terms of effectiveness?” (Asgari et al., 2023).
• “What research about employment sustainability for people with intellectual disability has been published internationally between 2010 and 2020?” (Taubner et al., 2022).

In summary, the research question needs to be defined clearly, precisely, and in detail, and the research question can be changed along the way. Firstly, it is recommended that the researcher conduct in-depth research on interest. It is stated that this process will facilitate the clearer determination of the research question. After determining the research question, the importance of including the sample and research designs that will participate in the research is emphasized. It is stated that frameworks such as PICO, PICOS, and SPIDER are tools that can be used to determine the research question. These frameworks help researchers create clearer and more structured questions. Finally, it is emphasized that the research questions aim to transform theoretical knowledge into practical applications.

The type of review to be conducted depends on the question to be answered. For example, it is possible to answer the question, “Which research on the sustainability of employment for people with intellectual disabilities has been published internationally between 2010 and 2020” with the bibliometric review method (Taubner et al.,2022). The following table shows the types of reviews (HSL, 2024). Examining the review types allows you to determine the most appropriate review type for your research question. Using two or more review types to answer some of the questions of the studies may be possible (Grant & Booth, 2009). For example, when conducting research on the effectiveness of trauma intervention programs in the last ten years, it is possible to systematically analyze all the studies conducted in the last ten years and then calculate the impact value by meta-analysis of the numerical data obtained. In this case, systematic review and meta-analysis methods are used together. It is possible to conduct mixed design reviews, as in the example (Taubner et al.,2022).

In Table 1, there is a resource intended to guide researchers by comparing the purposes, approximate completion times, and search strategies of different review types. Each type of review addresses research questions from a different perspective and offers different methods for gaining a deeper understanding of a particular research topic. It provides detailed information to help researchers choose the most appropriate examination method to suit their needs and research process. It also provides a clear overview of the characteristics of each review type, completion times, and search strategies, providing researchers with a framework for planning the research process. It helps researchers choose the examination method best suited to their research questions and goals while also allowing a comprehensive review and analysis of the research literature.

Before starting the research, developing a protocol that determines which stages the research will cover or which methods will be included in the research is a stage that should be considered. The protocol is the road map in the process of conducting the research. In addition to providing a roadmap for the researcher, developing a protocol also has benefits, such as reducing bias and contributing to accountability. The protocol should include the research topic, the area to be searched (you can determine the databases or languages to be searched at this stage), the keywords to be used in the search, and timing targets. Depending on the type of review, researchers can include the number of articles to be screened or inclusion and exclusion criteria in the protocol.

Below is the research protocol that Kushairi and Ahmi (2021) prepared in their bibliometric analysis article titled "Flipped Classroom in the Second Decade of the Millennia: A Bibliometrics Analysis with Lotka's Law ."While the researchers utilized the protocol in the screening and review processes, they also contributed to the reliability of their research by reporting it in the article.

There are several protocol development guidelines for systematic reviews. The Preferred Reporting Items for Systematic Review and Meta-analysis extension for Protocols (PRISMA-P) (Moher et al., 2016) is the most well-known of these guidelines. According to PRISMA-P guidelines, a protocol should include the following components:

“1. Introduction

(a) The rationale for the selection of the selected topic

(b) a clear and understandable research question or research questions, including PICO terms

2. Method

(a) Inclusion criteria should be set for research and report characteristics (language, publication status). These could be age groups, geographical regions, study designs, or outcome measures. Open inclusion criteria make it easier to identify relevant articles.

(b) All sources of information should be specified with anticipated dates of inclusion (databases to be used, personal contact, use of trial records, sources of gray literature).

(c) Outline the search strategy in at least one database.

(d) A description of how the data will be managed and reviewed throughout the process

(e) The inclusion and exclusion process (e.g., two independent reviewers, etc.) for each part of the review should be described.

(f) The planned data collection method should also describe the data generation process. For example, forms could be included to ensure consistency in data generation.

(g) Any data assumptions or simplifications identified should be listed.

3. The results and prioritization section should include a description and list of all results for which data analysis will be conducted. It should also detail the prioritization of primary and secondary outcomes.
4. The methods identified to assess the risk of bias and how they will be used in the data synthesis process should be explained in detail.
5. Data synthesis methods should be listed along with the following criteria:

(a) Criteria for which studies will be quantitatively synthesized. Where data are suitable for quantitative synthesis, the planned summary measures, data processing, aggregation methods, and any additional analyses proposed.

(b) Where quantitative analysis is not possible, the type of summary is planned.

6. Any planned consideration of meta-bias, such as publication bias, should be described.
7. Confidence in the cumulative evidence should be summarized by describing how the evidence will be assessed.”

The systematic review protocol should be followed at all stages of the review. In addition, changes to the protocol should be tracked and dated (Moher et al., 2016).

In the protocol development process, the importance of developing a protocol that determines which stages the research will cover or which methods will be included in the research is emphasized before starting the research. The protocol serves as a road map for carrying out the research process. In addition to providing a road map for the researcher, developing a protocol also has benefits such as reducing bias and contributing to accountability. A predetermined protocol gives structure and direction to the research process, helps reduce error and bias, ensures that the review is recorded, and may be a requirement for publication.

In carefully prepared systematic reviews, it is crucial to determine the conceptual framework that will form the basis of the review at the planning stage. The conceptual frameworks that the researchers themselves will create or select will guide the researchers in the selection, classification, and interpretation of the findings (Hallinger, 2013).

Below is an example of the conceptual framework created in the research titled "A Systematic Review of Research on the Relationship between School Leadership and Student Achievement: An updated framework and future direction" (Özdemir et al., 2022).

As in the example, the conceptual framework for systematic reviews should include the review's topic, aims, research questions, the theoretical background used to select the studies to be included, the source and type of studies, and the limitations and findings of the studies.