SRDR+ 4.2 Resources for Screeners
This page is meant to provide instructions for project members using the SRDR+ Abstract Screener tool (previously Abstrakr).
- 4.2.1 The Basics
- 4.2.2 Title, Abstract and Publication Information
- 4.2.3 Include / Exclude / Maybe Choices
- 4.2.4 Rejection Reasons
- 4.2.5 Using Tags
- 4.2.6 Using Notes
- 4.2.7 Screening Form
- 4.2.8 Highlighting Terms for Inclusion and Exclusion
- 4.2.9 Reviewing and Re-screening
4.2.1 The Basics
The basic screening window will look like the following.
We will walk through each part of the screen.
4.2.2 Title, Abstract and Publication Information
On the left side of the screen, you will see the title, the abstract and the publication information (if the project leader does not have the author and journal hidden). You will review this information to make a determination regarding inclusion or exclusion (or maybe if you cannot decide).
4.2.3 Include / Exclude / Maybe Choices
At the bottom right of the screen are three buttons:
- Green check mark: click this button to mark the article to be included in the project. The article must meet all inclusion criteria to be included.
- Purple question mark: click this button if you are unsure whether this article meets inclusion criteria.
- Red X mark: click this button if you believe the article does not meet inclusion criteria and should be rejected.
Tips for using Maybe: It may be tempting to use the Maybe button often as you are simply not sure, given the information in the title and abstract, whether the article should be screened in or out. However, we caution against using Maybe and recommend using as infrequently as possible. There are several reasons for this.
- Using Maybe automatically sets the article into “conflict” status. Conflict status is where two screeners disagree. So, this means a decision will still have to be made, but by the consolidator. It is best for you, as a screener, to make a decision and provide as much rationale as necessary for your decision and your hesitations (e.g., in Notes).
- Err on the side of inclusion. Because title/abstract screening is just the first screening step—it will be followed by a full-text screening step—even if an article ultimately will be rejected, it is best to let it be rejected when all the information is available (at full-text screen).
We recommend using Maybe only when there is a genuine question about inclusion/exclusion criteria. This confusion should be brought to the project leader for clarification.
4.2.4 Rejection Reasons
Before a citation can be marked for rejection, a Rejection Reason must be provided. The project lead will have set up a list of reasons to select from. Check with the project lead if you have any questions about these reasons and what they mean. Your project lead may allow you to add additional reasons (check with the project lead). If so, you can add additional reasons by clicking on the plus sign at the bottom right of the Rejection Reasons list.
Note: the reasons for your project may differ from those provided in the example above. Also, your project lead may allow you to select more than one reason to reject an article (check with your project lead). If you are only allowed to choose one reason (e.g., wrong population, wrong intervention, wrong outcome, etc.), select one of these.
4.2.5 Using Tags
Not all projects will use tags. This list is often but not always used to allow you to provide a bit more information about the article. Often, you will see an option for “Background article.” Sometimes, you may run across an article that does not meet inclusion criteria (e.g., a review article or a commentary) that you think may nonetheless be useful for the project. Selecting the Background article tag (if available) will allow you to flag the article to be pulled for the project.
4.2.6 Using Notes
Notes is a free text field that you can use for any reason. Typical reasons for using Notes:
- You think the article should be included or excluded, but there may be some lingering doubt. You can use the notes field to jot down some thoughts. These will be used in case there is a conflict on whether to include or exclude the article.
- You gave a maybe response. Depending on the project it may be required to enter some rationale in the Notes field if you select the Maybe option (the purple button at the bottom). Here you would enter information about why you weren’t sure one way or another—perhaps too little information was provided in the abstract.
- Notes can be used for any reason at all. You may want to simply put your rationale for making the decision you made. This is typically not necessary (except for Maybe in some projects) but is an option.
4.2.7 Screening Form
Some projects may use a short screening form to help you with your assessment. Since it may sometimes be difficult to remember all the inclusion criteria (if there are many for a project), the project lead may provide a question or series of questions regarding whether inclusion criteria are met. This is simply a way to help you with your screening.
Below is an example of a checklist of inclusion criteria that must be met for an article to be included. Note that once you have completed the screening form question, you must mark the screening form as complete for it to register your response.
If you have questions regarding the screening form, consult the project lead for more directions.
4.2.8 Highlighting Terms for Inclusion and Exclusion
An additional feature of the screening tool is that terms or phrases indicating likely inclusion or exclusion can be highlighted to aid the screening process. Highlighting certain terms can speed up screening. In the following example, the term “cognitive bias” strongly indicates likely acceptance, while “inference” weakly indicates acceptance. In contrast, the terms “drug” and “drugs” strongly indicate rejection.
When you first open an abstract and much of it is highlighted in colors indicating “likely accept”, you’ll know (even before reading the full abstract) that this article may be a good candidate for inclusion. Alternatively, if there are many terms that would indicate “likely reject” then you can suspect that the article will likely be rejected upon full reading.
There are two ways that Terms and Phrases can be highlighted:
- Project-wide terms and phrases: These are terms and phrases that have been decided upon by the team to indicate likely inclusion or exclusion. The project lead will generally create this list (working with other members of the team) and share a file (a json file). You will be directed to import this file into your screening project. When you do this, all terms will take on the appropriate highlight. To import the file provided by your project lead, use the Import Groups (JSON format) button below the Terms and Phrases box.
Just follow the instructions to import the project list of terms and phrases.
- Individualized terms and phrases: You can also highlight terms yourself. There are a couple of ways of doing this, but the easiest is simply to highlight a term or phrase within the abstract or title and then assign it a value. When you highlight a word or set of words, a popup will open. Simply select the appropriate valence for the highlighted text.
Note that you can also download the Terms and Phrases Groups that you have defined (e.g., to share with the rest of the team).
Good Practice Note: To make sure that everyone is on the same page when screening, it is a good idea for the entire team to be working off the same list of terms or phrases. Work with your project lead and other team members to identify these terms and work out how to share them across all screeners.
4.2.9 Reviewing and Re-screening
You will notice three buttons at the center of the screen just above left of the abstract text.
These buttons allow you to do the following:
- Your Labels: If you want to review the screenings you have already completed or if you want to return to a previously screened abstract to rescreen (perhaps you changed your mind), you can click this button. When you do this, a popout will open on the left with a list of all the articles you’ve already screened. By clicking on the title of the article, you can rescreen it.
- Continue Screening: If you have used the “Your Labels” button to jump to another screened citation, you can use the Continue Screening button to jump back to the last abstract in your queue.
- Exit: You want to end your screening session and closeout. Simply click this button.