Category Archives: Submission Tips

How to Do a Peer Review: Part One

by Jose Rodriguez, MD, FAAFP, Meharry Medical College School of Medicine, Nashville, TN

As journal editors, we fundamentally believe in peer reviewing. Peer review helps make published papers higher quality. Objective experts and peers often see areas in a manuscript and research study that the authors and editors did not elucidate. Journals in general (and Family Medicine specifically) have a hard time finding peer reviewers. Doing a peer review takes time, is unpaid, and often feels like one more thing for already overwhelmed faculty. On behalf of the editorial team of Family Medicine, we are writing a series of blog posts about why we think you should sign up to be a peer reviewer (Family Medicine), how your expertise can contribute to the mission of the journal, and step-by-step instructions on how to construct a valuable peer review.

Why Was I Asked to Do This Review?
We often hear from early-career faculty that they don’t feel qualified to conduct peer reviews because they aren’t “experts.” Our Associate Editors aim to include a diversity of viewpoints in each manuscript. So, they may ask an expert to comment on the methodology or the statistics. But we also want input from our readers. Yes, you may not be a content area expert, but if you are a reader of the journal, your opinion is valuable. If you didn’t understand some of the paper, then other readers may also not understand. You should feel empowered to include comments to the editor about which aspects of the paper you feel qualified to comment on. I will often state, “I am not a statistician, but the numbers do not make sense to me.” If it doesn’t make sense to you, it may not make sense to others, so we want to know!

Getting Started
If you do not know where to start, go to the reviewer page on the journal’s website. There is a lot of material about how to do a peer review. Alternatively, you can ask a senior colleague or mentor for help. If you feel comfortable doing the review, then the first step is to read the paper. Most people recommend reading the paper through to the end the first time and not getting bogged down with comments or questions.

The first questions to ask yourself after you read the paper the first time are: 

1. Did this make sense?

2. Does it add to the field?

3. Does it matter?

4. Is it written well?

Often, we don’t notice if a paper is written well, but we do see if it is written in an unclear manner or if there are typos or grammatical errors. Those errors, while easily corrected, usually signal that the manuscript needs more work.

The Second Time Through  
After you have done a full read of the paper and answered some general questions to yourself, it is time to reread it. This time, when you read it, we want you to focus on all the details. We want reviewers to pay attention to the details of every section of the paper. The following two blogs will go section by section with descriptions of what to look for and how to provide feedback.

How to Organize Your Review
This is a matter of personal preference. Some reviewers organize their reviews by section. So, they start the review with comments on the title and continue with comments on the abstract, the introduction, the methods, the results, the discussion, the tables, the conclusion, and the references. Other reviewers prefer a more “free form” review, using bullet points or a numbered list to capture all the comments for each section. But, bottom line, we want reviewers to carefully assess all these sections of the paper. As editors, we must see in your review that you read the paper. A one-sentence review that is general, like “this was a great paper” or “this paper is not acceptable,” without comments on each section or other specific evaluative statements, is not helpful in the evaluation of a paper.

Tone and Goal of the Review
The overall goal of any peer review is to make the paper better. As such, we ask that you frame your feedback in a constructive manner and avoid disparaging comments. SS once had a reviewer say, “if the authors had only read the literature, they wouldn’t have made this mistake.” A better way of phrasing that same sentiment would be, “I suggest that the authors review these papers to get a different perspective on the subject.” These two phrases say essentially the same thing, but one is much more respectful. Remember, academic family medicine is a small community. Treat the authors as if they knew it was you writing the review, and keep your comments constructive and respectful.

The next two blogs will review how to evaluate specific sections of the paper in your review.

Mistakes That Authors Make in Their Submissions to Family Medicine

By Sarina Schrager, MD, MS, Editor in Chief, Family Medicine, and the Family Medicine editorial team.

As the official journal of STFM, Family Medicine aims to publish papers that will advance the art and science of academic family medicine. The journal is interested in curriculum designed for medical students and residents, projects that impact resident and faculty work life, as well as policy papers that comment on issues related to the discipline. The journal is also interested in papers describing DEIA initiatives developed in departments, residencies, and medical schools. We publish research, narratives, and commentaries. The editorial team wants authors to be successful and has come up with the following list of common errors to avoid when submitting a manuscript.

Not following the author instructions. There is nothing that annoys an editor more than a paper that is formatted incorrectly, submitted in the wrong category, doesn’t meet the word count requirement, or when authors submit a paper that is outside the scope of Family Medicine. Please read and follow the author instructions before you submit a paper, available here Family Medicine Author Information (stfm.org).  

Submitting a paper that is outside of the scope of the journal. Reviewing the author instructions can help you understand the goals and aims of the journal. Family Medicine is focused on education in primary care and does not publish clinical articles. Some papers about quality improvement will be within the scope of the journal, if the project is done in a residency clinic or has an impact on learners, for example, but much QI that is focused on clinical improvement only is not in the scope of the journal. If you are unsure whether your paper is within the scope of the journal, please e-mail us at fmeditor@stfm.org

Does not fill a gap in the literature. This may seem obvious, but the editors suggest doing a thorough literature search before you start your research project so that you can make sure that no one else has done the same study. If there are similar studies in the literature, think carefully about what your work adds. Is your study in a different population? Do you use different methods to measure the same outcome? Are you confirming the results of a previous small study? If you are just doing the same study that others have done, then we may not be interested in accepting the paper. We suggest that you be very clear in your paper what your study adds to the existing literature.

Lack of a cohesive narrative through your paper. For example, does the title of your paper describe what you did in your study, or what results you found?Does the methodology of your study answer the questions you propose in your objectives? Do your conclusions arise directly from your results?  Be careful about editorializing (i.e. making large generalizations from limited data or data from a limited sample). The editors frequently see a mismatch between the objectives of the study or research question, the data collected and the conclusions. We recommend that you think through these questions before you start writing. 

Lack of robust evaluation of your data. This mistake is by far the most common error that the editors see with original research submissions or brief reports.When you are starting to plan your study or your curricular change, it is important to think about how you are going to evaluate your intervention. The Kirkpatrick levels of evaluation (The Kirkpatrick Model (kirkpatrickpartners.com) provide a template to use when thinking about the outcomes of your study. The Kirkpatrick Model describes how learners or participants change after your intervention. 

  • Level 1 evaluation looks at the reaction to the intervention. Did the participants enjoy the educational activity?  Did they think it was relevant to their work?  Family Medicine does not publish papers with only Level 1 evaluations. 
  • Level 2 evaluation measures how much participants learned during the intervention.  Pre and post-tests immediately after a seminar are examples of level 2 evaluations.  Family Medicine will occasionally publish otherwise well-done studies that only use Level 2 evaluation, but most of the time these papers will be rejected.
  •  Level 3 evaluation is looking at whether the educational intervention changed the behaviors of participants. For example, after a seminar about lung cancer screening, you could measure how often residents ordered low dose lung CT scans.  
  • Level 4 evaluation measures results of outcomes.  This is the highest level of evaluation.  In the previous example, you would be looking to see if rates of lung cancer deaths decreased, or if rates of early diagnosis of lung cancer was affected. 

Obviously, these higher levels of evaluation are harder to measure. Family Medicine prioritizes papers that use Level 3 or 4 evaluations.

Special consideration for narrative submissions. The editors of Family Medicine believe that stories about family medicine education and the clinical experiences of faculty and learners are vitally important to enhance the discipline.  As such, we seek narrative submissions, both poetry and essays. The biggest mistake that we see in narrative submissions is Telling not Showing. What do we mean by that?  Telling the reader that a patient was scared is much less effective than describing the nervous movements of her hands, for example.Describing how you feel with a sentence like, “I was happy”  is much less compelling than describing a characteristic, “like my face hurt from smiling so much” or “my heart felt light”. Here is more information that can help you when you are writing narratives. (Show, Don’t Tell: The Simple Guide for Writers (jerryjenkins.com))

Again, the editors of Family Medicine want to hear about your work. To paraphrase Leo Tolstoy, strong papers are all alike, but weak papers are each weak in their own specific way. We hope that this blog post helps authors consistently submit strong papers in the future.