{"id":103550,"date":"2017-04-04T10:04:18","date_gmt":"2017-04-04T09:04:18","guid":{"rendered":"https:\/\/clarivate.com\/?p=103550"},"modified":"2025-08-04T16:26:37","modified_gmt":"2025-08-04T16:26:37","slug":"how-to-evaluate-a-manuscript-critically-12-questions-you-should-always-ask-yourself","status":"publish","type":"post","link":"https:\/\/clarivate.com\/academia-government\/blog\/how-to-evaluate-a-manuscript-critically-12-questions-you-should-always-ask-yourself\/","title":{"rendered":"How to evaluate a manuscript critically: 12 questions you should always ask yourself"},"content":{"rendered":"<p>It&#8217;s finally happened: you have received your first invitation to peer review. You accept, pick up your red pen, and shuffle gleefully in your chair. This is your much anticipated contribution to the scientific community. But then the panic sets in:\u00a0<em>what does peer review really mean, and what should you look out for while reading the manuscript?<\/em><\/p>\n<p>Peer review can be challenging for new academics. Your role is to help maintain the quality and integrity of published research and, in turn, protect the public from flawed and misleading findings. This may feel like a daunting task given the\u00a0<a href=\"http:\/\/journals.plos.org\/plosone\/article?id=10.1371\/journal.pone.0005738\" target=\"_blank\" rel=\"noopener\">admissions of fraudulent research practices<\/a>, surge in\u00a0<a href=\"https:\/\/www.ncbi.nlm.nih.gov\/pmc\/articles\/PMC3704583\/\" target=\"_blank\" rel=\"noopener\">retractions<\/a>\u00a0and the\u00a0<a href=\"http:\/\/www.nature.com\/news\/1-500-scientists-lift-the-lid-on-reproducibility-1.19970\" target=\"_blank\" rel=\"noopener\">reproducibility crisis<\/a>\u00a0facing science today &#8211; but fighting against these problems is not only vital for scholarly communication, it will also improve your own skills as a researcher.<\/p>\n<p>Your peer review contributions will help you understand what editors are looking for, and you\u2019ll become a better writer and a more successful published author in the process. You\u2019ll keep abreast of research in your field, learn new and best-practice methods, and start examining your own research from that critical vantage point.<\/p>\n<p>However, to start contributing to the scientific community and reaping the benefits of peer review, you\u2019ll first need to learn what makes a great peer reviewer.<\/p>\n<p>Key to this is knowing when to accept a review invitation (<a href=\"https:\/\/publons.com\/blog\/are-you-the-right-reviewer\/\" target=\"_blank\" rel=\"noopener\">see here for our tips<\/a>) and how to critique a research paper.<\/p>\n<p>We asked\u00a0<a href=\"https:\/\/publons.com\/community\/academy\/\" target=\"_blank\" rel=\"noopener\">Publons Academy<\/a>\u00a0Advisor Elisabeth Bik for her\u00a0<a href=\"https:\/\/publons.com\/blog\/peer-review-essentials-for-the-beginning-peer\/\" target=\"_blank\" rel=\"noopener\">advice<\/a>\u00a0on how to read a manuscript critically.\u00a0<a href=\"https:\/\/publons.com\/author\/250457\/elisabeth-m-bik#profile\" target=\"_blank\" rel=\"noopener\">Bik<\/a>\u00a0is a Research Associate at the Department of Microbiology and Immunology at Stanford University&#8217;s School of Medicine. Alongside putting together a helpful list of general questions to ask yourself while reviewing, Bik offered her valuable expertise during the creation of our Publons Academy. This is a free on-demand course that teaches you how to become a better peer reviewer. You can sign up for that\u00a0<a href=\"https:\/\/publons.com\/academy\" target=\"_blank\" rel=\"noopener\">here<\/a>\u00a0to master the core competencies of peer reviewing and to connect with editors at elite journals.<\/p>\n<p>&nbsp;<\/p>\n<h3 id=\"toptipstocriticallyreviewaresearchpaper\">Top Tips to Critically Review a Research Paper<\/h3>\n<p>Elisabeth Bik: Asking these questions should help you form an opinion about the paper, even if you have no idea where to start. It&#8217;s the list that I wished I had access to when I started my first peer review. Here we go:<\/p>\n<p><strong>1.<\/strong>\u00a0Do you have a conflict of interest when reviewing this paper? Do you collaborate with these authors, are they your personal friends, or are they direct competitors? Have you reviewed (and rejected) this paper before? If so, you need to let the editors know.<\/p>\n<p><strong>2.<\/strong>\u00a0Do the title and abstract cover the main aspects of the work, would it spark interest to the right audience?<\/p>\n<p><strong>3.<\/strong>\u00a0Is the Introduction easy to follow for most readers of this particular journal? Does it cite the appropriate papers? Does it provide a hypothesis or aim of the study?<\/p>\n<p><strong>4.<\/strong>\u00a0Does the Methods section provide enough details for the general reader to repeat the experiments?<\/p>\n<p><strong>5.<\/strong>\u00a0If you skip the Methods, does the Results section give the right amount of detail to understand the basic details of the experiments?<\/p>\n<p><strong>6.<\/strong>\u00a0Do the Results refer to the figures in a logical order? Do the numbers in the tables add up correctly? Are any figures\/tables mislabeled or unclear?<\/p>\n<p><strong>7.<\/strong>\u00a0Given the data that was obtained in this study, did the authors perform all the logical analyses? Did they include the proper controls?<\/p>\n<p><strong>8.<\/strong>\u00a0Does the Discussion address the main findings, and does it give proper recognition to similar work in this field?<\/p>\n<p><strong>9.<\/strong>\u00a0In general, is the paper easy to follow and does it have a logical flow? Are there any language issues?<\/p>\n<p><strong>10.<\/strong>\u00a0Did the authors make all their data (e.g. sequence reads, code, questionnaires used) available for the readers?<\/p>\n<p><strong>11.<\/strong>\u00a0Is this paper novel and an advancement of the field, or have other people done very similar work?<\/p>\n<p><strong>12.<\/strong>\u00a0Finally (and hopefully you will never have to answer yes to any of these questions): Does the paper raise any ethical concerns? Any suspicion of plagiarism (text or experiments), duplicated or tampered images, lack of IRB approval, unethical animal experiments, or &#8220;dual use of research concern&#8221;?<\/p>\n<p>Follow these tips and you\u2019ll be well on your way to becoming a skilled and sought-after peer reviewer. And remember &#8211; if you want to master peer review and connect with top editors then head over to our Publons Academy\u00a0<a href=\"https:\/\/publons.com\/community\/academy\/\" target=\"_blank\" rel=\"noopener\">here<\/a>.<\/p>\n<p><strong>The\u00a0<a href=\"http:\/\/publons.com\/community\/academy\" target=\"_blank\" rel=\"noopener\">Publons Academy<\/a>\u00a0is a free online course designed by expert reviewers, editors and Nobel Prize winners to teach you how to become a master of peer review and connects you with real life editors.<\/strong><\/p>\n<p><a href=\"https:\/\/publons.com\/\" target=\"_blank\" rel=\"noopener\">Publons<\/a>\u00a0allows you to record, verify, and showcase your peer review contributions in a format you can include in job and funding applications (without breaking reviewer anonymity).<\/p>\n<p><a href=\"https:\/\/publons.com\/account\/signup\/\" target=\"_blank\" rel=\"noopener\">Register now<\/a>\u00a0to start building your verified peer review record.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>It&#8217;s finally happened: you have received your first invitation to peer review. You accept, pick up your red pen, and shuffle gleefully in your chair. This is your much anticipated&#8230;<\/p>\n","protected":false},"author":70,"featured_media":36798,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"footnotes":""},"categories":[16],"tags":[20,22,88],"class_list":["post-103550","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-academia-government","tag-peer-review","tag-practical-guide","tag-researchers"],"acf":[],"lang":"en","translations":{"en":103550},"publishpress_future_workflow_manual_trigger":{"enabledWorkflows":[]},"pll_sync_post":[],"_links":{"self":[{"href":"https:\/\/clarivate.com\/academia-government\/wp-json\/wp\/v2\/posts\/103550","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/clarivate.com\/academia-government\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/clarivate.com\/academia-government\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/clarivate.com\/academia-government\/wp-json\/wp\/v2\/users\/70"}],"replies":[{"embeddable":true,"href":"https:\/\/clarivate.com\/academia-government\/wp-json\/wp\/v2\/comments?post=103550"}],"version-history":[{"count":1,"href":"https:\/\/clarivate.com\/academia-government\/wp-json\/wp\/v2\/posts\/103550\/revisions"}],"predecessor-version":[{"id":287776,"href":"https:\/\/clarivate.com\/academia-government\/wp-json\/wp\/v2\/posts\/103550\/revisions\/287776"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/clarivate.com\/academia-government\/wp-json\/wp\/v2\/media\/36798"}],"wp:attachment":[{"href":"https:\/\/clarivate.com\/academia-government\/wp-json\/wp\/v2\/media?parent=103550"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/clarivate.com\/academia-government\/wp-json\/wp\/v2\/categories?post=103550"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/clarivate.com\/academia-government\/wp-json\/wp\/v2\/tags?post=103550"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}