Medical Writing Statistics Statistical analyses and methods in the published literature: The SAMPL guidelines

Volume 25, Issue 3 - Statistics

Statistical analyses and methods in the published literature: The SAMPL guidelines

Abstract

Despite calls for guidelines on reporting statistical aspects of studies, most journals have still not included in their instructions for authors more than a paragraph or two about reporting statistical methods and results. However, given that many statistical errors concern basic statistics, a comprehensive – and comprehensible – set of reporting guidelines might improve how statistical analyses are documented. The SAMPL guidelines are designed to be included in a journal’s Instructions for Authors. These guide - lines tell authors, journal editors, and reviewers how to report basic statistical methods and results. Although these guidelines are limited to the most common statistical analyses, they are nevertheless sufficient to prevent most of the reporting deficiencies routinely found in scientific articles.

Download the full article

References

  1. Esquirol JED. Cited in: Pearl, R. Introduction to Medical Biometry and Statistics. WB Saunders, Philadelphia; 1941.
  2. Schor S, Karten I. Statistical evaluation of medical journal manuscripts. J Am Med Assn. 1966;195:1123-8.
  3. Prescott RJ, Civil I. Lies, damn lies and statistics: errors and omission in papers submitted to Injury 2010-2012. Injury. 2013;44:6-11.
  4. Fernandes-Taylor S, Hyun JK, Reeder RN, Harris AH. Common statistical and research design problems in manuscripts submitted to high-impact medical journals. BMC Res Notes. 2011;4:304.
  5. Bosker T, Mudge JF, Munkittrick KR. Statistical reporting deficiencies in environmental toxicology. Environ Tox Chem. 2013;32(8):1737-9.
  6. Vesterinen HM, Egan K, Deister A, Schlattmann P, Macleod MR, Dirnagl U. Systematic survey of the design, statistical analysis, and reporting of studies published in the 2008 volume of the Journal of Cerebral Blood Flow and Metabolism. J Cerebr Blood Flow Metab. 2011;31:1064-72.
  7. Kim JS, Kim DK, Hong SJ. Assessment of errors and misused statistics in dental research. Int Dent J. 2011;61:163-7.
  8. Lee HJ, Jung SK. The use of statistical methodology in articles in medical journals and suggestions for the quality improvement of the Pediatric Allergy and Respiratory Disease. Pediatr Allergy Respir Dis. 2011;21:144-55.
  9. Yim KH, Nahm FS. Han KA, Park SY Analysis of statistical methods and errors in the articles published in the Korean Journal of Pain. Kor J Pain. 2010;23:35-41.
  10. Al-Benna S, Al-Ajam Y, Way B, Steinstraesser L. Descriptive and inferential statistical methods used in burns research. Burns. 2010;36(3):343-6.
  11. Robinson PM, Menakuru S, Reed MW, Balasubramanian SP. Description and reporting of surgical data – scope for improvement? Surgeon. 2009;7(1);6-9.
  12. Afshar K, Jafari S, Seth A, Lee JK, MacNeily AE. Publications by the American Academy of Pediatrics Section on Urology: the quality of research design and statistical methodology. J Urol. 2009;182(4 Suppl):1906-10.
  13. Barbosa FT, de Souza DA. Frequency of the adequate use of statistical tests of hypothesis in original articles published in the Revista Brasileira de Anestesiologia between January 2008 and December 2009. Rev Brasil Anestesiol. 2010;60:528-36.
  14. Neville JA, Lang W, Fleischer AB. Errors in the Archives of Dermatology and the Journal of the American Academy of Dermatology from January through December 2003. Arch Dermatol. 2006;142:737-40.
  15. Kurichi JE, Sonnad SS. Statistical methods in the surgical literature. J A Coll Surg. 2006;202:476-84.
  16. Scales CD, Norris RD, Preminger GM, Vieweg J, Peterson BL, Dahm P. Evaluating the evidence: statistical methods in randomized controlled trials in the urological literature. J Urol. 208;180 1463-7.
  17. Gaskin CJ, Happell B. Power, effects, confidence, and significance: an investigation of statistical practices in nursing research. Int J Nurs Stud. 2014;51(5):795-806.
  18. Jaykaran YP. Quality of reporting statistics in two Indian pharmacology journals. J Pharmacol Pharmacother. 2011;2(2):85-9.
  19. Mikolajczyk RT, DiSilvestro A, Zhang J. Evaluation of logistic regression reporting in current obstetrics and gynecology literature. Obst Gynecol. 2008;111(2 Pt 1):413-9.
  20. Burton A, Altman DG. Missing covariate data within cancer prognostic studies: a review of current reporting and proposed guidelines. Br J Cancer. 2004;91:4-8.
  21. Mackinnon, A. The use and reporting of multiple imputation in medical research – a review. J Intern Med. 2010;268:586-93.
  22. Abraira V, Muriel A, Emparanza JI, Pijoan JI, Royuela A, Plana MN. Cano A, Urreta I, Zamora J. Reporting quality of survival analyses in medical journals still needs improvement. A minimal requirements proposal. J Clin Epidemiol. 2013;66:1340-6.
  23. Kim M. Statistical methods in Arthritis & Rheumatism – current trends. Arthr Rheum. 2006;54:3741-9.
  24. Reed JF, Salen P, Bagher P. Methodological and statistical techniques: what do residents really need to know about statistics? J Med Syst. 2003;27(3):233-8.
  25. Aljoudi AS. Study designs and statistical methods in the Journal of Family and Community Medicine: 1994-2010. J Fam Commun Med. 2013;20(1):8-11
  26. Lee CM, Soin HK, Einarson TR. Statistics in the pharmacy literature. Ann Pharmacother. 2004;38(9): 1412–8
  27. Lang T, Secic M. How to Report Statistics in Medicine: Annotated Guidelines for Authors, Editors, and Reviewers, 2nd edn. American College of Physicians, Philadelphia; 2006.
  28. O’Fallon, J.R., Duby, S.D., Salsburg, D.S. et al. Should there be statistical guidelines for medical research papers? Biometrics. 1978;34:687–95.
  29. Shott S. Statistics in veterinary research. J Am Vet Med Association 1985; 187:138–41.
  30. Hayden GF. Biostatistical trends in Pediatrics: implications for the future. Pediatrics. 1983;72:84–7.
  31. Altman DG, Bland JM. Improving doctors’ understanding of statistics. J Royal Stat Soc SerA. 1991;154, 223– 67.
  32. Altman DG, Gore SM, Gardner MJ, Pocock SJ. Statistical guidelines for contributors to medical journals. BMJ. 1983;286, 1489–93.
  33. Bailar JC, Mosteller F. Guidelines for statistical reporting in articles for medical journals. Amplifications and explanations. Ann Intern Med. 1988;108 (2), 266–73.
  34. Bond GR. Mintz J, McHugo GJ. Statistical guidelines for the Archives of PM&R. Arch Phys Med Rehab. 1995;76:784–7.
  35. Wilkinson L, Task Force on Statistical Inference. Statistical methods in psychology journals. Guidelines and explanations. Am Psych. 1999;54: 594–604.
  36. Curran-Everett D, Benos DJ. American Physiological Society. Guidelines for reporting statistics in journals published by the American Physiological Society. Am J Physiol Endocrinol Metab. 2004;287: E189–91.
  37. Curran-Everett D, Benos DJ. Guidelines for reporting statistics in journals published by the American Physiological Society: the sequel. Adv Physiol Ed. 2007;31:295–8.
  38. Moher D, Schulz K, Altman DG, for the CONSORT Group. CONSORT statement: revised recommendations for improving the quality of reports of parallel-group randomized trials. Ann Intern Med. 2001;134:657–62.
  39. DesJarlais DC, Lyles C, Crepaz N, Trend Group. Improving the reporting quality of nonrandomized evaluations of behavioral and public health interventions: the TREND statement. Am J Publ Health. 2004;94(3):361–6.
  40. von Elm E, Altman DG, Egger M, Pocock SJ, Gotzsche PC, Vandenbroucke JP. The Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) Statement: guidelines for reporting observational studies. Ann Inter Med. 2007;147 (8), 573–7.
  41. International Committee of Medical Journal Editors. Uniform requirements for manuscripts submitted to biomedical journals: writing and editing for biomedical publication. 2011 [cited 12 Dec 2012]. Available from: http://www.icmje.org
  42. Schriger DL, Arora S, Altman, DG. The content of medical journal instructions for authors. Ann Emerg Med. 2006;48:743–9.
  43. Lang T. How to Write, Publish, and Present in the Health Sciences: A Guide for Clinicians and Laboratory Researchers. Philadelphia: American College of Physicians; 2010.

Search

Articles

Statistics for medical writers
President's Message
EMWA News
History of biostatistics
The illusion of certainty and the certainty of illusion
Never P alone: The value of estimates and confidence intervals
A medical writer's guide to meta-analysis
Study design made easy
Statistical analyses and methods in the published literature: The SAMPL guidelines
How to interpret and report the results from multivariable analyses
Biostatistics and medical writing: Synergy in preparing clinical trials documents
Best friends forever: A pattern of collaboration between medical writers and biostatisticians within the Russian CRO
Where have all the UK entry level pharmaceutical regulatory medical writing jobs gone?
News from the EMA
Journal Watch
In the Bookstores
The Webscout
Good Writing Practice
Medical Communications
Getting Your Foot in the Door
Lingua Franca and Beyond
Gained in Translation
Teaching Medical Writing
Profile: An interview with Professor Peter Jüni on methodology and statistics in scientific manuscripts
Out On Our Own

Links

The Write Stuff Archive Contact Instructions for Authors Article Template (Word) Journal Policies

Editoral Board

Editor-in-Chief

Raquel Billiones

Co-Editors

Evguenia Alechine

Jonathan Pitt

Managing Editor

Victoria White

Associate Editors

Anuradha Alahari

Jennifer Bell

Nicole Bezuidenhout

Claire Chang

Barbara Grossman

Sarah Milner

John Plant

Sampoorna Rappaz

Amy Whereat

Section Editors

Daniela Kamir

AI/Automation

Jennifer Bell

Biotechnology

Nicole Bezuidenhout 

Digital Communication

Somsuvro Basu

EMWA News 

Ana Sofia Correia 

Gained in Translation

Ivana Turek

Getting Your Foot in the Door

Wendy Kingdom / Amy Whereat

Good Writing Practice

Alison McIntosh 

In the Bookstores

Maria Kołtowska-Häggström

Lingua Franca and Beyond

Maddy Dyer

Publications

Lisa Chamberlain-James

Medical Communications/Writing for Patients

Payal Bhatia

Medical Devices

Evguenia Alechine

My First Medical Writing

Anuradha Alahari

News from the EMA

Adriana Rocha

Freelancing

Tiziana von Bruchhausen

Pharmacovigilance

Clare ChangZuo Yen Lee 

Regulatory Matters

Sam Hamilton

Regulatory Public Disclosure

Claire Gudex

Teaching Medical Writing

Louisa Ludwig-Begall / Sarah Kabani

The Crofter: Sustainable Communications

Louisa Marcombes

Veterinary Writing

Editors Emeritus

Elise Langdon-Neuner

Phil Leventhal

Layout Designer

Chris Monk