goodthingswithdata.com

Data in the MMWR

Context (11 of 12)

Data in the MMWR (§6.3): Place interpretation in context, including limitations
Posted to LinkedIn

2026-02-24

NotePreviously published

Posted to LinkedIn on 2026-02-24. The text below is the post as published.

Read the original on LinkedIn

Links to works now on this site point to their pages here; the words are as published. Where the post showed a web address, the icon stands in for it (hover over it to see the address as posted).

Data in the MMWR (§6.3): Place interpretation in context, including limitations On this site (opens in a new tab)
[2026-02-24]

MMWR full reports typically include a paragraph that enumerates limitations, in part to establish transparency, and in part to help the reader avoid overinterpreting results and potential implications.

Principles: Enumerated limitations should allow a reader to contextualize the interpretations of findings, including a sense of how the interpretations could differ if the setting or assumptions varied from those in the report.

Observations: The overwhelming majority (about 95%) of weekly reports contain a sentence worded as follows: “The findings in this report are subject to at least [number] limitations.” Over the period under review in this report, 731 weekly reports (not just full reports) enumerated at least 1 limitation, with 104 (14%) listing 6-9 limitations. Among the 56 full reports under review, 55 report at least 1 limitation (all except a guidance document), and 11 (20%) list 6-9 limitations.

Recommendations: Ideally, a limitation is accompanied by the expected implication of that limitation for interpreting the results under discussion. This is especially true for limitations related to bias, unmeasured confounders, and causal claims. Ensure that limitations pertain to the reported data, methods, results, and interpretation, and do not attempt to imply conclusions that are otherwise not supported by the particular study design or sample selection procedures. Rather than enumerating each distinct limitation statement, consider grouping limitation statements conceptually, such as those pertaining to potential bias or that might limit generalizability. If the number or weight of limitations is substantial, narrow the scope of the report’s claims.

Next topic: Additional practices: How else might data presentation improve? (§§7.1-7.3)

Data in the MMWR