This essay presents views that I have developed throughout my career, especially during my 8-year tenure as the Associate Director for Data Science in CDC’s Center for Surveillance, Epidemiology, and Laboratory Services from January 2015 through CSELS’s dissolution in January 2023. I wrote this essay to bring together as a coherent whole several related ideas on how CDC should think about, talk about, and support a work culture oriented to doing good things with data. In my view, this is CDC’s single greatest area for gains from doing good things with data: connecting technical excellence and analytic rigor to doing science better, getting better at learning things about the world, and getting better at doing things with what has been learned. In my experience, CDC has tended to overemphasize technology and underemphasize critical reflection and practical wisdom in doing things with data.
This essay is a snapshot in time. It reaches back to extensive reading and study that I undertook from 2014 through 2016, but it stops around 2021. The field continues to change rapidly. But as much as data science is about keeping up with fast-moving methods, tools, and technology, the schema for data science is itself stable. So, for example, where I describe how CDC should think about machine learning and artificial intelligence, I don’t specifically address recent large language (“chat”) models.
I dedicate this essay to the dozens of folks whom I have mentored since I joined CDC as a federal employee in February 2000. I believe in you. You’re the reason that I wholeheartedly believe that a progressive culture for data centers on learners—because learners believe.
Arnold BF, Laan MJ van der, Hubbard AE, Steel C, Kubofcik J, Hamlin KL, Moss DM, Nutman TB, Priest JW, Lammie PJ. 2017-05. Measuring changes in transmission of neglected tropical diseases, malaria, and enteric pathogens from quantitative antibody levels.
PLoS Neglected Tropical Diseases. 11(5):e0005616.
https://doi.org/10.1371/journal.pntd.0005616
Baehr J. 2013-05b. Educating for intellectual virtues: From theory to practice.
Journal of Philosophy of Education. 47(2):248–262.
https://doi.org/10.1111/1467-9752.12023
Baehr J. 2013a. The cognitive demands of intellectual virtue. In: Henning T, Schweikard DP, editors.
Knowledge, Virtue, and Action: Putting Epistemic Virtues to Work. 1st Edition. New York: Routledge; p. 99–118.
https://doi.org/10.4324/9780203098486
Baehr J. 2015. Cultivating
Good Minds:
A Philosophical &
Practical Guide to
Educating for
Intellectual Virtues.
https://jasonbaehr.gumroad.com/l/IJxPL
Baehr JS. 2021. Deep in thought: A practical guide to teaching for intellectual virtues. Cambridge, Massachusetts: Harvard Education Press.
Bertke SJ, Meyers AR, Wurzelbacher SJ, Measure A, Lampl MP, Robins D. 2016-03. Comparison of methods for auto-coding causation of injury narratives.
Accident Analysis & Prevention. 88:117–123.
https://doi.org/10.1016/j.aap.2015.12.006
Blei DM, Smyth P. 2017-08. Science and data science.
Proceedings of the National Academy of Sciences. 114(33):8689–8692.
https://doi.org/10.1073/pnas.1702076114
Bowen DA, Mercer Kollar LM, Wu DT, Fraser DA, Flood CE, Moore JC, Mays EW, Sumner SA. 2018-10. Ability of crime, demographic and business data to forecast areas of increased violence.
International Journal of Injury Control and Safety Promotion. 25(4):443–448.
https://doi.org/10.1080/17457300.2018.1467461
Breiman L. 2001-08. Statistical modeling: The two cultures (with comments and a rejoinder by the author).
Statistical Science. 16(3):199–231.
https://doi.org/10.1214/ss/1009213726
Costa AL, Kallick B. 2008-12. Describing the habits of mind. In:
Learning and Leading with Habits of Mind: 16 Essential Characteristics for Success. Association for Supervision; Curriculum Development; p. 15–41.
https://www.ascd.org/books/learning-and-leading-with-habits-of-mind?chapter=learning-through-reflection-learning-and-leading-with-habits-of-mind
Data Science Association. Data
Science Code of
Professional Conduct.
https://www.datascienceassn.org/code-of-conduct.html
Davenport TH, Patil DJ. 2012-10. Data scientist: The sexiest job of the 21st century.
Harvard Business Review.
https://hbr.org/2012/10/data-scientist-the-sexiest-job-of-the-21st-century
Dishman L. 2016-01. These are the top 25 jobs in the
US this year.
Fast Company.
https://www.fastcompany.com/3055629/these-are-the-top-25-jobs-in-the-us-this-year
Donoho D. 2017-10. 50 years of data science.
Journal of Computational and Graphical Statistics. 26(4):745–766.
https://doi.org/10.1080/10618600.2017.1384734
Freedman B. 1987-11. Scientific value and validity as ethical requirements for research: A proposed explication.
IRB: Ethics & Human Research. 9(6):7–10.
https://doi.org/10.2307/3563623
Gehrke A, Luo M, Takahata S. 2021-09. Critical Factors for Building Successful Data Science Teams Final Summary Report.
Goertzel BN, Pennachin C, De Souza Coelho L, Gurbaxani B, Maloney EM, Jones JF. 2006-04. Combinations of single nucleotide polymorphisms in neuroendocrine effector and receptor genes predict chronic fatigue syndrome.
Pharmacogenomics. 7(3):475–483.
https://doi.org/10.2217/14622416.7.3.475
Goldstick JE, Carter PM, Walton MA, Dahlberg LL, Sumner SA, Zimmerman MA, Cunningham RM. 2017-05. Development of the
SaFETy score:
A clinical screening tool for predicting future firearm violence risk.
Annals of Internal Medicine. 166(10):707–714.
https://doi.org/10.7326/M16-1927
Gu W, Vieira AR, Hoekstra RM, Griffin PM, Cole D. 2015-10. Use of random forest to estimate population attributable fractions from a case-control study of
Salmonella enterica serotype
Enteritidis infections.
Epidemiology and Infection. 143(13):2786–2794.
https://doi.org/10.1017/S095026881500014X
Holt AC, Salkeld DJ, Fritz CL, Tucker JR, Gong P. 2009-12. Spatial analysis of plague in
California: Niche modeling predictions of the current distribution and potential response to climate change.
International Journal of Health Geographics. 8(1):38.
https://doi.org/10.1186/1476-072X-8-38
Jones ML. 2018-11. How we became instrumentalists (again): Data positivism since
World War II.
Historical Studies in the Natural Sciences. 48(5):673–684.
https://doi.org/10.1525/hsns.2018.48.5.673
King N. 2014-09. What are intellectual virtues?
Five key features of the intellectual virtues.
https://cct.biola.edu/intellectual-virtues/
Koza JR, Bennett FH, Andre D, Keane MA. 1996. Automated design of both the topology and sizing of analog electrical circuits using genetic programming. In: Gero JS, Sudweeks F, editors.
Artificial Intelligence in Design ’96. Dordrecht: Springer Netherlands; p. 151–170.
https://doi.org/10.1007/978-94-009-0279-4_9
Kracalik IT, Kenu E, Ayamdooh EN, Allegye-Cudjoe E, Polkuu PN, Frimpong JA, Nyarko KM, Bower WA, Traxler R, Blackburn JK. 2017-10. Modeling the environmental suitability of anthrax in
Ghana and estimating populations at risk:
Implications for vaccination and control.
PLoS Neglected Tropical Diseases. 11(10):e0005885.
https://doi.org/10.1371/journal.pntd.0005885
Ladd-Acosta C, Shu C, Lee BK, Gidaya N, Singer A, Schieve LA, Schendel DE, Jones N, Daniels JL, Windham GC, et al. 2016-01. Presence of an epigenetic signature of prenatal cigarette smoke exposure in childhood.
Environmental Research. 144:139–148.
https://doi.org/10.1016/j.envres.2015.11.014
Lee SH, Levin D, Finley PD, Heilig CM. 2019-05. Chief complaint classification with recurrent neural networks.
Journal of Biomedical Informatics. 93:103158.
https://doi.org/10.1016/j.jbi.2019.103158
Lee SH, Maenner MJ, Heilig CM. 2019-09. A comparison of machine learning algorithms for the surveillance of autism spectrum disorder.
PLoS ONE. 14(9):e0222907.
https://doi.org/10.1371/journal.pone.0222907
Maenner MJ, Yeargin-Allsopp M, Van Naarden Braun K, Christensen DL, Schieve LA. 2016-12. Development of a machine learning algorithm for the surveillance of autism spectrum disorder.
PLoS ONE. 11(12):e0168224.
https://doi.org/10.1371/journal.pone.0168224
Menon R, Bhat G, Saade GR, Spratt H. 2014-04. Multivariate adaptive regression splines analysis to predict biomarkers of spontaneous preterm birth.
Acta Obstetricia et Gynecologica Scandinavica. 93(4):382–391.
https://doi.org/10.1111/aogs.12344
Meyers AR, Al-Tarawneh IS, Wurzelbacher SJ, Bushnell PT, Lampl MP, Bell JL, Bertke SJ, Robins DC, Tseng C-Y, Wei C, et al. 2018-01. Applying machine learning to workers’ compensation data to identify industry-specific ergonomic and safety prevention priorities:
Ohio, 2001 to 2011.
Journal of Occupational and Environmental Medicine. 60(1):55–73.
https://doi.org/10.1097/JOM.0000000000001162
Millis J. 2015-06. Data scientists don’t scale.
Machine intelligence does.
http://blog.nutonian.com/data-scientists-dont-scale
National Academies of Sciences, Engineering, and Medicine. 2018. Envisioning the
Data Science Discipline:
The Undergraduate Perspective:
Interim Report. Washington, DC: The National Academies Press.
https://doi.org/10.17226/24886
NIST Big Data Public Working Group. 2015-10.
NIST Big Data Interoperability Framework:
Volume 1,
Definitions. National Institute of Standards; Technology.
https://doi.org/10.6028/NIST.SP.1500-1r2
Olshen R. 2001-05. A conversation with
Leo Breiman.
Statistical Science. 16(2):184–198.
https://doi.org/10.1214/ss/1009213290
Pasteur L, Vallery-Radot LP. Discours prononcé à Douai le 7 décembre 1854 à l’occasion de l’installation solennelle de la faculté des lettres de Douai et de la faculté des sciences de Lille. In: Réunies par Pasteur Vallery-Radot. Vol. Tome 7. Masson (Paris).
Pearl J. 2009. Causality. 2nd ed. Cambridge University Press.
https://doi.org/10.1017/CBO9780511803161
Peng RD, Matsui E. 2015-09. The
Art of
Data Science:
A Guide for
Anyone Who Works with
Data. Leanpub.
http://leanpub.com/artofdatascience
Petersen ML, LeDell E, Schwab J, Sarovar V, Gross R, Reynolds N, Haberer JE, Goggin K, Golin C, Arnsten J, et al. 2015-05. Super learner analysis of electronic adherence data improves viral prediction and may provide strategies for selective
HIV RNA monitoring.
JAIDS Journal of Acquired Immune Deficiency Syndromes. 69(1):109–118.
https://doi.org/10.1097/QAI.0000000000000548
Rubaiyat AHM, Toma TT, Kalantari-Khandani M, Rahman SA, Chen L, Ye Y, Pan CS. 2016-10. Automatic detection of helmet uses for construction safety. In:
2016 IEEE/WIC/ACM International Conference on Web Intelligence Workshops (WIW). Omaha, NE, USA: IEEE; p. 135–142.
https://doi.org/10.1109/WIW.2016.045
Savel TG, Foldy S. 2012-07. The role of public health informatics in enhancing public health surveillance.
MMWR Supplements. 61(3):20–24.
https://www.cdc.gov/mmwr/preview/mmwrhtml/su6103a5.htm
Turri J, Alfano M, Greco J. 2021. Virtue epistemology. In: Zalta EN, editor.
The Stanford Encyclopedia of Philosophy. Winter 2021. Metaphysics Research Lab, Stanford University.
https://plato.stanford.edu/archives/win2021/entries/epistemology-virtue/
Wagner RM. 2022-03. Authorities and Mechanisms for Hiring and Retaining Data Scientists at HHS.
Wheeler MW. 2019-03. Bayesian additive adaptive basis tensor product models for modeling high dimensional surfaces: An application to high-throughput toxicity testing.
Biometrics. 75(1):193–201.
https://doi.org/10.1111/biom.12942
Yanamala N, Orandle MS, Kodali VK, Bishop L, Zeidler-Erdely PC, Roberts JR, Castranova V, Erdely A. 2018-01. Sparse supervised classification methods predict and characterize nanomaterial exposures: Independent markers of
MWCNT exposures.
Toxicologic Pathology. 46(1):14–27.
https://doi.org/10.1177/0192623317730575