About
Dr. Howard Wainer is an award-winning American statistician and research scientist. His specialization is the use of graphical methods for data analysis and communication, robust statistical methodology, and the development and application of generalizations of item response theory. After serving on the faculty of the University of Chicago, a period at the Bureau of Social Science Research during the Carter Administration, and 21 years as Principal Research Scientist in the Research Statistics Group at Educational Testing Service, he is recently retired from his position as Distinguished Research Scientist at the National Board of Medical Examiners. Dr. Wainer has authored hundreds of peer-reviewed journal articles and more than 21 books, including Truth or Truthiness: Distinguishing Fact from Fiction by Learning to Think Like a Data Scientist. He has served on the Scientific Advisory Board since 2016.
ResearchGate Profile: https://www.researchgate.net/profile/Howard-Wainer
Publications
BOOKS
A History of Data Visualization and Graphic Communication. (with M. Friendly). Harvard University Press, 2021.
A Gleam in the Mind’s Eye: Visual Discovery and the Rise of Data Visualization (with M. Friendly). Cambridge: Harvard University Press, 2019.
Truth or Truthiness: Distinguishing Fact from Fiction by Learning to Think like a Data Scientist. New York: Cambridge University Press, 2016. (named by the Financial Times to its ‘Top Six books of 2016’). https://youtu.be/rm9AZb3jbBk
Medical Illuminations: Using Evidence, Visualization & Statistical thinking to Improve Healthcare. London: Oxford University Press, 2014 (finalist Royal Society Winton Book Prize).
A Statistical Guide for the Ethically Perplexed (with L. Hubert). New York: Chapman and Hall, 2013.
Uneducated Guesses Using Evidence to Uncover Misguided Education Policies. Princeton, NJ: Princeton University Press, 2011 (finalist for the Grawemeyer/World Order Award)
Picturing the Uncertain World: How to Understand, Communicate and Control Uncertainty through Graphical Display. Princeton, NJ: Princeton University Press, 2009.
Testlet Response Theory and its Applications (with E. Bradlow & X. Wang). New York: Cambridge University Press, 2007.
The Commercial and Political Atlas, Representing, by means of Stained Copper-Plate Charts, The Progress of the Commerce, Revenues, Expenditure, and Debts of England, during the whole of the Eighteenth Century, by William Playfair. Edited and introduced by Howard Wainer and Ian Spence. New York: Cambridge University Press, 2007.
The Statistical Breviary; Shewing on a Principle entirely new, the resources of every state and kingdom in Europe; illustrated with Stained Copper-Plate Charts, representing the physical powers of each distinct nation with ease and perspicuity by William Playfair. Edited and introduced by Howard Wainer and Ian Spence. New York: Cambridge University Press, 2007.
Graphic Discovery: A Trout in the Milk and Other Visual Adventures. Princeton, N.J.: Princeton University Press, 2005. (Named by Choice “Best Math book of 2005”).
Test Scoring. (with D. Thissen). Hillsdale, NJ: Lawrence Erlbaum Associates, 2001.
Visual Revelations: Graphical Tales of Fate and Deception from Napoleon Bonaparte to Ross Perot. (2nd edition) Hillsdale, N. J.: Lawrence Erlbaum Associates, 2000.
Computerized Adaptive Testing: A Primer, 2nd edition (with N. Dorans, D. Eignor, R. Flaugher, B. Green, R. Mislevy, L. Steinberg & D. Thissen) Hillsdale, N. J. : Lawrence Erlbaum Associates, 2000.
Drawing inferences from self-selected samples (2nd printing). Hillsdale, N. J.: Lawrence Erlbaum Associates, 2000.
Visual Revelations: Graphical Tales of Fate and Deception from Napoleon Bonaparte to Ross Perot. New York: Copernicus Books, 1997.
Differential Item Functioning (with P. W. Holland). Hillsdale, NJ: Lawrence Erlbaum Associates, 1993.
Computerized Adaptive Testing: A Primer (with N. Dorans, R. Flaugher, B. Green, R. Mislevy, L. Steinberg & D. Thissen) Hillsdale, N. J. : Lawrence Erlbaum Associates, 1990.
Test Validity (with H. Braun) Hillsdale, N. J. : Lawrence Erlbaum Associates, 1988.
Drawing inferences from self-selected samples. New York: Springer-Verlag, 1986.
Principals of modern psychological measurement. (with S. Messick) Hillsdale, N.J. : Lawrence Erlbaum Associates, 1983.
Semiology of Graphics by Jacques Bertin (translated by William Berg; Howard Wainer, Technical Editor)Madison, Wisconsin: University of Wisconsin Press, 1983.
Graphics and Graphic Information Processing by Jacques Bertin (Translated by William Berg; Howard Wainer, Technical Editor) Elmsford, N. Y. : Walter de Gruyter, 1981.
Predicting adult stature for individuals. (with A. F. Roche & D. Thissen) Basel: Karger, 1975.
Skeletal maturity: The knee joint as a biological indicator. (with A. F. Roche & D. Thissen) New York: Plenum, 1975.
Selected Publications
2021
Wainer, H. (2021). Some Thoughts on a World Without Tests. CHANCE. 34. 28-29. 10.1080/09332480.2021.2003637.
2020
Wainer, H., & Friendly, M. (2020). The Graphical Birth of Plate Tectonics. CHANCE. 33. 44-47. 10.1080/09332480.2020.1726122.
Friendly, M., & Wainer, H. (2020). Galton’s gleam Visual thinking and graphic discoveries. Significance. 17. 28-33. 10.1111/1740-9713.01403.
On the Origins of Data Visualizations (with M. Friendly). In Statistics in the Public Interest: In Memory of Stephen E. Fienberg. (Carriquiry, A., Eddy, W. & Tanur, J., eds.) New York: Springer, 2020.
2019
Using Graphics of the 2nd Kind to Find Visual Answers to Scientific Questions (with M. Friendly). The American Scientist, 106, xxx-xxx, 2019.
A Statistician Reads the Obituaries: On the Relative Effects of Race and Crime on Employment. Chance, 32 xx-xx, 2019
2018
Ancient Visualizations (with M. Friendly), Chance, 31(2), 62-64, 2018.
2017
The Great Migration: A Graphics Novel Featuring the Contributions of
W. E. B. Du Bois and C. J. Minard (with RJ Andrews), Significance, 14(3), 14-19, 2017,
https://www.significancemagazine.com/culture/564-the-great-migration-a-graphics-novel also
http://infowetrust.com/picturing-the-great-migration/
Debts to the past: Building on History, Chance, 30(4), xx-xx, 2017.
The Birth of Statistical Graphics and their European Childhood: On the historical development of W.E.B. Du Bois’ graphical narrative of a people, Chance, 30(3), 61-67, 2017.
The Grabovsky Curve. Chance, 30(1), 44-47, 2017.
The case for Bayesian methods when investigating test fraud (with W. Skorupski). Chapter 18 in Handbook of Quantitative Methods for Detecting Cheating on Tests ( Edited by G. J. Cizek & J. A. Wollack). New York: Routledge, 346-357, 2017.
The Cut-Score Operating Function: A new tool to aid in standard setting (with I. Grabovsky).. Journal of Educational and Behavioral Statistics, 42(3), 251-263, 2017.
A Guide for setting the cut-scores to minimize weighted classification errors in test batteries (with I. Grabovsky).. Journal of Educational and Behavioral Statistics, 42(3), 264-281, 2017.
The futility of defining honors (with Joseph Bernstein). Journal of the American College of Surgeons, 224(2), 220, (February) 2017.
http://www.journalacs.org/article/S1072-7515(16)31585-X/fulltext
“William Playfair and the invention of statistical graphs” (with Ian Spence), in A. Black, P. Luna, O. Lund, and S. Walker (editors). Information design: research and practice. New York and London: Routledge. 43-60, 2017.
2016
Evidence in the 2016 Presidential Campaign. Chance, 29(3), 62-64, 2016.
The stanchions of statistics. Science, V. 352, P. 779, May 13, 2016.
Playfair, William. (with Ian Spence) Encyclopedia of Mathematics. URL: http://www.encyclopediaofmath.org/index.php?title=Playfair,_William&oldid=38048
Don’t let ignorance triumph in the US debate on family planning. New Scientist, 10 February 2016.
A Tale of Two Tests (and of two examinees) (with A. Clauser). Educational Measurement: Issues and Practice, 35(2), 19-28, 2016.
On the Evidence Supporting Changes in Breast Cancer Screening (with W. P Skorupski), Significance, 13, 24-27, 2016.
‘Extracting sunbeams from cucumbers: How to design a better table’, Significance, significancemagazine.com/sunbeams .
https://www.significancemagazine.com/science/297-extracting-sunbeams-from-cucumbers
Using Experiments to Answer Four Vexing Questions. Chance, 29(3), xx-xx, 2016.
Discussion of Thissen’s “Bad Questions: An Essay Involving Item Response Theory.” Journal of Educational and Behavioral Statistics, 41(1), 100-103, 2016.
VAMs And Baseball (with L. Steinberg). Chance, 29(2), 64. 2016.
Don’t try this at home. Significance, 13(February), 22-23, 2016.
Defeating Deception: Escaping the Shackles of Truthiness by Learning to Think Like a Data Scientist, Chance, 29(1), 61-64, 2016
Joseph Fletcher, thematic maps, slavery and the worst places to live in the UK and the US (with R. Cook), in Visible Numbers, the History of Statistical Graphics, C. Kostelnick & M. Kimball (Eds.). Farnham, UK: Ashgate Publishing, pp. 83-106. 2016.
2015
Graphs ‘R Us: A discussion of Antony Unwin’s Graphical Data Analysis with R. (With Friendly and Millán-Martinez). Journal of Educational and Behavioral Statistics, 40(6), 665-670, 2015.
How much is enough: A reply to Sinharay, Haberman & Boughton (with R. Feinberg). Educational Measurement: Issues & Practice, 34(4), 9-9, 2015.
The Bayesian Flip: Correcting the Prosecutor’s Fallacy(with W. Skorupski) Significance, 12(4), 16-20, August 2015.
For want of a nail: Why worthless subscores may be seriously impeding the progress of Western Civilization (with R. Feinberg). Significance, 12(1), 16-21, 2015. (Reprinted in The Best Writing on Mathematics – Edited by Mircea Pitici, 2016 edition, Princeton University Press., pp. 321-330.
An Interview with Howard Wainer. (with Sam Behseta), Chance, 28(1), 12-20, 2015.
Causal Inference and Death (with Don Rubin), Chance, 28(2), 58-64, 2015.
Item Response Theory: a statistical theory of measurement based on fungible items (with P. Baldwin). In The Routledge International Handbook of Advanced Quantitative Methods in Nursing Research, S. J. Henly, (Ed.). Abingdon, UK: Routledge/Taylor & Francis..pp. 58 – 80, 2015.
A Review of Yan, von Davier and Lewis’ Computerized Multistage Testing: Theory and Applications. Psychometrika, 80(1), 259-261, 2015.
2014
The Route to the USMLE: The Shibboleth of Modern Medical Licensure. Journal of Medical Regulation, 100, 21-28, 2014.
When Can We Improve Subscores by Making Them Shorter?: The Case Against Subscores with Overlapping Items. (With R. Feinberg). Educational Measurement: Issues and Practice Fall 2014, Vol. 33, No. 3, pp. 47–54.
A Simple Equation to Predict a Subscore’s Value. (With R. Feinberg). Educational Measurement: Issues and Practice Fall 2014, Vol. 33, No. 3, pp. 55-56.
“William Playfair” (version 3) (with Ian Spence). StatProb: The Encyclopedia Sponsored by Statistics and Probability Societies. Freely available at http://statprob.com/encyclopedia/WilliamPLAYFAIR.html
Cheating: Some ways to detect it badly. Chapter 3 in Kingston, N. & Clark, A. K..Test fraud: Statistical detection and methodology. New York: Routledge., 8-20, 2014.
Guilding the Medical Lily: As West Virginia Goes, so Goes the Nation. Journal of Medical Regulation, 100(1), 24, 2014.
On the Crucial Role of Empathy in the Design of Communications. Chance, 27(1), 45-50, 2014.
Life follows art: Gaming the missing data algorithm . Chance, 27(2), 56-57, 2014.
Musing about changes in the SAT: Is the College Board getting rid of the bulldog? Chance, 27(3), 59-63, 2014.
Happiness and Causal Inference. Chance, 27(4), 61-64, 2014.
2013
Comments on “Not the Last Word: Harvard Beats Yale and other Fallacies”. Clinical Orthopaedics and Related Research, 471(12), 3747-3749. Published on-line on October 19, 2013.
Taking a Chance: An interview with William F. Eddy and Stephen E. Fienberg. Chance, 26(4), 30-34, 2013.
How the Rule of 72 can provide guidance to advance your wealth, your gas mileage and your career. Chance, 26(3), 47-48, 2013.
Reflections on a too extreme idea. (with B. Clauser), Educational Psychology Review , 25, 325-330, 2013.
Stigler’s Law of Eponymy and Marey’s Train Schedule: Did Serjev do it before Ibry, and what about Jules Petiet? (with P. Harik & J. Neter), Chance, 26(1), 53-56, 2013.
Plotting evidence to affect social policy: guns, murders, life, death and ignorance in contemporary America. (with R. Cook). Chance, 26(2), 38-44, 2013.
Op-Ed: The DOE’s Teacher Evaluation System Has Obvious Flaws That Ought to Be Corrected Before Initial Implementation. NJSpotlight, April 8, 2013.
http://www.njspotlight.com/stories/13/04/08/op-ed-the-doe-s-teacher-evaluation-system-has-obvious-flaws-that-ought-to-be-corrected-before-initial-implementation/
2012
More Statistics: a contribution to One Hundred Great Ideas for Higher Education.” Academic Questions, 25, 69, Winter, 2012.
Cheating: Some ways to detect it badly. Chance, 25(3), 54-57, 2012.
The Survival of the Fittists.. The American Scientist, 100 (September-October), 358-361, 2012.
Review of Erich Lehmann’s Fisher, Neyman and the Creation of Classical Statistics. Journal of Educational Measurement, 49, 335-338, 2012.
Waiting for Achilles. Chance, 25(4), 50-51, 2012.
When nothing is not zero: A true saga of missing data, Adequate Yearly Progress and a Memphis charter school. Chance, 25(2), 49-51, 2012.
Review of The Theory That Would Not Die. (w/ S. Savage). Journal of Educational Measurement, 49, 227-232, 2012
Piano virtuosos and the four-minute mile. Significance, 9(1), 28-29, 2012.
A century and a half of Moral Statistics in the United Kingdom: Variations on Joseph Fletcher’s Thematic Maps (with R. Cook). Significance, 9(3), 31-36, 2012.
Moral statistics and the Thematic Maps of Joseph Fletcher Chance, 25(1), 43-47, 2012.
How statistics rescued a damsel in distress. NJEA Review, January 2012, 16-19.
2011
A Remarkable Horse: An Inquiry into the Accuracy of Medical Predictions (with L. Hubert). Chance, 24(4), 55-57, 2011.
Waiting for Achilles. November 30, 2011. Op Ed Essay in NJ Spotlight of the Newark Star Ledger
http://www.njspotlight.com/stories/11/1130/1236/
Assessing teachers from student scores: On the viability and fairness of value-added models for STEM Teachers, US News & World Report.com Op Ed, October 11, 2011..
http://www.usnews.com/news/articles/2011/10/11/the-viability-and-fairness-of-value-added-models-for-stem-teachers
Extracting Sunbeams from Cucumbers. (with R. Feinberg) Journal of Computational and Graphical Statistics Dec 2011, Vol. 20, No. 4: 1-18.
How much is tenure worth? Chance, 24(3), 54-57, 2011.
The first step toward wisdom. Chance, 24(2), 60-61, 2011.
Value-Added Models to evaluate teachers: A cry for help. Chance, 24(1), 11-13, 2011.
Do adjusted Subscores Lack Validity? Don’t Blame the Messenger. (with Sinharay, S.,and Haberman, S. J.) Educational and Psychological Measurement. 7(5), 789-797, 2011.
A Statistical Guide for the Ethically Perplexed.(with L. Hubert). In The Handbook of Ethics in Quantitative Methodology, A. T. Panter and S. Sterba (Eds.) New York: Taylor & Francis, 61-124, 2011.
Review of The Pleasures of Statistics: The Autobiography of Frederick Mosteller. Psychometrika, 76(1), 155-157, 2011.
Some reflections on data display and evidence. Journal of Computational and Graphical Statistics Mar 2011, Vol. 20, No. 1: 8–15.
How should we screen for breast cancer: Using evidence to make medical decisions. Significance, 8(1), 28-30, 2011.
Assessing long-term risk with short-term data (with L. Hubert). Significance, 8(4), 170-171. 2011.
A Profile of Karl G. Joreskog. Journal of Educational and Behavioral Statistics, 36(3), 403-412, 2011.
2010
Pies, Spies, Roses, Lines and Symmetries . Chance, 23(4), 58-61, 2010.
Preface to the 4th edition of the English translation of Jacques Bertin’s Semiology of Graphics. Redlands, California: ESRI Press, xi-xii, 2010.
Inside-Out Plots (with J. O. Ramsay) Chance, 23(3), 57-62, 2010.
Using Testlet Response Theory to Analyze Data from a Survey of Attitude Change among Breast Cancer Survivors. (with Wang, X. Baldwin, S., Bradlow, E. , Reeve, B., Smith, A., Bellizzi, K. & Baumgartner, K.), Statistics in Medicine, 29, 2028-2044, 2010.
Commentary on the 2008 National Healthcare Quality Report and State Snapshots. Chance, 23(2), 45-51, 2010.
Detecting DIF: Many Paths to Salvation. (with E. Bradlow & X. Wang) Journal of Educational and Behavioral Statistics, 35, 489-493, 2010.
Schrödinger’s cat & the conception of probability in item response theory. Chance, 23(1), 51-54, 2010.
14 conversations about 3 things. Journal of Educational and Behavioral Statistics, 35(1), 5-25, 2010.
Exams and disabilities. Princeton Alumni Weekly, 110(7), 11-12, 2010.
A Good Table Can Beat A Bad Graph: It matters who plays Mozart. Chance, 22(4), 55-57, 2009.
Response to Quade, Chance, 22(3), 7, 2009.
That’s funny…. (with S. Lysen). The American Scientist, 97 (July-August), 272-275, 2009.
Can we ever prevent the imprisonment of innocent people? Miller-McCune, May-June, 6-9, 2009.
Hip Psychometrics (with P. Baldwin and J. Bernstein). Statistics in Medicine, 28(17), 2277-2292, 2009.
A Little Ignorance: How Statistics Rescued a Damsel in Distress (with P. Baldwin ). Chance, 22(3), 49-52, 2009.
Pictures at an exhibition. (with M. Larsen). Chance, 22(2), 46-54, 2009.
An Eye-Witness to the Principles and Principals of 20th Century Statistics — A Review of Erich L. Lehmann’s Reminiscences of a Statistician: The Company I Kept. Journal of Educational Measurement, 46(2), 243-245, 2009.
A centenary celebration for Will Burtin: A pioneer of scientific visualization. Chance, 22(1), 51-55, 2009.
A Response to critics. The American Scientist, 97, 5-6, (January-February) 2009.
Introduction to Linda S. Gottfredson. Journal of Educational and Behavioral Statistics, 34, 395-397, 2009.
A Profile of Linda S. Gottfredson. (w/ D. Robinson). Journal of Educational and Behavioral Statistics, 34, 397-427, 2009.
2008
Why is a raven like a writing desk? Musing on the power of convention. The American Scientist, 96, 446-449, 2008.
Looking at blood sugar (with P. Velleman). Chance, 21(4), 56-61, 2008.
Giving the finger to dating services (with G. Lee & P. Velleman). Chance, 21(3), 59-61, 2008.
Computerized Adaptive Testing. In Corsini’s Encyclopedia of Psychology, 4th edition (P. Rossi ed.), John Wiley & Son: New York., 2008, pages 376-378.
Improving graphic displays by controlling creativity (with discussion). Chance, 21(2), 46-53, 2008.
Until Proven Guilty: False Positives and the War on Terror .(With S. Savage), Chance, 21(1), 55-58, 2008.
A Bayesian method for studying DIF: A cautionary tale filled with surprises and delights (with E. Bradlow, X. Wang, & E. Muller). Journal of Educational and Behavioral Statistics, 33, 363-384, 2008.
2007
Science and the SAT. Princeton Alumni Weekly, 4-5. November 7, 2007.
L’Equazione piu Pericolosa, Le Science, 470, 80-87. October, 2007.
A Psychometric Cicada: Educational Measurement returns. Educational Researcher, 36(8), 485-486, 2007.
A Profile of Susan E. Embretson. (w/ D. Robinson). Journal of Educational and Behavioral Statistics, 32, 431-439, 2007.
Taking a Chance: An interview with William F. Eddy and Stephen E. Fienberg. Chance, 20(4), 33-39, 2007.
A Catch-22 in assigning primary delegates (With A. Gelman), Chance, 20(4), 6-7, 2007
Improving data displays: ours and the media’s, Chance, 20(3), 8-16, 2007
The most dangerous equation. American Scientist, 95(3), 249-256, 2007.
Galton’s normal is too platykurtic. Chance, 20(2), 57-58, 2007
Insignificant is not zero: Rescoring the SAT as an example. Chance, 20(1), 55-58, 2007.
Value-Added Modeling (with Henry Braun). In Handbook of Statistics (Volume 27) Psychometrics (Eds C. R. Rao and S. Sinharay). Elsevier Science, Amsterdam. 2007, pages 867-892.
Three statistical paradoxes in the interpretation of group differences: Illustrated with medical school admission and licensing data (with Lisa Brown). Chapter 26 in the Handbook of Statistics (Volume 27) Psychometrics (Eds C. R. Rao and S. Sinharay). Elsevier Science, Amsterdam. 2007, pages 893-918.
A Profile of Roderick McDonald. (w. D. Robinson). Journal of Educational and Behavioral Statistics, 32, 315-332, 2007.
A Profile of Fumiko Samejima. (w. D. Robinson). Journal of Educational and Behavioral Statistics, 32, 206-222, 2007.
2006
Profiles in Research: R. Darrell Bock (with Dan Robinson). Journal of Educational and Behavioral Statistics, 31(1), 101-122, 2006.
Profiles in Research: Arthur Jensen (with Dan Robinson). Journal of Educational and Behavioral Statistics, 31(3), 327-352, 2006.
Chance Conversation with Judith Tanur. Chance, 19(4), 52-57, 2006.
A modern classic expands and improves: A review of the 2nd edition of Leland Wilkinson’s The Grammar of Graphics, Psychometrika, 71, 603, 2006.
Logical and empirical evidence that smaller schools do not improve student achievement (with Harris Zwerling). The Phi Delta Kappan, 87, 300-303, 2006.
Finding what is not there through the unfortunate binning of results: The Mendel effect (with M. Gessaroli & M. Verdi) , Chance, 19(1), 49-52, 2006.
How’s your wife? A review of Defending standardized testing by Richard Phelps. Journal of Educational Measurement, 43(1), 77-84, 2006.
Using graphs to make the complex simple: The Medicare drug plan as an example, Chance, 19(2), 55-56, 2006.
On model-based inferences: A fitting tribute to a giant. Chapter 4 in D. Hantula (ed.) Methodological & Theoretical Advances in Social & Organizational Psychology, Hillsdale, NJ: Lawrence Erlbaum Associates, 2006, pps. 61-73.
An application of Testlet Response Theory in the scoring of a complex certification exam (with L. M. Brown , E. T. Bradlow, X. Wang, W, P. Skorupski, & J. Boulet). In D. M. Williamson, R. J. Mislevy, & I. I. Bejar(eds.) Automated Scoring of Complex Tasks in Computer Based Testing. Hillsdale, NJ: Lawrence Erlbaum Associates, 2006, Chapter 6, pps. 169-200.
Statistical Graphics: A guidepost for scientific discovery. (with Paul F. Velleman). In Complementary methods for research in education (3rd edition). (edited by Green, J. L., Camilli, G., & Elmore, P.B.) Washington, D.C.: American Educational Research Association, 2006, pps. 605-621..
2005
Profiles in Research: Howard Wainer (Interview by Dan Robinson). Journal of Educational and Behavioral Statistics, 30(4), 465-476.
Playfair, William (with Ian Spence). Encyclopedia of Social Measurement, Volume 3, p. 71-79, 2005.
Chance Conversation with Martha Farnsworth Riche. Chance, 18(4), 48-51., 2005.
William Playfair and his graphical inventions (with I. Spence). The American Statistician, 59(3), 224-229, 2005.
Old Mother Hubbard and the United Nations: An adventure in exploratory data analysis.. (with discussion) (with D. Vasilescu). Chance,18(3), 38-45, 2005.
Truth is slower than fiction: Francis Galton as an illustration (with B. Clauser). Chance,18(4), 52-54, 2005.
Shopping for colleges when what we know ain’t. Journal of Consumer Research, 32(3), 337-342, 2005.
Non Random Sampling. In B. Everitt & D. Howell (eds.). Encyclopedia of Statistics in Behavioral Sciences (Volume 3). London: Wiley, 2005, pps. 1430-1433.
Graphical presentation of longitudinal data (with I. Spence). In B. S. Everitt & D. C. Howell (eds.). Encyclopedia of Statistics in Behavioral Sciences. Volume 2, Chichester: Wiley, 2005, pps. 762-772. (https://www.researchgate.net/publication/229725498_Graphical_Presentation_of_Longitudinal_Data)
A Bayesian method for evaluating passing scores: The PPoP curve (with Xiaohui Wang, William P. Skorupski, and Eric Bradlow). Journal of Educational Measurement, 42(3), 271-281, 2005.
Was it ethnic and social-class bias or was it statistical artifact? Logical and empirical evidence against Freedle’s method for reestimating SAT scores (with W. P. Skorupski), Chance, 18(2), 17-24, 2005..
Stumbling on the path toward the visual communication of complexity. Chance,18(2), 53-54, 2005.
Item and Test Bias. (with Stephen Sireci). Encyclopedia of Social Measurement (volume 2) (K. Kempf-Leonard, editor) . San Diego, CA: Elsevier Academic Press. 365-371, 2005.
William Playfair and the Invention of Statistical Graphs. (with Ian Spence). Encyclopedia of Social Measurement(volume 3) (K. Kempf-Leonard, editor) . San Diego, CA: Elsevier Academic Press. 71-80, 2005.
Resizing triathalons for fairness (with R. de Veaux) pages 317-321 in Anthology of Statistics in Sports. J. H. Albert, J. Bennett, & J. J. Cochran (Eds.) Philadelphia, PA: Society for Industrial and Applied Mathematics, 2005.
2004
An Editor’s Gratitude: Reviewer Acknowledgement. Journal of Educational and Behavioral Statistics, 29(4), 489-490, 2004.
User’s Guide for SCORIGHT (Version 3.0): A computer program for scoring tests built of testlets including a module for covariate analysis (with Xiaohui Wang & Eric Bradlow). ETS Technical Report RR-04-49. Princeton, NJ: Educational Testing Service.
On Assessing the Quality of Physician’s Clinical Judgment: The Search for Dependent Variables (with Janet Mee), Evaluation & the Health Professions, 27(4), 369-382, 2004.
Two statistical paradoxes in the interpretation of group differences: Illustrated with medical school admission and licensing data (with L. Brown). The American Statistician, 58, 117-123, 2004
Value Added Assessment: An introduction and history, Journal of Educational and Behavioral Statistics, 29(1), 1-4, 2004.
When form violates function. Chance,17(3), 49-52, 2004.
Curbstoning IQ and the 2000 presidential election. Chance,17(4), 43-46, 2004.
Nobody’s perfect. (with Michael Friendly). Chance,17(2), 48-51, 2004.
Numbers and the remembrance of things past. (with Henry Braun), Chance,17(1), 44-48, 2004.
How much does extra time on the SAT help? (with B. Bridgeman, M. Najarian and C. Trapani). Chance, 17(2), 19-24, 2004.
The promises and pitfalls of making national educational assessments adaptive: America’s assessment as an example. Metodología de las Ciencias del Comportamiento (Methodology of Behavioural Sciences), 5(2), 211-224, 2004.
2003
John Wilder Tukey: Statistical inventor, discoverer and revolutionary. Statistical Science, 18(3), 285-286, 2003.
Editor’s Forward to: “Comparing harm done by mobility and class absence: missing students and missing data,” by Michelle Dunn, Joseph Kadane and John Garrow, Journal of Educational and Behavioral Statistics, 28(3), 267-268, 2003.
One cheer for null hypothesis significance testing. In Methodological Issues & Strategies in Clinical Research (3rd Edition). A. E. Kazdin (ed.). Washington, DC: American Psychological Association, 461-464, 2003.
Shaping Up the Practice of Null Hypothesis Significance Testing. (with D. H. Robinson). Educational Researcher,32(7), 22-30, 2003.
A political statistic. (with Daniel Koretz) Chance,16(4), 45-47, 2003.
La diffusion de quelques idées: A master’s voice. Chance,16(3), 58-61, 2003.
How long is short? Chance,16(2), 55-57, 2003.
A graphical legacy of Charles Joseph Minard: Two jewels from the past. Chance,16(1), 56-60, 2003.
2002
A Small Hurrah for the Black Death (with S. Zabell). Chance,15(4), 58-60, 2002.
The BK-Plot: Making Simpson’s Paradox clear to the masses. Chance,15(3), 60-62, 2002.
On the Past and Future of Null Hypothesis Significance Testing (with D. H. Robinson). Journal of Wildlife Management, 66, 263-271, 2002.
“Reporting Test Results in Education.” In the Encyclopedia of Psychological Assessment, R. Fernandez-Ballesteros (ed). New York: Sage, 2002.
….and still champion: A review of the Second Edition of Edward Tufte’s
The Visual Display of Quantitative Information. Psychometrika, 67, 173-178, 2002.
A general Bayesian model for testlets: Theory and applications (with X. Wang & E. Bradlow). Applied Psychological Measurement, 26(1), 109-128, 2002.
Clear thinking made visible: Redesigning score reports for students. Chance,15(1), 56-58, 2002.
Reporting Test Results to Institutions and Nations. Chance, 15(2), 58-61, 2002.
On the automatic generation of test items: Some whens, whys and hows. In Item Generation for Test Development (S. Irvine & P. Kyllonen, Eds.). Hillsdale, N.J. : Lawrence Erlbaum Associates, pages 287-305, 2002.
Remembering Sam Messick. In Item Generation for Test Development (S. Irvine & P. Kyllonen, Eds.). Hillsdale, N.J. : Lawrence Erlbaum Associates, page xxxi, 2002.
2001
Winds across Europe: Francis Galton and the graphic discovery of weather patterns Chance,14(4), 44-47, 2001.
Review of Presenting your findings: A practical guide for creating tables by Adelheid A. M. Nichol & Penny M. Pexman, Teachers College Review, 103, 93-98, 2001.
Statistical Graphics: Mapping the Pathways of Science (with P. Velleman). The Annual Review of Psychology, 52, 305-335, 2001.
Sex, Smoking and Life Insurance. Chance, 14(3), 42-45, 2001.
On the alienation of content and evidence from commercial design. Chance,14(3) 37-39, 2001.
Overview of Test Scoring (with D. Thissen). In D. Thissen & H. Wainer (eds.) Test Scoring. Hillsdale, NJ: Lawrence Erlbaum Associates, 2001, Chapter 1, pps. 1-20.
True Score Theory: The Traditional Method. (with D. Thissen). In D. Thissen & H. Wainer (eds.) Test Scoring. Hillsdale, NJ: Lawrence Erlbaum Associates, 2001, Chapter 2, pps. 21-72.
Augmented Scores – “Borrowing Strength” to compute scores based on small numbers of items (with J. L Vevea, F. Camacho, B. Reeve, K. Rosa, L. Nelson, K. Swygert, & D. Thissen). In D. Thissen & H. Wainer (eds.) Test Scoring. Hillsdale, NJ: Lawrence Erlbaum Associates, 2001, Chapter 9, pps. 343-388.
New tools for exploratory data analysis: III. Smoothing & Nearness Engines. Chance,14(1), 43-46, 2001.
Graphical Details: A review of Leland Wilkinson’s The Grammar of Graphics. Psychometrika, 66, 307-310, 2001.
William Playfair (1759-1823): An inventor and ardent advocate of statistical graphics (with Ian Spence). In Statisticians of the Centuries (C. C. Heyde & E. Seneta, eds.).Springer-Verlag: New York, 105-110, 2001.
Order in the court. Chance,14(2), 43-46, 2001.
Review of Understanding USA. Chance 14(2), 37-39, 2001.
2000
Cholera, Rocket Ships and Tom’s Veggies: Contemporary and historical ideas toward the effective communication of school performance. Evaluation and Research in Education, 14, 148-180, 2000.
Narrow and Shallow: Further Comments on Statistical Methods in Psychology Journals (L. Wilkinson & the rest of the APA Task Force on Statistical Inference). (2000). American Psychologist, 55, 965-966.
CATs: Whither and whence. Psicologica, 21(1), 121-133, 2000.
Empirical evidence in support of Kelley’s Paradox: A Response to Zaslavsky. Chance, 13(3), 3-4, 2000.
New tools for exploratory data analysis: I. Automating 2-way table decomposition. Chance, 13(3), 43-47, 2000.
New Tools For Exploratory Data Analysis: II. Rotatable SPLOMS & A Slicing Engine. Chance, 13(4), 45-47, 2000.
The Centercept: An estimable and meaningful regression parameter. Psychological Science, 11, 434-436, 2000.
Review of Understanding USA. Print, 54(3), 34 & 194, June/July 2000.
Frederic Mather Lord (1912-2000). Educational Measurement: Issues and Practice, 19, 24-25, 2000.
Frederic Mather Lord (1912-2000) (with M. Stocking). Psychometrika, 65, 143-144, 2000.
Frederic Mather Lord (1912-2000). Chance, 13(2), 8, 2000.
Testing the disabled: Using statistics to navigate between the Scylla of standards and the Charybdis of court decisions. Chance, 13(2), 42-44, 2000.
Using a New Statistical Model for Testlets to Score TOEFL. (with X. Wang). Journal of Educational Measurement, 37,203-220, 2000.
Kelley’s Paradox. Chance, 13(1), 47-48, 2000.
Assessing time trends in sex differences in swimming & running (with C. Njue & S. Palmer). (with discussions) Chance, 13(1), 10-15, 2000.
Sex and Sports and Martin and Price: A Rejoinder (with S. Palmer & C. Njue). Chance, 13(1), 21, 2000.
Rescuing Computerized Testing by Breaking Zipf’s Law. Journal of Educational and Behavioral Statistics, 25, 203-224, 2000.
Caveats, pitfalls and unexpected consequences of implementing large-scale computerized testing (with D. Eignor). In H. Wainer et al, Computerized Adaptive Testing: A Primer (2nd edition). Hillsdale, NJ: Lawrence Erlbaum Associates, 2000, Chapter 10, pps. 271-300.
The Aptitude-Achievement Function: An Aid for Allocating Educational Resources, with an Advanced Placement Example (with W. Lichten). Educational Psychology Review, 12(2), 201-228, 2000.
Testlet Response Theory: An analog for the 3-PL useful in adaptive testing (with E. Bradlow and Z. Du). In Computerized adaptive testing: Theory and practice (W.J. van der Linden & C.A.W. Glas, Eds.). Boston, MA: Kluwer-Nijhoff, 2000, Chapter 13, pps. 245-270.
Maximum Marginal Likelihood and Expected A Posteriori estimates for the testlet response model (with C. Glas & E. Bradlow). In Computerized adaptive testing: Theory and practice (W.J. van der Linden & C.A.W. Glas, Eds.). Boston, MA: Kluwer-Nijhoff, 2000, Chapter 14, pps. 271-288.
Some paths toward making Praxis scores more useful. (with K. Sheehan & X. Wang). Journal of Educational Measurement, 37,113-140, 2000.
1999
Statistical methods in psychology journals: Guidelines and explanations. (L. Wilkinson & the rest of the APA Task Force on Statistical Inference). (1999). American Psychologist, 54, 594-604.
Comparing the incomparable: An essay on the importance of big assumptions and scant evidence. Educational Measurement: Issues and Practice, 18, 10-16, 1999.
Is the Akebono School failing its best students? An Hawaiian adventure in regression. Educational Measurement: Issues and Practice, 18, 26-33, 1999.
Some comments on the Ad Hoc Committee’s critique of the Massachusetts Teacher Tests. Education Policy Analysis Archives, 7(5), Entire issue, 1999.
Alternative Displays for Communicating NAEP Results: A Redesign and Validity Study (with R. K. Hambleton and K. Meara). Journal of Educational Measurement, 36, 301-335, 1999.
A graphical investigation of the scourge of Vietnam. Chance, 12(4), 44-46, 1999.
Reynold B. Johnson (1906-1998) Chance, 12(2), 9-10, 1999.
The soul of wit. Contemporary Psychology, 44, 22-23, 1999.
A Bayesian random effects model for testlets (with E. T. Bradlow and X. Wang). Psychometrika, 64, 153-168, 1999.
Scaling the Market. Chance, 12(3), 43-44, 1999.
Simpson’s Paradox. Chance, 12(2), 43-44, 1999.
A Puzzle Solved? Chance, 12(1), 42-43, 1999.
The most dangerous profession: A note on non sampling error. Psychological Methods, 4,250-256, 1999.
One cheer for null hypothesis significance testing. Psychological Methods, 4(2), 212-213, 1999.
1998
Some statistical and logical considerations when rescoring tests (with E. T. Bradlow). Statistica Sinica, 8, 713-728, 1998.
Rounding Tables. Chance, 11(1), 46-50, 1998.
No Order in the Court. Chance, 11(3), 39-41, 1998.
The graphical inventions of Dubourg and Ferguson: Two precursors to William Playfair. Chance, 11(4), 39-41, 1998.
Publication delays in statistics journals (with E. T. Bradlow). Chance, 11(1), 42-45, 1998.
Toward a coherent view of reliability in test theory. (with Heng Li). Journal of Educational and Behavioral Statistics, 23, 478-484, 1998.
Psychometrics: An Overview (with S. Sireci and H. Braun). In Encyclopedia of Biostatistics (P. Armitage & T. Colton, editors) London: John Wiley & Sons LTD, 1998.
A selection of selection anomalies (with S. J. Palmer, & E. T. Bradlow). Chance, 11(2), 3-7, 1998.
1997
Like a trout in the milk. Chance, 10(4), 34-36, 1997.
Tom’s veggies and the American way. Chance, 10(3), 40-42, 1997.
Graphical birth announcements, Chance, 10(2), 58-60, 1997.
William Playfair: A Daring Worthless Fellow (with Ian Spence), Chance, 10(1), 31-34, 1997.
Who was Playfair? (with Ian Spence), Chance, 10(1), 35-37, 1997.
How reliable are TOEFL scores? (with R. Lukhele). Educational and Psychological Measurement, 57(5), 749-766, 1997.
Managing the influence of DIF from big items: The 1988 Advanced Placement History test as an example (with R. Lukhele). Applied Measurement in Education, 10(3) , 201-215, 1997.
“The history of test development” (with R. F. Ittenbach & I. G. Esters). Chapter 2 in D. P. Flanagan, J. Genshaft, & P. L. Harrison (Eds.) Beyond traditional assessment: Contemporary and emerging theories, tests, and issues. New York: Guilford Publications. pps. 17-31, 1997.
Some Multivariate displays for NAEP Results. Psychological Methods, 2, 34-63, 1997.
Improving tabular displays: with NAEP tables as examples and inspirations. Journal of Educational and Behavioral Statistics, 22, 1-30, 1997.
1996
A Priestley View of International Stock Exchanges, Chance, 9(4), 31-33, 1996.
Scaling the heights (and widths) Chance, 9(3), 43-49, 1996.
Why Playfair? Chance, 9(2), 43-52, 1996.
Depicting error. The American Statistician, 50(2) , 101-111, 1996.
How is reliability related to the quality of test scores? What is the effect of local dependence on reliability? (with D. Thissen). Educational Measurement: Issues and Practice, 15(1), 22-29, 1996.
Using trilinear plots for NAEP data. Journal of Educational Measurement, 33,41-55, 1996.
A Nobel Plot. (with J. Durso). Chance, 9(1), 12-16, 1996.
1995
Measurement problems. In D. Laveault, B. D. Zumbo, M. E. Gessaroli, & M. W. Boss (Eds. ) Modern theories in measurement: Problems and issues. Ottawa: University of Ottawa Press. pps. 375-407, 1995.
On the viability of some untestable assumptions in equating exams that allow examinee choice (with X-b. Wang & D. Thissen), Applied Measurement in Education, 8(3) , 211-225, 1995.
Trilinear plots. Chance, 8(1), 48-54, 1995.
A rose by another name. Chance, 8(2), 46-51, 1995.
Graphical mysteries. Chance, 8(3), 52-56, 1995.
Picturing an LA bus schedule. Chance, 8(4), 44-48, 1995.
Precision & Differential Item Functioning on a testlet-based test: The 1991 Law School Admissions Test as an example. Applied Measurement in Education, 8(2), 157-187, 1995.
1994
Problèmes de mesure. Mesure et évaluation en éducation, 17(2), 115-146, 1994.
On the Academic Performance of New Jersey’s Public School Children: I. Fourth and Eighth Grade Mathematics in 1992, Education Policy Analysis Archives, 2(10), Entire issue, 1994.
Implicit graphs. Chance, 7(4), 44-48, 1994.
Making triathlons fair: The ultimate triathlon (with R. Deveaux). Swim Magazine, 10(6), 18-21, 1994.
Visual Aids When Comparing an Apple to the Stars. Chance, 7(3), 50-53, 1994.
Three Graphic Memorials. Chance, 7(2), 52-55, 1994.
Resizing triathlons for fairness (with R. Deveaux). Chance, 7(1), 20-25, 1994.
Todai moto kurashi. Chance, 7(1), 46-49, 1994.
On the relative value of multiple-choice, constructed response, and examinee-selected items on two achievement tests (with R. Lukhele & D. Thissen). Journal of Educational Measurement, 31,234-250, 1994.
How well can we compare scores on test forms that are constructed by examinees’ choice? (with X-b. Wang & D. Thissen) Journal of Educational Measurement, 31,183-199, 1994.
Are tests comprising both multiple-choice and free-response items necessarily less unidimensional than multiple-choice tests? An analysis of two tests. (with X-b. Wang & D. Thissen), Journal of Educational Measurement, 31,113-123, 1994.
On examinee choice in educational testing. (with D. Thissen). Review of Educational Research, 64, 159-195, 1994.
1993
Does spending money on education help? A reaction to the Heritage Foundation and the Wall Street Journal. Educational Researcher, 22, 22-24, 1993.
Graphical Answers to Scientific Questions. Chance, 6(4), 48-50, 1993.
Tabular presentation. Chance, 6(3), 52-56, 1993.
Making readable overhead displays. Chance, 6(2), 46-49, 1993.
Combining multiple choice and constructed response test scores: Toward a Marxist theory of test construction. (with D. Thissen) Applied Measurement in Education, 6, 103-118, 1993.
How much more efficiently can humans run than swim? Chance, 6, 17-21, 1993.
Graphs in the presidential campaign: Why weren’t they used by more than one candidate? Chance, 6, 48-51, 1993.
The Validity of the SAT at the University of Hawaii: A riddle wrapped in an enigma (with T. Saka & J. R. Donoghue), Educational Evaluation and Policy Analysis, 15, 91-98, 1993.
Graphing multiple comparisons: Some comments on Tukey. Journal of Computational and Graphical Statistics, 2,35-40, 1993.
Measurement problems. Journal of Educational Measurement, 30,1-21, 1993.
Some research problems encountered at the Educational Testing Service (with E. Johnson, C. Lewis & R. Mislevy). Journal of Official Statistics, 9, 189-201, 1993.
Some practical considerations when converting a linearly administered test to an adaptive format. Educational Measurement: Issues and Practice, 12, 15-20, 1993.
Detection of differential item functioning using the parameters of item response models (with D. Thissen & L. Steinberg). In P. W. Holland & H. Wainer (Eds. ) Differential Item Functioning. Hillsdale, NJ: Lawrence Erlbaum Associates, 1993, Chapter 4, pps. 67-113.
Model-based standardized measurement of an item’s differential impact. In P. W. Holland & H. Wainer (Eds. ) Differential Item Functioning. Hillsdale, NJ: Lawrence Erlbaum Associates, 1993, Chapter 6, pps. 123-135.
Graphical data analysis. (with D. Thissen). In G. Keren & C. Lewis (Eds. ), A handbook for data analysis in the behavioral sciences: Statistical issues (Chapter 13, pp. 391-457). Hillsdale, NJ: Lawrence Erlbaum Associates, 1993.
1992
Sense-lining. Chance, 5, 71-72, 1992.
Sex differences in performance on the mathematics section of the Scholastic Aptitude Test: A bidirectional validity study (with L. Steinberg). Harvard Educational Review, 62, 323-336, 1992.
A comparison of the performance of simulated hierarchical and linear testlets (with B. Kaplan & C. Lewis). Journal of Educational Measurement, 29,243-251, 1992.
Review of SAS System for Statistical Graphics by Michael Friendly (with P. Pashley). Journal of the American Statistical Association, 87, 899-900, 1992.
Prologue — How the following article came to be. Educational Researcher, 21, 12-13, 1992.
Understanding graphs and tables. Educational Researcher, 21, 14-23, 1992.
A harmless necessary CAT. Contemporary Psychology, 37, 149-150, 1992.
1991
Elegance, Grace, Impact and Graphical Displays. Chance, 4(4), 45-47, 1991.
Integrating figures and text. Chance, 4(3), 58-60, 1991.
The Isthmus of Acceptance: A graphical tool for function-based item analysis
and test construction. Journal of Educational Statistics, 16, 109-124, 1991.
Humble pie. Chance, 4(2), 52-53, 1991.
Double Y-axis graphs. Chance, 4(1), 50-51, 1991.
Building algebra testlets: A comparison of hierarchical and linear structures (with C. Lewis, B. Kaplan, & J. Braswell). Journal of Educational Measurement, 28, 311-323, 1991.
Differential testlet functioning: Definitions and detection (with S. G. Sireci and D. Thissen). Journal of Educational Measurement, 28, 197-219, 1991.
On the reliability of testlet-based tests (with S. G. Sireci and D. Thissen). Journal of Educational Measurement, 28, 237-247, 1991.
Adjusting for differential base-rates: Lord’s Paradox again. Psychological Bulletin, 109, 147-151, 1991.
1990
Measuring graphicacy. Chance, 3(4), 52 & 58, 1990.
Edwards & Cummings’ “Fuzzy Truncation Model” is a step in the right direction. (with P. W. Holland). Applied Measurement in Education, 3(4), 377-380, 1990.
Graphical visions from William Playfair to John Tukey. Statistical Science, 5, 340-346, 1990.
Confidence envelopes for item response theory (with D. Thissen). Journal of Educational Statistics, 15, 113-128, 1990.
The first four millennia of mental testing: From ancient China to the computer age. The Score, 13, 4-5,11-13, April, 1990.
Adjusting NAEP for self-selection: A useful place for “Wall Chart” technology? Journal of Educational Statistics, 15,1-7, 1990.
Toward a psychometrics for testlets (with Charles Lewis). Journal of Educational Measurement, 27, 1-14, 1990.
Sources of uncertainty often ignored in adjusting state mean SAT scores for differential participation rates: The rules of the game. (with P. W. Holland) Applied Measurement in Education, 3, 167-184, 1990.
An introduction to computerized adaptive testing. In H. Wainer et al, Computerized Adaptive Testing: A Primer. Hillsdale, NJ: Lawrence Erlbaum Associates, 1990, Chapter 1, pps. 1-22.
Item response theory, item calibration and proficiency estimation (with R. Mislevy). In H. Wainer, et al, Computerized Adaptive Testing: A Primer. Hillsdale, NJ: Lawrence Erlbaum Associates, 1990, Chapter 4, pps. 65-102.
Validity (with L. Steinberg & D. Thissen). In H. Wainer, et al, Computerized Adaptive Testing: A Primer. Hillsdale, NJ: Lawrence Erlbaum Associates, 1990, Chapter 8, pps. 187-232.
Future challenges (with N. Dorans, B. Green, R. Mislevy, L. Steinberg & D. Thissen). In H. Wainer, et al, Computerized Adaptive Testing: A Primer. Hillsdale, NJ: Lawrence Erlbaum Associates, 1990, Chapter 9, pps. 233-272.
1989
Eelworms, bulletholes & Geraldine Ferraro: Some problems with statistical adjustment and some solutions. Journal of Educational Statistics, 14, 121-140, 1989 (with discussions). Reprinted in Shaffer, J. P. (Ed. ) (1992). The role of models in nonexperimental social science (pps. 129-148). Washington, D. C. : American Educational Research Association & American Statistical Association.
Responsum. Journal of Educational Statistics, 14, 187-200, 1989. Reprinted in Shaffer, J. P. (Ed. ) (1992). The role of models in nonexperimental social science (pps. 195-207). Washington, D. C. : American Educational Research Association & American Statistical Association.
Graphical visions from William Playfair to John Tukey. Proceedings of the American Statistical Association: Sesquicentennial Invited Paper Sessions (pps. 382-390). Washington, DC: The American Statistical Association, 1989.
The future of item analysis. Journal of Educational Measurement, 26(2), 191-208, 1989.
Making essay test scores fairer with statistics (with H. Braun) In J. Tanur, et al. Statistics: A guide to the unknown (3rd edition) San Francisco: Holden Day, 1989, pps. 178-187.
1988
Review of Rousseuw & Leroy’s Robust Regression and Outlier Detection. Journal of Educational Statistics, 13, 358-364, 1988.
How accurately can we assess changes in minority performance on the SAT? American Psychologist, 43, 774 – 778, 1988.
Use of item response theory in the study of group differences in trace lines. (with D. Thissen & L. Steinberg). In H. Wainer and H. Braun (Eds. ), Test Validity ( 147-169) Hillsdale, N. J. : Lawrence Erlbaum Associates, 1988.
Statistical history from a Stigler for detail. Contemporary Psychology, 33, 293-295, 1988.
Plotting in the Modern World: Statistics Packages and Good Graphics. (with D. Thissen) Chance,1, 10 – 20, 1988
1987
Estimating ability with the wrong model. (with D. Thissen) Journal of Educational Statistics, 12, 339-368, 1987.
Deja view: A discussion of dynamic graphics for data analysis. Statistical Science, 2, 388-389, 1987. Reprinted in W. S. Cleveland & M. E. McGill (Eds. ) Dynamic graphics for statistics, (60-62). Belmont, CA: Wadsworth, 1988.
Item clusters and computerized adaptive testing: A case for testlets. (with G. Kiely) Journal of Educational Measurement, 24, 185-202, 1987.
Review of Chapman’s Plain Figures, Short Book Reviews, 7, 1, 1987.
1986
The SAT as a social indicator: A pretty bad idea. In H. Wainer (Ed. ) Drawing inferences from self-selected samples. (pp. 7-21)New York: Springer-Verlag, 1986.
Computer graphics for the scholar. (with D. Thissen) Scholarly Communication, 6, pps. 1, 11-16, 1986.
Minority contributions to the SAT score turnaround: An example of Simpson’s paradox. Journal of Educational Statistics, 11, 229-244, 1986.
He knows the words but not the music. Contemporary Psychology, 31, 792-793, 1986.
Review of The Statistical Exorcist by M. Hollander & F. Proschan (with L. Wainer) Psychometrika, 51, 341-343, 1986.
XTREE: A multivariate graphical icon applicable in the evaluation of statistical estimators. (with D. Thissen) The American Statistician, 40, 149-153, 1986.
Can a test be too reliable? Journal of Educational Measurement, 23, 171-173, 1986.
Five pitfalls encountered while trying to compare states on their SAT scores. Journal of Educational Measurement, 23, 69-81, 1986.
1985
Minority advances in test performance: A response to Jones. American Psychologist, 40, 103, 1985.
On “State Education Statistics” (with P. Holland, S. Swinton, & M. Wang) Journal of Educational Statistics, 10, 293-325, 1985.
1984
Psychology and mathematics. The American Scientist, 72, 208, 1984.
An exploratory analysis of performance on the SAT. Journal of Educational Measurement, 21, 81-91, 1984.
How to display data badly. The American Statistician, 38,137-147, 1984.
Was there one distractor too many? (with J. R. J. Wadkins & A. Rogers) Journal of Educational Statistics, 9, 5-24, 1984.
1983
Review of The Visual Display of Quantitative Information by E. R. Tufte. Psychometrika, 48, 645-647, 1983.
Foreword to Bertin’s Semiology of Graphics. Madison, Wisconsin: University of Wisconsin Press, 1983.
Multivariate displays. In M. H. Rizvi, J. Rustagi & D. Siegmund (Eds. ), Recent advances in statistics (pp. 469-508). New York: Academic Press, 1983.
Are we correcting for guessing in the wrong direction? In D. J. Weiss (Ed. ) New horizons in testing: Latent trait test theory and computerized adaptive testing (pp. 63-80). New York: Academic Press, 1983.
Gapping. In S. Kotz, N. L. Johnson and C. B. Read (Eds. ) Encyclopedia of Statistical Sciences, Vol. 3 (pp. 301-304). New York: John Wiley & Sons, 1983.
Pyramid power: Searching for an error in test scoring with 830,000 helpers. The American Statistician, 37, 87-91, 1983.
Reply to Oderwald and others. The American Statistician, 37, 351-352, 1983.
Toward the measurement and prediction of victim proneness. (with D. Thissen) Journal of Research in Crime and Delinquency, 20, 243-261, 1983.
How are we doing? A review of Social Indicators III. Journal of the American Statistical Association, 78, 492-496, 1983.
On item response theory and computerized adaptive tests: The coming technological revolution in testing. The Journal of College Admissions, 28, 9-16, 1983.
1982
Some standard errors in item response theory (with D. Thissen). Psychometrika,47, 397-412, 1982.
Robust statistics: A survey and some prescriptions. In G. Keren (Ed. ) Statistical and methodological issues in psychology and social sciences research. (pp. 187-216). Hillsdale, N. J. : Lawrence Erlbaum Associates, 1982.
Robust estimation of parole outcome. (with A. M. B. Morgan) Journal of Research on Crime and Delinquency, 19, 84-109, 1982.
1981
A parameterization of recidivism. Evaluation Review, 5, 810-821, 1981.
An excellent item. Contemporary Psychology, 26, 680-682, 1981.
Influence enhanced scatter plots. (with L. Baker & D. Thissen) Psychological Bulletin, 90, 179-184, 1981.
Reply to Abt and Meyer. The American Statistician, 35, 57-58, 1981.
Discussion of Kleiner & Hartigan’s trees and castles. Journal of the American Statistical Association, 76, 272-275, 1981.
Graphical data analysis. (with D. Thissen). In M. R. Rosenzweig & L. W. Porter (Eds. ), Annual Review of Psychology (pp. 191-241). Palo Alto, CA: Annual Reviews, 1981.
1980
Making newspaper graphs fit to print. In P. Kolers, M. E. Wrolstad, & H. Bouma (Eds. ), Processing of Visible Language: 2. (pp. 125-142), New York: Plenum, 1980. (Republished in two parts: Chapel Hill, NC, Newspaper design notebook, 1981, 2, pps. 1, 10-16 and 1981, 3, pps. 1, 3-5. ).
Quantitative approaches to the study of parole. (with R. Perline). In S. E. Fienberg & A. J. Reiss (Eds.) Indicators of Crime and Criminal Justice: Quantitative Studies. Washington, D. C. : U. S. Department of Justice, 1980, 59-60.
A timely error. Royal Statistical Society News and Notes. 7, 6, 1980.
A review of estimation procedures for the Rasch Model with an eye toward longish tests. (with J. E. Gustafsson & A. M. B. Morgan). Journal of Educational Statistics, 4, 35-64, 1980.
A test of graphicacy in children. Applied Psychological Measurement, 5, 331-340, 1980.
An empirical inquiry into human understanding of “Two Variable Color Maps. ” (with C. Francolini), The American Statistician, 34, 81-93, 1980. Also in the Proceedings of the First General Conference on Social Graphics. (Tech. Report No. 49, pps. 80-113) Washington, D. C. : Bureau of the Census, 1980.
Review of Exploratory Data Analysis by F. Hartwig and B. E. Dearing. Psychometrika, 45, 499, 1980.
Robust estimation of ability in the Rasch model. (with B. D. Wright) Psychometrika, 45, 373-391, 1980.
1979
Current uses of the computer in medicine. Journal of the American Osteopathic Association, 79, 7, 1979.
On the assessment of skeletal maturity. American Journal of Clinical Nutrition, 32, (6), 1184-1185, 1979.
On the robustness of a class of naive estimators. (with D. Thissen) Applied Psychological Measurement, 3(4), 543-551, 1979.
Review of R. A. Fisher: The life of a scientist by J. F. Box. Psychometrika, 44, 253‑254, 1979.
The Rasch model as additive conjoint measurement. (with R. Perline & B. D. Wright) Applied Psychological Measurement, 3(3), 237-256, 1979.
1978
A discussion of D. B. Rubin’s “Multiple imputation in sample surveys: A phenomenological Bayesian approach to nonresponse. ” In Imputation and Editing of Faulty or Missing Survey Data, Washington, D. C. : Bureau of the Census, 1978.
Assessing the efficacy of visual displays. (with M. Reiser) In Proceedings of the 1976 American Statistical Association Meetings (Social Statistics Section), Part I, 89-92. Reprinted in Graphic presentation of statistical information (Technical Report No. 43, pp. 83-88) Washington, D. C. : Bureau of the Census, 1978.
Gapping. (with S. Schacht) Psychometrika, 43, 203-212, 1978.
On the sensitivity of regression and regressors. Psychological Bulletin, 85, 267-273, 1978.
Predicting adult stature without skeletal age and without paternal stature. (with S. Bell & A. F. Roche) Pediatrics, 61, 569-572, 1978.
Predicting the impact of simple and compound life change events. (with D. Fairbank & R. Hough) Applied Psychological Measurement, 2, 313-322, 1978.
Reply to Noyes. (with A. D. Biderman) The Cartographic Journal, 15 (2), 104, 1978.
1977
EXPAK: A FORTRAN IV program for exploratory data analysis. (with D. Thissen) Applied Psychological Measurement, 1, 49-50, 1977.
Introduzione All’Inferenza Bayesiana. In R. P. Runyon and A. Haber’s Fondamenti di statistica. (pp. 228-232). Amsterdam: Inter-European Editions, 1977.
Late elongation of the cranial base. (with A. B. Lewis, R. McCartin & A. F. Roche) Journal of Dental Research, 56, 802-808, 1977.
Measuring the effects of a liberal arts education on the perception of poetry. (with P. Schofer) American Educational Research Journal, 14, 125-135, 1977.
Review of Exploratory Data Analysis by John W. Tukey. Psychometrika, 42, 635-638, 1977.
Some methodological comments on evaluating maps. (with A. D. Biderman) The Cartographic Journal, 14, 109-114, 1977.
Speed vs. reaction time as a measure of cognitive performance. Memory and Cognition, 5, 278-280, 1977.
1976
Baudelaire in the classroom: An application of multidimensional scaling in educational evaluation. (with W. J. Berg). Sciences de l’Art — Scientific Aesthetics, 1, 57-66, 1976.
Estimating coefficients in linear models: It don’t make no nevermind. Psychological Bulletin, 83, 213-217, 1976.
Hereditary and environmental determinants of growth in height in a longitudinal sample of children and youth of Guatemalan and European ancestry. (with F. E. Johnson, R. MacVean, & D. Thissen) The American Journal of Physical Anthropology, 44, 469-475, 1976.
Individual growth in stature: A comparison of four U. S. growth studies. (with R. D. Bock, A. F. Roche, & D. Thissen) Annals of Human Biology, 3, 529-542, 1976.
Robust statistics: A survey and some prescriptions. Journal of Educational Statistics, 1, 285-312, 1976.
Rorschach revisited: A new look at an old test. (with L. Aiken & S. Hurt) Journal of Clinical and Consulting Psychology, 41, 390-399, 1976.
Three steps toward robust regression. (with D. Thissen) Psychometrika, 41, 9-34, 1976.
Two programs for the prediction of stature in individuals. (with D. Thissen) Pediatrics, 58, 368-369, 1976.
1975
Multivariate semi-metric smoothing in multiple prediction. (with D. Thissen). Journal of the American Statistical Association, 70, 568-573, 1975.
A double logistic comparison of growth patterns of normal children and children with Down’s syndrome. (with G. L. Rarich, V. A. Seedfeldt, & D. Thissen). Annals of Human Biology, 2, 339-346, 1975.
The RWT method for the prediction of adult stature. (with A. F. Roche, & D. Thissen) Pediatrics, 56, 1026-1033, 1975.
When jackknifing fails (or does it?) (with D. Thissen). Psychometrika, 40, 113-114, 1975.
1974
Multidimensional scaling of concept learning in an introductory course. (with K. Kaye) Journal of Educational Psychology, 66, 591-598, 1974.
Museums USA: A Type III error. Museum News, 53, 42-44, 1974.
Predicting the outcome of the Senate trial of Richard M. Nixon. Behavioral Science, 19, 404-406, 1974.
The Roche-Wainer-Thissen method of predicting adult stature. (with A. F. Roche, & D. Thissen) In the Proceedings of the Compe-Rendu de la XXIIe Reunion des Equipes Charge des Etudes sur la Croissance et le Developpement de l’Enfant Normal. Paris, 50-62, 1974.
TREBIG: A 360/75 FORTRAN program for three mode factor analysis (designed for big data sets). (with M. Blair & G. Gruvaeus) Behavioral Research Methods and Instrumentation, 6(1), 53-54, 1974
Using variance as a discriminator in lie detection. (with M. Blair, G. Gruvaeus, & N. Zill) Journal of Applied Psychology, 57, 110-112, 1974.
1973
A parameterization of individual human growth curves. (with R. D. Bock, J. Murray, A. Peterson, A. F. Roche, & D. Thissen) Human Biology, 45, 63-80, 1973.
CATJUD: An IBM 370 FORTRAN IV program using the method of successive intervals (Law of Categorical Judgment). (with G. Bond) Behavioral Science, 18, 223-225, 1973.
GAPPER: An IBM 360 program for finding gaps in univariate data strings. (with D. Thissen) Behavioral Science, 18, 77-78, 1973.
Senatorial decision making: I. The determination of structure. (with G. Gruvaeus & N. Zill) Behavioral Science, 18, 7-19, 1973.
Senatorial decision making: II. Prediction (with G. Gruvaeus & N. Zill) Behavioral Science, 18, 20-26, 1973.
The other tail. The British Journal of Mathematical and Statistical Psychology, 26, 182-187, 1973.
1972
A practical note on one-tailed tests. The American Psychologist, 27, 775-776, 1972.
Basic principles of measurement, data analysis and hypothesis testing. In R. Lana & R. Rosnow, Introduction to Contemporary Psychology, (pp. 413-439). New York: Holt, Rinehart, Winston, 1972.
The dimensions of de Maupassant: A multidimensional analysis of students’ perception of literature. (with W. J. Berg) American Educational Research Journal, 9, 485-491, 1972.
Blurring. (with G. Bond) Psychotherapy: Theory, Research and Practice. 19, 9-10, 1972.
MOCA: A 360/65 program for Multiple-Ordered Cluster Analysis. (with G. Gruvaeus) Behavioral Science, 17, 490, 1972.
On style in college textbooks. Educational Researcher, 1, 13-14, 1972.
Two additions to hierarchical cluster analysis. (with G. Gruvaeus) The British Journal of Mathematical and Statistical Psychology, 25, 200-206, 1972.
1971
A 360/65 computer program for stem-and-leaf displays and third generation statistics. (with G. Bond) Behavioral Science, 16, 422-423, 1971.
A CDC 6400 program for the clustering of distances from Eckhart-Young decomposition. Behavioral Science, 16, 415-416, 1971.
A multidimensional analysis of school satisfaction. (with U. Gluskinos) American Educational Research Journal, 8, 423-434, 1971.
Some methodological notes on Gluskinos and Wainer. American Educational Research Journal, 8, 567-571, 1971.
Piecewise regression: A simplified procedure. The British Journal of Mathematical and Statistical Psychology, 24, 83-92, 1971.
TREMOD: A computer program for three mode factor analysis. (with G. Gruvaeus & F. Snyder) Behavioral Science, 16, 421-422, 1971.
1970
A computer program for the principal components analysis of learning data. Behavioral Science, 15, 206-207, 1970.
Personality and group impression formation as a function of the amount of overlap in evaluative meaning of the stimulus elements. (with R. Arms & R. Rosnow) Sociometry, 33, 472-484, 1970.
1969
Anderson’s personality-trait words rated by men and women as a function of sex of stimulus. (with R. Arms & R. Rosnow) Psychological Reports, 24, 787-790, 1969.
Civis, smartphones and score reports. Part of an invited symposium on score reports at the annual meeting of NCME. New York, April 16, 2018.
Graphs as poetry. Princeton University, Princeton, N.J. on February 21, 2018.
http://princetonaaa.org/posts/417
Graphs as poetry. New York University, New York, NY. on February 7, 2018.
Graphs as poetry. Given at the Educational Testing Service in Princeton, N.J. on January 18, 2018.
Debts to the past: Building on History. Invited Symposium on Communicating Statistics to the Public. Joint Statistical Meetings, Baltimore, MD August 2, 2017.
On the historical development of W.E.B. Du Bois’ graphical narrative of a people. Invited Lecture in the Department of Informatics at The New School for Social Research, given in New York City, May 1, 2017.
Four easy pieces. Given at the Educational Testing Service in Princeton, N.J. on March 22, 2017.
Four easy pieces. Invited Lecture in the Department of Statistics, University of Michigan, given in Ann Arbor, Michigan, March 31, 2017.
On the historical development of W.E.B. Du Bois’ graphical narrative of a people. Invited Lecture in the Department of Statistics, University of Michigan, given in Ann Arbor, Michigan, March 31, 2017.
Four easy pieces. E. F. Lindquist Memorial Lecture given in Washington, D.C. at AERA, April 10, 2016.
How to display data badly. Part of a workshop on data display given in Washington, D.C. at AERA, April 8, 2016.
How to extract sunbeams from cucumbers. Part of a workshop on data display given in Washington, D.C. at AERA, April 8, 2016.
Causal Inference and Death, The Center for Positive Psychology, University of Pennsylvania, Philadelphia, PA, July 22, 2015
Pictures at an Exhibition: Sixteen Visual Conversations about One Thing. Banquet Speaker at ICSA/Graybill Conference. Ft. Collins, CO, June 16, 2015.
Discussion of David Thissen’s Item Response Theory, Serendipity, and Bad Questions. Invited Discussion at the annual meeting of NCME Chicago, April 18, 2015.
Arguing for More Experimentation in Education: Four Studies That Need Doing. Invited Lecture at the annual meeting of AERA Chicago, April 17, 2015.
Causal Inference and happiness, Center for Human Values, Princeton University, Princeton, NJ, April 14, 2015.
Causal Inference, happiness and experiments in testing, Educational Testing Service, Princeton, NJ, March 3, 2015.
For want of a nail: Why worthless subscores may be seriously impeding the progress of Western Civilization. Department of Educational Psychology, Kansas University, Lawrence, KS, March 13, 2015.
Arguing for More Experimentation in Education: Four Studies That Need Doing. Department of Educational Psychology, Kansas University, Lawrence, KS, March 12, 2015.
Uneducated Guesses: Three examples of how mistreating missing data yields misguided educational policy. Epidemiology and Biostatistics Department of Drexel University, Philadelphia, PA, January 21, 2015.
Uneducated Guesses: Three examples of how mistreating missing data yields misguided educational policy. Statistics Department of Cornell University, Ithaca, New York, October 15, 2014.
An Argument for More Experimentation in Education: Four Studies that Need Doing. The University of Pennsylvania (Department of Psychology), Philadelphia, PA August 1, 2014.
Pictures at an Exhibition: Sixteen Visual Conversations about One Thing. SAS Institute , Cary, NC, March 21, 2014
Tabular Presentation. SAS Institute, Cary, NC, March 21, 2014
A conversation with Howard Wainer. A Webcast from the SAS Institute. September 1, 2014. Link to view webcast: jmp.com/premiere/wainer
How to detect cheating badly. Annual Joint Statistical Meetings, Boston, MA August 3, 2014..
Uneducated Guesses: Three examples of how mistreating missing data yields misguided educational policy. Key Note Address, Psychometric Society, Madison Wisconsin, July 24, 2014.
The Science of Measurement: The 1st 4000 Years on the Road to USMLE as the Shibboleth of Modern Medical Licensure. The Centenary Celebration of the National Board of Medical Examiners, Washington, DC, April, 4, 2014.
Uneducated Guesses: Three examples of how mistreating missing data yields misguided educational policy. Key Note Address, Association of Test Publishers, Phoenix, AZ, March 3, 2014.
Uneducated Guesses: Two examples of how mistreating missing data yields misguided educational policy. NYU Steinhardt Education Policy Breakfast, February 21, 2014.
Pictures at an Exhibition: Sixteen Visual Conversations about One Thing. Keynote address at the annual meeting of the American Medical Informatics Association, Washington DC, November 16, 2013.
Scoring tests with contaminated response vectors. (with Arnond Sakworawich). The 2nd Annual Conference on the Statistical Detection of Potential Test Fraud,
Madison, WI, October 17-19, 2013.
Detecting terrorists. Interview on BBC World News, June 1, 2013, 4:30PM GMT.
http://www.bbc.co.uk/programmes/b01snyk3
Two ideas we need to teach the media (and everyone else). Annual Joint Statistical Meetings, Montreal, Canada, August 3, 2013.
Pictures at an Exhibition: Sixteen Visual Conversations about One Thing. Keynote address at the annual meeting of the Society for Epidemiologic Research. Boston, Massachusetts, June 19, 2013.
JPSM Short Course: Pictures at an Exhibition: The Visual Display of
Quantitative Phenomena. University of Michigan, Institute for Social Research, Washington DC, April 8, 2013.
Some thoughts on the feasibility of AchieveNJ for evaluating teachers. NJ State Board of Education, Trenton, NJ, April 3, 2013.
Pictures at an Exhibition: Sixteen Visual Conversations about One Thing. Keynote address at the Netherlands Society of Statistics, Utrecht, Holland, March 21, 2013.
Two ideas we need to teach the media (and everyone else). Institute of Mathematics, Leiden University, Leiden, Holland, March 22, 2013.
Scoring tests with contaminated response vectors, National Center for Assessment in Higher Education, Riyadh, Saudi Arabia, December 4, 2012.
Uneducated Guesses: Three examples of how mistreating missing data yields misguided educational policy. National Institute of Testing and Evaluation, Jerusalem, Israel, December 11, 2012.
Pictures at an Exhibition: The role of visual displays in an evidence-based science, National Institute of Testing and Evaluation, Jerusalem, Israel, December 12, 2012.
Scoring tests with contaminated response vectors. National Institute of Testing and Evaluation, Jerusalem, Israel, December 12, 2012.
Workshop on Graphics: Pictures at an Exhibition: The Visual Display of
Quantitative Phenomena. Bureau of the Census, Washington, D.C., November 8, 2012.
Workshop on Graphics: Pictures at an Exhibition: The Visual Display of
Quantitative Phenomena. Research Triangle Institute, Research Triangle, North Carolina, July 10, 2012.
How to detect cheating badly. Keynote Speaker at the Conference on Statistical Detection of Possible Test Fraud. Kansas University, Lawrence, KS, May 23, 2012.
Detection of Aberrant Responses, Discussant. at the Conference on Statistical Detection of Possible Test Fraud. Kansas University, Lawrence, KS, May 24, 2012.
On the role of replication in the advance of science: The survival of the fittist. Workshop on Statistical Methods in Diagnostic Assessments. Department of Statistics, Columbia University, New York, N.Y. April 27, 2012.
Uneducated Guesses: Using Evidence to Uncover Misguided Education Policy. Distinguished Visiting Lecturer. The Graduate School of Education of the University of Pennsylvania. Philadelphia, PA, February 13, 2012.
Uneducated Guesses: Three examples of how mistreating missing data yields misguided educational policy. The Philadelphia Chapter of the American Statistical Association – – Philadelphia, PA, January 27, 2012.
Uneducated Guesses: Three examples of how mistreating missing data yields misguided educational policy. The University of Massachusetts – – Invited Seminar sponsored by the departments of statistics and education. Amherst, MA, October 11, 2011
Pictures at an Exhibition: The role of visual displays in an evidence-based science,. The University of Massachusetts – Invited Seminar sponsored by the departments of statistics and education. Amherst, MA, October 11, 2011.
Uneducated Guesses: Three examples of how mistreating missing data yields misguided educational policy. Princeton Public Library – “An Evening with a Public Intellectual” Series. .Princeton, NJ September 14, 2011.
Educating Guesses: Three examples of how a little data can reduce a lot of errors in educational policy, Joint Statistical Meetings, Miami, Florida, August 4, 2011
Uneducated Guesses: Three examples of how mistreating missing data yields misguided educational policy. Statistics Department of Stanford University, Stanford, California, May 31, 2011.
A workshop on graphic display. Cleveland Chapter of the ASA, Cleveland, Ohio, May 16, 2011.
Value Added Models: Their role in evaluating teachers. Educational Testing Service, Princeton, NJ, January 19, 2011.
Testing Screw-ups. Department of Psychology, University of Kansas, Lawrence, Kansas, November 12, 2010.
Pictures at an Exhibition: The role of visual displays in an evidence-based science, University of Kansas, Lawrence, Kansas, November 12, 2010.
On the Crucial Role of Empathy in the Design of Score Reports. ETS Invitational Conference on Score Reporting, Princeton, New Jersey, November 4, 2010.
VAM 1.01 and other related topics aimed at improving education. Governor’s Educator Effectiveness Council. Annapolis, Maryland, September 22, 2010.
Testing Screw-ups. ACT, Iowa City, Iowa, April 28, 2010,
Hip Psychometrics. ACT, Iowa City, Iowa, April 28, 2010,
Pictures at an Exhibition: The role of visual displays in an evidence-based science. The University of Notre Dame, South Bend, Indiana, March 26, 2010.
Hip Psychometrics. The University of Notre Dame, South Bend, Indiana, March 26, 2010.
Hip Psychometrics. The College Board, Newtown, Pennsylvania, March 12, 2010.
Some useful Epistemology for Improving Health Care. National Board of Medical Examiners, Philadelphia, PA, March 9, 2010.
Hip Psychometrics. 25th Anniversary Workshop on Item Response Theory. University of Twente, Enschede, The Netherlands. October 15, 2009.
Pictures at an Exhibition: The role of visual displays in an evidence-based science. The Samuel J. Messick Career Achievement Award Invited Lecture. Division 5 of the American Psychological Association Conference. Toronto, Canada, August 8, 2009.
Using the SAT as an Educational Indicator: A Successful Application. Looking Back: A Conference in Honor of Paul W. Holland. Educational Testing Service, Princeton, NJ, September 19-20, 2008.
14 conversations about three things. Part of an invited symposium at the 2008 meeting of the National Council on Measurement in Education. New York, New York, March 25, 2008.
Schrodinger’s cat, Rasch’s P and the most dangerous equation. Invited address at the 2008 meeting of the National Council on Measurement in Education. New York, New York, March 26, 2008.
The most dangerous equation, GIS conference, Greenville, SC, October 17, 2007.
Value-added modeling. A conference at AAMC, June 25, 2007, Washington, D.C.
Value-added modeling. In an invited symposium entitled “Accountability, Measurement, and Value-Added Models,” at the 2007 meeting of the National Council on Measurement in Education. Chicago, Illinois, April 12, 2007.
Using testlet response theory to understand a survey of breast cancer patients. Department of Statistics, the University of Vermont. Burlington, VT, March 5, 2007.
The most dangerous equation. Educational Testing Service, Princeton, NJ, February 7, 2007.
The most dangerous equation. Senior Honors Psychology Seminar, University of Pennsylvania. Philadelphia, PA, January 29, 2007.
The most dangerous equation. Department of Statistics, Duke University, Durham, NC, December 1, 2006.
The most dangerous equation. Department of Statistics, Cornell University, Ithaca, NY, November 15, 2006.
Three challenges to the practicality of value-added models. The Curry School of Education,The University of Virginia. Charlottesville, VA, November 2, 2006.
The most dangerous equation. Department of Statistics ,The University of Virginia. Charlottesville, VA, November 2, 2006.
The most dangerous equation. Department of Psychology ,The University of Vermont. Burlington, VT, September 29, 2006.
Using testlet response theory to understand a survey of breast cancer patients. NIH PROMIS Conference, Gaithersburg, MD, September 11, 2006.
Three challenges to the practicality of value-added models. Department of Education, The University of Massachusetts. Amherst, MA, April 24, 2006.
Graphic Discovery: Sixteen short tales. Senior Honors Psychology Seminar, University of Pennsylvania. Philadelphia, PA, February 20,, 2006.
Logical and empirical evidence that smaller schools do not improve student achievement. The College Board, New York, February 1, 2006.
What happens if you don’t require the SAT? Bowdoin College as an example. The College Board, New York, February 1, 2006.
Three challenges to the practicality of value-added models. The College Board, New York, February 1, 2006.
Graphic Discovery: Sixteen short tales. The Germantown Society for Science and the Arts. Philadelphia, PA, January 23, 2006.
Three paradoxes in the interpretation of group differences. The Department of Psychology, The University of North Carolina, Chapel Hill, November 14, 2005.
Three challenges to the practicality of value-added models. University Lecture, The University of North Carolina, Chapel Hill, November 14, 2005.
Interviewed on Berkeley Groks. KALX 90.7 FM, Berkeley, CA, April 4, 2005
Three challenges to the practicality of value-added models. Talk to the Chicago Chapter of the American Statistical Association on May 6, 2005.
Visual Discovery: Data display whither and whence. A Workshop sponsored by the American Educational Research Association, Montreal Canada, April 10, 2005.
Three challenges to the practicality of value-added models. Talk in the Department of Statistics of the Wharton School of the University of Pennsylvania, Philadelphia, Pennsylvania. on April 6, 2005.
Three challenges to the practicality of value-added models. Talk as part of a panel discussion at Temple University, Philadelphia, Pennsylvania. on March 23, 2005.
Three challenges to the practicality of value-added models. Keynote address at the National Conference of the National Education Association, Austin, Texas, December 3, 2004.
Three challenges to the practicality of value-added models. Talk at National Board of Medical Examiners, Philadelphia, Pennsylvania. on November 16, 2004
Chance Musings. Department of Psychology, the University of Pennnsylvania, Philadelphia, Pennsylvania. November 15, 2004.
Value-added assessment. South Eastern Regional Conference of the Pennsylvania State Education Association, Galloway, NJ, October 15, 2004.
How to display data badly. Department of Psychology, the University of Vermont, Burlington, Vermont. September 10, 2004.
Chance Musings. Educational Testing Service, Princeton, New Jersey. September 29, 2004.
Chance Musings. National Board of Medical Examiners, Philadelphia, Pennsylvania. October 18, 2004.
A graphical legacy of Charles Joseph Minard: Two jewels from the past. Annual meeting of the American Statistical Association, Toronto, Canada. August 11, 2004.
Freedle’s Folly. Annual meeting of the Statistical Society of Canada, Montreal, Canada. June 1, 2004.
How to display data badly. University of Texas at Austin. April 23, 2004.
Three statistical paradoxes. . University of Texas at Austin. April 23, 2004.
A workshop on the effective display of NAEP data. Westat. San Francisco, California. January 27, 2004.
Graphical Discovery – a series of lectures at Wabash College, Crawfordsville, Indiana. October 20-22, 2003.
Three paradoxes in the interpretation of group differences: Illustrated with data on medical school admissions and licensing. The Department of Economics, the University of Pennsylvania. October 6, 2003, Philadelphia, PA.
How to display data badly. American Association of Advertising Agencies. Boca Raton, Florida. September 8, 2003.
A workshop on effective display. American Association of Public Opinion Research. Nashville, TN. May 15, 2003.
Three paradoxes in the interpretation of group differences: Illustrated with data on medical school admissions and licensing. Educational Testing Service. Princeton, NJ. January 24, 2003.
How to display data badly. Princeton University, School of Engineering. Princeton, NJ. November 20, 2002.
Three paradoxes in the interpretation of group differences: Illustrated with data on medical school admissions and licensing. The Graduate School of Education, the University of Pennsylvania. November 6, 2002, Philadelphia, PA.
A trout in the milk. A workshop on graphical display sponsored by the Washington Statistical Society. October 23, 2002. Washington, D.C.
On examinee choice in educational testing. The Department of Statistics atThe Wharton School, The University of Pennsylvania, PA, March 27, 2002.
EDA whither and whence: A personal journey. Department of Statistics, University of Colorado-Denver and the Denver Area Chapter of the American Statistical Association. Denver Colorado, October 27, 2001
Testlet Response Theory. Annual Meeting of the Dutch Research Group on Item Response Theory, Enschede, The Netherlands. October 1-4, 2001.
John Wilder Tukey (1915-2000). Annual Meeting of the American Statistical Association, Atlanta, GA. August 6, 2001.
How to display data badly. National Board of Medical Examiners. Philadelphia, PA. August 3, 2001.
Testlet Response Theory. Annual Meeting of the Psychometric Society, Valley Forge, PA. June 23, 2001.
Cholera, Rocket Ships and Tom’s Veggies: Contemporary and historical ideas toward the effective communication of educational phenomena. Graduate School of Education, Teachers College, Columbia University, New York, NY, March 28, 2001.
Cholera, Rocket Ships and Tom’s Veggies: Contemporary and historical ideas toward the effective communication of educational phenomena. Graduate School of Education, Rutgers University, New Brunswick, NJ, January 22, 2001.
EDA whither and whence: A personal journey. Department of Statistics, Rutgers University, New Brunswick, NJ, November 8, 2000.
Cholera, Rocket Ships and Tom’s Veggies: Contemporary and historical ideas toward the effective communication of educational phenomena. Graduate School of Education, Harvard University, Cambridge, MA, November 4, 2000.
How to display data badly. Graduate School of Education, Harvard University, Cambridge, MA, November 4, 2000.
John Wilder Tukey and EDA: Its past and future. Department of Statistics, The Johns Hopkins University, Baltimore, MD, October 25, 2000.
EDA whither and whence: A personal journey. Keynote address at the Chicago Chapter of the American Statistical Association’s special conference on exploratory data analysis. Chicago, Illinois, May 5, 2000.
Lines in time: From The Creation to Tom’s Veggies. Department of Statistics, Columbia University, November 15, 1999.
Cholera, Rocket Ships and Tom’s Veggies: Contemporary and historical ideas toward the effective communication of quantitative phenomena. Keynote address at the Second International Conference on Evidence-Based Policies & Indicator Systems. University of Durham, England, July 13, 1999.
Cholera, Rocket Ships and Tom’s Veggies: Contemporary and historical ideas toward the effective communication of quantitative phenomena. Keynote address at the 14th Annual Conference on Making Statistics More Effective in Schools of Business at Babson College on June 11, 1999.
Lines in time: From The Creation to Tom’s Veggies. Department of Atomic Physics, Yale University, October 9, 1998.
How to display data badly. Case Western Reserve University , Cleveland, OH, October 2, 1998.
Rescuing Computerized Testing by Breaking Zipf’s Law. Case Western Reserve University , Cleveland, OH, October 2, 1998.
How to display data badly. CHANCE Conference, Dartmouth College , Hanover, NH, July 10, 1998.
Lines in time: From The Creation to Tom’s Veggies. School of Communication, Cornell University , Ithaca, N.Y., April 10, 1998.
How to display data badly. School of Communication,Cornell University , Ithaca, N.Y., April 9, 1998.
How to display data badly. Rutgers University , New Brunswick, NJ, February 23, 1998.
Comparing the Incomparable: On the Importance of Big Assumptions and Scant Evidence. American Association for the Advancement of Science. Philadelphia, PA, February 17, 1998.
How to display data badly. The Princeton Chapter of the American Statistical Association , Princeton, NJ, February 10, 1998.
Cholera, Rocket Ships and Tom’s Veggies: Contemporary and historical ideas toward the effective communication of school performance.The Peg Jones Memorial Lecture given at the annual meeting of State Researchers of the National Education Association. Washington, DC, December 4, 1997.
Visual Revelations. Law School Admissions Council. Newtown Pennsylvania, September 23, 1997.
Visual Revelations. Hawaii State Department of Education. Honolulu, Hawaii, August 20, 1997.
How to display data badly. The Bureau of Labor Statistics, Washington, D.C., July 14, 1997.
Rescuing Computerized Testing by Breaking Zipf’s Law. Department of Education, University of Massachusetts, Amherst, MA, May 5, 1997.
Rescuing Computerized Testing by Breaking Zipf’s Law. Department of Statistics, Cornell University, Ithaca, NY, April 4, 1997.
Graphical Disasters: How to Construct or Avoid Them. The W. Edwards Deming Lecture at the 1996 Conference on Applied Statistics of the American Society for Quality Control. Atlantic City, NJ, December 11, 1996
How to display data badly. The Wharton School, The University of Pennsylvania, PA, December 4, 1996 and again April 21, 1997.
On Examinee Choice. Department of Statistics, Carnegie Mellon University, Pittsburgh, PA, May 17, 1996.
How to display data badly. Pittsburgh Chapter of the American Statistical Association, Pittsburgh, PA, May 16, 1996.
How to display data badly. Syracuse Chapter of the American Statistical Association, Syracuse, NY, March 29, 1996.
Data presentation. Keynote speaker at Conference on Indicators of Children’s Well-Being, Washington, D. C. , November 17, 1994.
How to display data badly. SIAM Annual Teachers’ Day Workshop, Philadelphia, PA, July 9, 1994.
NAEP and Hawaii. Invited address to the Hawai’ian State Department of Education. Honolulu, Hawai’i, February 17, 1994.
Understanding graphs and tables. . Annual Malcolm James Ree invited lecture at the Air Force’s Armstrong Laboratories in San Antonio, Texas, August 18, 1993.
Understanding graphs and tables. Annual Meeting of the Statistical Society of Canada. Nova Scotia, Canada, June 5, 1993
Understanding graphs and tables. Statistics and Operations Research Seminar, Department of Civil Engineering and Operations Research, Princeton University. Princeton, NJ, November 17, 1992.
Understanding graphs and tables. Hawaii State Department of Education, Honolulu, HI, February 10, 1992.
Measurement problems. Department of Educational Psychology, University of Hawaii, Honolulu, HI, February 10, 1992.
Understanding graphs and tables. Department of Psychology, Villanova University, December 6, 1991.
Graphical visions. Keynote address for Division D of the American Educational Research Association Meeting, Chicago, IL, April 4, 1991.
Eelworms, bulletholes & Geraldine Ferraro. Department of Ecology, Rutgers University, March 4, 1991.
Test results, self-selection and public policy. Keynote Speaker at Hawaiian Educational Association Meeting, Honolulu, HI, January 19, 1991.
At the Hebrew University in Jerusalem, under the sponsorship of Israel’s National Institute for Testing & Evaluation – February 1990.
“How to display data badly”
“Effective display: 1. Tables”
“Effective display: 2. Graphs”
“Effective display: 3. Multivariate data”
“Eelworms, bulletholes & Geraldine Ferraro: Drawing inferences from self- selected samples”
“Testlets: An idea whose time has come”
“Four potholes on the road to a CAT version”
“DIF & DAF: A review of statistically optimal model-based methods for the study of differential item and alternative functioning”
“The first four millennia of mental testing”
“The future of item analysis”
“The Isthmus of acceptance: A new tool for test construction”
How to display data badly. Featured speaker at National Education Association Workshop for Researchers, San Antonio, TX, November 29, 1989.
How to display data badly. Featured speaker at National Education Association Summer Workshop for State Association Leaders, Sun Valley, ID, July 13, 1989.
Workshop on “Effective display of information,” Office of Energy Information, Washington, DC, September 22-23, 1988.
How to display data effectively. American Demographics Institute, Washington, DC, September 15, 1988. (This was videotaped by PBS and broadcast in May 1989. )
Workshop on effective data display. Conference on Human Factors in Computing Systems. Washington, DC, May 15-16, 1988.
Workshop on effective data display. Ralston Purina Company, St. Louis, MO, May 5-6, 1988.
How to display data badly. The United Way, Los Angeles, CA, February 23, 1988.
Eelworms, bulletholes and Geraldine Ferraro: Some problems in adjusting for survey nonresponse. The East-West Demographic Center, Honolulu, HI, February 2, 1988.
Workshop on effective data display. University of North Carolina, Greensboro, NC, November 12, 1987.
Workshop on effective data display. Berlex Laboratories, Cedar Knolls, NJ: October 29-30, 1987.
How to display data badly. The Wharton School of the University of Pennsylvania, Philadelphia, PA, October 8, 1987.
Some problems in adjusting for survey non-response. Joint ETS-DOD Conference on job performance assessment. San Diego, CA, March 12, 1987.
Workshop on effective data display. The American Demographic Institute, Fort Lauderdale, Florida, February 11, 1987.
How to display data badly. Ontario Institute for Studies in Education. Toronto, Canada, November 21, 1986.
How to display data badly. The R. J. Reynolds Tobacco Company, Greensboro, NC, October 20, 1986.
Eelworms, bulletholes and Geraldine Ferraro: Some problems in adjusting for survey nonresponse. The Pennsylvania State University, State College, PA, October 10, 1986.
Promises and pitfalls of graduate admissions testing in the 21st century. GRE Board Retreat, Boston, MA, June 1986.
The SAT as an educational indicator. National Public Radio interview, March 1986.
Multivariate displays. Northern New Jersey Chapter of the American Statistical Association, Somerville, NJ, March 11, 1986.
Multivariate displays for exploratory analysis. Canadian Statistical Association Meeting, Banff, Alberta, Canada, May 7, 1986.
Eelworms, bullet holes and Geraldine Ferraro: Some problems in statistically adjusting for survey nonresponse. American Demographics Conference, Hollywood, FL, February 13, 1986.
The use of graphics in court: A workshop. Sponsored by the Hawaiian Association of Legal Assistants, Honolulu, HI, January 18, 1986.
How to display data badly. Statistics Canada, Ottawa, Canada, May 2, 1986.
How to display data badly. Department of Psychology, The Johns Hopkins University, Baltimore, MD, March 5, 1986.
How to display data badly. The East-West Demographic Center, Honolulu, HI, January 17, 1986.
Detecting differential item performance with IRT. Joint ETS-DOD Conference on Testing, Princeton, NJ, December 3, 1985.
Multivariate displays from Quipus to Faces. Philadelphia Chapter of the American Statistical Association, Temple University, Philadelphia, PA, November 12, 1985.
Multivariate displays from Quipus to Faces. American Mathematical Association, Rochester, NY, November 8, 1985.
The SAT as a social indicator. A pretty bad idea. University of Chicago, Chicago, IL, October 27, 1985.
Effective communication of quantitative information. Maryland State Test Directors, Ocean City, MD, October 4, 1985.
Some ways of looking at multivariate data (and some ways that they can look back). Annual meeting of the American Statistical Association, Las Vegas, August 1985.
How to display data badly. 31st Conference on the Design of Experiments in Army Research, Madison, WI, October 17-18, 1985.
How to display data badly. Cornell University, Department of Statistics, Ithaca, NY, September 25, 1985.
How to display data badly. NBC, Research Division, New York, NY, June 4, 1985.
How to display data badly. Bell Atlantic, Washington, DC, March 26, 1985.
How to display data badly. Department of Mathematics, Rochester Institute of Technology, Rochester, NY, November 14, 1984.
How to display data badly. General Foods, Cranbury, NJ, November 8, 1984.
How to display data badly. University of Manitoba, Department of Psychology, Winnipeg, Canada, November 29, 1984.
How to display data badly. Princeton University, Center for Energy and Environmental Studies, October 2, 1984.
How to display data badly. General Foods, Cranbury, NJ, November 29, 1984.
On multivariate display. General Foods, Cranbury, NJ, November 29, 1984.
Dynamic displays. General Foods, November 8, 1984.
The SAT as a social indicator. Interagency Conference on Child and Family Statistics, April 1984.
How to display data badly. AT&T, Philadelphia, PA, 1984.
How to display data badly. RCA, Hightstown, NJ, 1984.
Multivariate display. Yale University, New Haven, CT, March 1983.
An exploratory analysis of performance on the SAT. National Science Foundation, Washington, DC, October 1983.
How to display data badly. National Education Association, Washington, DC, October 1983.
How to display data badly. Bureau of the Census, Washington, DC, October 1983.
How to display data badly. Bureau of the Census, Washington, DC, December 1983.
How to display data badly. Bureau of Justice Statistics, Washington, DC, December 1983.
How to display data badly. AT&T, Washington, DC, December 1983.
How to display data badly. RCA, Princeton, NJ, December 1983.
How to display data badly. Department of Statistics, University of Wisconsin, November 1983.
How to display data badly. Department of Statistics, Princeton University, December 1983.
How to display data badly. Graduate School of Business, The University of Chicago, October 1983.
How to display data badly. American Educational Research Association, Annual Convention, Montreal, Canada, April 1983.
How to display data badly. McGill University, April 1983.
How to display data badly. Statistics Day, University of Delaware, April 1983.
Multivariate data display. Abt Associates, Cambridge, MA, March 1981.
How to display data badly. University of Pennsylvania, Philadelphia, PA, January 1983.
How to display data badly. Arizona State University, Tempe, AZ, November 1982.
How to display data badly. Military Testing Association, San Antonio, TX, November 1982.
How to display data badly. The College of William and Mary, Williamsburg, VA, October 1982.
How to display data badly. The National Center for State Courts, Williamsburg, VA, October 1982.
How to display data badly. American Statistical Association, Cincinnati, OH, August 1982.
How to display data badly. Sieman’s Corporation, Princeton, NJ, August 1982.
How to display data badly. Stanford University, Stanford, CA, July 1982.
How to display data badly. Bell Telephone Laboratories, Murray Hill, NJ, July 1982.
How to display data badly. International Business Machines Corporation, New York, July 1982.
Dynamic data display: An exhibition of pictures. A videotape and talk presented at: The National Science Foundation, September 1981; Princeton University, October 1981; Educational Testing Service Technology Fair, November 1981; and the National Institute of Justice, February 1982.
Are newspaper graphs getting fitter to print? Society of Newspaper Designers, Miami, November 1981.
Pyramid power: Searching for an error in test scoring with 830,000 helpers. The University of Chicago, October 1981.
Are we correcting for guessing in the wrong direction? The Military Testing Association, Washington, DC, October 1981.
Graphical data analysis. The Université de Montreal, April 1981.
Robust estimation in test models: Some epistemological questions. The Université de Montreal, April 1981.
Testing and test theory: Whither and whence. Educational Testing Service, Washington, DC, January 9, 1981.
The role of computers in the future of testing. National Public Radio interview, December 1980.
Multivariate data display: The “worst American state” as an example. European Meeting of the Psychometric Society, Groningen, The Netherlands, June 1980.
Robust estimation in latent trait models. Department of Psychology and the Institute for Human Development, University of California, Berkeley, January 8, 1980.
Multivariate data display. Department of Psychology and the Institute for Human Development, University of California, Berkeley, January 7, 1980.
Making newspaper graphics fit to print. Annual meeting of the American Association for the Advancement of Science, San Francisco, January 8, 1980.
Multivariate displays: Some methods and some examples. Department of Psychology, McGill University, November 5, 1979.
Making newspaper graphics fit to print. Montreal Chapter of the American Statistical Association, November 6, 1979.
Robust estimation of ability in the Rasch model. The Psychometric Society Meetings, Monterey, CA, June 8, 1979.
Robust estimation of ability in the Rasch model. The 1979 Computerized Adaptive Testing Conference, Minneapolis, MN, June 27-30, 1979.
Making newspaper graphs fit to print. Processing of Visible Language II, Niagara-on-the-Lake, September 3-7, 1979.
Graphical display. The University of Kansas, Department of Psychology, December 1978.
Graphical display. The University of Colorado, Institute of Behavioral Science, December 1978.
Graphical display. European Mathematical Psychology Association, Uppsala, Sweden, June 12, 1978.
Graphics, graphicacy and graphitti. Department of Psychology, University of Maryland, October 25, 1977.
Graphics, graphicacy and graphitti. Department of Psychology, Johns Hopkins University, October 21, 1977.
Graphics and graphicacy: Whither and whence. Department of Psychology, McGill University October 14, 1977.
Robust statistics: A survey and some prescriptions. Fourth Delaware Symposium on Curriculum, Learning and Instruction, June 10, 1977.
Graphical and tabular display: How and why. The Board of Directors of The National Assessment Centers for Crime and Delinquency, May 9, 1977.
One dimensional clustering. Citadel Invitational Conference on Clustering, March 25, 1977.
Graphics and graphicacy: Whither and whence. Educational Testing Service, March 30, 1977.
Graphics, graphicacy: Whither and whence. National Institute of Education, January 24, 1977.
Robust statistics: An introduction. Annual meeting of the Mathematical Psychology Group, New York, September 1, 1976.
Assessing the efficacy of visual displays. Symposium on Visual Displays for Social Science Data, Annual Meeting of the American Statistical Association, Boston, August 24, 1976.
Rorschach revisited: A new look at an old test. Symposium on Psychiatric Classification, joint meeting of the Psychometric Society and Classification Society, Iowa City, April 25, 1974.
Predicting individual voting behavior in the U. S. Senate. Seminar on Mathematical Models of Congress, Aspen, CO, June 16-23, 1974.
Foretelling the future: The use of multivariate statistics for the prediction of upcoming events. Summer Seminar in Multivariate Statistics, Jarvsø, Sweden, June 10, 1974.
Discussant in a symposium on exploratory data analysis. American Association for the Advancement of Science Convention, Washington, DC, December 27, 1972.
Senatorial decision making. University of Chicago School of Business-Research Colloquium, November 10, 1972.