Repudiating the Faustian Bargain

"What if Ingeborg Heinrich, my student at the Institute for Advanced Studies in Vienna in the fall of 1973, had succeeded in her project of teaching me how to use Rasch models? I could have started several years earlier on the studies that made up my work in the 1980s, and perhaps we would have had, that much sooner, the result reported by Hout, Duncan, and Sobel in 1987, that a Rasch model for a pair of polytomous variables implies that the cross-classification in the population is quasi-symmetric [QS]."

"Let {Fij} (i=1,...,R; j=1,...,R) denote the expected [person] frequencies in the RxR contingency table [the cross-tabulation of two items, each with R categories]. We write QS as

Fij = ßißjαjδij

where ßij if i=j, δijij if i<>j, δii=1, i=1,...,R and παj=1" (Hout, Duncan, Sobel, 1987). This is close to a multiplicative form of the Rasch model for two polytomous items.

"And what if - now I am speculating about the future, so there is the bare possibility that the rumination will not be entirely fruitless - someone picks up on the amazing coincidence that QS is the key to these two apparently disparate conceptual domains [Rasch and mobility tables]? We are looking for a bright person with ten or twenty prime working years left. She could conceivably get her clue from my use of QS in testing the Rasch model for some Occupational Change in a Generation data deriving from Peter Blau's brilliant invention, the brother's education variable (Duncan 1990)."

"And what if - now it gets really wild - said investigator decides to take seriously the distinction between a scientific model and a mere statistical model? This distinction became salient to me in the paper Rogosa (1987) contributed ..."

"The critical distinction is between models that start with the individual process as opposed to models for relations among variables, of which path analysis, covariance structure analysis, and other causal modeling strategies are prominent examples. I see these models for relations among variables as statistical models without a substantive soul. Substantive processes happen to or act on individual units (persons), not to variables. And a useful model should be a representation of the relevant phenomena. Otherwise as Freedman finds with path analysis, `the technology tends to overwhelm common sense', and I feel that's because the technology has little or no link to common sense." (Rogosa, 1987)

"In what I had hoped would prove to be my last contribution to the sociological literature (Duncan and Stenbeck 1988), though not the last to be published, I mobilized every variety of rhetoric I knew to try to pound home this distinction and the absurd consequences of ignoring it."

"A statistical model may serve very well as a basis for inferences about multivariate population distributions. Unfortunately, the intellectual attractiveness of the problems of statistical inference that arise in working with complex cross-classifications makes it easy to mistake their solution for a contribution to scientific method. We feel it is time to re-establish the correct priorities. The design of investigations is the essential ingredient of scientific method, indeed, of empirical science itself. Data analysis by suitable statistical methods is a mere auxiliary to the central scientific task. It was the determination of what observations to make, under what conditions, that required the genius of a Tycho Brahe, a Galileo, a Mendel, or a Pasteur, all of whom could have made good use of statistical methods, had they been available, but none of whose discoveries could have been made by a platoon of statisticians." (Duncan and Stenbeck, 1988).

"The main point to emphasize here is that the postulate of probabilistic response must be clearly distinguished in both concept and research design from the stochastic variation of data that arises from random sampling of a heterogeneous population. The distinction is completely blurred in our conventional statistical training and practice of data analysis, wherein the stochastic aspects of the statistical model are most easily justified by the idea of sampling from a population distribution. We seldom stop to wonder if sampling is the only reason for making the model stochastic. The perverse consequence of doing good statistics is, therefore, to suppress curiosity about the actual processes that generate the data." (Duncan and Stenbeck, 1988)

"What if, in other words, some younger quantitative sociologist repudiates our Faustian bargain with statistics, the bargain which gave us instant, voluminous, and easy results - but results that often were mischievous or meaningless when they were not both?"

excerpted from Otis Dudley Duncan. 1992. What if? In Symposium: The American Occupational Structure: Reflections after Twenty-five Years. Contemporary Sociology, 21:5, 667-8.

Duncan, O.D. 1990. Family and Birth-Order Effects on Educational Attainment. pp. 167-77 in Structures of Power and Constraint: Papers in Honor of Peter M. Blau, edited by C. Calhoun, M.W. Meyer, and W.R. Scott. Cambridge: Cambridge University Press.

Duncan, O.D., Stenbeck, M. 1988. Panels and Cohorts: Design and Model in the Study of Voting Turnout. pp. 1-35 in Sociological Methodology 1988, edited by C. C. Clogg. Washington, DC: American Sociological Assoc.

Hout, M., Duncan, O.D., Sobel, M.E. 1987. Association and Heterogeneity: Structural Models of Similarities and Differences. pp. 146-84 in Sociological Methodology 1987, edited by C. C. Clogg. Washington, DC: American Sociological Association.

Rogosa, D. 1987. Casual [sic] Models Do Not Support Scientific Conclusions: A Comment in Support of Freedman. Journal of Educational Statistics 12:185-95.

Repudiating the Faustian bargain. Duncan O.D. … Rasch Measurement Transactions, 2000, 14:1 p.734




Rasch Publications
Rasch Measurement Transactions (free, online) Rasch Measurement research papers (free, online) Probabilistic Models for Some Intelligence and Attainment Tests, Georg Rasch Applying the Rasch Model 3rd. Ed., Bond & Fox Best Test Design, Wright & Stone
Rating Scale Analysis, Wright & Masters Introduction to Rasch Measurement, E. Smith & R. Smith Introduction to Many-Facet Rasch Measurement, Thomas Eckes Invariant Measurement: Using Rasch Models in the Social, Behavioral, and Health Sciences, George Engelhard, Jr. Statistical Analyses for Language Testers, Rita Green
Rasch Models: Foundations, Recent Developments, and Applications, Fischer & Molenaar Journal of Applied Measurement Rasch models for measurement, David Andrich Constructing Measures, Mark Wilson Rasch Analysis in the Human Sciences, Boone, Stave, Yale
in Spanish: Análisis de Rasch para todos, Agustín Tristán Mediciones, Posicionamientos y Diagnósticos Competitivos, Juan Ramón Oreja Rodríguez

To be emailed about new material on www.rasch.org
please enter your email address here:

I want to Subscribe: & click below
I want to Unsubscribe: & click below

Please set your SPAM filter to accept emails from Rasch.org

www.rasch.org welcomes your comments:

Your email address (if you want us to reply):

 

ForumRasch Measurement Forum to discuss any Rasch-related topic

Go to Top of Page
Go to index of all Rasch Measurement Transactions
AERA members: Join the Rasch Measurement SIG and receive the printed version of RMT
Some back issues of RMT are available as bound volumes
Subscribe to Journal of Applied Measurement

Go to Institute for Objective Measurement Home Page. The Rasch Measurement SIG (AERA) thanks the Institute for Objective Measurement for inviting the publication of Rasch Measurement Transactions on the Institute's website, www.rasch.org.

Coming Rasch-related Events
May 17 - June 21, 2024, Fri.-Fri. On-line workshop: Rasch Measurement - Core Topics (E. Smith, Winsteps), www.statistics.com
June 12 - 14, 2024, Wed.-Fri. 1st Scandinavian Applied Measurement Conference, Kristianstad University, Kristianstad, Sweden http://www.hkr.se/samc2024
June 21 - July 19, 2024, Fri.-Fri. On-line workshop: Rasch Measurement - Further Topics (E. Smith, Winsteps), www.statistics.com
Aug. 5 - Aug. 6, 2024, Fri.-Fri. 2024 Inaugural Conference of the Society for the Study of Measurement (Berkeley, CA), Call for Proposals
Aug. 9 - Sept. 6, 2024, Fri.-Fri. On-line workshop: Many-Facet Rasch Measurement (E. Smith, Facets), www.statistics.com
Oct. 4 - Nov. 8, 2024, Fri.-Fri. On-line workshop: Rasch Measurement - Core Topics (E. Smith, Winsteps), www.statistics.com
Jan. 17 - Feb. 21, 2025, Fri.-Fri. On-line workshop: Rasch Measurement - Core Topics (E. Smith, Winsteps), www.statistics.com
May 16 - June 20, 2025, Fri.-Fri. On-line workshop: Rasch Measurement - Core Topics (E. Smith, Winsteps), www.statistics.com
June 20 - July 18, 2025, Fri.-Fri. On-line workshop: Rasch Measurement - Further Topics (E. Smith, Facets), www.statistics.com
Oct. 3 - Nov. 7, 2025, Fri.-Fri. On-line workshop: Rasch Measurement - Core Topics (E. Smith, Winsteps), www.statistics.com

 

The URL of this page is www.rasch.org/rmt/rmt141e.htm

Website: www.rasch.org/rmt/contents.htm