Likelihoods, Scores and Measures

What is the "correct" estimate of a person's ability? Whatever the method used to estimate item difficulties, person measures are estimated as though the item difficulties are exactly known. But we can imagine several bases for estimation.

Maximum likelihood

What is the ability for which a person's set of responses is most likely to be observed? R. A. Fisher proposed this approach. In the Figure below, there are 5 items of logit difficulties, 0, 1, 2, 3, 4. The target person has a score of 3 out of 5. The likelihood of this score is the product of the probabilities of the responses made by the person. Different response strings "11100", "01110", "00111" have different likelihoods for a person of a particular ability. For a person of low ability, any of these response strings is very unlikely, similarly for a person of high ability. Somewhere in the middle of the ability range, these likelihoods will reach their peaks.

Since likelihoods are numbers very close to zero, it is convenient to take their logarithms and express them as negative numbers. The Figure shows a surprising feature of the Rasch model. The log-likelihoods, and so the likelihoods, of all three response strings (and all similar ones) have their maxima at the same measure! 2.6 logits is the person ability estimate given by the Method of Maximum Likelihood.

Estimation by Maximum Likelihood


Expected Score

Another approach, paralleling Gaussian least-squares, is to estimate the ability measure to be the measure at which the squared difference between the observed and expected score for the person is minimized. We can, in fact, reduce this difference to zero. The observed score is 3 out of 5. A low measure would predict a score less than 3, a high measure a score higher than 3. Somewhere a measure would exactly predict 3. The Figure shows that this occurs at a person ability estimate of 2.6 logits. Surprisingly, but conveniently, this is the same as the maximum likelihood estimate. This coincidence is a feature of the mathematical properties of the Rasch model.

Best Fit

Estimation by Chi-Squared


A third approach is to estimate the ability measure to be the value which gives the best fit according to some fit statistic. The second Figure shows the abilities estimated from three response strings based on minimizing a chi-square fit statistic. It is seen that different ways of making the same raw score yield different measures. Though this approach to estimation has a rich history, going back at least to Yule (1925), there is an arbitrariness in the choice of fit statistic, and an indeterminacy in the measure corresponding to a "score", that contradict the usual concept of "measurement."

John M. Linacre

Yule G.U. (1925) The growth of population and the factors which control it. Presidential address. Journal of the Royal Statistical Society 88 1-62 (261)


Likelihoods, Scores and Measures Linacre, J.M. … Rasch Measurement Transactions, 2001, 15:2 p. 815-6

Please help with Standard Dataset 4: Andrich Rating Scale Model



Rasch Publications
Rasch Measurement Transactions (free, online) Rasch Measurement research papers (free, online) Probabilistic Models for Some Intelligence and Attainment Tests, Georg Rasch Applying the Rasch Model 3rd. Ed., Bond & Fox Best Test Design, Wright & Stone
Rating Scale Analysis, Wright & Masters Introduction to Rasch Measurement, E. Smith & R. Smith Introduction to Many-Facet Rasch Measurement, Thomas Eckes Invariant Measurement: Using Rasch Models in the Social, Behavioral, and Health Sciences, George Engelhard, Jr. Statistical Analyses for Language Testers, Rita Green
Rasch Models: Foundations, Recent Developments, and Applications, Fischer & Molenaar Journal of Applied Measurement Rasch models for measurement, David Andrich Constructing Measures, Mark Wilson Rasch Analysis in the Human Sciences, Boone, Stave, Yale
in Spanish: Análisis de Rasch para todos, Agustín Tristán Mediciones, Posicionamientos y Diagnósticos Competitivos, Juan Ramón Oreja Rodríguez

To be emailed about new material on www.rasch.org
please enter your email address here:

I want to Subscribe: & click below
I want to Unsubscribe: & click below

Please set your SPAM filter to accept emails from Rasch.org

www.rasch.org welcomes your comments:

Your email address (if you want us to reply):

 

ForumRasch Measurement Forum to discuss any Rasch-related topic

Go to Top of Page
Go to index of all Rasch Measurement Transactions
AERA members: Join the Rasch Measurement SIG and receive the printed version of RMT
Some back issues of RMT are available as bound volumes
Subscribe to Journal of Applied Measurement

Go to Institute for Objective Measurement Home Page. The Rasch Measurement SIG (AERA) thanks the Institute for Objective Measurement for inviting the publication of Rasch Measurement Transactions on the Institute's website, www.rasch.org.

Coming Rasch-related Events
March 31, 2017, Fri. Conference: 11th UK Rasch Day, Warwick, UK, www.rasch.org.uk
April 2-3, 2017, Sun.-Mon. Conference: Validity Evidence for Measurement in Mathematics Education (V-M2Ed), San Antonio, TX, Information
April 26-30, 2017, Wed.-Sun. NCME, San Antonio, TX, www.ncme.org - April 29: Ben Wright book
April 27 - May 1, 2017, Thur.-Mon. AERA, San Antonio, TX, www.aera.net
May 26 - June 23, 2017, Fri.-Fri. On-line workshop: Practical Rasch Measurement - Core Topics (E. Smith, Winsteps), www.statistics.com
June 30 - July 29, 2017, Fri.-Fri. On-line workshop: Practical Rasch Measurement - Further Topics (E. Smith, Winsteps), www.statistics.com
July 31 - Aug. 3, 2017, Mon.-Thurs. Joint IMEKO TC1-TC7-TC13 Symposium 2017: Measurement Science challenges in Natural and Social Sciences, Rio de Janeiro, Brazil, imeko-tc7-rio.org.br
Aug. 7-9, 2017, Mon-Wed. In-person workshop and research coloquium: Effect size of family and school indexes in writing competence using TERCE data (C. Pardo, A. Atorressi, Winsteps), Bariloche Argentina. Carlos Pardo, Universidad Catòlica de Colombia
Aug. 7-9, 2017, Mon-Wed. PROMS 2017: Pacific Rim Objective Measurement Symposium, Sabah, Borneo, Malaysia, proms.promsociety.org/2017/
Aug. 10, 2017, Thurs. In-person Winsteps Training Workshop (M. Linacre, Winsteps), Sydney, Australia. www.winsteps.com/sydneyws.htm
Aug. 11 - Sept. 8, 2017, Fri.-Fri. On-line workshop: Many-Facet Rasch Measurement (E. Smith, Facets), www.statistics.com
Aug. 18-21, 2017, Fri.-Mon. IACAT 2017: International Association for Computerized Adaptive Testing, Niigata, Japan, iacat.org
Sept. 15-16, 2017, Fri.-Sat. IOMC 2017: International Outcome Measurement Conference, Chicago, jampress.org/iomc2017.htm
Oct. 13 - Nov. 10, 2017, Fri.-Fri. On-line workshop: Practical Rasch Measurement - Core Topics (E. Smith, Winsteps), www.statistics.com
Jan. 5 - Feb. 2, 2018, Fri.-Fri. On-line workshop: Practical Rasch Measurement - Core Topics (E. Smith, Winsteps), www.statistics.com
Jan. 10-16, 2018, Wed.-Tues. In-person workshop: Advanced Course in Rasch Measurement Theory and the application of RUMM2030, Perth, Australia (D. Andrich), Announcement
Jan. 17-19, 2018, Wed.-Fri. Rasch Conference: Seventh International Conference on Probabilistic Models for Measurement, Matilda Bay Club, Perth, Australia, Website
May 25 - June 22, 2018, Fri.-Fri. On-line workshop: Practical Rasch Measurement - Core Topics (E. Smith, Winsteps), www.statistics.com
June 29 - July 27, 2018, Fri.-Fri. On-line workshop: Practical Rasch Measurement - Further Topics (E. Smith, Winsteps), www.statistics.com
Aug. 10 - Sept. 7, 2018, Fri.-Fri. On-line workshop: Many-Facet Rasch Measurement (E. Smith, Facets), www.statistics.com
Oct. 12 - Nov. 9, 2018, Fri.-Fri. On-line workshop: Practical Rasch Measurement - Core Topics (E. Smith, Winsteps), www.statistics.com
The HTML to add "Coming Rasch-related Events" to your webpage is:
<script type="text/javascript" src="http://www.rasch.org/events.txt"></script>

 

The URL of this page is www.rasch.org/rmt/rmt152a.htm

Website: www.rasch.org/rmt/contents.htm