Georg Rasch and Item Fit

Georg Rasch didn't expect all kinds of items to fit a Rasch model in all kinds of frames of reference, so he was always extremely careful about testing the items to see whether there was something wrong with the way they had been constructed or with the theory underlying the items. He was in fact an absolute fundamentalist when it came to model checking not only for the Rasch model, but for all kinds of statistical models.

Rasch 1960 Figure 14

Figure 14. Subtest F of BPP. lri plotted against lr. for each group of items. From Rasch (1960) "Probabilistic Models for Some Intelligence and Attainment Tests".

Graphical techniques were very important to Rasch. He had a principle saying (in Danish) that you should "tegne" before you "regne" (meaning "plots" before "calculations") and he had a lot of students (including Peter Allerup) doing the plots for him. He would never draw the ICC curves as we do today. Rasch plotted the logistic values of the probabilities against estimates of person parameters (or similar but more complicated functions of the item parameters against the total scores) because it is much easier to assess systematic departures from straight lines than departures from logistic curves (See Figure from Rasch, 1960).

In addition to these plots he would, of course, also use numerical tests and he would always insist that these calculations should be made relative to the conditional distribution of item responses given the total score to make sure that he had separated his inference on items from the persons.

You can find some of this in his 1960 book, but far from all. We know that he at some point worked on a sequel to the book that he never finished. When we celebrated his centenary in 2001 we published a collection of his unpublished papers and notes. (You can find this collection at www.rasch.org/rasch.htm). Among these papers we included a chapter on "Estimation of Parameters and Control of the Model for Two response Categories" where he describes five different methods including a test for the hypothesis that the item discrimination is the same for all items and including much of the theory of conditional inference that Erling B. Andersen worked on and published during the 70'es. It is quite interesting reading so take a look at it. You can find it at www.rasch.org/memo196y.pdf.

Rasch's view on item fit analyses were that evidence against the item means that it should be either revised (if at all possible) or removed. That goes both for items where item discrimination is too weak and items where discrimination is too strong (Infits and/or Outfits that are smaller than 1). That is also my point of view, but the interpretation of the lack of fit of the item is very different for items that do not discriminate and items with too strong discrimination. In the first case I would suspect inept item writing or multidimensionality. In the second case I would always look for evidence of local response dependence (LD) because I know that positive local dependence has the effect that the item discrimination of the items look stronger than expected by the Rasch model. It is my experience this is the case in many of the analyses where I find evidence of too strong discrimination. You can find one such example in
Kreiner S (2011) A Note on Item-Restscore Association in Rasch models. Applied Psychological Measurement, 35, 557-561
where the local dependence is a consequence of inept item writing in the sense that items are phrased in such a way that local dependence is unavoidable.

Svend Kreiner
University of Copenhagen
Denmark



Georg Rasch and Item Fit, S. Kreiner, Rasch Measurement Transactions, 2012, 26:1, 1354


Please help with Standard Dataset 4: Andrich Rating Scale Model



Rasch Publications
Rasch Measurement Transactions (free, online) Rasch Measurement research papers (free, online) Probabilistic Models for Some Intelligence and Attainment Tests, Georg Rasch Applying the Rasch Model 3rd. Ed., Bond & Fox Best Test Design, Wright & Stone
Rating Scale Analysis, Wright & Masters Introduction to Rasch Measurement, E. Smith & R. Smith Introduction to Many-Facet Rasch Measurement, Thomas Eckes Invariant Measurement: Using Rasch Models in the Social, Behavioral, and Health Sciences, George Engelhard, Jr. Statistical Analyses for Language Testers, Rita Green
Rasch Models: Foundations, Recent Developments, and Applications, Fischer & Molenaar Journal of Applied Measurement Rasch models for measurement, David Andrich Constructing Measures, Mark Wilson Rasch Analysis in the Human Sciences, Boone, Stave, Yale
in Spanish: Análisis de Rasch para todos, Agustín Tristán Mediciones, Posicionamientos y Diagnósticos Competitivos, Juan Ramón Oreja Rodríguez

To be emailed about new material on www.rasch.org
please enter your email address here:

I want to Subscribe: & click below
I want to Unsubscribe: & click below

Please set your SPAM filter to accept emails from Rasch.org

www.rasch.org welcomes your comments:

Your email address (if you want us to reply):

 

ForumRasch Measurement Forum to discuss any Rasch-related topic

Go to Top of Page
Go to index of all Rasch Measurement Transactions
AERA members: Join the Rasch Measurement SIG and receive the printed version of RMT
Some back issues of RMT are available as bound volumes
Subscribe to Journal of Applied Measurement

Go to Institute for Objective Measurement Home Page. The Rasch Measurement SIG (AERA) thanks the Institute for Objective Measurement for inviting the publication of Rasch Measurement Transactions on the Institute's website, www.rasch.org.

Coming Rasch-related Events
March 31, 2017, Fri. Conference: 11th UK Rasch Day, Warwick, UK, www.rasch.org.uk
April 2-3, 2017, Sun.-Mon. Conference: Validity Evidence for Measurement in Mathematics Education (V-M2Ed), San Antonio, TX, Information
April 26-30, 2017, Wed.-Sun. NCME, San Antonio, TX, www.ncme.org - April 29: Ben Wright book
April 27 - May 1, 2017, Thur.-Mon. AERA, San Antonio, TX, www.aera.net
May 26 - June 23, 2017, Fri.-Fri. On-line workshop: Practical Rasch Measurement - Core Topics (E. Smith, Winsteps), www.statistics.com
June 30 - July 29, 2017, Fri.-Fri. On-line workshop: Practical Rasch Measurement - Further Topics (E. Smith, Winsteps), www.statistics.com
July 31 - Aug. 3, 2017, Mon.-Thurs. Joint IMEKO TC1-TC7-TC13 Symposium 2017: Measurement Science challenges in Natural and Social Sciences, Rio de Janeiro, Brazil, imeko-tc7-rio.org.br
Aug. 7-9, 2017, Mon-Wed. In-person workshop and research coloquium: Effect size of family and school indexes in writing competence using TERCE data (C. Pardo, A. Atorressi, Winsteps), Bariloche Argentina. Carlos Pardo, Universidad Catòlica de Colombia
Aug. 7-9, 2017, Mon-Wed. PROMS 2017: Pacific Rim Objective Measurement Symposium, Sabah, Borneo, Malaysia, proms.promsociety.org/2017/
Aug. 10, 2017, Thurs. In-person Winsteps Training Workshop (M. Linacre, Winsteps), Sydney, Australia. www.winsteps.com/sydneyws.htm
Aug. 11 - Sept. 8, 2017, Fri.-Fri. On-line workshop: Many-Facet Rasch Measurement (E. Smith, Facets), www.statistics.com
Aug. 18-21, 2017, Fri.-Mon. IACAT 2017: International Association for Computerized Adaptive Testing, Niigata, Japan, iacat.org
Sept. 15-16, 2017, Fri.-Sat. IOMC 2017: International Outcome Measurement Conference, Chicago, jampress.org/iomc2017.htm
Oct. 13 - Nov. 10, 2017, Fri.-Fri. On-line workshop: Practical Rasch Measurement - Core Topics (E. Smith, Winsteps), www.statistics.com
Jan. 5 - Feb. 2, 2018, Fri.-Fri. On-line workshop: Practical Rasch Measurement - Core Topics (E. Smith, Winsteps), www.statistics.com
Jan. 10-16, 2018, Wed.-Tues. In-person workshop: Advanced Course in Rasch Measurement Theory and the application of RUMM2030, Perth, Australia (D. Andrich), Announcement
Jan. 17-19, 2018, Wed.-Fri. Rasch Conference: Seventh International Conference on Probabilistic Models for Measurement, Matilda Bay Club, Perth, Australia, Website
May 25 - June 22, 2018, Fri.-Fri. On-line workshop: Practical Rasch Measurement - Core Topics (E. Smith, Winsteps), www.statistics.com
June 29 - July 27, 2018, Fri.-Fri. On-line workshop: Practical Rasch Measurement - Further Topics (E. Smith, Winsteps), www.statistics.com
Aug. 10 - Sept. 7, 2018, Fri.-Fri. On-line workshop: Many-Facet Rasch Measurement (E. Smith, Facets), www.statistics.com
Oct. 12 - Nov. 9, 2018, Fri.-Fri. On-line workshop: Practical Rasch Measurement - Core Topics (E. Smith, Winsteps), www.statistics.com
The HTML to add "Coming Rasch-related Events" to your webpage is:
<script type="text/javascript" src="http://www.rasch.org/events.txt"></script>

 

The URL of this page is www.rasch.org/rmt/rmt261b.htm

Website: www.rasch.org/rmt/contents.htm