MFORMS: one-step (concurrent) Item Banking and Concurrent Equating Computer Program

Persons concerned with item banking will be interested in a new computer program, MFORMS (Wright & Schulz, 1987). MFORMS is a derivative of MSTEPS (Wright, et al., 1986), and is similar to MICROSCALE (Wright and Linacre, 1985), in its ability to accommodate missing values in a data matrix.

The accommodation of missing values in MFORMS enables one to combine data from a network of multiple forms into a single matrix. The missing values in this matrix then arise because no one individual takes all of the items in all of the forms and no item is taken by all of the persons. This is the usual situation when building large item banks.

The data need not be submitted to MFORMS in the form of a large matrix with missing values, however. MFORMS can read records from multiple forms, and create its own internal matrix. The user must include a form-identification field in each record, and supply additional information that tells MFORMS the item-in-bank sequence number of each item-within-forms. MFORMS uses this information in two "../indexing" arrays.

The virtual memory needed by MFORMS to hold the data is less than would be needed to hold the large NI*NN matrix implied by all items (NI) and all persons (NN). MFORMS stores the data in NN*NIFORM bytes, where NIFORM is the maximum number of items per form.

MFORMS will accept initial estimates of item calibrations. This feature is particularly useful when the items cover two or more grade levels in an educational curriculum. Well chosen initial estimates enable the program to converge faster, as is shown in the following example.

The MFORMS program was used at the Chicago Public Schools to equate 960 test items covering the reading curriculum of grades 3 to 8. There were 160 items per grade level. A test linking network was set up for a total of 40 forms. Most forms were 40 items long, and contained 10 linking items. The remaining forms were 80 items long and contained 50 linking items. There were 8,496 records, 8,296 of which had non-perfect scores.

The virtual memory required by MFORMS to hold these data was 8496*80 (NN*NIFORM), or approximately 700K bytes. This is a critical savings of virtual memory, since about 8200K bytes (NN*NI) would be needed were there no indexing arrays in MFORMS. The indexing arrays in this case use 20K bytes. The total virtual memory used by MFORMS for this problem was 2760K.

The MFORMS program was used on the above data with three sets of initial item calibrations, corresponding to three sizes of expected difference between adjacent grades. The default initial calibrations were set at 0.0 logits between grades. That is, all items begin with 0.0. The other initial calibrations set differences of 0.5 logits or 1.0 logit between grades. With 0.5 logits difference, grade 3 items and grade 8 items were initialized at -1.25 and +1.25 logits respectively. With 1.0 logits difference, grade 3 and grade 8 items were set at -2.5 and +2.5 logits respectively. Intermediate grade levels had intermediate initial values.

The RMT articles describes a situation common to all estimation processes which use an iterative technique. The convergence criteria must be set tight enough for the problem at hand. Iterative processes are used widely in statistics and engineering. If in doubt, set the convergence criteria too tight. The only down-side may be that the analysis takes longer to run than necessary.

The MFORMS program took approximately 35 seconds of IBM 3033 CPU per JMLE (UCON) iteration. With initial calibrations of -1.25 to +1.25 logits, (0.5 logits between grade levels), the standard deviation of item calibrations reached 1.396 logits (N=960) on the 167th iteration, and remained there through the 300th iteration. Rounding, the standard deviation of items reached 1.4 on the 26th iteration, and 1.40 on the 131st iteration. The CPU times necessary to bank these items to accuracies of 1.4, 1.40, and 1.396, were 18.2 minutes, 78.5 minutes, and 98.2 minutes. The mean standard error of item calibration was 0.14 logits.

When no initial calibrations were provided, the standard deviation of items reached a rounded value of 1.4 on the 188th iteration, and had not reached 1.40 by the 250th iteration. When initial calibrations were 1.0 logits between grade levels (-2.5 to +2.5), the program reached 1.4 by the 180th iteration, but had not reached 1.40 by the 250th iteration.

Figure 1.


Figure 1 shows the plot of item standard deviations against UCON iterations for these three sets of preset calibrations. The advantage of supplying initial calibrations for one-step (concurrent) item banking with MFORMS is clear. With an initial difference of 0.5 logits between grade levels, the spread of item calibrations reaches a stable value sooner.

Regardless of whether initial item calibrations are provided, one-step (concurrent) item banking via the MFORMS, MSCALE, or MSTEPS programs offers the following advantages over multistep procedures of item banking: 1) simultaneous use of all the data bearing on a person measure or item calibration, 2) savings of man-hours, and 3) reduction of potential for error. The advantage of simultaneously using all the data bearing on parameter estimates is discussed by Kelderman (1986). Man hours are saved, in this case, by combining 40 separate Rasch analyses (40 forms) into one and eliminating the need for secondary analyses to compute and apply translation constants between forms. The potential for human error is reduced with a reduction in the time and handling of data needed to equate the items.

MFORMS is unique, however, in the following respects: 1) it takes less virtual memory to store the data, 2) it reads data from multiple forms and sets up the data matrix, and 3) it accepts initial estimates for the item calibrations, thereby reducing the CPU time necessary to reach convergence. MFORMS is available for IBM-compatible and DEC- compatible main- frame computers.

Kelderman, H. (1986). Common Item Equating Using the Loglinear Rasch Model (Research Report 86-9). Enschede, Netherlands: University of Twente, Department of Education, Division of Educational Measurement and Data Analysis.

Wright, B.D. and Linacre, J.M. (1985). MICROSCALE. Westport: MEDIAX.

Wright, B.D. and Schulz, E.M. (1987). MFORMS [A FORTRAN computer program for one-step (concurrent) item banking of dichotomous and partial credit data from multiple forms]. Chicago IL: MESA Press.

Wright, B.D., Schulz, E.M., Congdon, R.T. and Rossner, M. (1987) MSTEPS [A FORTRAN computer program for Rasch analysis of dichotomous and partial credit data]. Chicago IL: MESA Press.

Computer programs: MFORMS for one-step (concurrent) item banking and concurrent equating. Schulz EM. … Rasch Measurement Transactions 1:2 p.10-11


Computer programs: MFORMS for one-step (concurrent) item banking. Schulz EM. … Rasch Measurement Transactions, 1988, 1:2 p.10-11

Please help with Standard Dataset 4: Andrich Rating Scale Model



Rasch Publications
Rasch Measurement Transactions (free, online) Rasch Measurement research papers (free, online) Probabilistic Models for Some Intelligence and Attainment Tests, Georg Rasch Applying the Rasch Model 3rd. Ed., Bond & Fox Best Test Design, Wright & Stone
Rating Scale Analysis, Wright & Masters Introduction to Rasch Measurement, E. Smith & R. Smith Introduction to Many-Facet Rasch Measurement, Thomas Eckes Invariant Measurement: Using Rasch Models in the Social, Behavioral, and Health Sciences, George Engelhard, Jr. Statistical Analyses for Language Testers, Rita Green
Rasch Models: Foundations, Recent Developments, and Applications, Fischer & Molenaar Journal of Applied Measurement Rasch models for measurement, David Andrich Constructing Measures, Mark Wilson Rasch Analysis in the Human Sciences, Boone, Stave, Yale
in Spanish: Análisis de Rasch para todos, Agustín Tristán Mediciones, Posicionamientos y Diagnósticos Competitivos, Juan Ramón Oreja Rodríguez

To be emailed about new material on www.rasch.org
please enter your email address here:

I want to Subscribe: & click below
I want to Unsubscribe: & click below

Please set your SPAM filter to accept emails from Rasch.org

www.rasch.org welcomes your comments:

Your email address (if you want us to reply):

 

ForumRasch Measurement Forum to discuss any Rasch-related topic

Go to Top of Page
Go to index of all Rasch Measurement Transactions
AERA members: Join the Rasch Measurement SIG and receive the printed version of RMT
Some back issues of RMT are available as bound volumes
Subscribe to Journal of Applied Measurement

Go to Institute for Objective Measurement Home Page. The Rasch Measurement SIG (AERA) thanks the Institute for Objective Measurement for inviting the publication of Rasch Measurement Transactions on the Institute's website, www.rasch.org.

Coming Rasch-related Events
March 31, 2017, Fri. Conference: 11th UK Rasch Day, Warwick, UK, www.rasch.org.uk
April 2-3, 2017, Sun.-Mon. Conference: Validity Evidence for Measurement in Mathematics Education (V-M2Ed), San Antonio, TX, Information
April 26-30, 2017, Wed.-Sun. NCME, San Antonio, TX, www.ncme.org - April 29: Ben Wright book
April 27 - May 1, 2017, Thur.-Mon. AERA, San Antonio, TX, www.aera.net
May 26 - June 23, 2017, Fri.-Fri. On-line workshop: Practical Rasch Measurement - Core Topics (E. Smith, Winsteps), www.statistics.com
June 30 - July 29, 2017, Fri.-Fri. On-line workshop: Practical Rasch Measurement - Further Topics (E. Smith, Winsteps), www.statistics.com
July 31 - Aug. 3, 2017, Mon.-Thurs. Joint IMEKO TC1-TC7-TC13 Symposium 2017: Measurement Science challenges in Natural and Social Sciences, Rio de Janeiro, Brazil, imeko-tc7-rio.org.br
Aug. 7-9, 2017, Mon-Wed. In-person workshop and research coloquium: Effect size of family and school indexes in writing competence using TERCE data (C. Pardo, A. Atorressi, Winsteps), Bariloche Argentina. Carlos Pardo, Universidad Catòlica de Colombia
Aug. 7-9, 2017, Mon-Wed. PROMS 2017: Pacific Rim Objective Measurement Symposium, Sabah, Borneo, Malaysia, proms.promsociety.org/2017/
Aug. 10, 2017, Thurs. In-person Winsteps Training Workshop (M. Linacre, Winsteps), Sydney, Australia. www.winsteps.com/sydneyws.htm
Aug. 11 - Sept. 8, 2017, Fri.-Fri. On-line workshop: Many-Facet Rasch Measurement (E. Smith, Facets), www.statistics.com
Aug. 18-21, 2017, Fri.-Mon. IACAT 2017: International Association for Computerized Adaptive Testing, Niigata, Japan, iacat.org
Sept. 15-16, 2017, Fri.-Sat. IOMC 2017: International Outcome Measurement Conference, Chicago, jampress.org/iomc2017.htm
Oct. 13 - Nov. 10, 2017, Fri.-Fri. On-line workshop: Practical Rasch Measurement - Core Topics (E. Smith, Winsteps), www.statistics.com
Jan. 5 - Feb. 2, 2018, Fri.-Fri. On-line workshop: Practical Rasch Measurement - Core Topics (E. Smith, Winsteps), www.statistics.com
Jan. 10-16, 2018, Wed.-Tues. In-person workshop: Advanced Course in Rasch Measurement Theory and the application of RUMM2030, Perth, Australia (D. Andrich), Announcement
Jan. 17-19, 2018, Wed.-Fri. Rasch Conference: Seventh International Conference on Probabilistic Models for Measurement, Matilda Bay Club, Perth, Australia, Website
May 25 - June 22, 2018, Fri.-Fri. On-line workshop: Practical Rasch Measurement - Core Topics (E. Smith, Winsteps), www.statistics.com
June 29 - July 27, 2018, Fri.-Fri. On-line workshop: Practical Rasch Measurement - Further Topics (E. Smith, Winsteps), www.statistics.com
Aug. 10 - Sept. 7, 2018, Fri.-Fri. On-line workshop: Many-Facet Rasch Measurement (E. Smith, Facets), www.statistics.com
Oct. 12 - Nov. 9, 2018, Fri.-Fri. On-line workshop: Practical Rasch Measurement - Core Topics (E. Smith, Winsteps), www.statistics.com
The HTML to add "Coming Rasch-related Events" to your webpage is:
<script type="text/javascript" src="http://www.rasch.org/events.txt"></script>

 

The URL of this page is www.rasch.org/rmt/rmt12b.htm

Website: www.rasch.org/rmt/contents.htm