Technology+assessment

=Technology Assessment = Jan Andies (Karel de Grote Universiteit, Antwerpen) 30 August 2012, 11-11.30 Verslag door: Jeroen Donkers

Korte Samenvatting
Understand, use and assess technology with a critical appreciative stance in order to participate in society. 3 dimensions: understanding, using, being aware of technology. Complex to measure all three together. 3-year research project (17 schools, 2500 studensts).

Measuring: awareness & cognition, and attitude. Explorative studies, pilotstudy, main runs 2x of surveys. Evaluation of TAC test: Item response theory (in R).

A: dimensionality – VSS and unidim test. (we need 1 dimension), B: which model: 1-2-3 params: likelihood-ratio test. C: Analysing items using parameters: difficulty parameter should be within [-5;5] outside is too extreme / Discriminatory parameter : baker index / Guessing paramer: <25%.

DIF analysis: are the items the same for different groups of respondents? Using lordif package in R. Automatic flagging DIF items. Combining results and adjusting or deleting items. Test summary using test information curve: is it broad enough? Analysis is done after first main run and repeated after second run.

TAC: 39 items, 19 related to awareness, 20 to cognition. Students 12-14y, general education. Paper or computer based. Next step is: using technology, role of teacher, relation with other dimensions.

Keywords
Technology assessment, Item response theory for evaluation of tests.