在測驗含有題組(testlet)結構時，由於違反了試題反應理論(Item Response Theory, IRT)中局部獨立性的假設，使得IRT的估計方法產生偏誤，過去研究的解決方式為在IRT模型中多加入一個參數，將題組的影響力納入模型中，此即為題組反應理論(Testlet Response Theory, TRT)，在貝氏(Bayesian)的架構下，此方法的計算則可透過SCORIGHT軟體來達成。本研究旨在透過另一種方法，即廣義方程式(Generalized Estimation Equation, GEE)去處理測驗中的題組效果。GEE過去常被使用於分析縱貫式(longitudinal)的資料，本研究使用此方法來捕捉題組測驗下作答結果的相關性，並經重新參數化調整係數後使其能對受試者能力值進行估計。
電腦模擬的結果顯示GEE能有效的處理題組效果帶來的影響。在GEE和貝氏題組模型的比較上，GEE對於程度好和程度差的受試者有較佳的估計效果；而貝氏題組模型則對於程度中等的受試者表現較好，此外我們也針對GEE的估計效率進行了實驗，結果顯示先將受試者依能力分組再進行GEE估計能提升GEE的估計效率。
在文章中，我們也展示了使用GEE計算題組訊息量的方式，做為題組式測驗下評估該測驗對於各能力區間的受試者在估計準確度上的參考。 / If the tests have testlet structure, the bias may arise when using traditional Item Response Theory(IRT) estimation methods due to the violations to the assumption of local independence. To deal with the testlet effect, previous studies introduced a new parameter to the classical IRT model which called Testlet Response Theory(TRT). Under the Bayesian framework, the estimation can be accomplished on the SCORIGHT program. The purpose of this paper is to use another method named Generalized Estimation Equation(GEE) to model testlet response data. GEE was commonly used to analyze the longitudinal data. We use this method to capture the information from the correlated items and estimated ability of the examinees through re-parametrization.
Simulation results indicate that GEE can deal with the testlet effect effectively. On the comparison between GEE and Bayesian testlet model, GEE does better on estimation of the examinees who have high or low ability level. In contrast, Bayesian testlet model does better on estimation of medium ability level. In addition, we design the experiment to test the efficiency of GEE. The results show that group the examinees according to their ability before doing the GEE estimation can improve the efficiency of GEE.
In this paper, we also demonstrate the method to calculate testlet information using GEE which can be taken as reference for assessing estimation accuracy of each ability level in testlet-based testing.
| Identifer | oai:union.ndltd.org:CHENGCHI/G1043540181 |
| Creators | 李介中, Lee, Chieh Chung |
| Publisher | 國立政治大學 |
| Source Sets | National Chengchi University Libraries |
| Language | 中文 |
| Detected Language | English |
| Type | text |
| Rights | Copyright © nccu library on behalf of the copyright holders |
Page generated in 0.0017 seconds