RELIABILITY ESTIMATE IN THE MEASUREMENT OF TWO ITEMS: ANGOFF-FELDT COEFFICIENT

Authors

  • Sergio Alexis Domínguez Lara Universidad de San Martín de Porres , Lima, Perú
  • César Ayax Merino Soto Universidad de San Martín de Porres , Lima, Perú
  • Jhonatan S. Navarro Loli Universidad de San Martín de Porres , Lima, Perú

DOI:

https://doi.org/10.19083/ridu.10.463

Keywords:

reliability, Angoff-Feldt, congeneric measures

Abstract

Nowadays, the use of brief measurements in psychological evaluations is extending rapidly, but many times the reliability analysis of the scores is limited by the conditions which must be overcome to use certain coefficients (e.g. α coefficient). The compliance of the tau equivalent measurement model is one of the most important the α coefficient demands, and as it is not achieved, the estimate may be biased. The aim of this paper is to present the Angoff-Feldt (rAF) coefficient for reliability estimate, to be used in congeneric measures, that is, those that do not comply with the demands of the α coefficient (e.g. tau equivalent model). Although rAF was initially thought for two congeneric halves, this paper presents the application for the measurement of two items, assuming each is a half. An example of its usefulness is provided and the possibility of implementing its use discussed. 

Downloads

Download data is not yet available.

References

Angoff, W. H. (1953). Test reliability and effective test length. Psychometrika, 18(1), 1-14. doi:10.1007/BF02289023

Bennett, I. M., Coco, A., Coyne, J. C., Mitchell, A. J., Nicholson, J., Johnson, E., Horst, M., & Ratcliffe, S. (2008). Efficiency of a TwoItem Pre-Screen to Reduce the Burden of Depression Screening in Pregnancy and Postpartum: An IMPLICIT Network Study. The American Board of Family Medicine, 21(4), 317-325. doi:10.3122/jabfm.2008.04.080048

Brown, R. L., Leonard, T., Saunders, L. A., & Papasouliotis, O. (2001). A two-item conjoint screen for alcohol and other drug problems. The American Board of Family Medicine, 14(2), 95-106.

Cakmak, A., & Cevik, E. (2010). Cognitive emotion regulation questionnarie: Development of Turkish version of 18-item short form. African Journal of Business Management, 4(10), 2097-2102.

Cortina, J. M. (1993). What is coefficient alpha? An examination of theory and applications. Journal of Applied Psychology, 78(1), 98-104. doi:10.1037/0021-9010.78.1.98

Cronbach, L. (1951). Coefficient alpha and the internal structure of tests. Psychometrika, 16(3), 297-334. doi:10.1007/BF02310555

Dominguez, S., & Merino, C. (2015). Una versión breve del Cognitive Emotional Regulation Questionnarie: Análisis estructural del CERQ-18 en estudiantes universitarios limeños. Revista Peruana de Psicología y Trabajo Social, 4(1), 25-36.

Eisinga, R., Te Grotenhuis, M., & Pelzer, B. (2012). The reliability of a two-item scale: Pearson, Cronbach, or Spearman-Brown. International Journal of Public Health, 58(4), 637–642. doi:10.1007/s00038-012-0416-3

Elosua, P. & Zumbo, B. (2008). Coeficiente alfa para escalas de respuesta categórica ordenada. Psicothema, 20(4), 896-901.

Feldt, L.S. (1975). Estimation of reliability of a test divided into two parts of unequal length. Psychometrika, 40(4), 557–561. doi:10.1007/BF02291556

Feldt L.S. (2002). Reliability Estimation When a Test Is Split Into Two Parts of Unknown Effective Length. Measurement in Education, 15(3), 295-308. doi:10.1207/S15324818AME1503_4

Feldt, L. S., & Charter, R. A. (2003). Estimating the reliability of a test Split into two parts of equal or unequal length. Psychological Methods, 8(1), 102-109. doi:10.1037/1082-989X.8.1.102

Feldt, L. S., & Brennan, R. L. (1989). Reliability. En Linn, R. L. (Ed), Educational Measurement (pp. 105 – 146). New York: Macmillan.

Fornell, C., & Larcker, D.F. (1981). Evaluating structural equation models with unobservable variables and measurement error. Journal of Marketing Research, 18(1), 39-50. doi:10.2307/3151312

Garnefski, N., & Kraaij, V. (2006). Cognitive emotion regulation questionnarie-development of a short 18-item version (CERQshort). Personality and Individual Differences, 41(6), 1045-1053. doi:10.1016/j.paid.2006.04.010

Gosling, S., Rentfrow, P., & Swann, W., (2003). A very brief measure of the Big Five personality domains. Journal of Research in Personality, 37, 504-528. doi:10.1016/S0092-6566(03)00046-1

Graham, J. M. (2006). Congeneric and (essentially) tau-equivalent estimates of score reliability: what they are and how to use them. Educacional and Psychological Measurement, 66(6), 930 – 944. doi:10.1177/0013164406288165

Hain, S., Schermelleh-Engel, K., Freitag, C., Louwen, F., & Oddo, S. (2015). Development of a Short Form of the Personality Styles and Disorder Inventory (PSDI-6). European Journal of Psychological Assessment. Recuperado de: http://econtent.hogrefe.com/doi/full/10.1027/1015-5759/a000260.

Hancock, G. R., & Mueller, R. O. (2001). Rethinking construct reliability within latent variable systems. En R. Cudeck, S. H. C. du Toit & D. Sörbom (Eds.), Structural equation modeling: Past and present. A Festschrift in honor of Karl G. Jöreskog (pp. 195-261). Chicago: Scientific Software International.

Jensen, M. P., Keefe, F. J., Lefebvre, J. C., Romano, J. M., & Turner, J. A. (2003). One- and two- item measures of pain beliefs and coping strategies. Pain, 104(3), 453-469. doi:10.1016/S0304-3959(03)00076-9

Kroenke, K., Spitzer, R., & Williams, J. (2003). The Patient Health Questionnarie-2: Validity of Two-item Depression Screener. Medical Care, 41(11), 1284-1292.

Kroenke, K., Spitzer, R., Williams, J., Monahan, P. & Lowe, B. (2007). Anxiety disorders in primary care: prevalence, impairment, comorbidity, and detection. Annals of International Medicine, 146, 317-325.

Ledesma, R. (2002). Análisis de consistencia interna mediante Alfa de Cronbach: un programa basado en gráficos dinámicos. PsicoUSF, 7(2), 143-152. doi:10.1590/S1413-82712002000200003

Meyer, J. P. (2010). Reliability. New York: Oxford UniversitymPress.

Minoura, Y., & Narita, K. (2013). The development of the Two-Item SelfEsteem scale (TISE): Reliability and validity. Japanese Journal of Research on Emotions, 21(1), 37-45. doi:10.4092/jsre.21.37

Rae, G. (2006). Correcting coefficient alpha for correlated errors: Is αk a lower Bound to reliability? Applied Psychological Measurement,n30(1), 56-59. doi:10.1177/0146621605280355

Raykov, T. (1997). Estimation of composite reliability for congeneric measures. Applied Psychological Measurement, 22(2), 173-184. doi:10.1177/01466216970212006

Robins, R., Hendin, H., & Trzeaniewski, K. (2001). Measuring Global SelfEsteem: Construct validation of a single-item measure and the Rosenberg Self-Esteem Scale. Personality and Social Psychology Bulletin, 27(2), 151-161. doi:10.1177/0146167201272002

Sánchez-Meca, J., & López-Pina, J. (2008). El enfoque meta-analítico de generalización de la fiabilidad. Acción Psicológica, 5(2), 37-64.

Sijtsma, K. (2011). Future of psychometrics: Ask what psychometrics can do for Psychology. Psychometrika, 77(1), 4-20. doi:10.1007/s11336-011-9242-4

Warrens, M. J. (2015). Some relationships between Cronbach´s alpha and the Spearman-Brown formula. Journal of Classification, 32(1), 127-137. doi:10.1007/s00357-015-9168-0

Warrens, M. J. (2016). A comparison of reliability coefficients for psychometric tests that consist of two parts. Advances in Data Analysis and Classification, 10(1), 71–84. doi:10.1007/s11634-015-0198-6

Zumbo, B. D., & Rupp, A. A. (2004). Responsible modelling of measurement data for appropriate inferences: Important advances in reliability and validity theory. En D. Kaplan (Ed.): The SAGE Handbook of Quantitative Methodology for the Social Sciences (pp. 73-92). Thousand Oaks, CA: Sage Press.

Published

2016-06-30

How to Cite

Domínguez Lara, S. A., Merino Soto, C. A., & Navarro Loli, J. S. (2016). RELIABILITY ESTIMATE IN THE MEASUREMENT OF TWO ITEMS: ANGOFF-FELDT COEFFICIENT. Revista Digital De Investigación En Docencia Universitaria [Digital Journal of University Teaching Research], 10(1), 34–40. https://doi.org/10.19083/ridu.10.463

Issue

Section

Methodological articles