Outcome Questionnaire (oq-45.2): assessment of the psychometric properties using bifactor model and irt
DOI:
https://doi.org/10.15448/1980-8623.2016.4.24600Keywords:
Item Response Theory, Factorial analysis, Psychological assessment, Test validity, Psychotherapy.Abstract
The aim of this study was to evaluate the Psychometric properties of the Brazilian version of the Outcome Questionnaire - OQ-45.2, an instrument that assesses the progress of patients in psychotherapy. The adjustments of different measure models proposed to OQ-45.2 were compared through Confirmatory Factor Analysis, and the parameters of items and participants were estimated through the Andrich’s rating scale model. The sample comprised 419 adults (mean age: 32.18±14.3; 62.8% women). The results demonstrated the suitability of the bifactor model with three specific factors (subjective discomfort, interpersonal relationships and performance in social roles) and a general factor (overall maladjustment) when compared to others in the literature, like the one-factor and the three related factors models. It was observed a model invariance of the OQ-45 internal structure for both men and women assessment. Regarding the items’ properties (adjustment and difficulty) were obtained the appropriate psychometric parameters for the assessment of psychotherapeutic outcome. In conclusion, the OQ-45 is an appropriate measure tool for assessing these characteristics in Brazilian population.
Downloads
References
Abishe, D. R. (2008). Cross-cultural comparison of the Outcome Questionnaire. Tese de doutorado em filosofia. Universidade de Oklahoma. Norman: Oklahoma. ProQuest: UMI 3304221.
AERA – American Educational Research Association, APA – American Psychological Association, NCME – National Council on Measurement in Education (2014). Standards for educational and psychological testing. Washington, DC: American Educational Research Association.
Antony, M. M. & Barlow, D. H. (2010). Handbook of assessment and treatment planning for psychological disorders (2ª ed.). New York: Guilford Press.
Bond, T. G. & Fox, C. M. (2001). Applying the Rasch Model. Mahwah, NJ: LEA.
Boswell, D. L., White, J. K., Sims, W. D., Harrist, R. S., & Romans, J. S. (2013). Reliability and validity of the Outcome Questionnaire-45.2. Psychological Reports: Mental & Physical Health, 112(3), 689-693. http://dx.doi.org/10.2466/02.08.PR0.112.3.689-693
Brum, E. H. M., Frizzo, G. B., Gomes, Grill. A., Silva, M. R., Sousa, D. D., & Piccinini, C. A. (2012). Evolução dos modelos de pesquisa em psicoterapia. Estudos de Psicologia, 9(2), 259-269. http://dx.doi.org/10.1590/S0103-166X2012000200012
Butcher, J., Derksen, J., Sloore, H., & Sirigatti, S. (2003). Objective personality assessment of people in diverse cultures: European adaptations of the MMPI-2. Behaviour Research and Therapy, 41(7), 819-840. http://dx.doi.org/10.1016/S0005-7967(02)00186-9
Carvalho, L. F. & Rocha, G. M.A. (2009). Tradução e adaptação cultural do Outcome Questionnaire (OQ-45). Psico-USF, 14(3), 309-316. http://dx.doi.org/10.1590/S1413-82712009000300007
Chiappelli, M., Lo Coco, G., Gullo, S., Bensi, L., & Prestano, C. (2008). L’Outcome-Questionnaire 45.2.The Outcome Questionnaire 45.2. Italian validation of an instrument for the assessment of psychological treatments. Epidemiologia E Psichiatria Sociale, 17, 152-216.
Cook K. F., Kallen, M. A., & Amtmann D. (2009). Having a fit: impact of number of items and distribution of data on traditional criteria for assessing IRT’s unidimensionality assumption. Qual Life Res, 18(4), 447-460. http://dx.doi.org/10.1007/s11136-009-9464-4
Del Prette, G. (2011). Objetivos analítico-comportamentais e estratégias de intervenção nas interações com a criança em sessões de duas renomadas terapeutas infantis. Tese de doutorado não publicada. Universidade de São Paulo.
Doerfler, L. A., Addis, M. E., & Moran, P. W. (2002). Evaluating mental health outcomes in an inpatient setting: Convergent and divergent validity of the OQ-45 and BASIS-32. The Journal of Behavioral Health Services & Research, 29(4), 394-403. http://dx.doi.org/10.1007/BF02287346
Harmon, C., Hawkins, E. J., Lambert, M. J., Slade, K., & Whipple, J.S. (2005). Improving outcomes for poorly responding clients: The use of Clinical Support Tools and feedback to clients. A Journal of Clinical Psychology, 61(2), 175-185. http://dx.doi.org/10.1002/jclp.20109
Hatfield, D. & Ogles, B. M. (2004). The Use of Outcome Measures by Psychologists in Clinical Practice. Professional Psychology: Research & Practice, 35(5), 485-491. http://dx.doi.org/10.1037/0735-7028.35.5.485
Honda, G. C., Peixoto, E. M., Rocha, G. M., & Enéas, M. L. E. (2015).
Psicoterapia breve psicodinâmica no processo de formação profissional. In T. V. Santeiro & G. M. A. Rocha (Orgs.). Clínica de orientação psicanalítica: compromissos, sonhos e inspirações no processo de formação (pp. 76-80). São Paulo: Vetor.
Huag, S., Puschner, B., Lambert, M. J., & Kordy, H. (2004). Veraderungs messung in der psychotherapie mit dem Ergebnis Frage Bogen (EB-45) Assessment of change in psychotherapy with the German version of the Outcome Questionnaire (OQ-45). Zeitschrift fur Differenttielle und Diagnosfische Psychologie, 25,141-151.
Jong, K., Nugter, M. A., Polak, M. G., Wagenborg, J. E. A., Spinhoven, P., & Heiser, W. J. (2007). The Outcome Questionnaire (OQ-45) in a Dutch population: A cross-cultural validation. Clinical Psychology and Psychotherapy, 14(4), 288-301. http://dx.doi.org/10.1002/cpp.529
Lambert, M. J. (1983). Introduction to assessment of psychotherapy outcome: Historical perspesctive and current issues. In: M. J. Lambert, E. R. Christensen, & S. S. DeJulio (Eds.), The assessment of psychotherapy outcome (pp. 3-32). New York: John Wiley and Sons.
Lambert, M. J., Burlingame, G. N., Umphress, V., Hanse, N.B., Vermeersh, D. A., Clouse, G. C., & Yanchar, S. C. (1996).
The reliability and validity of the Outcome Questionnaire. Clinical Psychology and Psychotherapy, 3, 249-258. http://dx.doi.org/10.1002/(SICI)1099-0879(199612)3:4<249::AID-CPP106>3.0.CO;2-S
Lambert, M. J. & Finch, A. E. (1999). The Outcome Questionnaire. M. E. Maruish (Ed.). The use of psychological testing for treatment planning and outcomes assessment (pp. 831-869). New Jersey: Lawrence Erlbaum Associates, Publishers.
Lambert, M.J., Hansen, N.B., & Finch, A.E. (2001). Patient-focused research: Using patient outcome data to enhance treatment effects. Journal of Consulting and Clinical Psychology, 69, 159-172. http://dx.doi.org/10.1037/0022-006X.69.2.159
Lambert, M. J. (1994). Assessing psychotherapy outcomes and processes. In A. E. Bergin and S. L. Garfield (Eds.). Handbook of psychotherapy and behavior change, 4, 72-113. New York: John Wiley and Sons.
Lambert, M. J., Morton, J. J., Hartfield, D, Harmon, C., Hamilton, S. Reid, R. C., Shimokawa, K., Christopherson, C., & Burlingame, G. M. (2004). Administration and Scoring Manual for the OQ-45.2 Outcome Questionnaire. Salt Lake City: American Professional Credentialing Services.
Lambert, J. M., Smart, D. W., Campbell, M. P., Hawkins, E. J., Harmon, C., & Slade, K. L. (2006). Psychotherapy outcome, as measured by the OQ-45, in African American, Asia/Pacific Islander, Latino/a, and Native American clients compared with matched caucasian clients. Journal of College Student Psychotherapy, 20(4), 17-29. http://dx.doi.org/10.1300/J035v20n04_03
Lara, D. & Alexis, S. (2014). ¿Matrices Policóricas/Tetracóricas o Matrices Pearson? Un estudio metodológico. Revista Argentina de Ciencias del Comportamiento, 6(1), 39-48.
Lara, C., Cruz, C., Vacarezza, A., Florenzano U. R., & Trapp, A. (2008). Análisis comparativo de dos instrumentos de evaluación clínica: OQ45 e InterRAI – Salud Mental. Revista Chilena de NeuroPsiquiatria, 46(3),192-198. http://dx.doi.org/10.4067/S0717-92272008000300004
Linacre, J. M. (2002). What do Infit and Outfit, Mean-square and Standardized mean? Rasch Measurement Transactions, 16(2), 878. Linacre J. M. (2015). A user’s guide to Winsteps Ministep: Rasch-model computer programs. Retrieved from: http://www.winsteps.com
Lo Coco, G. L., Chiappelli, M., Bensi, L., Gullo, S., Prestano, C., & Lambert, M. J. (2008). The factorial structure of the Outcome Questionnaire-45: A study with an Italian sample. Clinical Psychology and Psychotherapy, 15, 418-423. http://dx.doi.org/10.1002/cpp.601
Machado, P. P. P. & Fassnacht, D. B. (2015). The Portuguese version of the Outcome Questionnaire (OQ-45): Normative data, reliability, and clinical significance cut-offs scores. Psychology and Psychotherapy: Theory, Research and Practice (2015), 88, 427-437. http://dx.doi.org/10.1111/papt.12048
Milfont, T. L. & Fisher, R. (2010). Testing measurement invariance across groups: Applications in cross-cultural research. International Journal of Psychological Research, 3(1), 111-121.
Mueller, R. M., Lambert, M. J., & Burlingame, G. M. (1998). Construct validity of the Outcome Questionnaire: A confirmatory factor analysis. Journal of Personality Assessment, 70(2), 248-262. http://dx.doi.org/10.1207/s15327752jpa7002_5
Muthén, L. K. & Muthén, B. O. (2012). Mplus User’s Guide (7th ed.). Los Angeles, CA.
Parra, G. & Bergen, V. (2002). OQ 45-2 Cuestionario para evaluación de resultados y evolución en psicoterapia: adaptación, validación, e indicaciones para su aplicación e interpretación. Revista de Terapia, 20, 161-176.
Pasquali, L. (2010). Testes Referentes a Construto: Teorias e Modelos de Construção. In: L. Pasquali et al. (Orgs.), Instrumentação Psicológica: Fundamentos e prática (pp. 165-198). Porto Alegre: Artmed.
Peuker, A. C., Habigzang, L. F., Koller, S. H., & Araujo, L. B. (2009). Avaliação de processo e resultado em psicoterapias: uma revisão. Psicologia em Estudo, 14(3), 439-445. http://dx.doi.org/10.1590/S1413-73722009000300004
Pieta, M. A. M., Siegmund, G., Gomes, W. B., & Gauer, G. (2015). Desenvolvimento de protocolos para acompanhamento de psicoterapia pela Internet. Contextos Clínicos, 8(2), 128-140. http://dx.doi.org/10.4013/ctc.2015.82.02
Peixoto, E. M. & Nakano, T. C. (2014). Problemas e perspectivas na utilização dos testes psicológicos em psicologia do esporte. In: C. R. Campos, T. C. Nakano. (Org.). Avaliação Psicológica direcionada a populações específicas: técnicas, métodos e estratégias (pp. 201-23). São Paulo: Vetor.
Primi, R, Carvalho, L. F., Miguel, F. K., & Muniz, M. (2010). Resultado dos fatores da BFP por meio da Teoria de Resposta ao Item: interpretação referenciada no item. In: C. H. S. S., Nunes, C. S., Hutz, & M. F. O., Nunes. (Org.). Bateria Fatorial de Personalidade (BFP): manual técnico (pp. 153-170). São Paulo: Casa do Psicólogo.
Reise, S. P. (2012). The rediscovery of bifactor measurement models. Multivariate Behavioral Research, 47(5), 667-696. http://dx.doi.org/10.1080/00273171.2012.715555
Rios, J. & Wells, C. (2014). Validity evidence based on internal structure. Psicothema, 26(1), 08-116. 10.7334/psicothema2013.260
Rodríguez, M. A. von B. (2000). Investigación Empírica em Psicoterapia: Validación del Cuestionario de Resultados Terapêuticos OQ-45.2. Tesis para optar al grado de Licenciado em Psicologia. Universidad Nacional Andres Bello. Santiago do Chile.
Santos, D. & Primi, R. (2014). Social and emotional development and school learning: a measurement proposal in support of public policy. Technical report for Organization for Economic Cooperation and Development (OCDE) Rio de Janeiro State Education Department (SEEDUC) and Ayrton Senna Institute. São Paulo: Ayrton Senna Institute.
Serralta, F. B., Nunes, M. L. T., & Eizirik, C. L. (2007). Elaboração da versão em português do Psychotherapy Process Q-Set. Revista Brasileira de Psiquiatria, 29(1), 44-55. http://dx.doi.org/10.1590/S0101-81082007000100011
Silva, S. M. (2013). Escala de Avaliação de Resultados (Outcome Questionnaire) – OQ-45.2: Validade e precisão. Tese de Doutorado [não publicada]. Universidade de São Paulo.
Umpress, V. J., Lambert, M. J., Smart, D. W., Barlow, S. H., & Clouse, G. (1997). Concurrent and construct validity of the Outcome Questionnaire. Journal of Psychoeducational Assessment, 15, 40-55. http://dx.doi.org/10.1177/073428299701500104
Wennberg, P., Philips, B., & de Jong, K. (2010). The Swedish version of the Outcome Questionnaire (OQ-45): Reliability and factor structure in a substance abuse sample. Psychology and Psychotherapy: Theory, Research and Practice, 83, 325-329. http://dx.doi.org/10.1348/147608309X478715
Published
How to Cite
Issue
Section
License
Copyright
The submission of originals to Psico implies the transfer by the authors of the right for publication. Authors retain copyright and grant the journal right of first publication. If the authors wish to include the same data into another publication, they must cite Psico as the site of original publication.
Creative Commons License
Except where otherwise specified, material published in this journal is licensed under a Creative Commons Attribution 4.0 International license, which allows unrestricted use, distribution and reproduction in any medium, provided the original publication is correctly cited.
