Adaptation and Validation of Instruments To Monitor the Implementation and Dissemination of Familias Unidas in Chile

J.M. Banderas¹, D. Pardo¹, M.L. Correa¹ (Presenting Author), V. Muñoz², M Sanchez¹. ¹Fundación San Carlos de Maipo, Chile; ²Family and Schools, Fundación San Carlos de Maipo, Chile

Introduction. Familias Unidas (FU) is a family-centered, evidence-based intervention program for drug use and sexual risk behavior prevention, developed at the University of Miami and implemented in Chile by Fundación San Carlos de Maipo (FSCM) since 2015. Currently the program is going through a dissemination process, being implemented with government funding in 7 regions of the country. Internationally validated questionnaires were reviewed and adapted to measure pre-post results.

Method. To identify changes based on adolescents’ self-reports, the following scales were selected from internationally validated questionnaires: “parental involvement”, “positive parenting”, and “poor monitoring” from the “Alabama Parenting Questionnaire” (Shelton, K.K., Frick, P.J., & Wootton, J., 1996); and “degree of openness in family communication” and “extent of problems with family communication” from “The Parent-Adolescent Communication Scale” (Barnes, H.L., & Olson, D.H., 1982). Considering these scales, a questionnaire was developed and validated by FSCM through 2 processes: (1) Content validation (5 cognitive interviews were conducted to identify elements that weren’t being understood and therefore needed to be modified); and (2) Pre-test (with 7th and 8th grade adolescents (N=69)). This allowed to: (i) adjust and validate the questionnaire according to its application in real context and fieldwork difficulties, and (ii) gather quantitative information to conduct statistical analyzes, such as scale reliability (Cronbach’s Alpha coefficient), non-response analysis, variance and out-of-range or inconsistent values. Considering these results, the questionnaire was adjusted and then answered by adolescents pre and post intervention (N = 136). Results of this application are presented below.

Results. The application of the adapted questionnaire (N=136) revealed high levels of reliability in the scales of “parental involvement” (Cronbach’s Alpha=0.78), “positive parenting” (0.80), “degree of openness in family communication” (0.89) and “extent of problems with family communication” (0.78). A less acceptable reliability level was found for “poor monitoring” scale (0.66). Regarding program results, significant improvements were observed at a 5% significance level when comparing pre (t1) and post (t2) data on all scales scores, but “positive parenting”. Improvements found were: “parental involvement” (t1=29.8, t2=31.07), “poor monitoring” (t1=7.36, t2=6.16), “degree of openness in family communication” (t1=28.8, t2=32.54) and “extent of problems with family communication” (t1=16.32, t2=14.11). “Positive parenting” remained without significant changes between both periods (t1=18.8, t2=18.84).

Conclusions. Adaptation and validation of questionnaires are crucial in order to obtain valid and accurate results. The validation process presented allowed to measure improvements in scale scores with reliable questionnaires, which suggests that the dissemination of Familias Unidas is on the right track. Finally, regarding “poor monitoring” scale reliability results, a challenge remains in adjusting a new parental monitoring scale that aligns with current times and is therefore more reliable and relevant.