Assessing Priority Program Evaluation Training Needs of University of Kentucky Extension Agents: Implications for Building Evaluation Capacity
DOI:
https://doi.org/10.5032/jae.v67i3.3325Keywords:
NEEDS ASSESSMENT, EVALUATION CAPACITY BUILDING, COOPERATIVE EXTENSION, EXTENSION AGENTS, PRIORITY NEEDSAbstract
Extension professionals play a crucial role in translating research into actionable knowledge, through evidence-based programming, to improve the livelihoods of individuals and communities. However, previous research has identified gaps in Extension agents’ evaluation skills, hence the need for evaluation capacity building efforts to enhance their evaluation competencies. This study presents the findings of a cross-sectional assessment aimed at identifying priority evaluation training needs of county-based Extension agents and whether these priority needs differ by agents’ education level, program area, and years of service in Extension. Data was collected from 341 University of Kentucky Extension agents who rated the extent to which they needed education on 21 evaluation topics. Results revealed eight top-priority evaluation topics including determining the economic value of programs, developing measurable medium- and long-term evaluation outcomes, conducting follow-up surveys, collecting real-time data from participants, developing effective quantitative data collection tools, utilizing online survey tools, and adapting existing questionnaires. Further analysis revealed statistically significant group differences in only one of the priority areas of need. Specifically, agents working in family and consumer sciences reported a higher need for training in adapting existing questionnaires for evaluating multiple programs. These findings highlight the importance of using needs assessments to promote data-driven evaluation capacity-building efforts within Extension. Such efforts help ensure the efficient use of limited resources, address specific evaluation needs, and ultimately strengthen the work of Extension professionals.
Downloads
References
Agbangba, C. E., Aide, E. S., Honfo, H., & Kakai, R. G. (2024). On the use of post-hoc tests in environmental and biological sciences: A critical review. Heliyon, 10(3). https://doi.org/10.1016/j.heliyon.2024.e25131 DOI: https://doi.org/10.1016/j.heliyon.2024.e25131
Arnold, N. L., Schonberger, H. L., Ferelli, A., Murphy, S. I., & Yang, L. L. (2022). Revitalizing the Future of Food Safety Extension. Food Protection Trends, 42(3). http://doi.org/10.4315/FPT-21-029 DOI: https://doi.org/10.4315/FPT-21-029
Benge, M., & Beattie, P. (2021). Challenges of Early Career Extension Agents in Florida. Advancements in Agricultural Development, 2(1), 42–55. https://doi.org/10.37433/aad.v2i1.87 DOI: https://doi.org/10.37433/aad.v2i1.87
Bourgeois, I., Lemire, S. T., Fierro, L. A., Castleman, A. M., & Cho, M. (2023). Laying a solid foundation for the next generation of evaluation capacity building: Findings from an integrative review. American Journal of Evaluation, 44(1), 29-49. https://doi.org/10.1177/10982140221106991 DOI: https://doi.org/10.1177/10982140221106991
DeCorby-Watson, K., Mensah, G., Bergeron, K., Abdi, S., Rempel, B., & Manson, H. (2018). Effectiveness of capacity building interventions relevant to public health practice: a systematic review. BMC public health, 18(1), 684. https://doi.org/10.1186/s12889-018-5591-6 DOI: https://doi.org/10.1186/s12889-018-5591-6
Diaz, J., Chaudhary, A. K., Jayaratne, K. S. U., & Assan, E. (2020). Expanding evaluator competency research: Exploring competencies for program evaluation using the context of non-formal education. Evaluation and Program Planning, 79, 101790. https://doi.org/10.1016/j.evalprogplan.2020.101790 DOI: https://doi.org/10.1016/j.evalprogplan.2020.101790
Diaz, J., Chaudhary, A. K., Jayaratne, K. S. U., & Warner, L. A. (2019). Program Evaluation Challenges and Obstacles Faced by New Extension Agents: Implications for Capacity Building. Journal of Extension, 57(4), Article 26. https://doi.org/10.34068/joe.57.04.26 DOI: https://doi.org/10.34068/joe.57.04.26
Donaldson, J. L., Graham, D., Arnold, S., Taylor, L. K., & Jayaratne, K. (2023). An Analytic Needs Assessment for Extension Education: Views from Extension Professionals and Faculty. Journal of Human Sciences and Extension, 11(1), 14. DOI: https://doi.org/10.55533/2325-5226.1388 DOI: https://doi.org/10.55533/2325-5226.1388
Donaldson, J. L., & Vaughan, R. (2022). A scoping study of United States Extension professional competencies. Journal of Human Sciences and Extension, 10(1), Article 8. https://doi.org/10.54718/BNRG8317 DOI: https://doi.org/10.54718/BNRG8317
Franz, N., & Archibald, T. (2018). Four approaches to building Extension program evaluation capacity. The Journal of Extension. https://doi.org/10.34068/joe.56.04.03 DOI: https://doi.org/10.34068/joe.56.04.03
Ghimire, N. R., & Martin, R. A. (2013). Does Evaluation Competence of Extension Educators Differ by Their Program Area of Responsibility? The Journal of Extension, 51(6), Article 18. https://doi.org/10.34068/ joe.51.06.18 DOI: https://doi.org/10.34068/joe.51.06.18
Harpe, S. E. (2015). How to analyze Likert and other rating scale data. Currents in pharmacy teaching and learning, 7(6), 836-850. https://doi.org/10.1016/j.cptl.2015.08.001 DOI: https://doi.org/10.1016/j.cptl.2015.08.001
Hernandez, F. J. (2025). Assessment of the Evaluation Competencies Needed for Extension Professionals at the University of Connecticut: Implications for Designing Professional Development Curriculum in Program Evaluation. Journal of Agricultural Education, 66(4), 9-9. https://doi.org/10.5032/jae.v66i4.3276 DOI: https://doi.org/10.5032/jae.v66i4.3276
Hetherington, C., Eschbach, C., & Cuthbertson, C. (2019). How Evaluation Capacity Building Grows Credible and Actionable Evidence for Cooperative Extension Programs. Journal of Human Sciences and Extension, 7(2), 10. https://doi.org/10.54718/GLDP7457 DOI: https://doi.org/10.54718/GLDP7457
Huh, I., & Gim, J. (2025). Exploration of Likert scale in terms of continuous variable with parametric statistical methods. BMC Medical Research Methodology, 25(1), 218. https://doi.org/10.1186/s12874-025-02668-1 DOI: https://doi.org/10.1186/s12874-025-02668-1
Kelsey, K. D. (2018). Building Evaluation Capacity within an Agricultural NGO using SWOT Analysis. Journal of International Agricultural and Extension Education, 25(1), 60-79. https://doi.org/10.5191/jiaee.2018.25106 DOI: https://doi.org/10.5191/jiaee.2018.25106
Labin, S. N., Duffy, J. L., Meyers, D. C., Wandersman, A., & Lesesne, C. A. (2012). A research synthesis of the evaluation capacity building literature. American Journal of Evaluation, 33(3), 307-338. https://doi.org/10.1177/1098214011434608 DOI: https://doi.org/10.1177/1098214011434608
Lakai, D., Jayaratne, K. S. U., Moore, G. E., & Kistler, M. J. (2014). Identification of current proficiency level of Extension competencies and the competencies needed for Extension agents to be successful in the 21st century. Journal of Human Sciences and Extension, 2(1), Article 5. https://doi.org/10.54718/UUTF8010 DOI: https://doi.org/10.54718/UUTF8010
McClure, M. M., Fuhrman, N. E., & Morgan, A. C. (2012). Program Evaluation Competencies of Extension Professionals: Implications for Continuing Professional Development. Journal of Agricultural Education, 53(4), 85–97. https://doi.org/10.5032/jae.2012.0408 DOI: https://doi.org/10.5032/jae.2012.04085
Mertens, D. M., Hall, J. N., & Wilson, A. T. (2025). Program evaluation theory and practice. Guilford Publications.
Narine, L. & Harder, A. (2021). Comparing the Borich model with the Ranked Discrepancy Model for competency assessment: A novel approach. Advancements in Agricultural Development 2(3): 96-111. https://doi.org/10.37433/aad.v2i3.169 DOI: https://doi.org/10.37433/aad.v2i3.169
Narine, L. K., & Ali, A. D. (2020). Assessing priority competencies for evaluation capacity building in extension. Journal of Human Sciences and Extension, 8(3), 4. https://doi.org/10.54718/OKVW8622 DOI: https://doi.org/10.54718/OKVW8622
Rodgers, M. S., Hillaker, B. D., Haas, B. E., & Peters, C. (2012). Taxonomy for assessing evaluation competencies in Extension. The Journal of Extension, 50(4), Article 3. https://doi.org/10.34068/joe.50.04.03 DOI: https://doi.org/10.34068/joe.50.04.03
Sarti, A. J., Sutherland, S., Landriault, A., DesRosier, K., Brien, S., & Cardinal, P. (2017). Understanding of evaluation capacity building in practice: a case study of a national medical education organization. Advances in medical education and practice, 761–767. https://doi.org/10.2147/AMEP.S141886 DOI: https://doi.org/10.2147/AMEP.S141886
Seckman, L. D. (2022). What is the perceived self-efficacy of defined job competencies for West Virginia University Extension faculty, West Virginia University. https://researchrepository.wvu.edu/etd/11387
Silliman, B., Crinion, P., & Archibald, T. (2016). Evaluation champions: What they need and where they fit in organizational learning. Journal of Human Sciences and Extension, 4(3), Article 2. https://doi.org/10.54718/WOLP9257 DOI: https://doi.org/10.54718/WOLP9257
Strong, R., & Harder, A. (2011). Recommended competencies needed for training in international extension settings. Journal of International Agricultural and Extension Education, 18(3), 72–83. https://doi.org/10.5191/jiaee.2011.18306 DOI: https://doi.org/10.5191/jiaee.2011.18306
Vengrin, C. A. (2016). Examining the evaluation capacity, evaluation behaviors, and the culture of evaluation in Cooperative Extension. Virginia Polytechnic Institute and State University. https://vtechworks.lib.vt.edu/bitstreams/18b5ab8f-d0a0-4930-9c46-f9e600966934/download
Ward, C. K. (2018). Professional development needs of Utah State University extension professionals (Master’s thesis, Utah State University). https://digitalcommons.usu.edu/etd/6927
Downloads
Published
How to Cite
Issue
Section
