The Study’s Purpose and Context
The study was conducted to evaluate the Agriculture and Fisheries Extension (AFE) Results-Based Monitoring and Evaluation (RBME) System. The system comprises a theory of change (ToC) and a results framework of 28 indicators designed to measure whether the DA-ATTI interventions in regions, activities, and projects (PAPs) align with higher-order outcomes and impact. The evaluation aimed to review and enhance the framework, identify implementation challenges, and recommend policy options to improve DA-ATTI programs.
Methodology Employed
The study employed a concurrent mixed-method approach, collecting both quantitative and qualitative data with convergent analysis to assess project performance and impact. To determine the results of DA-ATTI’s PAPs, the study validated RBME results using OECD-DAC criteria (relevance, effectiveness, efficiency, sustainability, and impact).
Analytical Techniques Used
Descriptive analysis was used to summarize dataset features such as central tendency, dispersion, and distribution. Inferential analysis, including paired t-tests, compared variable means before and after interventions. Binary logistic regression identified factors affecting technology adoption promoted by DA-ATTI. Thematic analysis qualitatively explored emerging themes from the data.
Key Findings on Framework Understanding
Findings revealed limited uniformity in understanding the AFE RBME framework across regions, particularly the ToC and Results Framework. While some staff were familiar with the System, newly hired regional staff lacked formal orientation. Implementation varied regionally, following structured yet adaptable approaches based on central guidelines. All regions recognized RBME’s importance in evaluating DA-ATTI effectiveness, technology adoption rates, and stakeholder feedback.
Regional Implementation Variations
Regional RBME implementation approaches differed based on logistical challenges and resources. Centers varied in capacity, with some facing manpower shortages and expertise gaps, highlighting the need for staff training. Other centers outsourced data collection to academic institutions to address capacity issues. In regions where M&E officers collected data, agricultural extension workers assisted as enumerators.
Performance and Impact Insights
RBME reports from 2016–2017 and 2018–2022 showed that indicators for increased access declined in the latter period due to pandemic restrictions. Indicators for client attitudes, skills, and knowledge remained stable, with 90% of clients reporting improved knowledge and high satisfaction. Farm productivity and income indicators showed limited progress.
