A process assessment framework for rural ICT projects in developing countries: an exploration of the Siyakhula Living Lab, South Africa

摘要

Rural development can be supported by information and knowledge which are key strategic resources for socio economic development. ICTs enable the facilitation and communication of information between remotely dispersed individuals or groups and more developed regions. While it has become common place that ICTs possess capabilities to potentially support rural development, the concept of ICT for development (ICT4D) is still fraught with challenges and barriers, which impede the success and sustainability of ICT4D projects. It is therefore essential to evaluate rural ICT projects, as such an analysis may aid in revealing information related to the need, effectiveness, impact, and sustainability of these projects. This research seeks to further the implementation and exploration of the Rural ICT Comprehensive Evaluation Framework (RICT-CEF), through the application of the Process Assessment domain in a real life rural ICT project environment. The RICT-CEF framework consisting of 7 evaluation domains has the primary objective of evaluating rural ICT projects from their inception stages to post implementation. A process assessment seeks to determine whether or not a rural ICT project is operating to implement its intended functions in the intended way specified in the projects plan. Such an assessment is invaluable to a comprehensive evaluation. Evaluation questions for a process assessment are centred around critical themes of project performance. Critical themes are aspects of a programme or projects implementation which must be enacted in order to achieve desired project outcomes. This research study is aimed at identifying critical themes of process assessment relevant to rural ICT4D projects. To identify critical themes, assessment approaches on social programme process assessments, evaluation of information systems in use, and rural ICT4D project evaluation case studies are comparatively analysed. Fourteen assessment approaches from these three categories are selected based on criteria. To analyse selected assessment approaches, a template is created based on the research questions, foundational literature on process assessment and identified challenges applicable to process assessments of rural ICT4D projects. Comparing and contrasting critical themes from these assessment approaches highlight critical themes essential to assess in the iterative implementation phase of rural ICT projects. Accentuated critical themes include, service utilization, organizational function and external project factors. These themes, along with suggested guiding principles from literature for conducting process assessments enable the creation of a framework for conducting process assessments of rural ICT projects. The framework is labelled "the Rural ICT Project Process Assessment Framework (RICTP-PAF)". The application of the RICTP-PAF in a real life rural ICT project through a design science case study provides lessons learned (suitability and shortcomings) from applying the framework. This essentially demonstrates the sensitivity of the RICTP-PAF to rural contexts in which it is implemented in. For instance, the implemented prototype of the RICTP-PAF reveals that the framework places a great deal of emphasis on rural beneficiary perspectives. A practice which has been lacking in such evaluation exercises. Furthermore, the guiding principles elucidated, bring to mind best practices to deal with issues such as stakeholder conflict, unreliable data elicitation and unethical assessment practices. The RICTP-PAF represents a fundamental tool for process assessments of rural ICT projects, and may be adopted and customized to various rural ICT project contexts in developing countries.