Journal Design Engineering Masthead
African Civil Engineering Journal | 03 September 2019

Comparative Methodological Evaluation of Process-Control System Adoption in Kenya

A Difference-in-Differences Analysis, 2000–2026
W, a, n, j, i, k, u, M, w, a, n, g, i, ,, A, m, i, n, a, O, c, h, i, e, n, g, ,, K, a, m, a, u, G, i, t, h, i, n, j, i
Difference-in-DifferencesProcess-ControlMethodological EvaluationKenya
DiD model sensitivity to parallel trends assumption is critically examined.
Analysis reveals potential for significant overestimation of treatment effects.
Data structure requirements frequently absent in available engineering datasets.
Methodological rigor must precede application of quasi-experimental designs.

Abstract

{ "background": "The adoption of advanced process-control systems in engineering sectors is a critical driver of industrial efficiency and productivity. However, rigorous quantitative evaluations of the causal impact of policies and interventions promoting such adoption in developing economies are scarce, limiting evidence-based decision-making.", "purpose and objectives": "This study conducts a methodological evaluation of the difference-in-differences (DiD) model for measuring adoption rates of process-control systems. It aims to assess the model's robustness and applicability within the Kenyan engineering context, identifying key methodological challenges and prerequisites for valid inference.", "methodology": "A comparative study design was employed, synthesising longitudinal data from engineering firms. The core DiD model is specified as $Y{it} = \\beta0 + \\beta1 \\text{Treat}i + \\beta2 \\text{Post}t + \\delta (\\text{Treat}i \\cdot \\text{Post}t) + \\epsilon_{it}$, where $\\delta$ is the average treatment effect. Estimation employed robust standard errors clustered at the firm level to account for serial correlation.", "findings": "The analysis reveals that the DiD estimator is highly sensitive to the parallel trends assumption, with a violation leading to a significant overestimation of the treatment effect by approximately 18 percentage points in simulated scenarios. Furthermore, the required data structure—balanced panels with consistent pre- and post-intervention periods—was frequently absent in available datasets, complicating direct application.", "conclusion": "While the DiD framework offers a powerful quasi-experimental design for evaluating adoption initiatives, its uncritical application in this context is problematic. Methodological rigour must be prioritised over the mere availability of panel data to ensure credible impact estimates.", "recommendations": "Future studies should incorporate pre-trend testing and robustness checks, such as event study designs or synthetic control methods. Investment in structured, high-frequency monitoring data is essential to build the evidence base required for effective industrial policy.", "key words": "process