Abstract
{ "background": "Systemic safety and operational risk in manufacturing facilities are persistent challenges in industrialising economies. Current policy evaluations often rely on observational data, which limits causal inference regarding the efficacy of engineering and procedural interventions.", "purpose and objectives": "This policy analysis evaluates the methodological rigour and implementation of a randomised field trial designed to measure the causal impact of a structured risk-reduction protocol on plant system failures.", "methodology": "A cluster-randomised controlled trial was implemented across multiple manufacturing sites. Participating plants were randomly assigned to treatment (implementation of a standardised risk-assessment and mitigation protocol) or control groups. The primary outcome was the rate of major system failures per operational hour. The analysis employed a generalised linear mixed model: $\\log(E[Y{ij}]) = \\beta0 + \\beta1 T{ij} + \\gamma X{ij} + uj$, where $Y{ij}$ is the failure count for plant $i$ in cluster $j$, $T{ij}$ is the treatment indicator, $X{ij}$ are covariates, and $uj$ is a cluster random effect. Inference was based on cluster-robust standard errors.", "findings": "The trial methodology proved feasible but revealed significant contextual challenges. The intervention group exhibited a 22% reduction in the incidence rate of major failures (incidence rate ratio 0.78, 95% CI: 0.64 to 0.95). A key theme from process evaluation was the critical role of mid-level engineering supervision in protocol adherence.", "conclusion": "Randomised trials can generate high-quality evidence for engineering safety policy but require careful adaptation to industrial contexts. The significant reduction in failures supports the efficacy of the structured protocol.", "recommendations": "Policy evaluations for engineering safety should incorporate randomised designs where practicable. Funding bodies should support pilot studies to test trial logistics. Implementation policies must address supervisory capacity building to ensure intervention fidelity.", "key words": "policy evaluation, randomised controlled