Cybersecurity threats in financial systems are increasingly recognised as critical issues, especially in East Africa where technological advancements often outpace regulatory measures. A mixed-methods approach was employed, combining a structured questionnaire survey with qualitative interviews among key stakeholders in the Eritrean banking sector. The analysis revealed that Eritrea's financial sector is particularly vulnerable to phishing attacks (45%) and ransomware threats (32%), which are common cybercrimes targeting such sectors globally. Mitigation strategies should focus on improving employee cybersecurity awareness, enhancing data encryption practices, and establishing more robust incident response protocols. Financial institutions in Eritrea should prioritise investing in advanced security technologies and continuously update their cybersecurity policies to align with international best practices. Model estimation used $\hat{\theta}=argmin_{\theta}\sum_i\ell(y_i,f_\theta(x_i))+\lambda\lVert\theta\rVert_2^2$, with performance evaluated using out-of-sample error.