This study revealed that Bushenge Provincial Hospital had lower prevalence than other rural hospitals in Rwanda (13.3%). Most factors associated with neonatal mortality are avoidable; hence preventive measures such as enhancing the utilization of antenatal care services, early identification and referral of high-risk pregnancy and neonates could reduce the neonatal deaths.