CDK5RAP3 is a binding protein of CDK5 activating proteins and also one of the key co-factors of the E3 enzyme in the UFMylation system. Several reports have implicated the involvement of CDK5 and other components of the UFMylation system in neuronal development and multiple psychiatric disorders. However, the precise role of CDK5RAP3 in neurons remains elusive. In this study, we generated CDK5RAP3 neuron-specific knockout mice (CDK5RAP(F/F): Nestin-Cre). CDK5RAP3 conditional knockout (CDK5RAP3 CKO) mice exhibited severe encephalo-dysplasia and a slower developmental trajectory compared to wild-type (WT) mice and succumbed to postnatal demise by day 14. Transcriptome sequencing unveiled that CDK5RAP3 deficiency affects synapse formation, transmembrane trafficking and physiological programs in the brain. Morphological analysis demonstrated that neuronal CDK5RAP3 deficiency leads to increased SLC17A6 and N-glycosylase (RPN1 and ALG2) protein expression, and while causing endoplasmic reticulum (ER) stress. In vitro experiments utilizing CDK5RAP3(F/F): ROSA26-ERT2Cre MEFs were conducted to elucidate similar mechanism following CDK5RAP3 deletion. Both in vivo and in vitro, CDK5RAP3 deficiency significantly increased the expression of N-glycosylases (RPN1 and ALG2), as well as the total amount of glycoproteins. CDK5RAP3 may potentially maintain a balance by enhancing the degradation of RPN1 and ALG2 through proteolytic degradation pathways and autophagy. This study underscores the indispensable role of CDK5RAP3 in neuronal development and sheds new light on drug discovery endeavors targeting early brain abnormalities.