Presynaptic activation of protein kinase A (PKA) induces LTP in cerebellar parallel fiber synapses. Presynaptic LTP is known to require the active zone protein RIM1alpha, but the underlying induction mechanism remains unclear. We now show that PKA directly phosphorylates RIM1alpha at two sites. Using paired recordings from cultured cerebellar granule and Purkinje neurons, we demonstrate that LTP is absent in neurons from RIM1alpha KO mice but is rescued by presynaptic expression of RIM1alpha. Mutant RIM1alpha lacking the N-terminal phosphorylation site is unable to rescue LTP in RIM1alpha knockout neurons but selectively suppresses LTP in wild-type neurons. Our findings suggest that PKA-mediated phosphorylation of the active zone protein RIM1alpha at a single N-terminal site induces presynaptic LTP.