Neuronal mitochondria play important roles beyond ATP generation, including Ca2+ uptake, and therefore have instructive roles in synaptic function and neuronal response properties. Mitochondrial morphology differs significantly in the axon and dendrites of a given neuronal subtype, but in CA1 pyramidal neurons (PNs) of the hippocampus, mitochondria within the dendritic arbor also display a remarkable degree of subcellular, layer-specific compartmentalization. In the dendrites of these neurons, mitochondria morphology ranges from highly fused and elongated in the apical tuft, to more fragmented in the apical oblique and basal dendritic compartments, and thus occupy a smaller fraction of dendritic volume than in the apical tuft. However, the molecular mechanisms underlying this striking degree of subcellular compartmentalization of mitochondria morphology are unknown, precluding the assessment of its impact on neuronal function. Here, we demonstrate that this compartment-specific morphology of dendritic mitochondria requires activity-dependent, Camkk2-dependent activation of AMPK and its ability to phosphorylate two direct effectors: the pro-fission Drp1 receptor Mff and the recently identified anti-fusion, Opa1-inhibiting protein, Mtfr1l. Our study uncovers a new activity-dependent molecular mechanism underlying the extreme subcellular compartmentalization of mitochondrial morphology in dendrites of neurons in vivo through spatially precise regulation of mitochondria fission/fusion balance.