The sense of smell has potent effects on appetite, but the underlying neural mechanisms are largely a mystery. The hypothalamic arcuate nucleus contains two subsets of neurons linked to appetite: AgRP (agouti-related peptide) neurons, which enhance appetite, and POMC (pro-opiomelanocortin) neurons, which suppress appetite. Here, we find that AgRP and POMC neurons receive indirect inputs from partially overlapping areas of the olfactory cortex, thus identifying their sources of odor signals. We also find neurons directly upstream of AgRP or POMC neurons in numerous other areas, identifying potential relays between the olfactory cortex and AgRP or POMC neurons. Transcriptome profiling of individual AgRP neurons reveals differential expression of receptors for multiple neuromodulators. Notably, known ligands of the receptors define subsets of neurons directly upstream of AgRP neurons in specific brain areas. Together, these findings indicate that higher olfactory areas can differentially influence AgRP and POMC appetite neurons, that subsets of AgRP neurons can be regulated by different neuromodulators, and that subsets of neurons upstream of AgRP neurons in specific brain areas use different neuromodulators, together or in distinct combinations to modulate AgRP neurons and thus appetite.