To elucidate the anti-inflammatory properties and constituents of Agrimonia pilosa Ledeb. (A. pilosa), a comprehensive investigation was conducted employing activity-guided isolation. The anti-inflammatory effects were evaluated through an in vitro nitric oxide (NO) assay on lipopolysaccharide (LPS)-treated RAW 264.7 macrophage cells. Seven bio-active compounds with anti-inflammatory properties were successfully isolated from the butanol fraction and identified as follows: quercetin-7-O-β-d-rhamnoside (1), apigenin-7-O-β-d-glucopyranoside (2), kaempferol-7-O-β-d-glucopyranoside (3), quercetin (4), kaempferol (5), apigenin (6), and apigenin-7-O-β-d-glucuronide-6″-butylester (7). All isolated compounds showed strong NO inhibitory activity with IC50 values ranging from 1.4 to 31 µM. Compound 6 demonstrated the most potent NO inhibition. Compound 7, a rare flavonoid, was discerned as a novel anti-inflammatory agent, ascertained through its inaugural demonstration of nitric oxide inhibition. Subsequently, a comprehensive structure-activity relationship (SAR) analysis was conducted employing eight flavonoids derived from A. pilosa. The outcomes elucidated that flavones exhibit superior NO inhibitory effects compared to flavonols, and the aglycone form manifests greater potency in NO inhibition than the glycone counterpart. These results highlight A. pilosa as a promising source of effective anti-inflammatory agents and indicate its potential as a health-beneficial dietary supplement and therapeutic material.