2,4-Dichlorophenoxyacetic acid (2,4-D) is a systemic conductive herbicide widely used across the world. With the large-scale and continuous use of 2,4-D, its possible harm to the environment and non-target organisms has attracted increasing attention, and the construction of a stable rapid on-site detection method is particularly important. In order to achieve on-site rapid detection of 2,4-D, we developed a gold nanoparticle immunochromatographic strip method with the visual elimination value was 50 ng/mL, and a quantitative detection limit of 11 ng/mL based on a nanobody. By combing with the color snap, the immunochromatographic strip could quantitatively analyze the amounts of 2,4-D. Meanwhile, a colorimetric card based on the true color of the test strips was developed for the qualitative analysis of 2,4-D on-site. The samples (water, fruits and vegetables) with and without 2,4-D were detected by the immunochromatographic strips, and the results showed the accuracy and reliability. Thus, this assay is a rapid and simple on-site analytical tool to detect and quantify 2,4-D levels in environmental samples, and the analytical results can be obtained in about ten minutes. In addition, the nanobody technology used in this study provides an inexhaustible supply of a relatively stable antibodies that can be archived as a nanobody, plasmid or even its sequence.