There has been increasing interest in the development of cellular behavior models that take advantage of three-dimensional (3D) cell culture. To enable assessment of differential perturbagen impacts on cell growth in 2D and 3D, we have miniaturized and adapted for high-throughput screening (HTS) the soft agar colony formation assay, employing a laser-scanning cytometer to image and quantify multiple cell types simultaneously. The assay is HTS compatible, providing high-quality, image-based, replicable data for multiple, co-cultured cell types. As proof of concept, we subjected colorectal carcinoma colonies in 3D soft agar to a mini screen of 1528 natural product compounds. Hit compounds from the primary screen were rescreened in an HTS 3D co-culture matrix containing colon stromal cells and cancer cells. By combining tumor cells and normal, nontransformed colon epithelial cells in one primary screening assay, we were able to obtain differential IC50 data, thereby distinguishing tumor-specific compounds from general cytotoxic compounds. Moreover, we were able to identify compounds that antagonized tumor colony formation in 3D only, highlighting the importance of this assay in identifying agents that interfere with 3D tumor structural growth. This screening platform provides a fast, simple, and robust method for identification of tumor-specific agents in a biologically relevant microenvironment.