Forward genetic screens with genome-wide CRISPR libraries are powerful tools for resolving cellular circuits and signaling pathways. Applying this technology to organoids, however, has been hampered by technical limitations. Here we report improved accuracy and robustness for pooled-library CRISPR screens by capturing sgRNA integrations in single organoids, substantially reducing required cell numbers for genome-scale screening. We applied our approach to wild-type and APC mutant human intestinal organoids to identify genes involved in resistance to TGF-β-mediated growth restriction, a key process during colorectal cancer progression, and validated hits including multiple subunits of the tumor-suppressive SWI/SNF chromatin remodeling complex. Mutations within these genes require concurrent inactivation of APC to promote TGF-β resistance and attenuate TGF-β target gene transcription. Our approach can be applied to a variety of assays and organoid types to facilitate biological discovery in primary 3D tissue models.