Currently, the arise of drug resistance and undesirable off-target effects of anti-cancer agents are major challenges for cancer treatment, which energizes medicinal chemists to develop more anti-cancer agents with high efficiency and low toxicity continuously. Sulfonamide derivatives are a class of promising compounds with diverse biological activities including anti-cancer, and parts of them have been marketed for cancer therapy, such as Belinostat, ABT-199 and Amsacrine. In this review, we summed up the recent advances of sulfonamide derivatives as potential anti-cancer agents based on the anti-cancer targets, such as aromatase, carbonic anhydrase (CA), anti-apoptotic B-cell lymphoma-2 (Bcl-2) proteins, topoisomerase and phosphatidylinositol 3-kinase (PI3K), and elucidated the corresponding structure-activity relationships (SARs) of most sulfonamide derivatives. We hope this review could provide a clear insight for medicinal chemists in the rational design of more potent and bio-target specific anti-cancer agents.