Metal ion chelators based on 8-hydroxyquinoline (8-HQ) have been widely explored for the treatment of many diseases. When aimed at being developed into potent anticancer agent, a largely unmet issue is how to avoid nonspecific chelation of metal ions by 8-HQ in normal cells or tissues. In the current work, a two-step strategy was employed to both enhance the anticancer activity of 8-HQ and improve its cancer cell specificity. Considering the well-known anticancer activity of nitric oxide (NO), NO donor furoxan was first connected to 8-HQ to construct HQ-NO conjugates. These conjugates were screened for their cytotoxicity, metal-binding ability, and NO-releasing efficiency. Selected conjugates were further modified with a ROS-responsive moiety to afford prochelators. Among all the target compounds, prodrug HQ-NO-11 was found to potently inhibit the proliferation of many cancer cells but not normal cells. The abilities of metal chelation and NO generation by HQ-NO-11 were confirmed by various methods and were demonstrated to be essential for the anticancer activity of HQ-NO-11. In vivo studies revealed that HQ-NO-11 inhibited the growth of SW1990 xenograft to a larger extent than 8-HQ. Our results showcase a general method for designing novel 8-HQ derivatives and shed light on obtaining more controllable metal chelators.