Ecto-5'-nucleotidase (CD73) is well known for its implication in cancer. Inhibition of ecto-5'-nucleotidases is thought to provide an attractive approach to cancer therapy. This study identifies sulfonic acid compounds as efficient inhibitors of ecto-5'-nucleotidases. The compounds were tested against recombinant human and rat ecto-5'-nucleotidases. The most potent new sulfonic acid inhibitor 6-amino-4-hydroxynaphthalene-2-sulfonic acid (1) of ecto-5'-nucleotidase had an IC₅₀ of 1.32 ± 0.09 μM for the human and 10.4 ± 3.3 μM for the rat enzyme. Generally, all compounds were more active against the human enzyme. Plausible binding mode models were developed for this new class of inhibitors. Furthermore, several sulfonic acid inhibitors were efficient cytotoxic agents when tested on H157 cancer cell lines. Hence, new ecto-5'-nucleotidases inhibitors displayed significant potential for further development as compounds for anti-cancer therapy.