Shp2 protein tyrosine phosphate (PTP) is a novel target for anticancer drug discovery. We identified estramustine phosphate as a Shp2 PTP inhibitor from the National Cancer Institute Approved Oncology Drug set. A focused structure-activity relationship study indicated that the 17-phosphate group is required for the Shp2 PTP inhibitor activity of estramustine phosphate. A search for estramustine phosphate analogs led to identification of two triterpenoids, enoxolone, and celastrol, having Shp2 PTP inhibitor activity. With the previously reported PTP1B inhibitor trodusquemine, our study reveals steroids and triterpenoids with negatively charged phosphate, carboxylate, or sulfonate groups as novel pharmacophores of selective PTP inhibitors.