Phidianidines A and B are two novel marine indole alkaloids bearing an uncommon 1,2,4-oxadiazole ring and exhibiting various biological activities. Our previous research showed that the synthesized phidianidine analogs had the potential to inhibit the activity of protein tyrosine phosphatase 1B (PTP1B), a validated target for Type II diabetes, which indicates that these analogs are worth further structural modification. Therefore, in this paper, a series of phidianidine derivatives were designed and rapidly synthesized with a function-oriented synthesis (FOS) strategy. Their inhibitory effects on PTP1B and T-cell protein tyrosine phosphatase (TCPTP) were evaluated, and several compounds displayed significant inhibitory potency and specific selectivity over PTP1B. The structure-activity relationship (SAR) and molecular docking analyses are also described.