A novel series of GPR40 agonists is designed by introducing nitrogen-containing heterocyclic ring at the terminal phenyl ring of TAK-875 with the aim of decreasing its lipophilicity. Three different β-substituted phenylpropionic acids were investigated as the acidic components. A total of 34 compounds have been synthesized, among which, compound 30 exhibited comparable GPR40 agonistic activity in vitro with TAK-875 and relatively lower lipophilicity through calculation (30, EC50 = 1.2 μM, cLogP = 1.3; TAK-875: EC50 = 5.1 μM, cLogP = 3.4). Moreover, compound 30 was able to enhance the insulin secretion of primary islets isolated from normal ICR mice and showed no obvious inhibition against cytochromes P450 in vitro. In vivo, compound 30 exhibited efficacy in oral glucose tolerance test (oGTT) in normal ICR mice.