The free fatty acid receptor 1 (FFA1) has emerged as an attractive anti-diabetic target that mediates glucose-stimulated insulin secretion. Several FFA1 agonists have been reported, but many of them possessed somewhat high lipophilicity and/or molecular weight. Herein, we describe the identification of sulfone-carboxylic acid moiety with the multiple advantages of reducing lipophilicity, cytotoxicity and β-oxidation associated with compound 2. Further structure-activity relationship study based on the previleged scaffolds led to the discovery of 2-{(4-[(2'-chloro-[1,1'-biphenyl]-3-yl)methoxy]phenyl)sulfonyl}acetic acid (compound 20), which showed a better balance than compound 2 in terms of physicochemical properties, cytotoxicity profiles and pharmacokinetic properties. Subsequent in vivo studies demonstrated that compound 20 robustly improves the glucose tolerance both in normal and type 2 diabetic models without the risk of hypoglycemia. Compared to the high risk of TAK-875 induced liver toxicity, there was no significant adverse effects such as hepatic and renal toxicity were observed in the chronic toxicity studies of compound 20 even at the higher dose.