Fructose-1,6-bisphosphatase (FBPase) is an essential enzyme of GNG pathway. Significant advances demonstrate the FBPase plays a critical role in treatment of diabetes. Numerous FBPase inhibitors were developed by targeting AMP site, nevertheless, none of these inhibitors has exhibited suitable potency and druggability. Herein, a new allosteric site (C128) on FBPase was discovered, and several nitrostyrene compounds exhibiting potent FBPase inhibitions were found covalently bind to C128 site on FBPase. Mutagenesis suggest that C128 is the only cysteine that can influence FBPase inhibition, the N125-S124-S123 pathway was most likely involved in allosteric signaling transmission between C128 and active site. However, these nitrostyrenes may bind with multiple cysteine besides C128 in FBPase. To improve pocket selectivity, a series of novel compounds (14a-14n) were re-designed rationally by integrating fragment-based covalent virtual screening and machine-learning-based synthetic complexity evaluation. As expected, the mass spectrometry validated that the proportion of title compounds binding to the C128 in FBPase was significantly higher than that of nitrostyrenes. Notably, under physiological and pathological conditions, the treatment of compounds 14b, 14c, 14i or 14n led to potent inhibition of glucose production, as well as decreased triglyceride and total cholesterol levels in mouse primary hepatocytes. We highlight a novel paradigm that molecular targeting C128 site on FBPase can have potent hypoglycemic effect.