A class of drugs in use for treating type II diabetes mellitus (T2D), typified by the pseudotetrasaccharide acarbose, act by inhibiting the alpha-glucosidase activity present in pancreatic secretions and in the brush border of the small intestine. Herein, we report the synthesis of a series of 4-substituted 1,2,3-triazoles conjugated with sugars, including D-xylose, D-galactose, D-allose, and D-ribose. Compounds were screened for alpha-glucosidase inhibitory activity using yeast maltase (MAL12) as a model enzyme. Methyl-2,3-O-isopropylidene-beta-D-ribofuranosides, such as the 4-(1-cyclohexenyl)-1,2,3-triazole derivative, were among the most active compounds, showing up to 25-fold higher inhibitory potency than the complex oligosaccharide acarbose. Docking studies on a MAL12 homology model disclosed a binding mode consistent with a transition-state-mimicking mechanism. Finally, the actual pharmacological potential of this triazole series was demonstrated by the reduction of postprandial blood glucose levels in normal rats. These compounds could represent new chemical scaffolds for developing novel drugs against T2D.