A series of novel thiazolidine-2,4-dione or rhodanine derivatives (<b>5a-5k</b>, <b>6a-6k</b>) were synthesized and evaluated for their α-glucosidase inhibitory activity. The majority of compounds exhibited potent inhibitory activity in the range of 5.44 ± 0.13 to 50.45 ± 0.39 μM, when compared to the standard drug acarbose (IC<sub>50</sub> = 817.38 ± 6.27 μM). Among the compounds in the series, compounds <b>5k</b>, <b>6a</b>, <b>6b</b>, <b>6e</b>, <b>6h</b> and <b>6k</b> showed potent inhibitory potential with IC<sub>50</sub> values of 20.95 ± 0.21, 16.11 ± 0.19, 7.72 ± 0.16, 7.91 ± 0.17, 6.59 ± 0.15 and 5.44 ± 0.13 μM, respectively. Compound <b>6k</b> (IC<sub>50</sub> = 5.44 ± 0.13 μM), containing chloro and rhodanine groups at the 2- and 4-positions of the phenyl ring respectively, was found to be the most active compound that inhibits α-glucosidase activity. Furthermore, molecular docking studies were performed to understand the binding interactions between the molecule and enzyme.