In the current work, we report the discovery of new sulfonate and sulfamate derivatives of benzofuran- and benzothiophene as potent inhibitors of human carbonic anhydrases (hCAs) II, IX and XII. A set of derivatives, 1a-t, having different substituents on the fused benzofuran and benzothiophene rings (R = alkyl, cyclohexyl, aryl, NH<sub>2</sub>, NHMe, or NMe<sub>2</sub>) was designed and synthesized. Most of the derivatives exhibited higher potency than acetazolamide as inhibitors of the purified hCAII, IX and XII isoforms. The most potent inhibitors for hCAII, hCAIX and hCAXII were 1g, 1b and 1d with an IC<sub>50</sub> ± SEM values of 0.14 ± 0.03, 0.13 ± 0.03 and 0.17 ± 0.06 µM, respectively. In addition, compounds 1d and 1n exerted preferential inhibitory effect against hCAXII isozyme with good potencies. Some selected compounds were docked within the active pocket of these isozymes and binding of the molecules revealed that sulfonate and sulfamate rings were located towards the active cavity and compounds coordinated to zinc ions.