Imine derivatives were obtained by condensation of sulfanilamide with substituted aromatic aldehydes. The Schiff bases were thereafter reduced with sodium borohydride, leading to the corresponding amines, derivatives of 4-sulfamoylphenyl-benzylamine. These sulfonamides were investigated as inhibitors of the human carbonic anhydrase (hCA, EC 4.2.1.1) isoforms hCA I and II (cytosolic isozymes), as well as hCA IX and XII (transmembrane, tumor-associated enzymes). We noted that the compounds incorporating secondary amine moieties showed a better inhibitory activity against all CA isozymes compared to the corresponding Schiff bases. Low nanomolar CA II, IX and XII inhibitors were detected, whereas the activity against hCA I was less potent. The secondary amines incorporating sulfonamide or similar zinc-binding groups, poorly investigated chemotypes for designing metalloenzyme inhibitors, may offer interesting opportunities in the field due to the facile preparation and possibility to explore a vast chemical space.