A series of N-substituted 4-alkylpiperidine hydroxamic acids, corresponding to the basic structure of histone deacetylase (HDAC) inhibitors (zinc binding moiety-linker-capping group) has been previously reported by our group. Linker length and aromatic capping group connection were systematically varied to find the optimal geometric parameters. A new series of submicromolar inhibitors was thus identified, which showed antiproliferative activity on HCT-116 colon carcinoma cells. We report here the second part of the strategy used in our research group to find a new class of HDAC inhibitors, namely the SAR study for the compounds bearing a sulfonyl group on the piperidine nitrogen. In the present work, we have considered both sulfonamides and sulfonyl ureas.