Inhibitors of histone deacetylase (HDAC) proteins such as suberoylanilide hydroxamic acid (SAHA) have emerged as effective therapeutic anti-cancer agents. To better understand the structural requirements of HDAC inhibitors, a small molecule library with a variety of substituents attached adjacent to the metal binding hydroxamic acid of SAHA was synthesized. The presence of a substituent adjacent to the hydroxamic acid led to an 800- to 5000-fold decrease in inhibition compared to SAHA. The observed results have implications for drug design, suggesting that HDAC inhibitors with substituents near the metal binding moiety will have inhibitory activities in the micromolar rather than nanomolar range.