Histone deacetylase (HDAC) inhibitors have been recognized as promising approaches to the treatment of various human diseases including cancer, inflammation, neurodegenerative diseases, and metabolic disorders. Several pan-HDAC inhibitors are currently approved only as anticancer drugs. Interestingly, SAHA (vorinostat), one of clinically available pan-HDAC inhibitors, shows an anti-inflammatory effect at concentrations lower than those required for inhibition of tumor cell growth. It was also reported that HDAC6 selective inhibitor tubastatin A has anti-inflammatory and anti-rheumatic effect. In our efforts to develop novel HDAC inhibitors, we rationally designed various HDAC inhibitors based on the structures of two hit compounds identified by virtual screening of chemical database. Among them, 9a ((E)-N-hydroxy-4-(2-styrylthiazol-4-yl)butanamide) was identified as a HDAC6 selective inhibitor (IC50 values of 0.199 μM for HDAC6 versus 13.8 μM for HDAC1), and it did not show significant cytotoxicity against HeLa cells. In vivo biological evaluation of 9a was conducted on a lipopolysaccharide (LPS)-induced mouse model of sepsis. The compound 9a significantly improved 40% survival rate (P = 0.0483), and suppressed the LPS-induced increase of TNF-α and IL-6 mRNA expression in the liver of mice. Our study identified novel HDAC6 selective inhibitor 9a, which may serve as a potential lead for the development of anti-inflammatory or anti-sepsis agents.