Alzheimer's disease (AD) is one of the most common neurodegenerative disorders, which is characterized by the primary risk factor, age. Several attempts have been made to treat AD, while most of them end in failure. However, with the deepening study of pathogenesis of AD, the expression of HDAC6 in the hippocampus, which plays a major role of the memory formation, is becoming worth of notice. Neurofibrillary tangles (NFTs), a remarkable lesion in AD, has been characterized in association with the abnormal accumulation of hyperphosphorylated Tau, which is mainly caused by the high expression of HDAC6. On the other hand, the hypoacetylated tubulin induced by HDAC6 is also fatal for the neuronal transport, which is the key impact of the formation of axons and dendrites. Overall, the significantly increased expression of HDAC6 in brain regions is deleterious to neuron survival in AD patients. Based on the above research, the inhibition of HDAC6 seems to be a potential therapeutic method for the treatment of AD. Up to now, various types of HDAC6 inhibitors have been discovered. This review mainly analyzes the HDAC6 inhibitors reported amid 2010-2020 in terms of their structure, selectivity and pharmacological impact towards AD. And we aim at facilitating the design and development of better HDAC6 inhibitors in the future.