The natural product harmine, a representative β-carboline alkaloid from the seeds of Peganum harmala L. (Zygophyllaceae), possesses a broad spectrum of biological activities. In this study, a novel series of harmine derivatives containing N-benzylpiperidine moiety were identified for the treatment of Alzheimer's disease (AD). The results showed that all the derivatives possessed significant anti-acetylcholinesterase (AChE) activity and good selectivity over butyrylcholinesterase (BChE). In particular, compound ZLWH-23 exhibited potent anti-AChE activity (IC<sub>50</sub> = 0.27 μM) and selective BChE inhibition (IC<sub>50</sub> = 20.82 μM), as well as acceptable glycogen synthase kinase-3 (GSK-3β) inhibition (IC<sub>50</sub> = 6.78 μM). Molecular docking studies and molecular dynamics simulations indicated that ZLWH-23 could form stable interaction with AChE and GSK-3β. Gratifyingly, ZLWH-23 exhibited good selectivity for GSK-3β over multi-kinases and very low cytotoxicity towards SH-SY5Y, HEK-293T, HL-7702, and HepG2 cell lines. Importantly, ZLWH-23 displayed efficient reduction against tau hyperphosphorylation on Ser-396 site in Tau (P301L) 293T cell model. Collectively, harmine-based derivatives could be considered as possible drug leads for the development of AD therapies.