Phosphodiesterase 2 (PDE2) has received much attention for the potential treatment of the central nervous system (CNS) disorders and pulmonary hypertension. Herein, we identified that clofarabine (4), an FDA-approved drug, displayed potential PDE2 inhibitory activity (IC50 = 3.12 ± 0.67 μM) by structure-based virtual screening and bioassay. Considering the potential therapeutic benefit of PDE2, a series of purine nucleoside derivatives based on the structure and binding mode of 4 were designed, synthesized and evaluated, which led to the discovery of the best compound 14e with a significant improvement of inhibitory potency (IC50 = 0.32 ± 0.04 μM). Further molecular docking and molecular dynamic (MD) simulations studies revealed that 5'-benzyl group of 14e could interact with the unique hydrophobic pocket of PDE2 by forming extra van der Waals interactions with hydrophobic residues such as Leu770, Thr768, Thr805 and Leu809, which might contribute to its enhancement of PDE2 inhibition. These potential compounds reported in this article and the valuable structure-activity relationships (SARs) might bring significant instruction for further development of potent PDE2 inhibitors.