Pleiotropic intervention has prominent advantages for complex pathomechanisms, such as Alzheimer's disease (AD). In this study, a series of novel 3-(4-pyridyl)-5-(4- sulfamido-phenyl)-1,2,4-oxadiazole derivatives were designed and synthesized following the multitarget-directed ligand-based strategy. All compounds were evaluated for glycogen synthase kinase 3β (GSK-3β) inhibition and antineuroinflammatory and neuroprotective activities. Given that abnormal glucose metabolism plays an important role in AD occurrence and development, the effects of all compounds on glucose consumption in HepG2 cells was evaluated. Compounds 5e and 10b showed good dual potency in GSK-3β inhibition (IC: 5e = 1.52 μM, 10b = 0.19 μM) and antineuroinflammatory potency (IC: 5e = 0.47 ± 0.64 μM, 10b = 6.94 ± 2.33 μM). The effect of compound 10b on glucose consumption was higher than that of positive drug metformin. These compounds exerted a certain neuroprotective effect. Compound 10b dramatically reduced Aβ-induced Tau hyperphosphorylation, thus inhibiting GSK-3β at the cellular level. Notably, compounds 5e and 10b exhibited good inhibitory effects on the formation of intracellular reactive oxygen species (ROS). Moreover, these compounds displayed proper blood-brain barrier permeability and lacked neurotoxicity up to 50 μM concentration. Finally, in vivo experiments revealed that compound 10b improved cognitive impairment in scopolamine-induced mouse models. Results indicated that compound 10b deserves further study as a multifunctional lead compound.