PB2 is an important subunit of influenza RNA-dependent RNA polymerase (RdRP) and has been recognized as a promising target for the treatment of influenza. We herein report the discovery of a new series of PB2 inhibitors containing the skeleton 5-(5-fluoro-1H-pyrrolo[2,3-b]pyridin-3-yl)pyrazin-2(1H)-one. Compound 12b is the most potent one, which showed K<sub>D</sub> values of 0.11 μM and 0.19 μM in surface plasmon resonance (SPR) and isothermal titration calorimetry (ITC) assays, respectively. In antiviral activity and cellular cytotoxicity assays, compound 12b showed an EC<sub>50</sub> value of 1.025 μM and a CC<sub>50</sub> value greater than 100 μM. Molecular docking was also used to predict the binding mode of 12b with PB2. Collectively, this study provides a promising lead compound for subsequent anti-influenza drug discovery targeting PB2.