Drug efflux pumps have emerged as a new drug targets for the treatment of bacterial infections in view of its critical role in promoting multidrug resistance. Herein, novel chromanone and 2H-benzo[h]chromene derivatives were designed by means of integrated molecular design and structure-based pharmacophore modeling in an attempt to identify improved efflux pump inhibitors that target Escherichia coli AcrB. The compounds were tested for their efflux inhibitory activity, ability to inhibit efflux, and the effect on bacterial outer and inner membranes. Twenty-three novel structures were identified that synergized with antibacterials tested, inhibited Nile Red efflux, and acted specifically on the AcrB. Among them, WK2, WL7 and WL10 exhibiting broad-spectrum and high-efficiency efflux inhibitory activity were identified as potential ideal AcrB inhibitors. Molecular modeling further revealed that the strong π-π stacking interactions and hydrogen bond networks were the major contributors to tight binding of AcrB.