Among the >120 modified ribonucleosides in the prokaryotic epitranscriptome, many tRNA modifications are critical to bacterial survival, which makes their synthetic enzymes ideal targets for antibiotic development. Here we performed a structure-based design of inhibitors of tRNA-(N<sup>1</sup>G37) methyltransferase, TrmD, which is an essential enzyme in many bacterial pathogens. On the basis of crystal structures of TrmDs from <i>Pseudomonas aeruginosa</i> and <i>Mycobacterium tuberculosis</i>, we synthesized a series of thienopyrimidinone derivatives with nanomolar potency against TrmD in vitro and discovered a novel active site conformational change triggered by inhibitor binding. This tyrosine-flipping mechanism is uniquely found in <i>P. aeruginosa</i> TrmD and renders the enzyme inaccessible to the cofactor <i>S</i>-adenosyl-l-methionine (SAM) and probably to the substrate tRNA. Biophysical and biochemical structure-activity relationship studies provided insights into the mechanisms underlying the potency of thienopyrimidinones as TrmD inhibitors, with several derivatives found to be active against Gram-positive and mycobacterial pathogens. These results lay a foundation for further development of TrmD inhibitors as antimicrobial agents.