It has been demonstrated that glutamine metabolism has become the main energy and building blocks supply for the growth and viability of a potentially large subset of malignant tumors. The glutamine metabolism often depends upon mitochondrial glutaminase (GLS) activity, which converts glutamine to glutamate and serves as a significant role for bioenergetic processes. Thus, recently, the GLS has become a key target for small molecule therapeutic intervention. Numerous medicinal chemistry studies are currently aimed at the design of novel and potent inhibitors for GLS, however, to date, only one compound (named CB-839) have entered clinical trials for the treatment of advanced solid tumors and hematological malignancies. The perspective summarizes the progress in the discovery and development of GLS inhibitors, including the potential binding site, biochemical techniques for inhibitor identification, and approaches for identifying small-molecule inhibitors, as well as future therapeutic perspectives in glutamine metabolism are also put forward in order to provide reference and rational for the drug discovery of novel and potent glutamine metabolism modulators.