SHP2 is a phosphatase/adaptor protein that plays an important role in various signaling pathways. Its mutations are associated with cancers and developmental diseases. SHP2 contains a protein tyrosine phosphatase (PTP) and two SH2 domains. Selective inhibition of these domains has been challenging due to the multitude of homologous proteins in the proteome. Here, we developed a monobody, synthetic binding protein, that bound to and inhibited the SHP2 PTP domain. It was selective to SHP2 PTP over close homologs. A crystal structure of the monobody-PTP complex revealed that the monobody bound both highly conserved residues in the active site and less conserved residues in the periphery, rationalizing its high selectivity. Its epitope overlapped with the interface between the PTP and N-terminal SH2 domains that is formed in auto-inhibited SHP2. By using the monobody as a probe for the accessibility of the PTP active site, we developed a simple, nonenzymatic assay for the allosteric regulation of SHP2. The assay showed that, in the absence of an activating phospho-Tyr ligand, wild-type SHP2 and the "PTP-dead" C459E mutant were predominantly in the closed state in which the PTP active site is inaccessible, whereas the E76K and C459S mutants were in the open, active state. It also revealed that previously developed monobodies to the SH2 domains, ligands lacking a phospho-Tyr, weakly favored the open state. These results provide corroboration for a conformational equilibrium underlying allosteric regulation of SHP2, provide powerful tools for characterizing and controlling SHP2 functions, and inform drug discovery against SHP2.