Abstract
Cavity-electromechanical systems are extensively used for sensing and controlling the vibrations of mechanical resonators down to their quantum limit. The nonlinear radiation-pressure interaction in these systems could result in an unstable response of the mechanical resonator showing features such as frequency-combs, period-doubling bifurcations and chaos. However, due to weak light-matter interaction, typically these effects appear at very high driving strengths. By using polariton modes formed by a strongly coupled flux-tunable transmon and a microwave cavity, here we demonstrate an electromechanical device and achieve a single-photon coupling rate (g0/2π) of 160 kHz, which is nearly 4% of the mechanical frequency ω(m). Due to large g(0)/ω(m) ratio, the device shows an unstable mechanical response resulting in frequency combs in sub-single photon limit. We systematically investigate the boundary of the unstable response and identify two important regimes governed by the optomechanical backaction and the nonlinearity of the electromagnetic mode. Such an improvement in the single-photon coupling rate and the observations of microwave frequency combs at single-photon levels may have applications in the quantum control of the motional states and critical parametric sensing. Our experiments strongly suggest the requirement of newer approaches to understand instabilities.