Complex coacervation plays an important role in various fields. Here, the influences of the backbone chemistry and ionic functional groups of five pairs of oppositely charged polyelectrolytes on complex coacervation were investigated. These pairs include synthetic polymers with aliphatic hydrocarbon backbones, peptides with amide bonds, and carbohydrates with glycosidic linkages. Despite sharing identical charged groups, specific pairs displayed distinct liquid/liquid and liquid/solid phase separations depending on the polyelectrolyte mixing ratio, buffer, and ionic strength. The coacervate phase boundary broadened in the orders: glycosidic linkages > amide backbone > aliphatic hydrocarbon backbone, and Tris-phosphate > Tris-acetate > Tris-chloride buffers. Coacervates prepared from polyelectrolytes with lower solubilities in water resisted disassembly at high salt concentrations, and their merge rate was slow. These observations suggest that the hydrophobic segments in polyelectrolytes interfere with the formation of complex coacervates; however, following coacervate formation, the hydrophobic segments render the coacervates stable and elastic.