Evidence for the tumour-supporting capacities of the tumour stroma has accumulated rapidly in colorectal cancer (CRC). Tumour stroma is composed of heterogeneous cells and components including cancer-associated fibroblasts (CAFs), small vessels, immune cells, and extracellular matrix proteins. The present study examined the characteristics of CAFs and collagen, major components of cancer stroma, by immunohistochemistry and Sirius red staining. The expression status of five independent CAF-related or stromal markers, decorin (DCN), fibroblast activation protein (FAP), podoplanin (PDPN), alpha-smooth muscle actin (ACTA2), and collagen, and their association with clinicopathological features and clinical outcomes were analysed. Patients with DCN-high tumours had a significantly worse 5-year survival rate (57.3% versus 79.0%; p = 0.044). Furthermore, hierarchical clustering analyses for these five markers identified three groups that showed specific characteristics: a solid group (cancer cell-rich, DCNLowPDPNLow); a PDPN-dominant group (DCNMidPDPNHigh); and a DCN-dominant group (DCNHighPDPNLow), with a significant association with patient survival (p = 0.0085). Cox proportional hazards model identified the PDPN-dominant group (hazard ratio = 0.50, 95% CI = 0.26-0.96, p = 0.037) as a potential favourable factor compared with the DCN-dominant group. Of note, DCN-dominant tumours showed the most advanced pT stage and contained the lowest number of CD8+ and FOXP3+ immune cells. This study has revealed that immunohistochemistry and special staining of five stromal factors with hierarchical clustering analyses could be used for the prognostication of patients with CRC. Cancer stroma-targeting therapies may be candidate treatments for patients with CRC.