Parenchyma represents a critically important living tissue in the sapwood of the secondary xylem of woody angiosperms. Considering various interactions between parenchyma and water transporting vessels, we hypothesize a structure–function relationship between both cell types. Through a generalized additive mixed model approach based on 2,332 woody angiosperm species derived from the literature, we explored the relationship between the proportion and spatial distribution of ray and axial parenchyma and vessel size, while controlling for maximum plant height and a range of climatic factors. When factoring in maximum plant height, we found that with increasing mean annual temperatures, mean vessel diameter showed a positive correlation with axial parenchyma proportion and arrangement, but not for ray parenchyma. Species with a high axial parenchyma tissue fraction tend to have wide vessels, with most of the parenchyma packed around vessels, whereas species with small diameter vessels show a reduced amount of axial parenchyma that is not directly connected to vessels. This finding provides evidence for independent functions of axial parenchyma and ray parenchyma in large vesselled species and further supports a strong role for axial parenchyma in long-distance xylem water transport.