The rocks are largely volcanic, the stratification being complex.
Its roof is a single flat stratum of limestone; its walls are well marked by lines of stratification; dripstone also partly covers the walls, fills a deep fissure at the end of the cave, and spreads over the floor, where it mingles with an ancient bed of ashes, forming an ash-breccia (mostly firm and solid) that encloses fragments of sandstone, flint spalls, flint implements, charcoal and bones.
The sides of the hill are rocky, and remarkable for the regular stratification of the limestone, which gives the hill at a distance the appearance of being terraced.
St Kilda is probably the core of a Tertiary volcano, but, besides volcanic rocks, contains hills of sandstone in which the stratification is distinct.
The horizontal stratification of some of these masses gives them a curiously architectural aspect, further increased by the effect of the numerous vertical joints by which the rock is cleft into buttresses and recesses along the fronts of the precipices and into pinnacles and finials along the summits.