The aggregation, arrangement and bonding together of a set of components to form the radial spoke, a protein complex that links the outer microtubule doublet of the ciliary or flagellum axoneme with the sheath that surrounds the central pair of microtubules.