The name Kalayat seems to be derived from Kapilayatana. There are two brick temples which date back to circa CE 850. Built with carved bricks without any mortar, these temples are good examples of temple architecture and show a creative flowering of sculptural art. The temples form representative specimens of Gurjara-Pratihara style, evolved from the Gupta and post-Gupta edifices.
The Prachin Sivalaya is datable to late medieval period.
In view of its historical importance it was declared protected as a monument of national importance vide notification no. S.O.3392 dated 13.12.1995.