According to Hindu legend, Shiva came down to earth in the form of Sundareswarar to marry Meenakshi, an incarnation of [Parvati]. Parvati had earlier descended to earth in the form of a small child in response to the great penance of the ruler of Madurai. After growing up to adulthood, she began ruling the city. The Lord appeared on earth and proposed to her. The marriage was supposed to be the biggest event on earth, with the whole earth gathering near Madurai. Vishnu, the brother of Meenakshi, was traveling to preside over the marriage . Due to a divine play, he was tricked by god [Indra] and delayed on the way. Meanwhile, the marriage was presided over by a local god [Koodal Azhaghar]. This is celebrated annually as 'Chitirai Thiruvizha' in Madurai. During the period of Nayakar rule in Madurai,in order to link the 'Azhakar Thiruvizha' and the 'Chitirai Thiruvizha' a story was added that Vishnu was angered and swore he'd never cross 'Vaigai' Later he was pacified by the other lords. Hence born the 'Azhaghar Thiruvizha'.

The history of the original structure is not properly known, but Tamil literature speaks about the temple for the last couple of millennia. [Thirugnanasambandar], the famous Hindu saint of [Shaiva] philosophy, has mentioned this temple as early as the 7th century, and describes the Lord as Aalavai Iraivan. The temple was believed to have been sacked by the infamous invader in 1310and all the ancient elements were destroyed. The initiative to rebuild the structure was taken by [Arya Natha Mudaliyar] , the Prime Minister of the first Nayak of Madurai (1559-1600 A.D.), the founder of 'Poligar System'. Then came the most valuable contributions of circa 1623 to 1659. He took considerable interest in erecting the Vasantha Mandapa of the temple complex.