The history of this holy place of Devarayana Durga is described in full length in a sacred book called "Karigiri Mahatme". This book consists of 12 chapters depicting the entire puranas (epics)
Asthe Karigira Kashin Thribhi Sammmuchitha
Sheesha SimhaGajakha Khagendra Eva Drishyanhe
The meaning of the above stanza is that Kari Giri consists of three mountains and it has got 4 different shapes. In the sacred legend there are detailed description of the origin of the temple. As per the orders of God Brahma Deva undertook penance in the mountain (Kari Giri) for about 10000 years to get the blessings of Shri Narasimha Swamy. Pleased by the penance of Brahma Deva God appeared before him in the form of Shri Lakshmi Narasimha Swamy. Along with Brahma Deva, 19 sages worshipped Shri Lakshmi Narasimha SWamy on the banks of Shri Narasimha Pond (Kumbi Mountain). The same place is the sanctum sanctorium of thiss temple. During Rathotsava the flag of Garuda will be hoisted in this place only.
The great Parashara sage prayed before the God to bless him with progeny. Immediately Shri Narasimha Swamy gave him a boon by saying "Varam Varaya Bhadranthe". At this juncture great Parashars sage requested Shri Narasimha Swamy to be born as his son. Accordingly Shri Narasimha Swamy took birth as the son of Parashara sage in the form of Veda Vyasa. To establish this fact there is still a pond called Parashara Pond in the north east direction of Narasimha Pond.