This is a branch temple of the Toyasan Shingon Sect main temple, Kongobu-ji. In the Keicho era, it was established as the workplace of the scholarly monks, Homon and Jumon of the Mount Koya. It was created as the "Koyasan Edo Zaibansho Koyaji". It negotiated general religious matters with the Tokugawa government and was used as a "furegashira" (a temple designated by the government) which notified the Old Shingon temples throughout the country of government communications. It played an important role, such as being the place where important officials from Mount Koya took turns visiting, a learning space for scholarly monks, and a place to practice Daishi worship.

Its history is very old and begins early in the Edo period in the Tokyo Betsuin of the Nagaira Temple of Soto-Shu Daihonzan. Many famous people such as the doctor and the culture person in the late Edo period (the district designated historic site), the former Isao Inoue Kaoru of the Meiji era and the western painter Kuroda Kiyoteru, and the comedy King Enoken are sleeping here. In April, 1977, the Bodhisattva statue, the world's largest, was completed as a single carving, although the rodent Kannon statue, which was the same work of Hasedera in Yamato and Kamakura, was involved in the war.

This branch temple is a direct branch of the Enpukuzan Myoganji Temple (commonly called Toyokawa Inari) in the city of Toyokawa, Aichi. During the Edo period, the impressive Buddha statue worshipped by Ooka Tadasuke of Echizen was moved from the Ooka mansion on the Hitotsugi Street of Akasaka to the current location here in 1887.