How Important Is It To Follow Rituals On Occasions Vs Remembering God Everyday

My dear, our scriptures say that doing rituals, poojas, going to temples etc bring chitta shuddhi, cleans out the mind of vasanas, good or bad. That enable us to see the truth behind everything and attain moksha/liberation from samsara. Being a Hindu, one is supposed to believe in the scriptures.
The fact that one doesnt feel like doing them, mostly due to practical reasons of our times, is fine. Most of all the rituals come in the karma kanda of our scriptures and each one carries a particular result. The fact is that we can never actually fulfill all the requisites of those rituals now and so there is doubt as to whether they carry the promised result at all.
You have said that you hold god in your heart and that is the main reason for all the pooja, pilgrimage etc. remembering something of a higher nature so the mind is happy, calm and peaceful. Periodic cleansing of the mind. At that time the mind is devoid of any of the 6 enemies of the mind...kama, krodha, loba, moha, madha, mascharya i.e. lust, anger, greed, illusion, pride and envy. In Hinduism, these 6 traits are considered negative characteristics of our mind.
Sri Ramakrishna says that when one evolves spiritually god himself helps the devotee to shed off such activities. He explains this through an analogy: "When a housewife is pregnant, her mother‑in-law reduces her duties. In the last month, she is almost free from work. When the child is born, there is complete renunciation of work. The mother only has to look after the baby. All chores in the household are attended to by the mother-in-law, the husband’s sister, or his elder sister-in-law.”-The Gospel of Sri Ramakrishna.
So you need not feel guilty, but its natural to feel that way, be at ease and continue to do what you are doing now. (Please bear with me for this very long reply)