Will it be hectic to pursue regular B.Com and CA together?

No, it won't be tough as the syllabus correlates.

You may start CA with CPT, and in your second year, you can join B.Com from School of Open Learning to keep it balanced. The regular course becomes difficult as you need to attend your CA coaching and prepare for the exams too. Nevertheless, students have completed both with flying colors.