Rob I would have a little chat with the doctor.
It does not matter how many times a week you go to the gym although its good for your heart. The Heart is just a muscle that needs to exercised.
Normally the fitter you are the slower your heart rate.
Get checked out mate dont want to worry you I had my first heart attack @43, 103 years ago.