I just caught a cold, which has completely threw my routine of jogging and swimming out of synch.

Am I correct to not exercise when I'm ill? I heard it can be counter productive. When should I start again? When the symptoms have gone away?