If you're not doing this before the light turns & ready to go immediately when it does turn, you're wasting others time & fuel particularly when not all cars get thru the light. I can not stand drivers who don't start moving soon after the light turns. So inconsiderate. You don't have to have a jack rabbit start that risks what you're worried about, but you do need to concentrate & be ready to go.
You missed the point entirely which was to delay driving into the intersection (after the light turned green) in case a car ran the red light from your left or right. Taking off the emergency brake and putting the vehicle into gear will take a 123 count.
I'm not worried about your time or fuel.