How bad is it to shift my dirt bike this way?

If you do it the way you are saying, then you shouldn't do any damage to your bike. Trouble comes when you "miss" a true power shift which is with a wide open throttle. I've blown a rod in a BSA in my younger days doing this.