“Throwing the head out” is a very common mistake that does not add any technical or presentational value to this skill.
In the horizontal or uneven bars, there are some skills such as back giants that are convenient to master with both the head neutral and with the head slightly out. Neutral for a clean single body line or specifically on the high uneven bar for visual contact with the lower bar and the head slightly out to maintain visual contact with the same bar during release moves such as Gingers and Kolmans.
Throwing the head back is different than moving it slightly out for visual contact. Gymnasts’ execution for most skills will improve when they are able to get rid of the bad habit.