Are the secretaries of defense, Army, Navy, etc, etc, necessary?

The service secretaries are appointed to the President's Cabinet. They provide civilian oversight of the military on behalf of the President. That helps ensure that the military is always under civilian control, rather than just doing their own thing.