There were a few dozen stunt men who were his height and build as you say. They also had 'Weaving wigs' on, that is, they had to have their heads shaved to match Hugo's 'large forehead' as he delicately put it. ;)