There's at least one very obvious point near the beginning of the fight too where it's obvious that it's not Smith being kicked around by Neo... try not to blink though;)