Tiger Woods 07 Wii Swing Question?

OK - got the hubby a wii for his bday back in August and also TW07. When he plays, he uses the regular wii controler and holds it face up but pointing down - kinda like a golf club - the problem he has is he'll still be swinging back or just starting to move and his golfer has already hit the ball - it's just very inconsistent - he hasn't let go of the on or anything . Has anyone ran into this and is there a "fix" for it or is it a bug in the system? Thanks for any help you can offer - i am finding i hate TG Wii golf afternoons as much as regular golf afternoons - lol