Frustrated low handicapper

I recently played with a golfer who is on a single figure handicap - and he got frustrated with his game.  It struck me that no matter what your handicap is, the enjoyment of a round comes from within, rather than counting the number of times I hit the ball!