Gold retreated after hitting a fresh record as investors weighed remarks from policymakers ahead of a key jobs report due Friday.