His frustration burst through when he was asked about it on the campaign trail this week, surrounded by crowds in the Brittany village of Spézet.