Our seaside holiday hotspot is being ruined by second home owners who clog it up in summer but leave it empty in the dead of winter – it’s ripping the soul out of our tight-knit town