Demolition has begun at a military site which has played a role in some of the most devastating moments in British history.