A former policy heavy-hitter from the Department of Finance has been named as a new Defence associate secretary.