London needs to be less “elitist” if it is to find long-term economic success post-Brexit, according to a government adviser