The New Forest is very nice for a holiday, but… as a base for the Olympics?!
So: you go somewhere nice and pleasant, but, instead of spending time enjoying the nice pleasant stuff, spend at least 4hrs each day on public transport getting to East London.