Yeah : LOD is the rule , several LOD !
And some objects should only be displayed when you are really near like tress etc ...
And your should write your own Town management engine.

Search on google to see how works GTA !
Keep it up.

Just do It !!

http://independentcreator.over-blog.com/pages/3D_Models-7792999.html