I think there is no magic trick to do this. In the end it depends on clever level design like connecting two areas containing a lot of entities with a small corridor and manually freeing the already visited area from memory and manually loading the new area into memory while the player walks through the corridor. Big games do thing like this all the time.