Immersive learning scenarios aim to involve the user in activities. 3D environments and tangible user interfaces enable immersive learning scenarios. The next step is combining real time 3D model generation, gesture control, and simulation engines into complex scenarios such as the following movie exemplifies with a sandbox and a kinnect based 3D modelling approach.
This combination of approaches (done by the UC Davis W.M. Keck Center for Active Visualization in the Earth Sciences, http://www.keckcaves.org) paves the way for learning scenarios, which combine the physical environment (here: the sandbox) with simulated augmentations (here: the water). Combined with the gesture control and the realtime model updates, this allows for very complex scenarios to be experienced in a simple trial and error manner.