Interactive Waterfall Projection with LiDAR

Abstract

This work presents an innovation in interactive design through a touch-controlled waterfall projection installation, utilizing RPLIDAR A2 and an InFocus IN136ST short-throw projector. Users intuitively interact by touching the projection wall, triggering a dynamic visual response of the waterfall splitting and virtual leaves falling. This interaction is enabled by a LiDAR sensor that accurately captures distance and degree data, which is then processed through a custom algorithm to convert the data into 2D vector coordinates. This algorithm allows a flat-plane projection to function as a touch screen without requiring physical modifications to its surface, a breakthrough in human-computer interaction. The result of this algorithm development is an SDK (Software Development Kit) actively used in the Immersive Design class at Universitas Multimedia Nusantara. This SDK is designed to simplify the development process of LiDAR-based interactive media applications, allowing students to focus on the creative and innovative aspects of their projects without being burdened by technical things. Thus, this SDK not only facilitates a more efficient development process but also encourages exploration and creation of innovative works in the field of art and interactive design. Beyond its unique and captivating aesthetic experience, this installation serves as a concrete demonstration of the potential applications of interactive technology in various contexts, including public installations such as interactive signage and interactive billboards. This work affirms how the integration of advanced technology and meticulous design can create meaningful, impactful experiences, and advance education and innovation in the realm of interactive design.