Implementation of a Push Button -Based Tangible User Interface for Virtual Object Control in Unity

Rizki Dwi Irianti; Ashafidz Fauzan Dianta; Zakha Maisat Eka Darmawan; Firnanda Pristiana Nurmaida; Armany Rizqullah Saputra

doi:10.61992/jiem.v8i1.254

Rizki Dwi Irianti Politeknik Elektronika Negeri Surabaya
Ashafidz Fauzan Dianta Politeknik Elektronika Negeri Surabaya
Zakha Maisat Eka Darmawan Politeknik Elektronika Negeri Surabaya
Firnanda Pristiana Nurmaida Politeknik Elektronika Negeri Surabaya
Armany Rizqullah Saputra Politeknik Elektronika Negeri Surabaya

DOI: https://doi.org/10.61992/jiem.v8i1.254

Keywords: Tangible User Interface, Push Button, Unity, Physical-Digital Interaction, Interactive Multimedia

Abstract

This study discusses the implementation of a push-button based Tangible User Interface (TUI) as a physical interaction medium to control virtual objects in the Unity environment . The system is designed by integrating physical input devices in the form of push buttons connected to a microcontroller with a Unity application via serial communication. This study uses a system design and implementation method that includes the stages of requirements analysis, system architecture design, hardware and software implementation, and functional testing. User input is processed by the system to produce a visual response in the form of movement of virtual objects to the left or right with a toggle mechanism. The test results show that the system is able to respond to physical input in real-time with stable and consistent object movement according to user commands. This TUI implementation provides a more concrete interaction experience compared to conventional mouse-or keyboard-based interfaces, and has the potential to be developed as a basis for interactive media, control simulations, and multimedia applications based on physical-digital interaction.

References

Antle, A. N., & Wise, A. F. (2019). Getting down to details: Using theories of cognition and learning to inform tangible user interface design. Interacting with Computers, 31(4), 377–390. https://doi.org/10.1093/iwc/iwz019

Lindeman, R. W., Sibert, J. L., & Hahn, J. K. (2019). Towards usable VR: An empirical study of user interfaces for immersive virtual environments. In Proceedings of the IEEE Virtual Reality Conference (pp. 64–71). IEEE.

Preece, J., Rogers, Y., & Sharp, H. (2015). Interaction design: Beyond human–computer interaction (4th ed.). Wiley.

Salazar-Cardona, A. G., Muñoz-Sáenz, P. A., & Roldán-Gómez, J. J. (2023). Designing a tangible user interface (TUI) for the elderly based on their motivations and game elements. Sensors, 23(23), 9513. https://doi.org/10.3390/s23239513

Sheer, O., & Hornecker, E. (2010). Tangible user interfaces: Past, present, and future directions. Foundations and Trends in Human–Computer Interaction, 3(1–2), 1–137. https://doi.org/10.1561/1100000026

Uhrík, M., Koniar, D., & Novák, P. (2022). Augmented reality and tangible user interfaces as an extension of computational design tools. Architecture Papers of the Faculty of Architecture and Design STU, 27(2), 41–52. https://doi.org/10.2478/alfa-2022-0021

Unity Technologies. (2023). Unity user manual. https://docs.unity3d.com/Manual/index.html

Yildirim, B., Yildirim, S., & Celik, E. (2024). Learning circuits and coding with Arduino board in higher education using tangible and graphical user interfaces. Information, 15(5), 245. https://doi.org/10.3390/info15050245