International Journal of Scientific Research and Engineering Development

The increasing usage of Internet of Things (IoT) technology in home settings has created a significant need for more intelligent and naturalistic means of controlling these devices. Current solutions, such as mobile app control, physical wall control, and voice control, all involve the user's cognitive process of mapping the digital control to the physical device, which is an unnecessary process and makes the control more difficult. This paper proposes a complete Augmented Reality (AR) solution for smart home automation, which will display the real-time status and control buttons of the devices directly on the physical device as seen on the smartphone's camera view, creating a Digital Twin interface. The system will be developed with an ESP32 microcontroller, which will be connected to the 2-Channel Active-Low Relay Module and will be set up as a Soft Access Point (SoftAP) with the IP address 192.168.4.1. The Android app will be developed with Java and the CameraX library for the camera view and the OkHttp library for network communication.The technical contribution of this work is in developing an 18-Degree Spatial Awareness Threshold (SAT) that leverages a smartphone's native Rotation Vector Sensor and quaternion-based orientation tracking to detect when a user is pointing at an appliance, thus triggering the AR overlay without any camera-based marker tracking. Over 50 trials, it was confirmed that there is a latency of 83.4 ms in detecting a point, 118.7 ms in actuating a relay, and a 96% accuracy in device identification, thus proving that it is a viable and efficient smart home interface.

Mr.Moinuddin Patel, Mr.Muqri Anas, Mr.Ansari Arshan, Mr.Yakub Nagpurwala, Ms.Aziza Walele, Ali Karim Sayed,"Smart Home Automation Using Augmented Reality" International Journal of Scientific Research and Engineering Development, V9(2): Page(1799-1804) Mar-Apr 2026. ISSN: 2581-7175. www.ijsred.com. Published by Scientific and Academic Research Publishing.