KMITL Innovation Expo 2026 LogoKMITL 66th Anniversary Logo

A Human-engaging Robotic Interactive Assistant

A Human-engaging Robotic Interactive Assistant

Abstract

The integration of intelligent robotic systems into human-centric environments, such as laboratories, hospitals, and educational institutions, has become increasingly important due to the growing demand for accessible and context-aware assistants. However, current solutions often lack scalability—for instance, relying on specialized personnel to repeatedly answer the same questions as administrators for specific departments—and adaptability to dynamic environments that require real-time situational responses. This study introduces a novel framework for an interactive robotic assistant (Beckerle et al. , 2017) designed to assist during laboratory tours and mitigate the challenges posed by limited human resources in providing comprehensive information to visitors. The proposed system operates through multiple modes, including standby mode and recognition mode, to ensure seamless interaction and adaptability in various contexts. In standby mode, the robot signals readiness with a smiling face animation while patrolling predefined paths or conserving energy when stationary. Advanced obstacle detection ensures safe navigation in dynamic environments. Recognition mode activates through gestures or wake words, using advanced computer vision and real-time speech recognition to identify users. Facial recognition further classifies individuals as known or unknown, providing personalized greetings or context-specific guidance to enhance user engagement. The proposed robot and its 3D design are shown in Figure 1. In interactive mode, the system integrates advanced technologies, including advanced speech recognition (ASR Whisper), natural language processing (NLP), and a large language model Ollama 3.2 (LLM Predictor, 2025), to provide a user-friendly, context-aware, and adaptable experience. Motivated by the need to engage students and promote interest in the RAI department, which receives over 1,000 visitors annually, it addresses accessibility gaps where human staff may be unavailable. With wake word detection, face and gesture recognition, and LiDAR-based obstacle detection, the robot ensures seamless communication in English, alongside safe and efficient navigation. The Retrieval-Augmented Generation (RAG) human interaction system communicates with the mobile robot, built on ROS1 Noetic, using the MQTT protocol over Ethernet. It publishes navigation goals to the move_base module in ROS, which autonomously handles navigation and obstacle avoidance. A diagram is explained in Figure 2. The framework includes a robust back-end architecture utilizing a combination of MongoDB for information storage and retrieval and a RAG mechanism (Thüs et al., 2024) to process program curriculum information in the form of PDFs. This ensures that the robot provides accurate and contextually relevant answers to user queries. Furthermore, the inclusion of smiling face animations and text-to-speech (TTS BotNoi) enhanced user engagement metrics were derived through a combination of observational studies and surveys, which highlighted significant improvements in user satisfaction and accessibility. This paper also discusses capability to operate in dynamic environments and human-centric spaces. For example, handling interruptions while navigating during a mission. The modular design allows for easy integration of additional features, such as gesture recognition and hardware upgrades, ensuring long-term scalability. However, limitations such as the need for high initial setup costs and dependency on specific hardware configurations are acknowledged. Future work will focus on enhancing the system’s adaptability to diverse languages, expanding its use cases, and exploring collaborative interactions between multiple robots. In conclusion, the proposed interactive robotic assistant represents a significant step forward in bridging the gap between human needs and technological advancements. By combining cutting-edge AI technologies with practical hardware solutions, this work offers a scalable, efficient, and user-friendly system that enhances accessibility and user engagement in human-centric spaces.

Objective

งานวิจัยนี้มีที่มาจาก ความต้องการที่เพิ่มขึ้นสำหรับผู้ช่วยอัจฉริยะ ใน สภาพแวดล้อมที่เน้นมนุษย์เป็นศูนย์กลาง เช่น ห้องปฏิบัติการและสถาบันการศึกษา ซึ่งเผชิญปัญหาเรื่อง ข้อจำกัดด้านทรัพยากรบุคคล ในการให้ข้อมูลแก่ผู้เยี่ยมชมและนักศึกษา ปัจจุบัน โซลูชันที่มีอยู่มัก ขาดความสามารถในการขยายขนาด และ ปรับตัวให้เข้ากับสภาพแวดล้อมที่เปลี่ยนแปลง ได้อย่างมีประสิทธิภาพ นอกจากนี้ ระบบผู้ช่วยแบบเดิมมักพึ่งพาบุคลากรเฉพาะทาง ทำให้เกิดภาระในการตอบคำถามซ้ำๆ และไม่สามารถรองรับจำนวนผู้ใช้ที่เพิ่มขึ้นได้ ดังนั้น งานวิจัยนี้จึงมุ่งพัฒนา ผู้ช่วยหุ่นยนต์เชิงโต้ตอบ ที่สามารถ ทำงานอัตโนมัติในสภาพแวดล้อมแบบไดนามิก โดยใช้ AI และโมเดลภาษาขนาดใหญ่ (LLM Predictor) ผสานกับ การรู้จำเสียง ท่าทาง และใบหน้า เพื่อเพิ่ม การมีส่วนร่วมของผู้ใช้ และ ความสามารถในการโต้ตอบ แบบเรียลไทม์ ระบบนี้ยังช่วยลดภาระของบุคลากรและเพิ่ม การเข้าถึงข้อมูล ได้อย่างแม่นยำและมีประสิทธิภาพ อีกทั้งยังรองรับการพัฒนาเพิ่มเติมเพื่อให้สามารถขยายขีดความสามารถและใช้งานได้หลากหลายขึ้นในอนาคต

Other Innovations

A Study of Sound Absorption Material Using Rubber Powder from Old Tires

คณะวิศวกรรมศาสตร์

A Study of Sound Absorption Material Using Rubber Powder from Old Tires

In Thailand, the quantity of old tires has been increasing annually, posing a significant environmental challenge due to their non-biodegradable material. However, old tires contain an internal porous structure, which suggests their potential application as sound-absorbing materials. Porosity is a key characteristic that enables materials to trap sound waves, making them effective for noise reduction. Therefore, this study aims to investigate and develop sound-absorbing materials from old tire rubber powder. The methodology involved mixing old tire powder with fresh latex at a ratio of 1:2, followed by drying at a temperature of 120°C for four hours. Subsequently, the physical properties influencing sound absorption, including density, porosity, and water absorption, were analyzed. The results indicated that the sound-absorbing material produced from old tire rubber powder showed a density of 0.96 g/cm³, a porosity value of 0.45, and a water absorption of 11.03%. Therefore, the findings suggest that old tire rubber powder has the potential to be effectively utilized as a sound-absorbing material.

Read more
Ginbanirose

คณะอุตสาหกรรมอาหาร

Ginbanirose

The Ginbanirose project aims to develop herbal extracts for alleviating menstrual pain using key ingredients: roselle, banana inflorescence, and ginger. These ingredients contain bioactive compounds with anti-inflammatory, antioxidant, and pain-relieving properties. The extracts are enhanced through liposome encapsulation technology, which improves absorption and stability. The production process involves herbal extraction, freeze-drying, and liposome formulation using lecithin and stabilizers. Experimental results demonstrate high phenolic content and antioxidant activity via the DPPH method. Ginbanirose addresses women’s quality of life concerns while offering significant business opportunities in the rapidly growing herbal market, particularly in the Asia-Pacific region.

Read more
Development of Carbon Nanofiber Composite Materials for Supercapacitors in Energy Storage

วิทยาลัยการจัดการนวัตกรรมและอุตสาหกรรม

Development of Carbon Nanofiber Composite Materials for Supercapacitors in Energy Storage

This study presents the development of carbon-based multiphase metal oxide nanocomposites (CNF@MOx; M = Ag, Mn, Bi, Fe) incorporating silver, manganese, bismuth, and iron nanoparticles within polyacrylonitrile (PAN)-derived carbon nanofibers. These nanocomposites were fabricated via the electrospinning technique followed by annealing in an argon atmosphere. The resulting nanofibers exhibited a uniform structure, with diameters ranging from 559 to 830 nm and embedded nanoparticles of 9-21 nm. Structural characterization confirmed the presence of various oxidation states of metal oxides, which play a crucial role in charge storage mechanisms. Electrochemical performance testing demonstrated that CNF@Ag/Mn/Bi/Fe-20 achieved the highest specific capacitance of 156 F g⁻¹ at a scan rate of 2 mV s⁻¹ and exhibited excellent cycling stability, retaining over 96% of its capacitance after 1400 charge-discharge cycles. The synergistic combination of electric double-layer capacitance and redox-based charge storage enhances the performance of these nanofibers as promising electrode materials for supercapacitor applications.

Read more