KMITL Expo 2026 LogoKMITL 66th Anniversary Logo

A Human-engaging Robotic Interactive Assistant

A Human-engaging Robotic Interactive Assistant

Abstract

The integration of intelligent robotic systems into human-centric environments, such as laboratories, hospitals, and educational institutions, has become increasingly important due to the growing demand for accessible and context-aware assistants. However, current solutions often lack scalability—for instance, relying on specialized personnel to repeatedly answer the same questions as administrators for specific departments—and adaptability to dynamic environments that require real-time situational responses. This study introduces a novel framework for an interactive robotic assistant (Beckerle et al. , 2017) designed to assist during laboratory tours and mitigate the challenges posed by limited human resources in providing comprehensive information to visitors. The proposed system operates through multiple modes, including standby mode and recognition mode, to ensure seamless interaction and adaptability in various contexts. In standby mode, the robot signals readiness with a smiling face animation while patrolling predefined paths or conserving energy when stationary. Advanced obstacle detection ensures safe navigation in dynamic environments. Recognition mode activates through gestures or wake words, using advanced computer vision and real-time speech recognition to identify users. Facial recognition further classifies individuals as known or unknown, providing personalized greetings or context-specific guidance to enhance user engagement. The proposed robot and its 3D design are shown in Figure 1. In interactive mode, the system integrates advanced technologies, including advanced speech recognition (ASR Whisper), natural language processing (NLP), and a large language model Ollama 3.2 (LLM Predictor, 2025), to provide a user-friendly, context-aware, and adaptable experience. Motivated by the need to engage students and promote interest in the RAI department, which receives over 1,000 visitors annually, it addresses accessibility gaps where human staff may be unavailable. With wake word detection, face and gesture recognition, and LiDAR-based obstacle detection, the robot ensures seamless communication in English, alongside safe and efficient navigation. The Retrieval-Augmented Generation (RAG) human interaction system communicates with the mobile robot, built on ROS1 Noetic, using the MQTT protocol over Ethernet. It publishes navigation goals to the move_base module in ROS, which autonomously handles navigation and obstacle avoidance. A diagram is explained in Figure 2. The framework includes a robust back-end architecture utilizing a combination of MongoDB for information storage and retrieval and a RAG mechanism (Thüs et al., 2024) to process program curriculum information in the form of PDFs. This ensures that the robot provides accurate and contextually relevant answers to user queries. Furthermore, the inclusion of smiling face animations and text-to-speech (TTS BotNoi) enhanced user engagement metrics were derived through a combination of observational studies and surveys, which highlighted significant improvements in user satisfaction and accessibility. This paper also discusses capability to operate in dynamic environments and human-centric spaces. For example, handling interruptions while navigating during a mission. The modular design allows for easy integration of additional features, such as gesture recognition and hardware upgrades, ensuring long-term scalability. However, limitations such as the need for high initial setup costs and dependency on specific hardware configurations are acknowledged. Future work will focus on enhancing the system’s adaptability to diverse languages, expanding its use cases, and exploring collaborative interactions between multiple robots. In conclusion, the proposed interactive robotic assistant represents a significant step forward in bridging the gap between human needs and technological advancements. By combining cutting-edge AI technologies with practical hardware solutions, this work offers a scalable, efficient, and user-friendly system that enhances accessibility and user engagement in human-centric spaces.

Objective

งานวิจัยนี้มีที่มาจาก ความต้องการที่เพิ่มขึ้นสำหรับผู้ช่วยอัจฉริยะ ใน สภาพแวดล้อมที่เน้นมนุษย์เป็นศูนย์กลาง เช่น ห้องปฏิบัติการและสถาบันการศึกษา ซึ่งเผชิญปัญหาเรื่อง ข้อจำกัดด้านทรัพยากรบุคคล ในการให้ข้อมูลแก่ผู้เยี่ยมชมและนักศึกษา ปัจจุบัน โซลูชันที่มีอยู่มัก ขาดความสามารถในการขยายขนาด และ ปรับตัวให้เข้ากับสภาพแวดล้อมที่เปลี่ยนแปลง ได้อย่างมีประสิทธิภาพ นอกจากนี้ ระบบผู้ช่วยแบบเดิมมักพึ่งพาบุคลากรเฉพาะทาง ทำให้เกิดภาระในการตอบคำถามซ้ำๆ และไม่สามารถรองรับจำนวนผู้ใช้ที่เพิ่มขึ้นได้ ดังนั้น งานวิจัยนี้จึงมุ่งพัฒนา ผู้ช่วยหุ่นยนต์เชิงโต้ตอบ ที่สามารถ ทำงานอัตโนมัติในสภาพแวดล้อมแบบไดนามิก โดยใช้ AI และโมเดลภาษาขนาดใหญ่ (LLM Predictor) ผสานกับ การรู้จำเสียง ท่าทาง และใบหน้า เพื่อเพิ่ม การมีส่วนร่วมของผู้ใช้ และ ความสามารถในการโต้ตอบ แบบเรียลไทม์ ระบบนี้ยังช่วยลดภาระของบุคลากรและเพิ่ม การเข้าถึงข้อมูล ได้อย่างแม่นยำและมีประสิทธิภาพ อีกทั้งยังรองรับการพัฒนาเพิ่มเติมเพื่อให้สามารถขยายขีดความสามารถและใช้งานได้หลากหลายขึ้นในอนาคต

Other Innovations

Development of alginate hydrogel/carrageenan/gellan gum based composited material and their application as oral delivery carriers.

คณะอุตสาหกรรมอาหาร

Development of alginate hydrogel/carrageenan/gellan gum based composited material and their application as oral delivery carriers.

This study aims to develop alginate-based hydrogels reinforced with carrageenan and gellan gum as composite materials for oral drug delivery. Alginate, a naturally derived polymer from brown algae, forms a gel upon exposure to cations such as calcium ions, enhancing the hydrogel’s structural integrity. Carrageenan and gellan gum, both polysaccharides, further improve stability and encapsulation efficiency. This research investigates the physical properties, mechanical strength, encapsulation capacity, and swelling behavior of hydrogel beads under simulated gastrointestinal conditions. The findings are expected to demonstrate that incorporating carrageenan and gellan gum enhances the durability and stability of hydrogel beads while enabling controlled release of active compounds in the gastrointestinal tract. These advanced hydrogel beads hold significant potential for applications in the food and pharmaceutical industries as effective oral delivery systems for bioactive substances.

Read more
A DESIGN GUIDELINE FOR PROTOTYPE APPLICATION OF PUBLIC TRANSPORTATION AT KING MONGKUT'S INSTITUTE OF TECHNOLOGY LADKRABANG.

คณะสถาปัตยกรรม ศิลปะและการออกแบบ

A DESIGN GUIDELINE FOR PROTOTYPE APPLICATION OF PUBLIC TRANSPORTATION AT KING MONGKUT'S INSTITUTE OF TECHNOLOGY LADKRABANG.

This research aims to study the guidelines and develop a prototype of an application for public transport users to plan their journey and increase safety in using different types of public transport to travel to King Mongkut's Institute of Technology Ladkrabang. The objectives are as follows: 1) To study the factors of user experience (UX) and user interface (UI) design that affect the users of the application for using public transport. 2) To study the needs of users of public transport applications who must travel to King Mongkut's Institute of Technology Ladkrabang. 3) To present the guidelines for designing the user experience (UX) and user interface (UI) and to produce a prototype of the application for using public transport to travel to King Mongkut's Institute of Technology Ladkrabang. The research includes a review of the literature on User Experience (UX) and User Interface (UI) design, as well as a look at examples of public transportation applications and pick-up sites near King Mongkut's Institute of Technology Ladkrabang. This study is based on qualitative research. There are examples of employing relevant applications during the interview. The target audience is students aged 18 to 35 who will give prototypes for application development to satisfy their requirements. Provide information that is actually useful to users. The research results found that the public transport vehicles that the target group used the most were the Songthaew (the pick-up truck), train, airport rail link, motorcycle taxi, taxi, and bus, respectively. Users were concerned about various safety issues and wanted to design features to increase safety and confidence in using public transport vehicles for students, such as sending locations to relevant officials in the event of an emergency or when assistance was needed, and important information about public transport vehicles that students needed, such as calculating prices, calculating travel times, bus schedules, official and clear pick-up and drop-off points, bus routes, driver registration, suggestions or route recommendations, and the time of public transport vehicles arriving at the point where users were waiting, etc. The guidelines for designing the User Experience (UX) were presented from the analysis of the target group's data, which was a prioritization of the features of the menu for recording frequently used routes, a menu showing nearby pick-up points, a menu for searching for routes and selecting using various user constraints, such as calculating travel prices or travel times, and a menu that could set fonts and color modes to support a variety of users. This was because the study of user needs for fonts found an equal demand for Thai fonts with looped (Looped font) and without looped (Loopless font), as well as a study of the application's color requirements, which required both light and dark colors to be displayed in approximately equal amounts. This includes the design of the user interface (User Interface) by designing symbols that allow users to access the desired information quickly without confusion.

Read more
The Development of Boardgame to Enhance Cooking Skills : Case study Burger.

คณะเทคโนโลยีการเกษตร

The Development of Boardgame to Enhance Cooking Skills : Case study Burger.

The development of a board game to enhance cooking skills focuses on a popular and well-known dish—burgers. This study integrates learning with interactive gameplay, allowing players to gain knowledge about burgers, including their ingredients, preparation methods, and even the basics of running a burger business. Through hands-on activities and engaging game mechanics, players can develop both their culinary skills and entrepreneurial mindset while enjoying the fun and immersive experience of the board game.

Read more