Innovation Owner
Miss CHATCHAYA MIYAMOTO
Student
Details
This study introduces a novel framework for an interactive robotic assistant designed for human-centric environments like laboratories and educational institutions. It leverages AI and mobile robotics to enhance information accessibility and reduce human resource constraints.
The integration of intelligent robotic systems into human-centric environments, such as laboratories, hospitals, and educational institutions, has become increasingly important. This study introduces a novel framework for an interactive robotic assistant designed to assist during laboratory tours and mitigate challenges posed by limited human resources. The proposed system operates through multiple modes:
- Standby Mode: Signals readiness with a smiling face animation while patrolling predefined paths.
- Recognition Mode: Uses advanced computer vision and real-time speech recognition to identify users and provide personalized greetings.
- Interactive Mode: Integrates advanced technologies including ASR Whisper, NLP, and the Ollama 3.2 large language model to provide a context-aware experience.
The framework utilizes a robust back-end architecture with MongoDB and a RAG mechanism to ensure accurate information retrieval. Its modular design allows for easy integration of additional features and hardware upgrades, ensuring long-term scalability.
Objective
The objective is to develop a framework for an interactive robotic assistant capable of operating in human-centric environments, focusing on enhancing user engagement and information accessibility through intelligent human-robot interaction.
The objective of this research is to develop a framework for an interactive robotic assistant capable of operating in human-centric environments, such as laboratories and educational institutions, with a focus on enhancing user engagement and information accessibility through intelligent human-robot interaction. The system is designed to:
- Reduce the burden on personnel by automating the provision of information to visitors.
- Utilize Artificial Intelligence (AI) and mobile robotics to support dynamic environments.
- Adapt to various situations in real-time.
- Develop Large Language Models (LLM Predictor) and technologies for speech, gesture, and facial recognition to enable effective communication.
- Create a scalable, user-friendly system that supports future development.