Embedded System
Smart vehicle
Building on the hardware development knowledge acquired earlier, we completed an intelligent car based on computer vision (CV) and a two-wheeled balancing vehicle using a gyroscope. These systems are significantly more complex, deepening our understanding of control principles such as speed feedback, dual-loop control, and fuzzy PID control, as well as computer vision and ARM embedded development, including GPIO and nested interrupts.
The vehicle, guided by image information captured by the camera, models the map and identifies elements like straight paths, curves, and roundabouts, executing varying control strategies accordingly. Even after the car was capable of completing the entire track, extensive debugging was conducted to pursue higher speeds.
Linux Chat Machine
Using an embedded development board, we have successfully implemented a system based on Baidu’s AI speech recognition technology. This system captures audio files through the board’s microphone, which are then processed in a Linux environment on the host machine to convert and recognize the speech as text results. These results are used to control various peripherals of the development board. To enhance user experience, we also integrated speech synthesis technology to convert text feedback into synthesized voice messages for playback.
Smart Home Assistant
Building upon the chatbot framework, we crafted an intelligent home assistant system that earned the distinction of a National Third Prize at the China Intelligent Robot Design Competition, a testament to our system’s ingenuity and practical application in the realm of home automation.
Leveraging the open-source smart home platform Home Assistant, we have developed a comprehensive digital twin and intelligent control system that advances the field of smart home technology. This system enables users to precisely control every smart device in their home. Whether through voice commands, gesture control, or direct manipulation via mobile devices and a home intelligence hub, operation of home appliances is made effortlessly accessible.
Our objective is to elevate the level of home automation, allowing users to issue commands from any terminal to achieve intelligent control throughout the home, thereby making domestic life more convenient and comfortable.