0%

Embedded System

Embedded System

Smart vehicle

Building on the hardware development knowledge acquired earlier, we completed an intelligent car based on computer vision (CV) and a two-wheeled balancing vehicle using a gyroscope. These systems are significantly more complex, deepening our understanding of control principles such as speed feedback, dual-loop control, and fuzzy PID control, as well as computer vision and ARM embedded development, including GPIO and nested interrupts.

image-20231103193513183

The vehicle, guided by image information captured by the camera, models the map and identifies elements like straight paths, curves, and roundabouts, executing varying control strategies accordingly. Even after the car was capable of completing the entire track, extensive debugging was conducted to pursue higher speeds.

Linux Chat Machine

Using an embedded development board, we have successfully implemented a system based on Baidu’s AI speech recognition technology. This system captures audio files through the board’s microphone, which are then processed in a Linux environment on the host machine to convert and recognize the speech as text results. These results are used to control various peripherals of the development board. To enhance user experience, we also integrated speech synthesis technology to convert text feedback into synthesized voice messages for playback.

image-20231103193647536

Smart Home Assistant

Building upon the chatbot framework, we crafted an intelligent home assistant system that earned the distinction of a National Third Prize at the China Intelligent Robot Design Competition, a testament to our system’s ingenuity and practical application in the realm of home automation.

image-20231103194144371

Leveraging the open-source smart home platform Home Assistant, we have developed a comprehensive digital twin and intelligent control system that advances the field of smart home technology. This system enables users to precisely control every smart device in their home. Whether through voice commands, gesture control, or direct manipulation via mobile devices and a home intelligence hub, operation of home appliances is made effortlessly accessible.

image-20231103194021064

Our objective is to elevate the level of home automation, allowing users to issue commands from any terminal to achieve intelligent control throughout the home, thereby making domestic life more convenient and comfortable.