The digital assistant robot
ERO
A classroom robot that takes the repetitive work off a lecturer, starting with the attendance, so they can focus on what needs a human.
97%attendance accuracy, trained on a dataset of 13 students
Best Project2023ISE · BMSCE
- Raspberry Pi in its head
- LED-matrix eyes, run by an Arduino
- A body made of repurposed pots
- Battery and speaker in its base
- 60 RPM motors, steered over Bluetooth
- Type
- Capstone project
- Year
- 2023
- Team
- Two of usGuided by a professor
- Award
- Best Project 2023, ISE Department
- Published
- IEEE CSITSS 2023
It can
- 01
Take the attendance
Recognises everyone in the frame at once and marks them present.
CLIP · OpenCV · Firebase
- 02
Listen and answer
Understands spoken commands and replies out loud.
speech_recognition · pyttsx3
- 03
Click a selfie
Takes a photo on command and saves it to the cloud.
OpenCV · Firebase Storage
- 04
Play music
Streams songs from Spotify through its own speaker.
Raspotify
- 05
Move around the room
Drives on two motors, steered over Bluetooth.
Arduino · HC-05
- 06
Show it all in an app
Students sign in with their USN to see attendance as it's marked, and their selfies.
Android · Firebase Auth
Inside ERO
- Raspberry Pi Model B, 4 GB, running Ubuntu
- Arduino Uno boards for the eyes and the wheels
- LED-matrix eyes
- Wide-angle USB camera
- Bluetooth microphone and a speaker
- HC-05 Bluetooth module
- Two 60 RPM motors and trolley wheels
- 12 V battery for the motors, a power bank for the Pi
- Repurposed pots, nuts, bolts and angle brackets
Stack: Python, OpenCV, CLIP, Raspberry Pi, Ubuntu, Arduino, HC-05 Bluetooth, Firebase, Android Studio, speech_recognition, pyttsx3, Raspotify, SSH