Simple ESP32-CAM Object Detection

  Переглядів 143,850

DroneBot Workshop

DroneBot Workshop

День тому

Train an ESP32-CAM for Object Detection using a free Edge Impulse account. All without writing any code!
Article with full instructions: dronebotworkshop.com/esp32-ob...
More articles and tutorials: dronebotworkshop.com
Join the conversation on the forum: forum.dronebotworkshop.com
Subscribe to the newsletter and stay in touch: dronebotworkshop.com/subscribe/
Object Detection is a Machine Learning (ML) technique that uses a computer with a camera to identify classes of objects it has been trained to recognize. Although this used to require massive computers and large datasets, it is now possible to perform decent object detection using microcontrollers.
While most microcontroller-based object detection projects use 64-bit chips like the powerful Kendryte K210, you can also use a 32-bit ESP32 to get the job done. And that’s exactly what we will do today - take a 9-dollar ESP32-CAM board and train it to detect objects.
I’ll be using a lantern battery and Robie, a 40-year-old Radio Shack robot, as my two “test objects” We’ll train a model using the powerful online neural network services of Edge Impulse; you’ll need an account, but don’t worry, it’s completely free.
Once we have our model trained, we’ll export it in the form of an Arduino Library. The library even includes a sample sketch we can use to test our model; no code to write! I’ll try it on an ESP32-CAM and ESP-EYE board.
Here is the Table of Contents for today's video:
00:00 - Introduction
02:34 - Object Detection
06:27 - Edge Impulse
08:15 - Workflow
10:47 - Look at ESP32-CAM & ESP-EYE
12:48 - Capturing Images - Webcam Setup
14:34 - Edge Impulse Setup
15:39 - Image Capture
17:57 - Label Images
20:32 - Create an Impulse
24:52 - Export to an Arduino Library
25:25 - Importing Library to Arduino IDE
27:41 - Testing with ESP-EYE
29:43 - Testing with ESP32-CAM
32:04 - EloquentESP32CAM Library
34:14 - Collect Images Sketch
35:35 - Capturing Images - ESP32-CAM
39:12 - Import & Label with Edge Impulse
42:46 - Build & Deploy Impulse
46:45 - Testing with ESP32-CAM
48:28 - EloquentArduino Code & Demo
51:32 - Conclusion
53:25 - Robie the Robot!
I will actually show you two methods of capturing images of your subject(s) - using a webcam or using the ESP32-CAM board itself. I’ll also introduce you to a library that can make doing all of this a lot easier.
The results are good, good enough to consider using the ESP32-CAM as an inexpensive object detection sensor.
Hope you enjoy the video!

КОМЕНТАРІ: 159
@Dronebotworkshop
@Dronebotworkshop 3 місяці тому
Hi everyone - It's come to my attention that there has been someone masquerading as myself, responding to some comments here with a link to a Telegram chat to win a prize from me. THIS IS A SCAM, I am not holding a contest, nor do I have a Telegram account. PLEASE DO NOT RESPOND TO THESE MESSAGES!! It's happening on a lot of my videos, I'm taking steps to remove them manually, but as I have 162 videos, it will take some time. If you do run across a suspicious comment, I would appreciate you letting me know at info@dronebotworkshop.com. Thanks! Bill (The real one!)
@GabbyShimoni
@GabbyShimoni 10 місяців тому
I've just taken some training on the topic of deep learning and this video completes my quest for an easy way to incorporate the subject into my students projects. Thanks a lot for another well done video
@dakcn
@dakcn 8 місяців тому
As usual, another fantastic tutorial. I really like having both the video and the written articles. Thank you!!
@anthonyd4539
@anthonyd4539 6 місяців тому
I really appreciate the time you take to give instructions. Your lessons give me the confidence to try new things and peak over the barriers that I will soon knock down.
@mirekcolakov1730
@mirekcolakov1730 6 місяців тому
And of course, as always, thank you and well done. Thorough, detailed and explained so well!!!
@svlaststar
@svlaststar 9 місяців тому
Wow!!! Excellent video and project. IT is one that's been on my list for a while and you just inspired me to move it up the list. Thanks for making your videos. Great job!!!
@Gengh13
@Gengh13 10 місяців тому
As someone without any knowledge in this area this was a nice introduction.
@LIMUNQUE
@LIMUNQUE 6 місяців тому
Thanks a lot, I was spending time trying to use opencv for an academical project and I didn't think to use this.
@davydbar
@davydbar 9 місяців тому
Excellent tutorial!! Like all your videos, I want to thank you, since you have inspired me to continue in robotics projects. Greetings from Santa Fe, Argentina.
@hamradio3716
@hamradio3716 10 місяців тому
Excellent. A lot of prep work. Thank you.😊
@mrcairo4
@mrcairo4 10 місяців тому
It is a very easy training scenario. I've tested with voice recognition and now I'll try it with different "generic" humans vs. dogs and cats.
@TheSelfUnemployed
@TheSelfUnemployed 10 місяців тому
I just built a tiny robot using an esp32-cam and now im going to attempt to add this badass functionality. great video and ive always loved your channel. thanks for sharing your knowledge with us!
@karimaaqa
@karimaaqa 3 місяці тому
hello when using edge impulse, which board did you chose? the espressif esp32 eye? since i am going to get the esp32 cam (the one without usb)
@edgarbaylosis1523
@edgarbaylosis1523 9 місяців тому
Finally the video that i've been lookin for months! Thanks!
@ShawnHymel
@ShawnHymel 10 місяців тому
This is fantastic! You do a great job at clearly explaining the steps. And gotta love a Robie cameo :)
@raulsw9088
@raulsw9088 3 місяці тому
👍🏻
@fremsoft
@fremsoft 6 місяців тому
Thank you for your explanation,I think I will introduce Edge Impulse in my classroom! This is very inspiring video 😄👍🏻
@fostee1
@fostee1 3 місяці тому
As always just what I was looking for. Best tutorials thank you
@TheOldKid
@TheOldKid 10 місяців тому
A tutorial that is greatly needed is on the s3 wroom cam board.
@donkeypoopdragon
@donkeypoopdragon 10 місяців тому
Awesome topic, Bill! Keep 'em comin!
@rogermathura
@rogermathura 10 місяців тому
Glad i subscribed, so i didn't miss your excellent tutorial . Thanks.
@gerdsfargen6687
@gerdsfargen6687 10 місяців тому
This is very sexy time for an esp32 cam. Cant wait to try this project out. Its brilliant!
@aladinmovies
@aladinmovies 10 місяців тому
You are nice teacher. Love your understanding material.
@Bianchi77
@Bianchi77 9 місяців тому
Well done, keep it up, thanks for sharing it with us:)
@michaelbarakat6095
@michaelbarakat6095 4 місяці тому
Great effort has been done in this tutorial thank you very much for this amazing work ☺️
@dldldl8028
@dldldl8028 Місяць тому
Great tutorial, exactly what I'm looking for. Thanks a lot
@adolphtrudeau
@adolphtrudeau 10 місяців тому
This is excellent, DroneBot Workshop--I can't wait to tell my kid and his robotics teammates
@mikedoyle7546
@mikedoyle7546 10 місяців тому
Great and precise video tutorial.
@NZHippie
@NZHippie 10 місяців тому
Thank you Bill, great video...
@terrificmenace
@terrificmenace 10 місяців тому
Very informative 👏🏻 thank you 😊
@jeffschroeder4805
@jeffschroeder4805 10 місяців тому
Another informative video - Thank You
@andrebullitt7212
@andrebullitt7212 7 місяців тому
Dude, you are the coolest!
@rubialugattimoreira1978
@rubialugattimoreira1978 10 місяців тому
Perfect! Sharing knologe always.
@GiC7
@GiC7 10 місяців тому
Thanks, love the study
@christopherleadholm6677
@christopherleadholm6677 10 місяців тому
This is *just* the type of video I was hoping for!
@ahmedihab9754
@ahmedihab9754 2 дні тому
I was searching for such a video for days
@Jean-Naimar
@Jean-Naimar 10 місяців тому
Great tutorial 👍
@manusaini2192
@manusaini2192 10 місяців тому
A great contents, i love your video's. Lot's of love ❤ From India 🇮🇳. Thanks for sharing knowledge with us.
@brendanowen7563
@brendanowen7563 10 місяців тому
Great video. Looking forward to having a go with my ESP32 Cam. My only comment is you probably got the 100% on your second example because you had multiple images that are nearly exactly the same. These would have been randomly distributed between the 80% training and 20% testing sets. You probably ended up with same images used in training and testing which would not give you a good measure of confidence. Again another great video, thank you.
@barnacode
@barnacode 9 місяців тому
Great video, very helpful. Can I implement the object detection on the car robot you built? Has it been done? Any help is appreciated.
@Dazza_Doo
@Dazza_Doo 9 місяців тому
You know these are the types projects I'm looking for (I've found the DroidsVader will be pleased), this can be extremely useful. Thank you!
@Ducerobot
@Ducerobot 10 місяців тому
I like this module . Ai camera works well. It's on the base for my project. 😁👍
@keshav2136
@keshav2136 10 місяців тому
I've a ESP-32. I'll try it.
@ibekwekingsley8538
@ibekwekingsley8538 9 місяців тому
Is there a way to get the live feed video of the image classified in a bounding box?
@MUFATECHSOLUTIONS
@MUFATECHSOLUTIONS 9 місяців тому
thank you sir
@arthus1971
@arthus1971 2 місяці тому
Bravooo!!! A powerfull Like to you!!! Thank you for teach us
@Abdul-bv4ku
@Abdul-bv4ku 10 місяців тому
That's great! What was the frame rate achieved?
@devluz
@devluz 10 місяців тому
Oh love seeing another one with the ESP32-Cam! I already have two of these in my network as cheap surveillance camera running my own software. I am curious if there are any good upgrade paths for higher frame rate / higher resolution cameras? Also more ports available to control a robot would be neat.
@mirekcolakov1730
@mirekcolakov1730 6 місяців тому
use espnow or mqtt protocol so multiple esp32s can talk to each other and do the heavy compute on a proper machine that is connected wireless so the robot does not need to carry it...
@varun8154
@varun8154 8 місяців тому
can you use esp32 cam to control like servo based on object detection
@threewheeler624
@threewheeler624 10 місяців тому
Thank you for a good video. Have a great week. I miss Radio Shacks in the malls.
@conversationwithgod272
@conversationwithgod272 Місяць тому
Great job from great man.
@digihz_data
@digihz_data 10 місяців тому
Just great!
@jamespletcher7574
@jamespletcher7574 10 місяців тому
Clever outro!
@ej21lalitkumawat81
@ej21lalitkumawat81 10 місяців тому
Lots of love and great video Proffecer love you From India❤❤
@UTube4075
@UTube4075 10 місяців тому
Aap engineer ho? Working professional??
@luiklaus3024
@luiklaus3024 7 місяців тому
hi, is there a limit on how many different objects the esp32 cam can recognize?
@AungZawMoe-zh8fu
@AungZawMoe-zh8fu 4 місяці тому
What a great job sir. This vd help me a lot for my project. And what a cute robot ROBIE
@coolprojects5297
@coolprojects5297 10 місяців тому
Great Job Thank you very much
@sudedemmanuel2975
@sudedemmanuel2975 10 місяців тому
Thank you very useful
@angelaponte4413
@angelaponte4413 2 місяці тому
Maravilloso video, si les sale error al subir a la tarjeta Esp32, revisen la versión de la tarjeta que están usando, a mí me sirvió con la versión 2.0.10
@yuriyyatsyshyn9717
@yuriyyatsyshyn9717 3 місяці тому
Thanks. Very usefull!!
@carlosporras6905
@carlosporras6905 8 місяців тому
Señor lo amooo
@mdrakibhossen8681
@mdrakibhossen8681 9 місяців тому
helo sir, this is a great video. i have one question. can i add a servo to this project so that when it detects robot or battery the servo will rotate?
@karaniii
@karaniii 7 місяців тому
I have been trying to do some research on this but haven't found answers yet. Can edge impulse be used for face recognition?
@christopherleadholm6677
@christopherleadholm6677 10 місяців тому
I totally remember that coin eating robot thing, btw. The good ol' days...
@letgodigital6787
@letgodigital6787 7 місяців тому
Hello sir Which variable from the codes store's the output of the detection I want to make decisions wit h the Arduino to turn on a fan
@ibekwekingsley8538
@ibekwekingsley8538 8 місяців тому
Is there a way to view the live feed with the object detected in a bounding box
@rostykromanyshyn6616
@rostykromanyshyn6616 9 місяців тому
great thanks a lot
@ulzs7683
@ulzs7683 3 місяці тому
This ones not in the ESP32 playlist is it? I think its a good addition to the collection along with the 2024 guide.
@vinothn4228
@vinothn4228 10 місяців тому
Better way of explaining ❗
@sam-el
@sam-el 8 місяців тому
How can object detection be implemented using de1-soc? I will like a guide please
@darshanpatel805
@darshanpatel805 9 місяців тому
@Dronebotworkshop I like all your content can you please make video of speech recognition using ESP? Thank you
@nonel7215
@nonel7215 8 днів тому
Thanks!
@Dronebotworkshop
@Dronebotworkshop 7 днів тому
And thank you as well!
@catalinalb1722
@catalinalb1722 10 місяців тому
Hi, I want to do a number plate recognition for my gate. Would this be good enough?
@stephankempa6914
@stephankempa6914 8 місяців тому
A slow running turn table and the ESP auto capturing.
@OverlordYashSrivastav
@OverlordYashSrivastav 7 місяців тому
i am using an ov7670 camera ,can it work with esp32 or pi pico
@raulsw9088
@raulsw9088 4 місяці тому
Hi, you have very good projects. Can this object detection project be done with the Xiao esp32s3 sense?
@erment55
@erment55 5 місяців тому
I follow your educational videos with great interest.I would be very happy if you could share a video on how to use the esp32 camera module in IoT Blynk 2.0.
@user-hx5tg7yz2y
@user-hx5tg7yz2y 9 місяців тому
you should make a turntable that turns at an extremely slow rate for taking images.
@iwandp8698
@iwandp8698 10 місяців тому
very helpfull
@w74anheda
@w74anheda 14 годин тому
hi, thanks for your helpful tutorial, i have a question: how can connect and stream cam a esp32 cam with cable to pc or raspberry pi??
@transientaardvark6231
@transientaardvark6231 10 місяців тому
Does this have any way to train using the COCO data set ?
@optipwr40
@optipwr40 6 місяців тому
Do you know if it's possible to use RectLabel (An offline image annotation labeling tool) which has limited export options? For custom object detection I'd prefer not to upload all of my images into an online source.
@LucasFerreira-qz1ib
@LucasFerreira-qz1ib 7 місяців тому
Hello, i've tried running this code on the arduino IDE, using the esp32 cam, but the code won't compile, perhaps it's a configuration issue in the ide?
@azizghazni2605
@azizghazni2605 4 місяці тому
is this suitable for eyes closure detection?
@renznormanpalma6312
@renznormanpalma6312 27 днів тому
Might be new here, but I would like to ask if its possible to control other peripheral based from the label it detected?
@mirekcolakov1730
@mirekcolakov1730 6 місяців тому
Hello, what is the upper limit of the amount of objects the library and EspCam can handle ??? thank you
@dienau6313
@dienau6313 8 місяців тому
Sir, I want to upload the video stream and info to android app, so how can I do it?
@AtlantaTerry
@AtlantaTerry 9 місяців тому
Is there a parts list somewhere?
@AliHassan-jw5yq
@AliHassan-jw5yq 2 місяці тому
Hi, can you please guide me how we use esp32 cam for face detection and object detection in a single project??
@cybercrazy1059
@cybercrazy1059 10 місяців тому
How many same object can esp32-cam detect at the same time?
@Junior-fq8jo
@Junior-fq8jo Місяць тому
Hi Mr Bill thx for ur helpful video. I followed all the steps of your process but during that i have met a problem as :"error for the ardûino borad Ai thinker Esp32-cam. If u can help me thx😊
@opdino8577
@opdino8577 3 місяці тому
i just have one question can the detection be with voice. like can the model speak what kind of object is in front
@juantellez2176
@juantellez2176 5 місяців тому
I dont have the mount board and i plan on using the regular esp32 cam by ai thinker version i believe with a regular esp32 wroom. Does anyone know the pinout connections for that or where i could find how to connect them so i have the usb input. I know buying a mount board might be easier but I am going to pair it with a thermal cam I have working with the esp32 wroom. thanks
@user-km4js5jd1h
@user-km4js5jd1h 8 місяців тому
please can you upload the 26_image_collect file?
@HEILZEUS
@HEILZEUS 25 днів тому
can i like, upload my own trained model onto edge impulse ? also, please mention that the auto labeller is enabled in your project because you have an enterprise edition and not the free community edition
@saysanvicente5238
@saysanvicente5238 Місяць тому
Is it possible to make an alarm connected to esp32?For example, the program object to detect is paper and plastic only. When the camera detected the plastic it will make an alarm. We're planning to make a detection system of paper and plastic waste for our capstone project.
@greggtracton2588
@greggtracton2588 3 місяці тому
At minute 51, we see that the number of objects dithers between "robot, battery" and "robot, battery, robot", but you didn't modify the scene at all. The only differences would be the random noise introduced by the cam, ex, low cost -> high noise. So which one of these detections would we accept, if we could only choose one? Maybe we should average the last N estimates? I note that the confusion matrix for this training session is 100% in all 9 boxes, which really doesn't mean anything WRT it's average performance on the ESP32, but rather, whether a good pattern could be found within the supplied images, most of which were identical except for noise.
@ibekwekingsley8538
@ibekwekingsley8538 9 місяців тому
Is there a way to run this with COCO dataset
@marsupialsrock010
@marsupialsrock010 2 місяці тому
Is this what Captcha is for? Training?
@vivekent4422
@vivekent4422 6 місяців тому
hey the eye board is not available i have an esp 32 its base and arduino is there any way i can still use edge impulse as these boards are not mentioned in the list of the software
@itstuff1924
@itstuff1924 3 місяці тому
Can it detect food types?
@letsgetcreativebyrishwin1238
@letsgetcreativebyrishwin1238 10 місяців тому
Bro, the Arduino uno rev 4 minima and the Arduino uno rev 4 wifi is out, plz to a review plz🥺🥺🥺
Programmable Wildlife / Security / Timelapse Camera Projects with an ESP-32 CAM
1:11:38
Build Your Own Object Detection System with Machine Learning
22:56
Edge Impulse
Переглядів 54 тис.
ДРУГА РЕПЕТИЦІЯ alyona alyona та Jerry Heil на сцені Євробачення-2024
00:34
Євробачення Україна | Eurovision Ukraine official
Переглядів 216 тис.
одни дома // EVA mash @TweetvilleCartoon
01:00
EVA mash
Переглядів 4,8 млн
Let's Start ML using ESP32Cam & Edge Impulse | Episode 1
12:40
techiesms
Переглядів 10 тис.
IoT based Object detection & Counting using ESP32+CAM & Displaying it in Telegram App Chat BoT
13:00
LoRa - Long-Range Radio for IoT | Arduino, ESP32, RPI Pico
1:07:58
DroneBot Workshop
Переглядів 278 тис.
ESP32-CAM MicroSD Card - Saving images with the ESP32-Cam
36:01
DroneBot Workshop
Переглядів 128 тис.
Cheap Remote Monitoring for ANY 3D Printer! #3dprinting
13:56
Nero3D the Canuck Creator
Переглядів 45 тис.
10 Great Artificial Intelligence projects using ESP32-CAM!!!
7:18
ToP Projects Compilation
Переглядів 134 тис.
I shouldn’t have kept the $1,000,000 computer
28:05
Linus Tech Tips
Переглядів 1,4 млн
ESP32 Guide 2024 | Choosing and Using an ESP32 Board
41:06
DroneBot Workshop
Переглядів 202 тис.
Coca Cola Donması
0:34
TeknoFinans
Переглядів 11 млн
Татуировку ПРИШЛОСЬ удалять ХИРУРГИЧЕСКИ
0:24
Виктор Лодин
Переглядів 1,5 млн
Никто не жмёт ему руку 😮
0:28
RenkO
Переглядів 5 млн
Паска #подарункиукраїна
0:30
Хома Джан
Переглядів 159 тис.