ESP32 CAM with Python OpenCV Yolo V3 for object detection and Identification, Image Processing

  Переглядів 72,146

Electronic Clinic

Electronic Clinic

11 місяців тому

ESP32 CAM with Python OpenCV Yolo V3 for object detection and Identification
Altium Designer: For Schematic and PCB designing
www.altium.com/yt/electronicl...
Altium 365:
www.altium.com/altium-365
Octopart, components search engine:
octopart.com/
download programming:
www.electroniclinic.com/esp32...
ESP32 Cam projects: related videos
Watch the same video in Hindi/Urdu
• ESP32 CAM with Python ...
ESP32 Cam and Arduino-based Car Parking Gate / Barrier control
• ESP32 CAM with Python ...
ESP32 Cam based Human Pose landmarks detection, security camera
• ESP32 Cam Python OpenC...
How to make IoT camera using ESP32 Cam and Telegram:
• IoT Camera using ESP32...
ESP32 Cam with ESP8266, google drive, and Google spreadsheet
• ESP32 CAM and ESP8266 ...
ESP32 CAM getting started video
• ESP32 Cam: ESP32 Camer...
ESP32 CAM DOOR LOCK CONTROL SYSTEM USING HUMAN RECOGNITION
• ESP32 Cam Face Recogni...
ESP32 CAM SEND IMAGES TO GOOGLE DRIVE
• ESP32 CAM Send Images ...
ESP32 CAM SMART IOT DOOR BELL
• ESP32 CAM Smart IoT Be...
ESP32 CAM SAVE IMAGES IN SD CARD
• ESP32 Cam save Image t...
Support me on Patreon and get access to hundreds of projects:
/ electroniclinic
Subscribe to my New UKposts Channel, if you want to watch my videos in Hindi/Urdu
/ @letsgetstartedd
Project Description:
********************
In this video, I am going to use ESP32 Camera module with Python OpenCV Yolo V3 for object detection and Identification. I am only using ESP32 Camera module for the live video streaming whereas for the image processing I am using Yolo V3.
I will test it on three different machines and you will be amazed with the end results. First I will test it using the Raspberry Pi 4 and it has 8GB RAM. Then I will test it on Core i3 Laptop. And finally, I will test it on my MSI Intel Core i7 with Nvidia Geforce 16GB GPU and 16GB RAM. I specially purchased this laptop for video editing and image processing.
Anyway, after performing initial tests then I will share with you the final code, which can be used for the detection and identification of specific objects. Let’s say you want to send an alert message when a specific object is detected.
In my case, I send an alert message when a bird and cat are detected both at the same time. While all the other objects are totally ignored.
We have a long list of the objects that we can detect. So, after watching this video you will be able to detect all these objects at the same time or you can select one or multiple objects of your choice and this way you can build amazing image processing based projects.
********************
Amazon Purchase links:
*****************
ESP32 Camera Module
amzn.to/45yPi9D
ESP32 CAM W-BT Board
amzn.to/3N24vbY
MSI Intel Core i7 Laptop check this out.
amzn.to/42ayHpL
Other must-have Tools and Components:
ESP32 WiFi + Bluetooth Module (My recommendation), more IO pins, improved speed, and supports a Lipo Battery:
amzn.to/3v40DkE
Arduino Uno, Nano, Mega, Micro "All types of Arduino Boards":
amzn.to/3fk5OTi
Top Arduino Sensors:
amzn.to/3vZbnfM
Super Starter kit for Beginners
amzn.to/3cq56C5
Top Oscilloscopes
amzn.to/3ctF3d8
Variable Supply:
amzn.to/2PEAqE7
Digital Multimeter:
amzn.to/2QGRPg1
Top Soldering iron kits: "best"
amzn.to/39nqDtb
Top Portable drill machines:
amzn.to/3suQMh7
Jumper Wires:
amzn.to/2NYPEDA
3D printers:
amzn.to/3ruG1dt
CNC Machines:
amzn.to/3cuZWVv
DISCLAIMER: This video and description contain affiliate links, which means that if you click on one of the product links, I will receive a small commission. This helps support the channel and allows me to continue to make videos like this. Thank you for your support!
****************
For more Projects and tutorials visit my Websites
Electronic Clinic:
www.electroniclinic.com/
Programming Digest:
programmingdigest.com/
Follow me on Instagram:
/ electroniclinic
Follow my Facebook Page Electronic Clinic:
web. profile.php?...
Follow my Facebook Group, Arduino Projects:
/ 190031841821771
Email:
stu_engineering@yahoo.com
About the Electronic Clinic:
Electronic Clinic helps the students and other professionals to learn electronics, designing, and programming. Electronic Clinic has tutorials on Arduino, Arduino Nano, Raspberry PI, image processing, gsm based projects, Bluetooth based projects, esp8266 projects, Nodemcu projects, robotics, desktop application designing and programming, PLC, SCADA, RC Planes, Electronics, Power Generation, HMI, and much more. Check my Playlists.
#esp32cam #yolov3 #opencvpython

КОМЕНТАРІ: 86
@ElectroniClinic
@ElectroniClinic 5 місяців тому
Watch my Latest Video on ESP32 Cam, Python, OpenCV, & Mediapipe based Diy Security Camera using Human Pose Landmarks ukposts.info/have/v-deo/qIVzrX-WbKmSs6c.html
@ackj9766
@ackj9766 5 місяців тому
what is you esp32 board version camear ip didnt appear
@jerroldleung8065
@jerroldleung8065 Місяць тому
hello, I have a problem with detection. The Detection window pops up but stays black. There is a live transmission window, this works well.
@shivaraghav2899
@shivaraghav2899 11 місяців тому
Mind blowing.... Super project
@muhammadsalem9924
@muhammadsalem9924 7 місяців тому
Thank you, professor Excellent work
@vedmaheshkale5943
@vedmaheshkale5943 3 місяці тому
your cat is cute!!!!!!!!! 🐈
@muhammadhamza6536
@muhammadhamza6536 2 дні тому
amazing really helpful
@benj5279
@benj5279 10 місяців тому
You really help me a lot with your videos i hope i can support you somehow ❤️
@ElectroniClinic
@ElectroniClinic 10 місяців тому
you can support me and my channel by subscribing, or liking the videos, and comments. And by sharing videos with your friends. Today, i will upload a new video about car tracking and gate/barrier control system. I hope you will like the idea.
@wdew1927
@wdew1927 8 місяців тому
Very nice subject ! During compiling a message "cannot find webserver.h". My board version is 2.0.10 Do you have a solution for this ?
@didzi6728
@didzi6728 10 місяців тому
Hey. When I try to run the code in Python IDLE I get this error: "Failed to open the IP camera stream". While if I copy and past the camera's url in the web browser it works fine! Any ideas on how to fix it?
@sam-el
@sam-el 8 місяців тому
I want to ask. Can you help me with a guide to create object detection using de1-soc
@joaogouveia4497
@joaogouveia4497 3 дні тому
im trying to do the same thing the only diference is that im using an esp32s3 camera that creates a webserver for the video but when i try to access the webserver ip my opencv crashes. Do you know what could have caused this?
@deeptanshugupta4241
@deeptanshugupta4241 Місяць тому
Is it possible to do this without connecting it to pc
@unik8985
@unik8985 11 днів тому
Hi, I've done everything right and have the live camera working but whenever I try to run the object detection code it gives me an error where: outputNames = [layernames[i[0]-1] for i in net.getUnconnectedOutLayers()] ~^^^ IndexError: invalid index to scalar variable. and I can't seem to fix it
@surendar4348
@surendar4348 5 місяців тому
Does it work with Yolo nas
@user-ds3zg5xs7i
@user-ds3zg5xs7i 20 днів тому
how do i incorporate the same for yolo v8 model?
@chideraagbasiere7868
@chideraagbasiere7868 12 днів тому
Where did the "Cat and Bird Detection" file come from @3:39 ?
@Radar131
@Radar131 Місяць тому
Want request may you make video about helmet and plate number detection ?
@user-fq6yi5fu3f
@user-fq6yi5fu3f 6 місяців тому
ERROR: Could not find a version that satisfies the requirement open-cv-python--4.5.3.56 (from versions: none) ERROR: No matching distribution found for open-cv-python--4.5.3.56 in cmd 2nd step installing open cv
@muhammadsalem9924
@muhammadsalem9924 7 місяців тому
Please tell me what are the appropriate computer specifications for deep learning and machine learning ? Please answer
@harshwardhansingh9915
@harshwardhansingh9915 2 місяці тому
Any computer with a GPU will work fine. But if you don't have that, you only need an internet connection. There are online tools like Google Collab that will provide you with an online jupyter notebook free of charge, you can use it for learning machine learning
@manishuike3830
@manishuike3830 6 місяців тому
can you make one for nut and bolt identifying
@parthimahi
@parthimahi Місяць тому
6:41 for its coming for me "camera fails"what should I do plse anyone suggest me
@PraveenKumar-vz4dy
@PraveenKumar-vz4dy 6 днів тому
8:10 we can't do image processing in esp32 cam (not enough computational power ) is this what u r trying to say ?
@nagababumarthi1942
@nagababumarthi1942 2 місяці тому
Pls make esp32 cam based pick and place robot
@CharlesMashava
@CharlesMashava 5 місяців тому
I watch your videos.I find them very helpful for my own going project. However i am running the an application with same weights but its supper slow on detecting and sending information to the esp32. How can i optimize it to be fast??
@glennimmanuel9338
@glennimmanuel9338 3 місяці тому
maybe you can try to use freeRTOS to manage the tasks
@orphaeel
@orphaeel 3 місяці тому
i have this problem... cv2.error: OpenCV(4.5.3) C:\Users unneradmin\AppData\Local\Temp\pip-req-build-sn_xpupm\opencv\modules\dnn\src\darknet\darknet_io.cpp:900: error: (-212:Parsing error) Unknown layer type: in function 'cv::dnn::darknet::ReadDarknetFromCfgStream' anyone have the solution for this problem???
@user-zm7qi7et3r
@user-zm7qi7et3r 3 місяці тому
why did you do the image processing and objec detection on Raspberry Pi or Laptop, can't it be done on the ESP32?
@sanakabanerjee4462
@sanakabanerjee4462 21 день тому
esp32 has very less ram and is only good for capturing image, it can no way run such a heavy model
@bberil4834
@bberil4834 4 місяці тому
Thank you for the video. I want to do the exact same project but I will use the ESP32 as a soft access point. How should I modify the code?
@aneshk425
@aneshk425 Місяць тому
You got any solution bro?..even am looking for the same thing
@user-fy3bh8ie2v
@user-fy3bh8ie2v 6 місяців тому
Hi, I want to make something similar, but instead of object detection, I want to make face detection system using esp32cam which will be used for storing student attendance, can you please help or provide some reference related to this.
@ElectroniClinic
@ElectroniClinic 6 місяців тому
for this you will need to train faces. I am working on a similar project. Its object the identification of other objects not available in the coco.names list.
@vikasreddy4864
@vikasreddy4864 6 місяців тому
Does object detection works for similar objects ? Does object detection works for identification of safflower stigma from saffron stigma?
@surendar4348
@surendar4348 5 місяців тому
You can train custom dataset to the model
@palindrome3212
@palindrome3212 9 місяців тому
i have this error in line 71 saying: outputNames = [layernames[i[0] - 1] for i in net.getUnconnectedOutLayers()] IndexError: invalid index to scalar variable. Can you help me with the error?
@BuddhiniJayakody
@BuddhiniJayakody 9 місяців тому
did you fix the issue? I also get the same issue
@auburngold4958
@auburngold4958 8 місяців тому
Fixed the issue, just remove the [0] and run the program. This only works on windows
@attacker21
@attacker21 5 місяців тому
@@auburngold4958 thanks a lot
@Jarniwan
@Jarniwan 6 місяців тому
you should have at least tell us if the middle part was a sponsor segment. that was awful.
@benj5279
@benj5279 10 місяців тому
Can this work if laptop and esp32 are connected to different wifi?
@manojshyaam6683
@manojshyaam6683 8 місяців тому
Yes it does
@user-ul2em8lv3v
@user-ul2em8lv3v 6 місяців тому
does this process can be run on raspberrypie without a computer after starting the process? i want make this for blind people which they can carry with them?
@ElectroniClinic
@ElectroniClinic 6 місяців тому
Ya you can use use raspberry pi
@haven-hw2wl
@haven-hw2wl 6 місяців тому
Hi sir your project is awesome, but when i try all of your instructions im having a problem with coco.names even if it's in the same folder but always displaying error that no coco.names found 😢
@aymanmrwan2410
@aymanmrwan2410 6 місяців тому
Yes me too
@haven-hw2wl
@haven-hw2wl 6 місяців тому
@@aymanmrwan2410 bro i already did it, just use different format not notepad
@kris8167
@kris8167 5 місяців тому
@@haven-hw2wl Then I would like to ask what format you use, thank you.
@rockstarsk4023
@rockstarsk4023 4 місяці тому
where is the main program file??
@juantellez2176
@juantellez2176 5 місяців тому
would this work with a pretraining yolov8?
@user-ds3zg5xs7i
@user-ds3zg5xs7i 20 днів тому
did you try it out?
@digitronix532
@digitronix532 Місяць тому
If my camera senses "Car" , any one of gpio should turn on in ESP32CAM . Help me
@ElectroniClinic
@ElectroniClinic Місяць тому
I have done it. Check playlist or the related projects list in the description.
@janarthanandayalan
@janarthanandayalan 2 місяці тому
Hi sir, is there a way we can give our very own data to train the camera?
@ElectroniClinic
@ElectroniClinic 2 місяці тому
Very soon I will make a video about this.
@sontruongpham6883
@sontruongpham6883 10 місяців тому
Your guide is very helpful. But I got this error in line 30 of esp32cam.cpp file while compile the esp32camera test code: error: 'camera_sensor_info_t' was not declared in this scope camera_sensor_info_t* info = esp_camera_sensor_get_info(&sensor->id); error: 'info' was not declared in this scope camera_sensor_info_t* info = esp_camera_sensor_get_info(&sensor->id); error: 'esp_camera_sensor_get_info' was not declared in this scope camera_sensor_info_t* info = esp_camera_sensor_get_info(&sensor->id); Could you help me? Thanks.
@sontruongpham6883
@sontruongpham6883 10 місяців тому
Turn out the problem is I have the old arduino esp32 version which is 1.0.6. When upgrade to 2.0.x its run normally.
@albertobesozzi5825
@albertobesozzi5825 8 місяців тому
I've got the same problem but my arduino is already updated to 2.1.1
@waleedhussain4409
@waleedhussain4409 9 місяців тому
can you please give the code for alert as an email or for arduino using gsm that you tell in last part of video it would e very helpul if you give code for it
@manojshyaam6683
@manojshyaam6683 8 місяців тому
Search for SMTP protocol for ESP 32 Best wishes
@benj5279
@benj5279 10 місяців тому
What do you use to run the python code?
@benj5279
@benj5279 10 місяців тому
Nvm i figured it out
@juantellez2176
@juantellez2176 5 місяців тому
I havent figured out what did u use to run python?
@eidgames8761
@eidgames8761 6 місяців тому
Failed to open the IP camera stream Process finished with exit code 0
@parthimahi
@parthimahi Місяць тому
You solved this problem man! I also getting this
@CsabaDzsurnik
@CsabaDzsurnik 8 місяців тому
Hello! It's awesome! But I get the following error on my PC: File "C:\Users\PC\Desktop\esp32\ ESP32 CAM with Python OpenCV Yolo V3 for object detection and Identification, Image Processing\esp32CamTest-PC.py", line 19, in net = cv2.dnn.readNetFromDarknet(modelConfig,modelWeights) cv2.error: OpenCV(4.8.0) D:\a\opencv-python\opencv-python\opencv\modules\dnn\src\darknet\darknet_io.cpp:902: error: (-212:Parsing error) Unknown layer type: in function 'cv::dnn::darknet::ReadDarknetFromCfgStream' could you help me please?
@AkuDapi
@AkuDapi 6 місяців тому
same case
@orphaeel
@orphaeel 3 місяці тому
have you found the solution???
@CsabaDzsurnik
@CsabaDzsurnik 3 місяці тому
@@orphaeel unfortunately not, but I found another tutorial that works on the same principle and is flawless.
@orphaeel
@orphaeel 3 місяці тому
@@CsabaDzsurnik with same model and config??? Anyways can you give me the link... really need it for my final project... TIA
@orphaeel
@orphaeel 3 місяці тому
@@CsabaDzsurnik can you tell me that tutorial, please???
@Mmorpg347
@Mmorpg347 2 місяці тому
When I open the serial monitor it shows me to write a message how can I fix this
@parthimahi
@parthimahi Місяць тому
Press reset button
@tyronetyrone2652
@tyronetyrone2652 9 місяців тому
How to use IP CAM instead of ESP32CMA
@ElectroniClinic
@ElectroniClinic 9 місяців тому
I will cover this in my upcoming videos.
@huanle4109
@huanle4109 18 днів тому
The serial monitor just show "CAMERA OK ", it did not show "......" line. How can i fix it ?
@anhviettran160
@anhviettran160 9 днів тому
Check lại tên wf và mk đúng chưa. Nếu đúng thì nó sẽ hiện ip của wf
@jaimeabug9090
@jaimeabug9090 5 днів тому
Bro I have same issue. Have you fix you?
@panduaksoro8845
@panduaksoro8845 7 місяців тому
where is the alert?
@ElectroniClinic
@ElectroniClinic 7 місяців тому
When it detects a cat and bird at the same time.
@panduaksoro8845
@panduaksoro8845 7 місяців тому
@@ElectroniClinic so the alert just like log in python app?
Simple ESP32-CAM Object Detection
54:56
DroneBot Workshop
Переглядів 142 тис.
Первая поломка Scirocco! Балацко попал на мотор.
1:13:12
10 Minutes To Escape Or This Room Explodes!
10:00
MrBeast
Переглядів 67 млн
ESP32-Cam Complete Guide
26:31
DIY Engineers
Переглядів 94 тис.
Object Detection in 10 minutes with YOLOv5 & Python!
10:45
Rob Mulla
Переглядів 204 тис.
Making the most EQUIPPED DIY Security Camera with ESP32-CAM
26:36
Max Imagination
Переглядів 322 тис.
ESP32 CAM based Object Detection & Identification System with OpenCV
5:58
IoT Projects Ideas
Переглядів 5 тис.
Object Identification & Animal Recognition With Raspberry Pi + OpenCV + Python
6:15
Let's Start ML using ESP32Cam & Edge Impulse | Episode 1
12:40
techiesms
Переглядів 10 тис.
The BEST ESP32 project based on ChatGPT | IOT Projects | NextPCB
16:27
Object Detection OpenCV Python | Easy and Fast (2020)
29:06
Murtaza's Workshop - Robotics and AI
Переглядів 474 тис.
ESP32 CAM Getting Started | Face Detection
10:11
Viral Science - The home of Creativity
Переглядів 251 тис.
Что если бы Apple делала зубные щётки?
0:59
Rabbit R1: Barely Reviewable
19:53
Marques Brownlee
Переглядів 6 млн