Visual and LIDAR based SLAM with ROS using Bittle and Raspberry Pi

День тому

Article on Hackster.io
www.hackster.io/dmitrywat/sla...
0:00 Intro
0:30 Quick demo
0:53 Theory
2:23 Elon Musk appearance :)
2:58 Visual SLAM with ORB-SLAM2
5:11 Hector SLAM
7:03 Ending
The hardware for this video was kindly provided by Seeed studio, check out RPLIDAR A1M8 LIDAR, Raspberry Pi 4 2Gb and other hardware at Seeed studio store!
www.seeedstudio.com/Raspberry...
www.seeedstudio.com/RPLiDAR-A...
More articles about SLAM:
What Is Simultaneous Localization and Mapping?
blogs.nvidia.com/blog/2019/07...
LSD-slam and ORB-slam2, a literature based explanation
/ lsd-slam-vs-orb-slam2-...
RPLIDAR and ROS programming- The Best Way to Build Robot
www.seeedstudio.com/blog/2018...
Driver and launch files for BIttle:
github.com/AIWintermuteAI/bit...

КОМЕНТАРІ: 56

@witchking64 3 роки тому

Thanks for this! I'm looking into implementing vision/pov into movement so your explanations help a lot

@Hardwareai 3 роки тому

You're very welcome!

@Tetsujinfr 3 роки тому

Thanks for your efforts on testing those components in the wild. Always good to see real world perf vs marketing videos bs. Keep up the good work!

@Hardwareai 3 роки тому

Thank you for the feedback! Real world performance wise, Bittle actually exceeded my expectations - I didn't think it would be able to even start with LIDAR and Pi 3 connected, because of the current draw, let alone walk/crawl and even (do not try this at home) jump. Hector SLAM performance was adequate. ORB-SLAM2 didn't not perform well - in the video you can see Path messages are mostly correct, but occupancy map doesn't make any sense. That can be issue about settings/camera height, but even if these issues are resolved, the camera still moves way too much during walking, so I don't think monocular SLAM is an option for Bittle. Would be interesting to try stereo.

@Tetsujinfr 3 роки тому

@@Hardwareai usually blur is a killer for feature matching. Fyi I am using a zed camera @ 100fps and it supports pretty fast movements, provided there is enough light (it does have an IMU to help track very fast/short rotation type of movements too). I did not experience with Lidar but your testing is cool, and I appreciate that achieving something with a rpi is quite something.

@antonwinter630 3 роки тому

thanks for sharing the results.

@Hardwareai 3 роки тому

My pleasure!

@lujustin668 Рік тому

Great video, makes the responsibility question easy to understand

@Hardwareai 10 місяців тому

Glad you enjoyed it

@iwoaugustynski9265 3 роки тому

Another inspiring video. Great work!

@Hardwareai 3 роки тому

Thanks so much!

@marktadlock5428 Рік тому

Thank you for being helpful about slam software

@Hardwareai 10 місяців тому

Glad it was helpful!

@DSEC_Siddhanthvjain 6 місяців тому

can we use this SLAM in VOXL with the help of ROS in it

@kimagurerobo 3 роки тому

Awesome!!! Thank you!

@Hardwareai 3 роки тому

You're welcome!

@andrewa6713 3 роки тому

Good evening sir 😊 I was wondering if you could make a video about integrating hector slam with the navigation stack ?

@Hardwareai 3 роки тому

Good morning :) I could, but aren't there existing videos for this topic already? I made this particular one because 1) I wanted to try LIDAR and camera on Bittle 2) not so much information on the internet about V-SLAM for ROS

@andrewa6713 3 роки тому

I would be very thankful if you send me one of these videos about this topic. Actually, you were the only one who made this kind of videos. Anyway, thank you sir for replying 😊

@ppowell1212 2 роки тому

Thanks for the video. I run a small nonprofit theatre. I'm looking to navigate small wheeled scenery pieces with an electric motor on and off stage. To drive themselves from point A to point B and back again. (they don't need to move fast) What you are doing seems similar, I just want to do it with wheeled platforms. Any thoughts on a model I could emulate to accomplish this?

@Hardwareai 2 роки тому

Model? I don't think a neural network model is necessary for that. Wheeled navigation will be a bit easier, just get LIDAR + motors with encoders. ROS packages are available for making Navigation work with this stack.

@ppowell1212 2 роки тому

@@Hardwareai Thanks. Forgive me, what is an ROS package?

@chiragsorate839 3 роки тому

Can you plz make a video on step by step implementation of this SLAM technique

@Hardwareai 3 роки тому

I have published a supplementary article for more details. Is there something that needs more detailed explanation?

@ahmedaly6698 3 роки тому

hi you said in the video that hector slam can be used to publish odometry to be later used in the navigation stack can you make a video or tell the guidelines how to integrate hector slam with the navigation stack thank you in advance (i finished hector slam controlling the robot using commands from the keyboard) side note:it is for a graduation project

@Hardwareai 3 роки тому

Right. Well, this video actually turned out to be more popular than I expected, so a continuation is a possibility indeed. Unfortunately I am super busy at the moment and probably will finish TinyML series first, despite that one wasn't very popular.

@ahmedaly6698 3 роки тому

@@Hardwareai if you aren't able at the moment to make a video if you know the main steps how to integrate them both it would be extremely helpful to just tell me the main steps

@andrewa6713 3 роки тому

What a coincidence ... it will be something great as it’s for my graduation project too.

@Tamingshih 10 місяців тому

nice job!

@Hardwareai 10 місяців тому

Thank you! Cheers!

@HemangJoshi Рік тому

Awesome bro...,👍👍👍

@Hardwareai Рік тому

Thanks ✌️

@melihaslan9509 2 роки тому

Awesome I learned something new

@Hardwareai 2 роки тому

Glad to hear it!

@levbereggelezo 3 роки тому

Very good 👍

@Hardwareai 3 роки тому

Thank you! Cheers!

@DSEC_Siddhanthvjain 6 місяців тому

@@Hardwareai can we use this SLAM in VOXL with the help of ROS in it pls help

@pewpewpistol 3 роки тому

That's a really small lidar! Where can I look that up? 5:40 mark, for later

@Hardwareai 3 роки тому

You can get it here www.seeedstudio.com/RPLiDAR-A1M8-360-Degree-Laser-Scanner-Kit-12M-Range.html

@grqfes Рік тому

im trying to use slam with an array of phototransistors close to the ground which would pick up white lines on the playing field for robocup soccer. this would also let it autonomously navigate. do you think its possible? how difficult would it be to set that up? i have around 5 months deadline

@Hardwareai 10 місяців тому

Okay, considering that was 9 month ago (sorry, was busy with my MSc at that time, replying to all old comments now).... That would be a very interesting task - but you will need a highly custom algorithm for that. Are you okay with using a cheap camera module(s) instead>

@pafcunha100 3 роки тому

Hi bro first of all nice work! Can i use Ubuntu MATE 20.04.1 LTS? Also, could u make a step by step video on install and usage? Thanks

@Hardwareai 3 роки тому

Thank you! Well, is there any reason to use 20.04 instead of 18.04 currently? 18.04 is more stable and from running it on Raspberry Pi has almost the same features. I understand it is newer, but unless it has features that you require and are not present in previous version, newer is not always "better" :)

@osaydhussein258 2 роки тому

Did it work for you ?

@DSEC_Siddhanthvjain 6 місяців тому

@@osaydhussein258 can we use this SLAM in VOXL with the help of ROS in it pls help

@MemoxCid Місяць тому

How did you run RVIZ in your raspberry so fast? I cant run RVIZ in my raspberry because is so slow...Great Video

@Hardwareai Місяць тому

I think it mentioned in either video or the article that I don't run RVIZ on Raspberry Pi? It's not recommended to do that. Instead you run one ROS node with image / LIDAR/ robot driver on the robot itself and another ROS node with RVIZ on your PC.

@MemoxCid Місяць тому

@@Hardwareai Is it posible to do this communication between Raspberry and PC using docker in both?

@Hardwareai Місяць тому

@@MemoxCid yes, here is the link wiki.ros.org/docker/Tutorials/Docker