Thanks again!

Fr

Wow, thank you! Hey you do know me now!! If you watch last 3 of my videos, you have been in my house and see Kimchi 3 times lol.

Now this is the KING of spatial video as well, not only VR180. Spread the love so more Dual Fisheye owner know they just triple the value of their investment

I am sure it will get easier in the workflow. This is week 2 of AVP lol. I still have lots to learn. We are in the same boat. When I have new trick I will share it immediately

Did you notice a loss of detail after the Mistika render? I’m using the 7 day trial version and the render (transcode actually) looks like half of the resolution of the original

Wow, thanks!

Glad it helped!

My pleasure!

Yes. I have several tutorials on this topic - but I will make a follow up soon and add Spatial Video support

thank you brother and happy Lunar New Year@@hughhou

Not only is it no longer available to mark stereoscopic content, they destroyed the existing tags, breaking most classic "3d" videos. They later made exceptions for a handful like OK Go music videos, but all who are not getting the elusive support have to reupload with embedded metadata, losing links, likes, views, comments etc. If you remux into Matroska format, you can set stereo_mode, e.g: ffmpeg -i input_file.mkv -c copy -metadata:s:v:0 stereo_mode=1 output_file.mkv

Indeed so everyone can try Spatial Video - which make brands aware of the format and want to do it professionally. Then leads to more jobs for creators - everyone win in the end! Thank you!

@@hughhou It makes more of us creators. But I'm personally excited to see what pros like you do in creating new content with Spatial Video and other immersive formats. I'm hoping that Apple and other's produce cinematic Spatial Video (not VR180). The display quality on the AVP is so impressive. That is what really commands that big price tag of the AVP. Micro-OLED is not cheap. Apple had to pay through the nose. They will eventually make the technology more accessible for others in the next couple of years. It's part of the Apple catalytic formula.

Glad it was helpful! Yes for people know VR180. But for massive audience out there have not heard of VR180, 3D Spatial Video is their gateway drug onto immersive storytelling. My hope is more people come here and understand the format and what is out there. And slowly move them into VR180 - the true immersive format - also pushing by Apple and heavy by Meta and Pico.

To be 100% honest, not really lol. AVP color is better and playback is smooth without refresh rate issue. But the quality is not like night and day different. But this is prob b/c the solution is not official yet. When Apple provide their Apple TV pipeline, then will be huge different!

Oh yes! That is coming next! 2X Insta360 or GoPro!!!!

🥰We know that you are always prepared to surprise us. You're the best!

It is certainly possible. I am working on a easy to follow solution now but take me a while to R&D. Will ping you when I release that workflow.

Moon player

Yes Moon Player right now. I am sure more to come.

Premiere does not support 3D editing (old school 3D) so in Adobe is hard. But I will let you know if I figure out how as I am pretty good at Premiere and After Effects.

I think you still need to tell AVP this is 3D video in metadata. Just don't inject spatial metadata.

Thank you! Cheers!

It is on my patreon: www.patreon.com/HughHouFilm

@@hughhou Thank you！

Immersive 180 on AVP is exact the same as on Meta Quest 3 which shot on this setup or similar like RED V-Raptor. There is no movement like spatial video. The best example is Alica Keys or Adventure series on Apple TV. That’s your reference from official Apple.

Thank you for being so personable and responsive!

NOT 6DoF - 6DoF is only available on VolCap or Game Engine. This is just optical illusion parallax effect using eye and head tracking on the AVP. It is more than JUST 3D but still based on original 3D video. And yes, this workflow add immersive view and "Apple Parallax Effect" (edge blocking and edge parallax). It will work on all 3D video. It has been confusing on this spatial video topic. I wish Apple just say this is 3D+ instead of Spatial Video.

@@hughhou thanks for the explaination! I was thinking maybe they uses their tof sensor or cameras to create a kind of multi layered video (or even using "Depth Anything" to estimate depth with AI). So it looks like its more about a good 3d integration in the passthough. I've tried the new "spatial video" on Meta Quest 3; does it look the same?

It is very similar on one of my old tutorial about defish Canon Fisheye using Fusion - it is one of my popular Resolve Tutorial on Canon Dual Fisheye lens. Same concept. Instead of 2 fish you get 1 fish here.

Thanks Hugh, found your video (ukposts.info/have/v-deo/aneIa6SZa22jo2g.html). Unfortunately I cannot find the KartaVR plugins for Resolve/Fusion available anywhere for download (the link goes to the Facebook page, which has not been active a couple years). Any idea where we can find them today? I am looking and will post here if I find anything. Thanks for any leads!

Doggonit. This isn’t what I hoped it would be. It’s sensing me to other hardware and software. It’s interesting that the video both assumes we are informant enough to need the tutorial but knowledgeable enough to know things like, what was so wrong with the initial 3D. I saw nothing wrong and so, do not know what the problem is that we are trying to solve with subsequent steps. Sadly, not for me. Best of luck to others.

Yeah, if you know what you're doing... there's no way you go back to spatial video. Well produced VR180 will now impress those with an Apple Vision Pro even MORE. BTW - the moon player is the closest to being able to play local VR180 files perfectly. There's a strange warp with the playback though... makes everything look like it was filmed on a giant ball. Bummer. But it should be fixed soon.

As Adam said. But most people don't know what VR180 is - just look at my video comments lol. Spatial Video is a gateway drug for them to get into VR180. But from 2D to VR180 is a big jump. Apple think that, not me.

Just 1 V-Raptor [X] is probably what I will go for or dream to own one ... but a UKpostsr can only dream lol

Haha Have you tried 6dof on it yet? 😅See that one, but renting is not always bad either!

I believe the Red komodo is not full frame, so it may not work with the 5.2mm lens

Thanks@@nariza7 good point - I had not thought of that.

Yes. The full trailer and full film are here: ukposts.info/have/v-deo/hn5pmXivi4SYo2Q.htmlsi=OlRLaQ5Hjc7eDQp1

Thanks @@hughhou ...Downloading. Shot with the AVP? and it can just be viewed on AVP or needs a player?

WOW! Awesome work! What was that filmed on - the really High Def parts? Especially the stabilised walking scenes. Thank you for sharing. I will be subscribing.

I have both on my channels already. You can search EOS VR Utility Hugh Hou it should show up :)

@@hughhouWill do, thanks!

iPhone spatial only shoots in 1080P

1. Consumer vs Professional quality. This should be always RENT than own. And get your clients pay for most of the cost. Hint commerial level. You can certainly use an iPhone to shoot commerials these days. But this is more a robust workflow. 2. I have a iPhone only workflow already which is in Davinci Resolve - link in this video description. FPC has no news so far. Crazy! 3. Yes. Apple is working hard on FPC to support Spatial Video. It is matter of time now. Right now, Resolve can do most of the thing and it is almost like free (if you get a BM camera or products).

Got it, thanks! @@hughhou

Yes! We actually explain it why on this video: ukposts.infoUbDPpcwlCh0

Lol thank you and Kimchi said hi

Honestly? I will not suggest it. Sync will be a nightmare as GoPro is not genlock sync and it will drift as rolling shutter. Great for people doing it but in practical shooting is hard to control. The drift can not be fixed in post.

Thank you very much for the reply! I was just trying to help a friend who need to shoot a music video in Italy and doesn’t have access to a Canon R5. So even with a remote that triggers both cameras, they’ll have sync issues…good to know, you saved us a lot of editing headaches! What camera would you try to get, even sacrificing some quality in favor of easy availability in Europe? Thanks a ton!

I am actually super close to Blackmagic and their camera sadly is not RF Mount. RF Mount is only for Canon and RED. I use URSA 12K to shoot test for ESPN for boardcast, but 3D we need genlock sync and global shutter - which BM does not do.

I wish there was a 180 lens for this beast! @@hughhou

I will have other solution very soon making a new tutorial on this topic. R5C can not do HLS streaming but this one can (and will work on Vision Pro if someone build the player app): ukposts.info/have/v-deo/op2AjGyYf6Bp0H0.htmlsi=HxN0DCQmrWws7Hum

Wow thank you!! More to come. Trying to keep it up 1 video a day but taking a break tomorrow for our Meta Quest VR Film release on Vday :)

H265 is HEVC - so yes in theory? MV-HEVC just has 3D wrapper on top of HEVC.

I need to test v62 on Quest 3 to report back. In theory, Meta is trying to show the full potential of Spatial Video but I have not have time to test it out yet.

I shot at C log 3 why you think it is not C log 3?

@@hughhou wow yea I guess I was misinformed from a video, was clog 3 supported on The r5c since the beginning? I just noticed in the menu on mine yesterday 🤔 I film mostly on my mavo.

不需要播放器-可以直接观看！

Yes! Tutorial is coming as well!

I see on the previous comment that 2 goPro will be a nightmare to sync (drift etc...). Is it better on two insta 360 to sync ?@@hughhou I'm waiting for the tutorial too !

I just realize the clip is part of my upcoming Spatial Video Feature Film - my director won't allow me to release it until launch - which is tomorrow! We are making the world 1st Spatial Film on Vision Pro (or at least we think it is the 1st ...)

1. You will need this tutorial to turn VR180 3D video into Spatial Video first then it can play back. VR180 and Spatial Video is TWO very different thing. It is like 360 video shot on 360 camera and reframe video crop from 360 video. / 2. There is huge debate in this topic. It is like 3D+ - not real parallax - but special treatment to make 3D look better in Spatial Video. It is NOT just 3D but it is not volumetric

@hughhou Got it. Thank you. I can see how it would help sell a more volumetric-like look without actually doing anything to the parallax of the original stereoscopic video. Ideally you'd want to add a depth map via AI and/or the lidar sensor to give it a more realistic parallax. Have you played around with Lifecast? It's volumetric video taken from the Canon dual fisheye and brought into Unreal. Would likely look even better in AVP than spatial video.

v62 is not out yet? I can't test it until it is out. Unless I missed the update?

I got the v62 update a few days ago and I tried it, looks like a regular 3D with blurred borders placed in the home environment with a little bit of dimming of the surroundings, it is pleasant to look at but there is 0 parallax effect on it as far as I can tell. I thought that Apple figured out how to process 3D footage with AI and introduce a little bit of a parallax effect to make it look like a pseudo volumetric video, even if it is very subtle it would go a long way to add realism and reduce the nauseating effect of regular 3D, I don’t have an AVP so I have no idea how the spatial video looks in it but I am pretty sure that is not as exaggerated as their promo video shows, am I wrong? how does it look to you on the AVP headset? An other interesting thing is that Boz, the Meta VR boss, on the Meta demo video explains what their “spatial” video is and it was nothing more than explaining how 3D video works in general, no parallax was mentioned in it and the video itself is just a simple 3D video on the Quest 2 I have. So are all the rest of the demo clips. What they did is they added a native 3D video player to the Quest OS so it can play the 3D videos recorded on the iPhone 15, nothing more imo, they are riding on the AVP hype… lol, again, there is no parallax effect in it at all, neither does your demo spatial video that I downloaded and also played through the Meta TV portal. My iPad pro recognizes it as a spatial video in the Photos app and it even displays a little icon confirming that it is that. Unfortunately I could not upload it to the headset through the Meta Mobile app as Meta is suggesting (they are very sloppy with programing in general btw), there is no upload button yet in the gallery on the app, according to reddit posts many people have similar experience, looks like they are rolling this feature out in increments. Maybe there is parallax effect on the Quest 3 or Pro but not on the Quest 2? idk, but it was underwhelming to be honest, I’ve been using the Quest 2 to view 3D videos and pictures for years now, I am a 3D photographer, so I got very exited about the possibility to record 3D video on the iPhone and even more excited about the “spatial” aspect of it but that is not coming through on Meta’s implementation of it. Confusing for sure, but I will get to the bottom of this! 😂🤣😅 Thank for your videos, they are very useful for 3D creators!

Yes in v62!!!!!

They are like 5 vs 6 - all not ideal lol. Maybe need AVP 2 to get there. I am cynical tho.

What would be ideal. How would you get a 10

New v62 will have lots of improvement. Wait till end of this week for update and try again?

Oh no my review is not even out yet lol. Haha, well, right now you are right on. VR180 is NOT technically support on AVP yet. But it is not even 10 days yet on one work that fast on develop something lol. It took 1 year to launch QTV on Meta. So we have to wait at least a month or 2. I don't think Apple will release support until FCP has a solution for making it better.

What is FCP?

@@gamerzcoolkidzredbull Final Cut Pro

final cut pro @@gamerzcoolkidzredbull

Final Cut Pro@@gamerzcoolkidzredbull

Mmmm... I render in ProRES from Misitka, and then I added VFX and Graphics on Davinci Resolve - maybe even light color grade. So try ProRes render but not compressed H265 / H264? Resolve is my final step.

@@hughhou thanks! I think part of the problem is the conversion to rectilinear expands the video far beyond the 4k image box, and so only about half of the image is used, as it stretches. So resolution is lost. I am trying to do this expand in Premiere, where I can control how much resolution is lost.

also is it possible to view any regular 3d sbs video as a spatial video on the meta quest?

Yes. Premiere natively support it! I use Premiere still on render.

So the sample I used belong to my latest film. So I will release it when I finish the Spatial Video version on AVP. Director do not want to release it until it is correctly color graded. So it should be available no later than Monday. The full film! I will ping you here when it is out.

Good suggestion. Let me put my CALF to work!!!

Here. It is official release now as a film: ukposts.info/have/v-deo/hn5pmXivi4SYo2Q.htmlsi=CbApKSDHEdrzFHWF - download the free trailer. The tallking head is iPhone and the film itself is R5C - you can even see the image quality different here! Great for educational purposes.

Sorry my director do not want me to put that out yet as that is part of this film: ukposts.info/have/v-deo/oXF4ZneFcGqlu3U.htmlsi=6IVvpZ4IJXWz-SJ3

Thank you@@hughhou -- I meant is that smaller file something that is generated from a workflow, or is that literally just a short clip.

Not really. MP4 work as well btw but MOV can get lossless audio and way way higher quality!

@@hughhou Thanks!

用spatial转换的时候，无法输入，这个工具是对分辨率有要求吗？

没有。是不是你的codec有问题？用handbrake来转换成h264？

Camera test! Kimchi love to be filmed!!

This is Spatial Video - basically fancy 3D+ video by Apple. Not immersive video. Canon already do immersive video natively - so no need to do anything extra

I respect Mic but I don't think he is 100% correct on this one. I have extended experience on the AVP at this point as I have it from day 1 till now, in it prob more than 100+ hours. The source video is 3D yes. But the presentation is different inside AVP - not something I ever experience, especially when I code my own 3D video into Spatial Video as point out in this tutorial. AVP has eye head tracking to offset head movement in 3D to reduce motion sickness and a more immersive view. It is not a 3D video stuck to your face like current Meta or Pico (although this inspire Meta to update Quest to v62 firmware also roll out spatial video support - which they also do not think that is JUST 3D video). It is software magic, yes! Not camera magic but AVP tracking and software live rendering. But call it JUST 3D is incorrect.

is great to know that Apple managed to enhance 3D videos like this… but is the parallax effect as extreme as on their promo video? there looks like a real volumetric video with 6DoF… it’s hard to believe it is, that would be some crazy realtime AI video magic!

See my other comment of the different between Spatial Video vs Immersive Format. This is about Spatial Video, and convert immersive format video into Spatial Video with way smaller FOV!

Yes But this professional level so you probably rent the camera and get paid BIG DOLLARS from your clients - hint, commerials quality or film quality production. If your client pay for your AVP and your salary, why not?

@@hughhou yes, recording for avatar 3 or 4 no?? 🤣🤣🤣👍

Yes. This is about Spatial Video NOT* immersive format. Immersive Format is exactly the same as what we used to on Meta Quest platform and we have been shooting immersive format on this channels for over 5 years. Apple themselve also only said Spatial Video is new, not Immersive Format as they know immersive format is VR180 video - what the Canon camera capture natively without you doing any extra thing.

Thank you for the feedback. I should stop the music after intro. This video does go indepth into the workflow. But there is pre-require understanding the space, why use professional camera instead of Vision Pro onboard camera to give a reason why we need to go tho all the trouble to produce high quality content. Not all viewers are as experience as you and need some upsell of the workflow to understand the importance. On an instructional design standpoint, I need the belt and whistle to keep the young generation interests. It is hard to be creators at modern day distrated world and compete with TikTok. But you are 100% right. This video are rapid speed produced, so lot less tho put into it like our normal content. Thank you for sticking around.