OpenAI Sora to Apple Vision Pro Spatial Video to 3D Hologram - The Future is Here NOW!
Переглядів 32,040
2 місяці томуExperience the mind-blowing world of AI-generated spatial video with OpenAI Sora on Apple Vision Pro! You'll feel like you're flying through a parallel universe with unparalleled depth and realism. Check out this free spatial video download here and step into the future today on your Apple Vision Pro, Meta Quest 3, UKposts VR, LumePad 2, or even on the Looking Glass Holographic Display.
👉 FREE MV-HEVC Spatial Video Download link is here: / openai-sora-to-98629022
There is a 1080P and 4K version. If you see a download error on the 4K version, meaning too many people are currently downloading. Try the attached 1080P version first. That one is way smaller and has no download limit.
🐕 FOLLOW ME & Kimchi:
➜ Instagram: / hugh.hou
➜ Facebook: / 360creator
➜ Meta Quest TV: ocul.us/30uMZUj
➜ TikTok: / hughhou
🤝 We are open for HIRE! Reach out: hi[at]hughhou.com
#openaisora #visionpro #3d
@yokkabai 2 місяці тому
One very intriguing possibility from this is the possibility of essentially destroying the technological barrier to create crystal clear VR180 video (with the caveat of it not being- real.. lol). Despite present day cameras being able to create great single shots - all 180 capable cameras, even Canon, can only show somewhat muddy low resolution 180 video. Now with AI like this it should be possible to create absolutely clear 180 video - since there are no limitations from camera sensors. This video shown here looks excellent in 3D already.. so, I’m very interested to see an AI created 3D 180 video someday! It should look amazing!
@hughhou 2 місяці тому
This is the goal! At least mixing AI and real footage and intercut them as no one can tell they are AI now with Sora. That eyes shot are so good in depth the clients freak out and can't wrap their mind how anyone can shoot close up 3D like this.
@brookep1 2 місяці тому
This is the stuff. 3D looks best in a headset and AI being this good already for making 3D content is nuts.
@hughhou 2 місяці тому
Indeed. Next is to get onto Sora beta list and start mixing AI-gen 3D to real Canon VR180 3D! Clients won't be able to tell and wondering how we get that amazing close up eye shots!!!
@MichaelRedman 2 місяці тому
Amazing on Quest 3. Better resolution in the browser than the UKposts app
@hughhou 2 місяці тому
Good to know the WebXR browser support the best 3D playback!!
@christofthuis1834 2 місяці тому
Skybox 8k youtube video is the way. Learned this on your channel
@trevordennis 2 місяці тому
I don't get what is special about spatial video. I watched the demo clips on my Quest and its 3D but only in a window. It's nowhere near as good as VR180 video where you actually feel like you're there where the camera was. in VR180 you can look around and people all look people sized.
@hughhou 2 місяці тому
Yes. I also agree VR180 is like 100000 time better than "Spatial Video". But most people do not know what is VR180 video (we don't have marketing budget compared to Apple). So I use Spatial Video as gateway drug to get them into VR180 video or 3D360 video. Baby steps lol.
@futureproductions 2 місяці тому
Where is the tutorial on how to achieve this effect for normal 4k 360 footage from MI Sphere camera? (Or just standard footage)I would love to know! Thanks very much.
@paulchiu 2 місяці тому
Hugh, where can I find the apple VR180 demo videos? The hot air balloon 180 and others? Thanks
@hughhou 2 місяці тому
@@futureproductions That is coming! Next tutorial!
@hughhou 2 місяці тому
@@paulchiu The one from Apple? That is inside Vision Pro called Adventure on AppleTV.
@joelface 2 місяці тому
What I like about sora is the extreme consistency. I picture being able to prompt Sora for a full 360 rotation of a character or object. Then I can import that video and make a convincing G-SPLAT or photogrammetry-based 3D model. These can then become TRULY spatial in a Vision Pro.
@hughhou 2 місяці тому
Yes! G-splat is already possible with Sora video model!! Some one pour this into just LumaAI and Unity. I just take it a step further into Vision Pro Spatial Video. What a time to be alive!
@letsgetsmall 2 місяці тому
Thanks for this, Hugh. Greatly appreciate all the tutorials you put out. Since I started my obsession with VR, your videos have enabled me to pull off my own project. A project that started as a pipe dream and now I have a meeting with Meta next month. They loved it! Thanks and keep doing what you do. You are an inspiration to all of us developers and dreamers.
@navinbhandari2001 2 місяці тому
thats amazing
@hughhou 2 місяці тому
Great to hear! Congrats!
@urbanvr 2 місяці тому
Amazing, Hugh!!! Can’t wait for the tutorial. 👏🏾
@hughhou 2 місяці тому
Coming soon! Hopefully I can finish it tomorrow. I want everyone have Vision Pro to try this now.
@snikadoodoo 2 місяці тому
Hey Hugh, Excellent content on OpenAI Sora! Do you happen to have a video tutorial detailing the process of converting 2D content into spatial video format?
@hughhou 2 місяці тому
Yes I do and it is in the make as we speak. It should be out Monday at 830am if I do not slack.
@woosung__k 2 місяці тому
wow this is amazing!! which app I can use to watch in Vision Pro?
@hughhou 2 місяці тому
No app is needed. Just download the Spatial Video in your Photo or Files (via iCloud in Vision Pro), then just play it. The video is already native Apple format.
@OppoAs-zo4bz 2 місяці тому
ความฝันที่กำหนดได้ และฝันโดยไม่ต้องตอนหลับ
@bishopsfinger9061 2 місяці тому
Hugh this is awesome and looks amazing - i did notice scale issues on the quest 3 in that the island views look like I’m looking at a small scale modal withe people moving around and in the seen from India (i think) the city in the background seems like a tiny modal, but then as the camera pans around and the people on the balcony come into view the look giant for a split second and then snap to real size - the background city then looks to scale The same with the jeep / Land Rover driving , it looks more toy scale than real life? Is this due to the camera used for the original filming or is it the AI artefacts ?
@hughhou 2 місяці тому
Actually the AI scale based on the 2D. The 2D already has scaling issue - like minitrue video on the drone one at least. With Depth, which make it even more obvious. In theory, in that distance it should not have any depth in the real life. But if AI force depth in it (what I did on purpose), it will become a giant looking at a mini world - which look incredible in my opinion and never be able to capture in real life. The spatial memory idea is capture reality into memory capsule - so it make sense. If we want real world - then none of the drone shot should have any 3D at all :)
@bishopsfinger9061 2 місяці тому
Ah that makes more sense I watched it twice more and could see the transitions better - more like a dream where reality is more fluid I like the style and the quality is amazing Keep up the amazing work
@barbuceanu2005 2 місяці тому
Hey, Hugh, Could you please explain what is the difference between a spatial video and a 3D video ? Thank you!
@hughhou 2 місяці тому
Here: ukposts.info/have/v-deo/bYmUZ2t-loV8onk.html
@vrquest_realidadevirtual 2 місяці тому
Hi Hugh Hou, Great Video! I did upload one AI video of Sora to my VR, and I can not find the correct settins. I know it is Side by Side and 3D, But which will be the corretc settings, like angle of view, and more? Thanks!
@hughhou 2 місяці тому
To you VR headset like what brand? So the downloadable video in this video is Spatial Video - meaning you will need Apple Vision Pro to play it natively. If you have Meta Quest, make sure you have an iPhone and download the latest Meta Quest iOS app. The follow this tutorial to load it on onto Meta Quest 3 / 2: ukposts.infoL6MNb2QIZH4 - right now Spatial Video only support on VitureXR Glasses, Apple Vision Pro and Meta Quest with iPhone. We hope more device support this format. But this UKposts video can be view on any VR headset with UKposts VR app :)
@MichalFornalczyk Місяць тому
That viaduct exist in Scotland, Glenfinnan Viaduct
@Gorto68 2 місяці тому
Hugh - since you seem to be so ahead of the curve - do you need the developer strap to connect the AVP to Reality Capture Pro? For the life of me, I can't find any documentation about making the connection. The upper right headset icon is just grayed out for me.
@hughhou 2 місяці тому
No you don't need the developer strap! You need to go into your AVP settings and enable connection to third party devices like your laptop. You only need to do once then as long as your Mac is in the same wifi network - it will show in Xcode / Reality composer
@hughhou 2 місяці тому
Go in your AVP - Settings - General - Remote Devices - pick your mac in the network! Then enable deveoper mode and you are golden!
@TopperWH-TH 2 місяці тому
OMG, I didn't know they could also produce stereoscopic video too! How did you find out about SBS? I can't find any mention of it in the official press release.
@hughhou 2 місяці тому
Oh not official. I don't do official stuffs like everyone else hehe. This is my way to figure out - tutorial coming tomorrow. I like to build on current tech to create art and solution that the official tech have not think of yet. Trying to help our viewers to be a step ahead of the game.
@TopperWH-TH 2 місяці тому
@@hughhou You are always on top of the game! So amazing!
@Instant_Nerf 2 місяці тому
Ok so how to take 2D video convert to Spacial for AVP?
@vr180asmr 2 місяці тому
I assume true VR180 format directly from Sora will not be possible yet. I hope to see true 180 degree projection video with stereoscopic left and right eye. I guess what we see here are the 2D Sora demo videos with an added depth map / anaglyph as post processing or something like that? Anyway interesting to see your new tutorial.
@hughhou 2 місяці тому
So not necessary as Sora can driven by Video to Video - meaning if you have a VR180 video with correct projection - you will get the correct projection as the "controlnet" (stable diffusion term) is what drive your video-gen. There is so many depth model in controlnet which you can use. Depth has been 2 years in the Stable Diffusion world so yes, it is highly possible and I can probably figure all these out if I have beta access in Sora :)
@vr180asmr 2 місяці тому
@@hughhouAh thanks for your answer. Yeah video to video might be the way! I hope you get the Sora beta access! Looking forward to your next video. It is all very interesting :)
@misja4122 2 місяці тому
Hmmm... I have to say that the examples look much more convincing in 2D than in VR.
@hughhou 2 місяці тому
Well the 2D is by official Sora and the VR is by me - I am just 1 guy messing around as an artist trying to break more boundary lol.
@misja4122 2 місяці тому
I appreciate that, Hugh. You've made some really great stuff for VR. I just feel like the usual AI glitches are a bit more obvious here in comparison.@@hughhou
@DaysonFeliz 2 місяці тому
Interesting, on my Apple TV this video plays in SBS while on my iPhone it’s in stereoscopic
@hughhou 2 місяці тому
Is Apple TV support 3D playback? You will need a 3D device to watch Spatial Video. Apple Vision Pro or Meta Quest 3 is recommanded. Or any VR headset has UKposts VR app for regular 3D playback.
@DaysonFeliz 2 місяці тому
@@hughhou I tried downloading the sample footage for my Vision Pro but I get an error on Google drive. Will try again tomorrow. Thank you!
@JimPAnimation 2 місяці тому
In the video you say if you returned your apple vision pro you can view it on Quest. Is it no longer "spatial" at that point? but just regular stereoscopic? And to generate the AI clips, do you need to pay Apple to generate? or is it going to be a free open site? I just don't understand how Apple gets the credit for "spatial" video. Apple CERTAINLY gets credit for lidar sensors and being able to do AR because you can put the computer generated behind real life items! But Blueray 3d Avatar will still be the same stereoscopic on both devices. Correct? Thank you
@hughhou 2 місяці тому
So I forget the linked out tutorial. But basically, Apple use MV-HEVC for Spatial Video. And MV-HEVC / Spatial Video is not owned by Apple. It is a standard every one can adapt I believe. That is why Meta Quest v62 update (slowly rolling out to everyone) allow you to watch Spatial Video kinda like inside Apple Vision Pro but directly on Meta Quest 3. The quality is nowhere compare to Vision Pro but the characteristic of a Spatial Video in there. Meta also do not call this 3D video - it is spatial video. I hope this make sense. There are multi-step workflow hacks I used here, some open source software but mostly AI. Nothing to do with Apple as it is me get this to work NOT* Apple. Wait for me next tutorial will make a lot more sense. This is the result video. But first part you do need OpenAI and it is not open beta yet.
@urbanvr 2 місяці тому
Is there any way to insert your own image into these type of AI videos?
@hughhou 2 місяці тому
Yes. That is upto OpenAI. But you can drive your AI generation with your own video.
@CalvoSaezLuisManuel 2 місяці тому
I downloaded a spatial video from your channel, I have v62 with spatial examples in my quest 3 and v254 in my android phone, seems there's no way to upload spatial videos from android phone yet. I wonder if this is just an option for iphone owners, that would be really sad I wanted to try your spatial video with the new feature 😢
@hughhou 2 місяці тому
Yes it has to iPhone owner as Meta using iPhone spatial processing. I am talking to Meta and begging them to just unlock Andorid processing but they are slow. It should be out soon tho hopefully.
@SteveandLizDonaldson 2 місяці тому
With any AI system, it needs to be trained. OpenAI got in trouble for training on (text at least) books and articles etc that are copyrighted. I sell video clips (Pond5 and Shutterstock) and have seen small (and I mean very small) royalties for digital AI sales. So the thing to watch out for is that your 3D, 360 etc videos are not stolen (used to train AI) and warped into something else without your permission.
@hughhou 2 місяці тому
Good call. I don't think there are enough sample to train 360 video yet as I am one of the few creators making them. But I don't might if they can use my sample to generate something useful. Most of my stuffs are open source for educational purposes. As long as they don't make money off open source content and pure educational that should be fine with me.
@nicholaslawrence1491 2 місяці тому
I’m currently watching on the Apple Vision Pro but I’m seeing a lot of red and green screens like it’s not putting the video together green screens
@hughhou 2 місяці тому
Are you watching it directly on UKposts or are you download the Spatial Video, airdrop it onto your Vision Pro and watch it with the native player? Do you go into "immersive" mode to see it?
@Bil30321 2 місяці тому
It would be amazing to see 180 3D VR (short) videos put out by Disney for Apple Vision Pro and Meta Quest of: Star Wars chase scenes, Pixar shorts, Avatar Flight of Passage, Jurassic TRex chasing you. All for free. (Perhaps anyone can generate something similar someday with AI such as Sora) :-)
@hughhou 2 місяці тому
I would LOVE to shoot for Apple / Disney to create Star Wars one of or any VR180 version of their IPs - anyone from Apple please hire us lol!
@Teacher-Fan 2 місяці тому
Can I watch it on my pico4?
@hughhou 2 місяці тому
UKposts VR app on Pico 4 - yes! Just watch it directly on UKposts inside Pico.
@MichaelRedman 2 місяці тому
When I download the file onto the Quest 3 it will only play as a flat 2D video (both the hi-res and the lower -res) but play in 3D on UKposts
@hughhou 2 місяці тому
The download file is Spatial Video. You need to follow this tutorial to play it correctly on latest v62 update on Quest: ukposts.infoL6MNb2QIZH4
@MichaelRedman 2 місяці тому
That only works if you have an iPhone 15 Pro. I downloaded an earlier spatial video from you into the Files app and it played OK (the one with the dog outside and the other with the headset@@hughhou
@nextcurve 2 місяці тому
My problem with Sora is that if you look closely you will see the hallucinations and other aberrations that make a lot of this content unusable ultimately. Horses with 3 legs. You actually don't have to look that hard. The typical issue with Gen AI.
@hughhou 2 місяці тому
Yes yes. But Legs and hands issues are being solved as we speak. hallucinations and other aberrations is also being solve with more controlnets or whatever openAI call it. So it is the speed of maturity scary the sh!t out of me. In several months, we won't be able to tell.
@nextcurve 2 місяці тому
It's actually not being solved. It is possibly statistically impossible. Many of the problems that plague this technology persist. It is deeply flawed technology that produces things that make people think it is great.@@hughhou
@md.fahimalam7481 2 місяці тому
how did you make a 2d video into a 3d video?
@hughhou 2 місяці тому
The tutorial is coming tomorrow!
@Naundob 2 місяці тому
How can I watch this on a Looking Glass Portrait?
@hughhou 2 місяці тому
This is coming hold on. I just demo it but tutorial is coming tomorrow.
@hahaho0606 2 місяці тому
I dont have ios&mac system. So i cant upload spacial video. I want to see spacial videos using Windows Pc or Android Mobile phone.
@hughhou 2 місяці тому
We will have a workflow here soon. Stay tuned!
@spediegunz 2 місяці тому
Hugh please keep us up to date if any spatial viewing steam apps (like the new meta ios app) come out for pcvr that take advantage of the parallax imbedded in this new spatial format so far non of my apps ive tried even play back the MV-HEVC format and when its converted to a sbs video it doesnt do the parallax…… ive tried deo vr player, virtual desktop, bigscreen, and virtual home theater
@hughhou 2 місяці тому
Will do. Right now Spatial Video only play back on Apple Vision Pro and Meta Quest 3 with v62 and an iPhone for upload to Quest server. I ping Meta to ask them build something or at least way to upload on Andorid. They are working on it.
@tlacui76 2 місяці тому
i downloaded the file but only came up 2d on quest 3
@hughhou 2 місяці тому
Yes. This is a spatial video. You need the latest v62 on Quest 3 to playback. Watch this short tutorial on how to watch Spatial Video on Quest 3: ukposts.infoL6MNb2QIZH4?si=xnnQKoFftalDh8UW
@tlacui76 2 місяці тому
@hughhou I have v62 and have the spatial video folder, I downloaded file directly on headset and it went to downloads but only 2d, I have an android phone does that make a difference? Thanks
@Somanybeats 2 місяці тому
Wow this is really impressive. AI has really come a long way. I noticed the only part of the video that actually looked spatial was at 00:50 when you're showing the Looking Glass. The AI generated videos looked more 3d-ish and at the end maybe iPhone spatial video. Still looked amazing though
@hughhou 2 місяці тому
Yes. Volume need lightfield capture.
@AeBlues 2 місяці тому
Thank you!. judging by the anaglyph view in all the AI generated stereo videos, it looks wrong. the parallax is the same in every distance
@hughhou 2 місяці тому
Not prefect for sure. But I won't say wrong neither. Watch it inside VR headset you see what I meant. They look good but not 100% correct. This is day 2 of the announcement lol. We are getting there and get it better. S
@AeBlues 2 місяці тому
@@hughhou Thanks. looks like simply even horizontal disparity as if you take 2 same images and offset one of them by even amount of pixels.
@Flowstatecaptain 2 місяці тому
AI will never match true stereo 3D cameras or renders. Maybe some day very close for basic scenes but not every little detail in a complex scene. Look at those messy blobs. Way off. I’d rather stick to 2D than AI 3D. Still interesting though
@cocoabias 2 місяці тому
spatial video is normal Side by side video .not include deep information
@hughhou 2 місяці тому
Spatial Video is based on SBS yes. But then AVP player make it better with all the extra datapoint and metadata. So it is MORE THAN JUST 3D.
PRO РОБОТОВ
Переглядів 84 тис.