OpenAI Sora: Beauty And Horror!

  Переглядів 243,938

Two Minute Papers

Two Minute Papers

Місяць тому

❤️ Check out Lambda here and sign up for their GPU Cloud: lambdalabs.com/papers
📝 My Master thesis on fluids, with source code: users.cg.tuwien.ac.at/zsolnai...
📝 Paper/poster on fluid control, with source code: users.cg.tuwien.ac.at/zsolnai...
📝 My paper on simulations that look almost like reality is available for free here:
rdcu.be/cWPfD
Or this is the orig. Nature Physics link with clickable citations:
www.nature.com/articles/s4156...
🙏 We would like to thank our generous Patreon supporters who make Two Minute Papers possible:
Alex Balfanz, Alex Haro, B Shang, Benji Rabhan, Bret Brizzee, Gaston Ingaramo, Gordon Child, Jace O'Brien, John Le, Kyle Davis, Lukas Biewald, Martin, Michael Albrecht, Michael Tedder, Owen Skarpness, Richard Putra Iskandar, Richard Sundvall, Taras Bobrovytsky, Ted Johnson, Thomas Krcmar, Tybie Fitzhugh, Ueli Gallizzi.
If you wish to appear here or pick up other perks, click here: / twominutepapers
Thumbnail background design: Felícia Zsolnai-Fehér - felicia.hu
Károly Zsolnai-Fehér's research works: cg.tuwien.ac.at/~zsolnai/
Twitter: / twominutepapers
#openai #sora

КОМЕНТАРІ: 649
@davidbrinnen
@davidbrinnen Місяць тому
4:06, the specular may be a bit high, but the light scattering through the leaves - still impressive.
@mikesh007
@mikesh007 Місяць тому
Es gibt immer Luft nach oben.
@Styleforces
@Styleforces Місяць тому
there is no point in judging it as a CGI rendering and comparison, there is no real physics there, just replication in a "brutal force" way
@fangbozhu7379
@fangbozhu7379 Місяць тому
Uhh, I think the AI generated a non-Euclidean house💀
@deseosuho
@deseosuho Місяць тому
Lovecraftian :)
@cerealpeer
@cerealpeer Місяць тому
try eliptic curve fourrier transformations of matrices in elementary systems of equations with variables of functions to the topology of the space
@gothicpando
@gothicpando Місяць тому
Welcome...to ai.
@blacknoir2404
@blacknoir2404 Місяць тому
I want to see a video of an FPS game in hyperbolic space
@hypercoder-gaming
@hypercoder-gaming Місяць тому
Lol yeah
@amarug
@amarug Місяць тому
Around 4:03 the front legs of the elephant mess up and essentially switch locations in a mind-bending-physics-breaking-biology-wrecking flinch
@BrooksMoses
@BrooksMoses Місяць тому
Wow, nicely spotted!
@MatthiasTTV
@MatthiasTTV Місяць тому
Interesting; this also happened to the lady in the red dress in the video the OpenAI team put out demonstrating Sora's release.
@Darthvanger
@Darthvanger Місяць тому
Wow that's actually a neat transition
@wtcbd01
@wtcbd01 Місяць тому
This happens in many of the Sora videos, like the woman walking with sunglasses in the street and the puppies playing in snow. The video of the African family does weird things with their hands, so not perfect but very close. Compared to about a year ago with the will Smith spaghetti video it seems decades ahead.
@Nulley0
@Nulley0 Місяць тому
Sora may be the greatest lucid dreamer to ever exist at this point in time.
@petrac.1739
@petrac.1739 Місяць тому
Sounds like an insult to lucid dreaming...
@justinwescott8125
@justinwescott8125 Місяць тому
@petrac.1739 You mad over here for no reason😂
@edupe6185
@edupe6185 Місяць тому
@@petrac.1739lucid dreaming is bad for everybody’s health
@ajoxadadeus785
@ajoxadadeus785 Місяць тому
can you elaborate ?​@@edupe6185
@Egg-Thor
@Egg-Thor Місяць тому
​@@edupe6185It's not
@remuladgryta
@remuladgryta Місяць тому
With the house tour example it does actually seem like it _is_ making things up as it goes. It stays mostly consistent with whatever is in-frame at any given time, but it makes nearly a full right-hand turn and ends up somewhere that doesn't look like the same place as the start of the clip. Even from room to room, there are some inconsistencies in perspective that leads to e.g. the floor not appearing planar.
@tomcollett228
@tomcollett228 Місяць тому
Also, there's a bed in the kitchen
@TheBeatfox
@TheBeatfox Місяць тому
Yeah, I have to take issue with his insistence that the AI "really has a model of the house itself". Sora may have much less consistency issues than previous AI video models, but they still clearly exist (especially in those "blooper" Sora clips, such as the weird chair at the archeological dig). And so many of those fly-through clips have a crazy amount of scale and perspective shifting that makes no sense in a true 3D context. On a fundamental level, it's still doing the same 2D "autocomplete" as prior video models - there's still no true spatial understanding.
@sentosaco
@sentosaco Місяць тому
placing a couch like that, right in front of the tv is VILE
@MassDefibrillator
@MassDefibrillator Місяць тому
I don't really like this youtube for this sort of reason. He rarely seems to approach things objectively, applying criticism even when it is obviously appropriate. It's more a channel where he just confirms his biases, and generates hype. Pretty misleading given the title of the channel.
@ForceField9
@ForceField9 Місяць тому
Yeah, and those are small issues. If this was a quick scene in a movie 90% of people would miss it completely or just... you know, not care. These will be easily fixed.
@Baleur
@Baleur Місяць тому
What i'm dying to see that nobody seems to have tried yet, is a prompt telling the "camera" or "viewer" to pass by a mirror. Without specifying "human" or "man/girl" or anything, it'd be interesting to see if Sora understands that the viewer itself ougth to be reflected in a mirror... And what would "it" look like when seeing itself in the mirror? Would it randomly assume it should be a person holding a camera, or something entirely weird? I thought about this because in these videos with a lot of reflective surfaces, the source "behind the camera" is never reflected.
@simplethings4487
@simplethings4487 Місяць тому
Really interesting idea. It's kind of like testing animals if they recognize themselves in the mirror but with a twist
@fishygaming793
@fishygaming793 Місяць тому
I`m curious about that too! There is only 1 AI video about a train that eventually moves trough a tunnel. You then see the reflection of a woman holding a phone, filming the scene.
@CamAlert2
@CamAlert2 Місяць тому
My assumption is that it would just choose randomly each time, unless you specify things.
@Egg-Thor
@Egg-Thor Місяць тому
It would probably just show a random person, like the woman filming in the train video
@maelstrom2313
@maelstrom2313 Місяць тому
The result would be highly contextual based on the specific wording of the prompt in relation to the training data.
@wesas2344
@wesas2344 Місяць тому
Damn, My grandmother at age of 83 is still alive and she was living in a old mud house at her teenage with no technological accomplishments, and AI is achieving these accomplishments now, God knows What AI will evolve When I become old.
@user-fs1lc2cj5s
@user-fs1lc2cj5s Місяць тому
fr. the fact that it’s growth will be exponential is kinda insane to think about.
@gravity_mxk5663
@gravity_mxk5663 Місяць тому
This dude’s dead consciousness reanimated via AI in a live audio video format will probably be telling us about a new incredible AI technology that can kill the user, but, hold on to your papers fellow scholars, because it can do this without the user even knowing! What a time to be alive!!!
@panicraptor2837
@panicraptor2837 Місяць тому
It will make sure you won't get old. In good and bad ways.
@carlosrivadulla8903
@carlosrivadulla8903 Місяць тому
My grandmother passed away last year. She was able to witness horse-drawn carriages and GPT3 during her lifetime.
@user-fs1lc2cj5s
@user-fs1lc2cj5s Місяць тому
@@carlosrivadulla8903 wild.
@spelcheak
@spelcheak Місяць тому
ah yes, 5 right turns means it really understands the space it's showing/s
@getsideways7257
@getsideways7257 Місяць тому
Come on, that's not really an accurate solution for Navier-Stokes. You can ask a decently good artist to draw you a whirlpool too. The result will most likely look convincing, but that does not mean he understands a squat about fluid dynamics (or light transport for that matter) - he's simply taught with patterns to a certain degree. And just like he can recognize the patterns, he can also CREATE them. And since your brain is ALSO taught on similar patterns - you see it as a "valid looking non-laminar flow of liquid". A neat trick for movies, but definitely not something you want to use in CAD/CAE...
@Dionyzos
@Dionyzos Місяць тому
So it doesn't understand the physics right? It just determines how to color each pixel based on all the videos it has watched?
@hombacom
@hombacom Місяць тому
Also human design has a purpose but it’s like it simulates and mix what it has seen but not understand why which can be problematic. I think a lot of people going to be disappointed when we try more concrete things.
@luisfonseca9045
@luisfonseca9045 Місяць тому
Don't think it's that simple, just like LLMs are not "just predicting the next words". LLMs need to learn the concept behind the words before being able to predict the next word. In the same manner, SORA needs to learn the concept of what is an elephant before being able to create one made out of leaves. Same goes for physics, and everything else, really. Hence why OpenAI is calling it a "World Model" and not just a "Video Generator". I don't think this is just propaganda from their end, the successor to this thing will probably be able to generate full virtual 3D worlds on the run if it was instructed to do so.
@hombacom
@hombacom Місяць тому
@@luisfonseca9045 it doesn’t need to learn the concepts to do it. Better to learn how these works to understand the limits. Even if we put hundreds of millions in cost to train them it still can’t calculate numbers better than a calculator. It struggle to break down words to letters because it’s trained on words. Sora forgets objects when they are hidden and changes them. Sora does wrong numbers on legs on ants. It’s a lot of challenges and there are not answers on everything. But it’s not all or nothing, it’s great tools but we can’t predict the future.
@BelaFox-vt5xu
@BelaFox-vt5xu Місяць тому
shush, it's ethically wrong to imply that humans might be better than anything, especially AI
@RickGladwin
@RickGladwin Місяць тому
@@luisfonseca9045 Do you have an example of an LLM that can “learn the concepts behind the words”? All I’ve seen are LLMs that are better at attention (relative importance) and the _relationships_ between words, and are trained on larger datasets, but none that actually know anything. Is there an LLM out there that isn’t just a really good text generator?
@SudiptoChandraDipu
@SudiptoChandraDipu Місяць тому
"What a time to be alive!" -- now it is only true for those in power and control of these things. For the rest... not so good of a time.
@juanmacias5922
@juanmacias5922 Місяць тому
Computation will hit a road block, even Sam Altman said they are expecting Nuclear Fusion (which is always only 30 years away) to help them across that road block.
@GeoMeridium
@GeoMeridium Місяць тому
Just in the news this week, Microsoft is dumping $115B on Stargate for OpenAI and Mistral, and Amazon is putting $150B into their own AI data centers for Anthropic. The compute side of the issue will probably to be resolved by the early 2030s, if the timelines hold up, although I'm sure this will only be the beginning of AI related megaprojects. In terms of power generation, nuclear fusion isn't really necessary, except to bring down the price of electricity production, and I don't think it's certain that it will ever be a viable energy source, though the possible benefits are obviously high enough to justify the research. In the meantime, Microsoft and OpenAI are already lobbying for fission plants in the shorter term. The timeline for their construction will be a lot faster than from any government initiative, since the funds will be readily available and not held hostage by "democracy". They also have the skilled labor and engineers on hand to design these plants, and the profit incentive for completion will be very high.
@juanmacias5922
@juanmacias5922 Місяць тому
@@GeoMeridium Capital can only take you as far at the implementation you are utilizing, but all the innovation has come from years old transformer papers google published. I don't think this will be solved with the current implementation. Only time will tell what comes of this. Thank you on the update tho. :)
@gunzor8717
@gunzor8717 Місяць тому
Yeah, but what's going to be accomplished before that roadblock? If the roadblock comes in 2035, even 2030, the computational advances will still be big enough to give us some crazy stuff
@juanmacias5922
@juanmacias5922 Місяць тому
@@gunzor8717 you can polish a turd all you want, at the end of the day, it's still a turd. :D
@larion2336
@larion2336 Місяць тому
@@juanmacias5922 Google played a big role in making transformers but to credit them with all the progress is kind of asinine. Tons of new things have been discovered since then.
@PyraJya-Luquay
@PyraJya-Luquay Місяць тому
"When everyone's super, no-one will be!" ~Syndrome, The Incredibles
@eugenes9751
@eugenes9751 Місяць тому
The next step will be of a Clau3 Opus level AI looking over those images frame by frame, critiquing the errors, and feeding that back into the model as synthetic new data. This problem will be solved effectively over night.
@AZaqZaqProduction
@AZaqZaqProduction Місяць тому
Ok that house video is definitely non-euclidean. The kitchen goes into the foyer where you start out. Funny how I see that just as you say it doesn't make things up. Still very impressive regardless!
@benjaminsandeen9241
@benjaminsandeen9241 Місяць тому
"What a [terrifying] time to be alive!"
@tonysax7464
@tonysax7464 Місяць тому
If I've learned anything from this channel its to look for and appreciate the reflections and refractions in A.I. generated work.
@guyelvy7317
@guyelvy7317 Місяць тому
2:24 I have never seen such a remarkable blending of VW, Mitsubishi and Subaru!
@pedropastador7498
@pedropastador7498 Місяць тому
The real horor is the fact that everybody will become a director.
@jerchongkong5387
@jerchongkong5387 Місяць тому
Like everything good that this AI brings, the bad will always come, there will be people who will use it to create garbage content, fraud, span and a lot of other things, personally I think that we are not ready to face the amount of malicious content that is coming.
@kphaxx
@kphaxx Місяць тому
Every time something good happens, there's someone there to poopoo it
@spyral00
@spyral00 Місяць тому
Crypto was a good idea until it wasn't. The infinite greed and research for immediate quick profit ruins everything.
@The1QwertySky
@The1QwertySky Місяць тому
i dont like paywals but here there should be one so that exact thing doesnt happen, or atleast not as often
@a.thiago3842
@a.thiago3842 Місяць тому
It's obvious for me that you're also aware of the dangers, clickbaits and such. But i doubt we'll be aware all the time. For example, the other day i watched a video about a french guy who filmed Pablo Escobar. He told how he managed to do that, what happened that day. In the end, after reading the comments below, i realized he was totally dubbed by IA into english! I got stunned! I know about IA, i know very well how to detect most of it, i know what this is capable of. But even with this ''skill'', i wasn't able to realize it, because i wasn't unaware of this as possiblity on a random video on internet. That's crazy! I also follow a page of old photos on Facebook. Great photographs, historic ones and such. But now, sometimes i can remind myself and ask to myself if what i'm seeing is a real image or one made by IA. From now, we will not be able to trust anything, not even a video, a very consistent photo and such. This is crazy and a lot of adjectives. lol
@brunodangelo1146
@brunodangelo1146 Місяць тому
Yeah I mean, it's not like we already have garbage content, fraud, spam, and a lot of other things.
@francisco_ponce
@francisco_ponce Місяць тому
sooo ... with the enough time, the ai will be able to create an entire videogame only with the words instructions ... and with even more time, it will be capable of create an entire simulation. What a time that we are living right now
@spumbibjorn
@spumbibjorn Місяць тому
Yeah the job market is going to fall apart and the difference between the super rich and everyone else will become larger. The ones that are replaced last are the heads of companies.
@benjaminsandeen9241
@benjaminsandeen9241 Місяць тому
@@spumbibjorn This is the only sane, non-hysterical comment that I've seen on this video
@spumbibjorn
@spumbibjorn Місяць тому
@@benjaminsandeen9241 Hopefully it all turns out alright, but whatever happens, things will get shaky for a while. I am studying for a master in computer science but I will try to pivot into cyber security because I do not wanna deal with this shit.
@francisco_ponce
@francisco_ponce Місяць тому
@@spumbibjorn Sam altman seems to be wanting to change the class World system that we have in west right now
@DimitriSafarikas
@DimitriSafarikas Місяць тому
@@spumbibjorn Heads of companies can be replaced (they cost too much). Shareholders are the end game.
@dreamzdziner8484
@dreamzdziner8484 Місяць тому
Sora is sorcery in this era of AI. The leafy elephant was mind blowing to another level. 😍🙇
@redwolfmedia2281
@redwolfmedia2281 Місяць тому
Yeah, I've decided to drop the creative field. I love AI, I hate that it's going to replace me, but I can pivot to a new field and continue my art as a passion. This is just how it is and I accept it.
@fnonpm
@fnonpm Місяць тому
That's a survivors mentality
@mktwos
@mktwos Місяць тому
I would recommend you keep track of the copyright lawsuits directed at AI companies right now.
@dirremoire
@dirremoire Місяць тому
@@mktwos Which will go nowhere. The Genie is out of the bottle.
@mktwos
@mktwos Місяць тому
@@dirremoire we will see.
@KTPDAILY
@KTPDAILY 13 днів тому
ONE OF MY ALL TIME FAVORITE CHANNELS AND VOICES AND MINDS --- YOU SIR HAVE MADE THIS WORLD BETTER AND WE THANK YOU
@Katiethekitten
@Katiethekitten Місяць тому
2:30 as a tour guide of Niagara falls I get to see the falls almost every day, and this isn't even close to what the falls looks like, the horseshoe falls is 2,700ft across, and the American falls is 850ft across, this looks like neither
@jameson32
@jameson32 Місяць тому
How's your hearing? That must be a major concern.
@lao-ce8982
@lao-ce8982 Місяць тому
You must be fun at parties.
@ForceField9
@ForceField9 Місяць тому
No one really cares bud
@The9thDoctor
@The9thDoctor Місяць тому
Why are people giving negative replies, this is a useful comment for people who haven't seen Niagara falls for a long time or even ever...
@robertruffo2134
@robertruffo2134 Місяць тому
@@The9thDoctor She's underlining the value of real shots of real things.
@snawsomes
@snawsomes Місяць тому
Legit... are humans doomed? What are we all going to do for work? Signed a scared designer.
@shreyash1
@shreyash1 Місяць тому
farming
@Omguserr
@Omguserr Місяць тому
AI still can only replicate - so at the moment it can't really be creative or stupid - so humanity still has 2 things going :)
@Lerppunen
@Lerppunen Місяць тому
@@OmguserrCreativity is often just combining known things in a new way. Just like what Sora is doing.
@Omguserr
@Omguserr Місяць тому
@@Lerppunen often ...
@wreckfest3728
@wreckfest3728 Місяць тому
AI is already being used to create all new new alloys, polymers, drugs​ etc. Anything you can and can't imagine. You don't need to be human to be creative. If there is an AI that imitates any form of creative sentience(learning from human creation) it's output will be creative. It will also combine that with the creations of the natural world it has also learned from.
@Blezster
@Blezster Місяць тому
Just watched his video! Haha perfect follow up vid. Thanks mate!
@existenceisillusion6528
@existenceisillusion6528 Місяць тому
Congrats, your 'sponsor message' is the first advertisement I ever considered responding to.
@a1919akelbo
@a1919akelbo Місяць тому
See uou guys in ten years when you can upload a book and generate an entire movie
@thenout
@thenout Місяць тому
Make that two years at the current rate...
@happytape307
@happytape307 Місяць тому
I would say in less than 12 months it will be near impossible to distinguish between AI & other sources.
@albertwang5974
@albertwang5974 Місяць тому
The line between truth and fake is gone, is it a good thing?
@kyer9677
@kyer9677 Місяць тому
No
@zipflame
@zipflame Місяць тому
These Sora videos for some reason always feel very similar to what I see when I dream. Cant really explain it but they feel close.
@xilix
@xilix Місяць тому
They definitely trained this on game engines and 3D programs, and who knows what else. I'm very hopeful open source will get to this stage in the next year or two, because I'm dying to pop the hood on something like this locally. Running things locally and having full control is really where it's at for me.
@reifuTD
@reifuTD Місяць тому
It's so fun looking at really good Sora videos and trying to spot the errors,
@IcyLucario
@IcyLucario Місяць тому
6:38 I like the two holding hands that walk off a cliff lol. Not to mention the floating people beyond them.
@exosproudmamabear558
@exosproudmamabear558 Місяць тому
Yeah we should start early on becasue it gonna get progresively more difficult
@marcfruchtman9473
@marcfruchtman9473 Місяць тому
Good stuff. Thanks for the video.
@megamanx466
@megamanx466 Місяць тому
It's really the pace of progress that's cool. AI seems to have the most problems it seems with hands, feet, and tires interacting with other matter. p.s. that is the smoothest dirt Rally track I have ever seen a car race on!
@abhishekparmar4983
@abhishekparmar4983 Місяць тому
What a time to be alive!
@Kemik8066
@Kemik8066 Місяць тому
What a time to be alive 😂! Love that!!
@xxgaelixsxx8151
@xxgaelixsxx8151 Місяць тому
Damn! and in so little time, it has reached interesting places.
@michaelleue7594
@michaelleue7594 Місяць тому
Exponentially more compute for constantly diminishing returns isn't really my idea of improvement, but okay. If I could see *one single video* at any resolution or length, which was good enough for any commercial application, I'd be completely convinced this was going somewhere. As it is, it seems like every iteration just gives us more and more refined unusable nonsense. Nothing is improving in ways that matter.
@CSPlayerDamon
@CSPlayerDamon Місяць тому
Amen
@daroldfuapse6178
@daroldfuapse6178 Місяць тому
Imagine the opportunity cost of having the brightest minds in the world reinventing the wheel.
@cosmiclounge
@cosmiclounge Місяць тому
The 'opportunity cost' of never re-inventing the wheel, would be failing to have invented the wheel.
@P.viridis
@P.viridis Місяць тому
What do you mean?
@daroldfuapse6178
@daroldfuapse6178 Місяць тому
@@cosmiclounge Well, I can’t argue with that logic. In any case, we already have plenty of videos and people can easily make more with current technology. There is a limited number of highly technical people. They could be working on the important problems that are facing our species and the planet. For example: disease, crop yields, pollution, energy, transportation, etc., but instead we get artificial cat videos (and that’s the best thing) because investors see the best prospect of a profitable IPO in that. Our fates are tied to Silicon Valley because when you put your money in the bank, someone who doesn’t own your money sends it there.
@DuckieMcduck
@DuckieMcduck Місяць тому
@@daroldfuapse6178 doesn't help either that the videogame business being a multi billion dollar industry. It's like they are trying to cash out on the bubble that is the entertainment industry rather than produce anything worthwhile
@gunzor8717
@gunzor8717 Місяць тому
@@daroldfuapse6178 The people behind this stuff aren't building this tech just to generate cute videos; video models are a byproduct of their attempt to create AGI, which they believe (correctly or incorrectly) will turn the planet into a utopia. They have the same goals as you
@no_nameno_name5442
@no_nameno_name5442 Місяць тому
Game of Thrones will be fixed at last...
@stoatystoat174
@stoatystoat174 Місяць тому
The elephant made of leaves was my favourite, can imagine that in a game or film foor sure ❤
@boxeriain
@boxeriain Місяць тому
Fantastic video ❤️
@jacktsai7165
@jacktsai7165 Місяць тому
i love your work
@SlyNine
@SlyNine Місяць тому
Its awesome. But there are a lot of glaring issues. It's definitly not simulating reality. Rather, its more like a strange dream version.
@chadkndr
@chadkndr Місяць тому
this is the worst it will ever be
@sleora
@sleora Місяць тому
The visual concept of that robot is VERY interesting! Good material for a game.
@robertruffo2134
@robertruffo2134 Місяць тому
No it's not. It's an averaged derivative of hundreds of robots I've seen before in cheap games and cheap sci fi movies.
@TheRune3400
@TheRune3400 Місяць тому
Regarding the low res crumbled duvet @1:28, I wonder if they used something like auto generated unreal engine world for training? This would give them training data with precise annotations...
@marcomoon6062
@marcomoon6062 Місяць тому
7:00 a pillar of the Golden gate Bridge is in between houses. But overall it looks cool like the San Francisco Rush arcade/n64 game
@timians9286
@timians9286 Місяць тому
sora ai reminds me alot about my dreams i love it
@TeeVeeStevie
@TeeVeeStevie Місяць тому
When he says his catchphrase now we can all feel that it really is as this is all starting to get so advanced at an increasingly quicker rate it's going to change the entire world over a very short period time. I go back to the Seventies and the technological advances that I saw and experienced first hand over decades that gradually changed the entire world is being repeated with AI. Except that progress is going so fast now it's mind boggling. I imagine if you jumped forward in time a decade to 2034 it will be so advanced you'd be the technological equivalent of someone travelling forward in time a hundred years from 1924 to 2024. Better strap in.
@Gerlaffy
@Gerlaffy Місяць тому
It's an AI voiceover...
@mattgenaro
@mattgenaro Місяць тому
Stating that "everyone will be a film director" is a bit too much. It's the same that saying that everyone is a photographer because they take pictures with their phone, or illustrator because they can use some poor GenAI. It will for sure democratize and infinitely speed up a video production, but be a "film director" requires a large set of skills that goes beyond generate animated image.
@eSKAone-
@eSKAone- Місяць тому
Still blows my mind.
@boltvanderhuge8711
@boltvanderhuge8711 Місяць тому
None of this is fluid simulation, fluid control, or any actual understanding of physics... like all text to image/video systems, it's simply combining similar elements from the data it was trained on, which ends up being convincing when given enough data to draw from.
@bottomtextdanny3050
@bottomtextdanny3050 Місяць тому
incorrect, it does have understanding of real world concepts, it just not right as of now, it will keep improving in the future
@boltvanderhuge8711
@boltvanderhuge8711 Місяць тому
@@bottomtextdanny3050 no, it really does not. It doesn't have any concept of the physics of flowing water, nor the rules behind light transport. It simply knows what a scene might look like when described as having "flowing water" or "a glass table". When specifying something like "Niagara Falls but with paint" it draws upon data of the appearance of niagara falls and of what paint looks like, and it just so happens that the only real correlation between the two is the regions with water since paint is often depicted as being poured. This correlation then causes those regions to share characteristics of both subjects, without even the slightest understanding of fluid dynamics.
@baerververgaert1308
@baerververgaert1308 Місяць тому
It's kind of difficult to tell whether it can learn or has learned physics concepts. The laws of physics are latent in the data. Or, at least in data captured from real-world footage. So, there is a possibility that these laws get encoded approximately in the neural net. In this sense, it is not doing fluid simulations intentionally but rather by consequence. There is however a lot more happening in videos that it also needs to encode, like objects, their moving components, their color patterns, and camera angles, light interactions, lens types, etc. If we are capable of extracting fluid simulation from the neural net, it is likely going to be a poor man's fluid simulation.
@williamihardwick2871
@williamihardwick2871 Місяць тому
I’d just like to say that this is a fascinating conversation to read.
@robertruffo2134
@robertruffo2134 Місяць тому
@@baerververgaert1308 You are correct. People don't get that AI is far less I than they realize. It's just a visual auto-complete based on stealing other people's hard work without consent.
@ashleysmith38
@ashleysmith38 Місяць тому
I'd love to see what they haven't released yet at openai. I hope you have a good time.
@marcomoon6062
@marcomoon6062 Місяць тому
6:48 the rabbit on the left has a pair of extra limbs...t-rex paws
@Poney01234
@Poney01234 Місяць тому
No, it's a bowtie, like the two middle ones
@HeortirtheWoodwarden
@HeortirtheWoodwarden Місяць тому
Rabbit centaur
@oooouaa
@oooouaa Місяць тому
0:19 " ...and you will see **HAARRR**"
@SeaSaltK
@SeaSaltK Місяць тому
I started learning 3d a year ago. Watching Sora AI now, I'm both amazed, scared and depressed
@markhegedus7952
@markhegedus7952 Місяць тому
we will always need good artists, don't worry CEOs probably still won't be creative enough to create stunning art. We'll need artists to generate art I think. And who knows maybe "handmade 3d Art"instead of AI art will be really precious in the future haha. Seriously tho I don't think learning art will ever be a waste of time, it will make you more creative so keep it up!
@jamescreativity
@jamescreativity Місяць тому
I get how you feel. You will always be able to practice 3D workflows. Same as how we can still paint. Push yourself and you’ll find a niche in the industry
@exosproudmamabear558
@exosproudmamabear558 Місяць тому
Problem is not we need artists ,problem is we will need less artists.
@dirremoire
@dirremoire Місяць тому
Design furniture to 3D print and sell it.
@GiovanneAfonso
@GiovanneAfonso Місяць тому
What a time to be alive!!!
@wrends
@wrends 13 днів тому
plot twist, all videos are post-processed!
@JH-ji6cj
@JH-ji6cj Місяць тому
Always reminds me of the movie _The Thing_ when I see A.I producing what is an expected manipulated representation of what we will be fooled by.
@b.s.7693
@b.s.7693 Місяць тому
It's interesting that nowadays the greatest advances are driven almost exclusively by computation, not mechanical engineering or anything else. Compare it with big inventions in the last 100 years ... this time is over. And I say that as a materials science engineer.
@mariusg8824
@mariusg8824 Місяць тому
Software eats the world.
@Darhan62
@Darhan62 Місяць тому
Sora is one of the coolest things I've seen yet. Still wonky in some videos, but really impressive in others.
@S1nwar
@S1nwar Місяць тому
4:24 thats interesting when i try to create cocktails that look a bit like space/stars etc with bing image creator it also appears to form honey like piles instead of beeing proper liquid
@isakisak9989
@isakisak9989 Місяць тому
They had this internally a year ago, i can't imagine how good the text to vid model they have not shown yet is.
@hombacom
@hombacom Місяць тому
Though we also know the limitations of ai image generation already and what it can’t do because it emulate and mix visual patterns but not understand why. Totally different from reasoning in text.
@apoc519
@apoc519 Місяць тому
What a horrifying time to be alive
@gabisyndulla9575
@gabisyndulla9575 Місяць тому
I love how the car has lego wheels x)
@memesramen
@memesramen Місяць тому
I love these narrating robots
@jasonmarcus1683
@jasonmarcus1683 Місяць тому
It's weird to think that most people will listen to your voice and think it's AI generated. What a time to be alive!
@hombacom
@hombacom Місяць тому
It’s probably edited and composed together if it’s a longer talk and that’s maybe not always natural
@jasonmarcus1683
@jasonmarcus1683 Місяць тому
@@hombacom idk man, nothing about his voice sounds natural... It is, but it's hard to accept. It sounds like a rare accent combination that resulted in this abomination. Of course, that's mean to say but my god, I can't help myself. It sounds to unbelievably fake. I wish him well though, but i can't tolerate listening to him for more than a minute, and this is a 2 minute talk, lol...
@Gerlaffy
@Gerlaffy Місяць тому
It is- Actually- 100% AI generated- Or sampled- AAND- you can tell- because- It repeats things- AAAND-
@jasonmarcus1683
@jasonmarcus1683 Місяць тому
@@Gerlaffy Hmm, but his channel has been around longer than AI has been good at voice imitation I think.
@jasonmarcus1683
@jasonmarcus1683 Місяць тому
@@Gerlaffy Well, I just viewed a video he uploaded 8 years ago and he sounds entirely different and natural sounding. I think you're right.
@crawkn
@crawkn Місяць тому
I've noted an effect in less carefully done computer art before, that if you give something a passing glance, everything seems okay, but if you study the image, or replay the video, you begin to note inconsistencies with reality. Often it just takes a more careful artist to catch them and correct them. In the case of AI, it will take a more careful artificial artist, or otherwise be left to humans to discern and prompt correction.
@chiragojha7311
@chiragojha7311 Місяць тому
1:02 the plant has leaves but we now know it's soul doesn't .. 😄
@SayrexZ
@SayrexZ Місяць тому
and its so consistent too hahaha
@piehnoharmony
@piehnoharmony Місяць тому
I feel sorry for the adult industry, animators, graphic designers, 3D special FX'ers because SORA and a.i will take over their jobs.
@naruinoiscanoninanalternat2947
@naruinoiscanoninanalternat2947 Місяць тому
boowomp
@TheElcentralen
@TheElcentralen Місяць тому
It will take over some peoples jobb for sure. But it will take a good more while before we see pure ai driven companies. Most people see it more like a incredible tool to aid artists in creating.
@jacobdunn4032
@jacobdunn4032 Місяць тому
I gotta go to school but I wanna watch this
@chiragojha7311
@chiragojha7311 Місяць тому
They have gold mines in form of human created content to train their tools on. Image the crap we will get out of tools that train on other AI created content available online which will be soon more than human created content in very near future. They should somehow preserve human created content for future context or we may soon have very superior computers and powerful processors but very crappy ouput from these AI tools.
@filipw9973
@filipw9973 Місяць тому
Okay sora generate the entirety of Better Call Saul season 2
@gnollio
@gnollio Місяць тому
Nice. Looking forward to future progress. You know it’s getting good when the comments are full of designers whining.
@djayjp
@djayjp Місяць тому
No, it doesn't use polygons.
@albertsitoe7340
@albertsitoe7340 Місяць тому
The training data? Was what he was referring to?
@IcyLucario
@IcyLucario Місяць тому
He wasn't saying they did, but rather might be emulating distanced based LOD in engines that use polygons.
@YOEL_44
@YOEL_44 Місяць тому
What car was suposed to be? A late 2000 Suzuki Swift? A Honda Civic EG6? A Hawkeye Subaru Impreza with cut back? A Renault Clio Sport? What a confusing amalgamation...
@MsHojat
@MsHojat Місяць тому
car
@user-qn2bg7zb9s
@user-qn2bg7zb9s Місяць тому
It's the platonic concept of a car lol
@08wolfeyes
@08wolfeyes Місяць тому
I can see there will come a time where you'll have some kind of software where you can go into different sections for making a movie! For example: You first prompt a script for a movie that you'd like to see then in no time at all, there it is. Then it generates the movie based on the script. You go on to creating the speech for the movie although that could be part of the section above, maybe the A.I giving you a choice of voices that you want to use. After that, should you need to, social effects can be added. Then of course any sound affects. And last but not least, creating the score for the movie that reflects the tone of each scene. These could be done in one program, which would be great but more likely than not, individually because someone will want to make more money that way. One things for sure, the future looks rather interesting.
@IcyLucario
@IcyLucario Місяць тому
What I'm curious about is when AI is good enough to make edits to things. How will discussion about a show/movie look if people can use AI to edit and continue it? A popular show comes out and someone asks the AI to edit a character out and continue the plot as if they aren't there... How will that go? Are we going to start seeing threads labeled: [BASE STORY ONLY]? Will we see people asking for the best fan edits? I don't think limitless AI creation will stop people from watching other people's shows. We've very social and a lot of people watch something just to see what the fuss is about. I'm very eager to see what people make, and I think the best ideas are the things you never thought of... But the landscape might get weird.
@08wolfeyes
@08wolfeyes Місяць тому
@IcyLucario That's definitely very true and food for thought! I've just been watching some things on here that show you can already create some amazing things given a little time and imagination while also using A.I. I feel that in some ways, A.i will have a specific style to it. While you can create many images and videos in different styles, there's still something that gives you that sense that it's A.I and that's without any failings the A.i images used to have which are greatly reduced now. It will be interesting to see what directions it takes. I also agree people will still want to watch real people and movies and there is some visceral about them, a gritty feeling. CGI as well as A.I still have that, everything is so perfect feel about them. In the real world there is dust, smoke etc which all have an effect on the world around us.
@08wolfeyes
@08wolfeyes Місяць тому
@Faizan29353 Yeah, mostly although I would also add that things seem shiny, they lack something the real world has.
@aarong8457
@aarong8457 Місяць тому
I'm not sure if it has this, but it needs some kind of on the fly negative feedback loop. So it learns not to make these obvious mistakes.
@jebes909090
@jebes909090 Місяць тому
ok i can honestly say those rabbits eating got me. my brain saw that as completely real. thats scary. all the other ones triggered that uncanny valley effect, but the rabbits didnt at all. soon we wont know whats real
@timkellermann7669
@timkellermann7669 Місяць тому
I Wonder if you could use nerf together with sora to generate 3D environments
@jere473
@jere473 Місяць тому
So what does this mean for light transfer researchers if it can easily do what was nearly impossible for you?
@76Eliam
@76Eliam Місяць тому
The thing is that what he says is not true. These kind of AI are good at generating things that LOOKS LIKE the data they learnt with, but they are not actually producing outputs based on the laws of physics. For example, if I ask an AI "Draw me the lenses of a refracting telescope" it will output something that looks like a set telescope lenses, but if you try to actually build the telescope based on those lenses it will be complete useless garbage. Same thing concerning fluid dynamics : you can generate content that looks like wind tunnel tests of a plane wing (for example) BUT it will be totally useless to determine stall angle or generated drag. It's not simply that "well maybe it's just a lack of computation power", the thing is that the model did not learnt light transport equations or Navier-Stokes equations, it learnt how to generate content that looks like the related physical phenomenon. However you can use AI to generate data to help light transportation or fluid dynamics or whatever simulations, for example in the case of fluid dynamics, the small scale turbulence exhibit a self-similar behavior with specific statistical properties, which can be learnt by an AI to generate "content" in a real fluid simulation (i.e, solving real laws of physics)
@CSPlayerDamon
@CSPlayerDamon Місяць тому
​@@76EliamExactly! I don't understand the need to imply that it understands physics, other than marketing. Do people understand physics if they remember how a waterfall looks and behaves?
@dimkadimon
@dimkadimon Місяць тому
This is the most impressive AI this year.
@robotninjashark1684
@robotninjashark1684 Місяць тому
If you have a chance to run prompts, I'd love to hear what results it can achieve when prompted with stereoscopic 3d video. Is it possible to replicate it with any reliability?
@unknownfilmmaker777
@unknownfilmmaker777 Місяць тому
What AI video platforms are available now? Are there any that allow you to add your own imagery as source material?
@unraveledultimatefate
@unraveledultimatefate 20 днів тому
When back then i had to use cebas thinking particles and pay for expensive software, plugins , and now things are easier, and cost less.
@SuperZaidin
@SuperZaidin Місяць тому
Ujung2 Ai yg bermanfaat apabila Ai menasihati manusia agar jgn sombong, dendam, marah2. Berakhlak baik.
@PedroHenriquePS00000
@PedroHenriquePS00000 Місяць тому
just a quick question because of 1:24 , the way you speak is rising a question in my mind, does ai RENDER the 3d environment with a mesh or it just replicates three dimentional looking things because it was trained on real 3d photos? and if its not rendered with a mesh, then why dont we add a mesh to the background to give it more structure? or even more data to an image? its sort of baking a hollow cake vs a filled one... it might look the same, from the outside but it isnt...
@stanb1455
@stanb1455 Місяць тому
it definitely just replicates 3d things
@jamescreativity
@jamescreativity Місяць тому
Replicates in this case. Although there are 3D AI generators which you could render the scene from
@jlopez4889
@jlopez4889 Місяць тому
Fortunately, right now it is too complicated for AI to make meshes and such. However AI is getting better at mimicking depth perception, which is what you are seeing
@jamescreativity
@jamescreativity Місяць тому
@@jlopez4889 this is not true though, AI models exist for mesh generation
@intothevoid2046
@intothevoid2046 Місяць тому
I work in VFX and I would love to do a matchmove (extract camera movement and scene geometry) from one of those shots. There are incorrect parallax transformations already visible. Still I wonder what the actual extracted 3d data would look like.
@jinxxpwnage
@jinxxpwnage Місяць тому
Yes or model and sim some scene in 3D and be able to pour all the time into the important parts and just have the far mid ground and background be generated in order to save time. this means no extra time wasted on simulation for basic oceans and having to spend time on a system for scattering trees or rocks. no wasted time setting up complex texturing systems for mountains or hue differences on trees. In a way we can use this for the boring stuff and hyper focus control onto the main subject. You can also do what you said. Use sora for concept footage to figure out the shot. maybe even extract nerf of photogrammetry as position guides to get started modelling.
@robertruffo2134
@robertruffo2134 Місяць тому
@@jinxxpwnage "No wasted time" in the real world = no paid salary hours and staff cuts. Thank goodness this stuff sucks and looks as awful as it does.
@jinxxpwnage
@jinxxpwnage Місяць тому
@@robertruffo2134 Well i'm all for tech if it's used to augment. I wasn't suggesting it's good to layoff staff. Of course it doesn't matter in the end things will fall into place for the better or worse.
@robertruffo2134
@robertruffo2134 Місяць тому
@@jinxxpwnage How do you know that? History is not consistent that way. The middle class is already hollowed out. And... It's not reasonable to be all for tech. Nuclear weapons are tech AR 15s are tech, not all tech is good.
@jinxxpwnage
@jinxxpwnage Місяць тому
@robertruffo2134 i mentioned i was all for tech if it augments. I'll add positively as a clarification. We can't really do anything about it. Again time will tell By the way i think you didn't finish reading my comment. I said things will play out for better or worse. I never stated it'd play out for the better.
@LouisGedo
@LouisGedo Місяць тому
SORA is amazing
@hegedusuk
@hegedusuk Місяць тому
very interesting! This is amazing. Where this will take us, I cannot entirely imagine. But it'll change a lot of jobs.
@TwinTailsRyu
@TwinTailsRyu Місяць тому
incredible tech
@pgc6290
@pgc6290 Місяць тому
Ai world is going to be so crazy!!!
@gravity_mxk5663
@gravity_mxk5663 Місяць тому
This dude’s dead consciousness reanimated via AI in a live audio video format will probably be telling us about a new incredible AI technology that can kill the user, but, hold on to your papers fellow scholars, because it can do this without the user even knowing! What a time to be alive!!!
@DhaoistAzazel
@DhaoistAzazel Місяць тому
This makes me feel like we are so close to having Ai build apps specific to the user's request. There is a very specific app I would like to build but don't know enough about coding to put it all together but it will change the health care industry.
@futurehistory2110
@futurehistory2110 Місяць тому
With it being April Fools' Day tomorrow, I was thinking that in the future kids might be like 'Let's use AI to make a hyper realistic news report of an alien invasion and have our friend watch it' 💀
@andrewdunbar828
@andrewdunbar828 Місяць тому
The bed quilt looks perfectly good to me. Were you expecting a sheet like you said rather than a quilt? (Doona for Aussies)
@smellthel
@smellthel Місяць тому
I can't wait for the day game development is just typing very specific prompts into an AI.
@diadetediotedio6918
@diadetediotedio6918 Місяць тому
It has not launched but I think I already grasped one of its clear limitations (to be fair, I was thinking about it since I've heard about the way this model works). If your video is slow enough the model will start to hallucinate things like other video models because the history context would be lost (this happened in the house video for example, where the camera rotating almost feels like a 4D video, there's just no space for that bed to appear).
@piteshbhanushali1140
@piteshbhanushali1140 Місяць тому
So in next 5 to 7 years ..we dont know what is real or made by ai..?
@diadetediotedio6918
@diadetediotedio6918 Місяць тому
@@piteshbhanushali1140 We don't?
DeepMind’s New Robots: An AI Revolution!
8:39
Two Minute Papers
Переглядів 195 тис.
DeepMind AlphaFold 3 - This Will Change Everything!
9:47
Two Minute Papers
Переглядів 116 тис.
Something Strange Happens When You Follow Einstein's Math
37:03
Veritasium
Переглядів 7 млн
How experts use SORA, Haiper ai, LTX Studio, EMO ai, Switchlight
4:50
Haydn Rushworth
Переглядів 3,8 тис.
SORA AI’s Problems [And Solutions]
15:49
ColdFusion
Переглядів 547 тис.
Blender 4.1 - Create Virtual Worlds…For Free!
6:14
Two Minute Papers
Переглядів 161 тис.
OpenAI Sora Just Supercharged Filmmaking!
6:08
Two Minute Papers
Переглядів 102 тис.
What Is an AI Anyway? | Mustafa Suleyman | TED
22:02
TED
Переглядів 716 тис.
Better Mountain Generators That Aren't Perlin Noise or Erosion
18:09
Josh's Channel
Переглядів 229 тис.
Two Astrophysicists Debate Free Will
15:19
StarTalk
Переглядів 57 тис.
Распаковал Xiaomi SU7
0:59
Wylsacom
Переглядів 857 тис.
Start from 0 at any point on the T1 Digital Tape Measure
0:14
REEKON Tools
Переглядів 35 млн
Creepy Samsung Alarm cannot be turned off 😱🤣 #shorts
0:14
Adani Family
Переглядів 972 тис.
Samsung UE40D5520RU перезагружается, замена nand памяти
0:46
Слава 100пудово!
Переглядів 3,1 млн
Как установить Windows 10/11?
0:56
Construct PC
Переглядів 1,8 млн