Splats can indeed come with view dependent colors to represent lighting, reflections… Those are captured in values called spherical harmonics of different levels 0, 1, 2, 3 representing different aspects like diffuse, directional lightning, highlights… Not all splat reconstructions come with spherical harmonics though. And they add rendering overhead.
Besides spherical harmonics splats are also good at representing high frequency detail that is harder with traditional meshes: Hair, clouds, vegetation… notice how trees in these reconstructions already look much better than in google maps / earth 3D views.
A lot of things have to come together: talent, capital that is not looking to maximize returns, ambition to compete in the marketplace. At peak Mozilla it was clear to everyone that we needed an undeniably successful product to be able to influence the market. Advocacy alone is not very effective.
All countries see AI as a geopolitical concern. An open source strategy is smart. It’s effective and also builds good will / soft power. Many see Chinese AI companies as the good guys and root for them. I’m pro open source and also celebrate but still aware this is most likely just the means to an end.
I used to work at Mozilla. I think we are missing a player in the market with a more principled open source approach.
The outcome is plausible. Open weights models though look like a tactical more than a principled play by Chinese companies to overcome the disadvantage and difficulties to access western markets. Two issues:
1. If market conditions change they might decide to close down like Meta did.
2. If as you said models keep getting more expensive to train, is an open weights strategy financially sustainable?
I’m a big fan of Musk. One of the few criticisms I have is how xAI is also inconsistent with original OpenAI mission. I had imagined xAI as en effort to correct and fully embody all original values of OpenAI and that Elon says they betrayed. That makes his criticism weaker and I understand why some can think it was all about control. In his words:
"I'm the reason OpenAl exists. I came up with the name. The name OpenAl refers to open source... The intent was - what was the opposite of Google? It would be an open source non-profit."
I sometimes feel xAI wants to live up to those open values so I always celebrate when they decide to engage in open source. They still don’t fully embrace it. Perhaps because they think is not practical or will make them less competitive?
I mostly agree with you but, how do you square the use of other types of automation that are not AI? e.g computer animation vs hand-drawn, CAD software for engineering and architecture… Are those lesser art forms or we’re just used to them?
I created and still maintain A-Frame (aframe.io). It’s been a gentle gateway to learn 3D graphics for a decade. Cool community if I can say so ha ha. Web is a great way to share stuff as you learn, collect feedback and get visibility. Many cases in the community of people that ended up doing 3d graphics professionally.
This is the most common scenario. That’s why can’t compare Vision Pro with the iPhone. First iPhone was limited yeah but those who bought it loved and used it all the time. Word of mouth setup the success of later versions.
Disclaimer: I haven't been involved in the game development but uses SparkJS (https://sparkjs.dev/) An open source 3D gaussian splatting rendering engine I help maintain.
I have the opposite impression. I have consumed tons of hours of interviews with Elon and he comes off as more technically sound and speaks more substance than any other large org CEO I can think of. Karpathy worked directly under him. I haven’t worked for Elon but know people that did and experience is similar. What makes you think you are right?
I was part of the temple build last year and cleanup is extremely serious. We spent two days cleaning after the burn with magnetic rakes looking for minute pieces of metal. We take samples of dirt at different spots and count the number of MOOP fragments to measure progress
How come? We give IP law / copyright legitimacy but it’s not clear to me the more I think about it. If you draw something you def own the physical drawing but owning the idea of the drawing during your lifetime feels strange to me. It’s also a very recent invention and humans created art before and will create after.
I spent most of my career in the open source world and doesn’t bother me models are trained on my output. Should I feel differently? It seems there’s a kind of ego or emotional attachment to the output that is more common among artists than devs? Perhaps abundance vs scarcity mindsets?
Thanks for the kind words. I helped on the brain rendering side of things but I’m not an expert in the field he he. You seem to be way more knowledgeable than me. Do you have any of your work out there? I would love to check it out.