Take a first look at Vision Pro's 3D virtual 'Yosemite Environment'
Boosting your spatial music mixing workflow
How Apple's 40 years of learning & iteration is powering Vision Pro
Apple patent involves using corrective lens with the upcoming Vision Pro
Can Apple Vision Pro reinvent the computer, again?
Learn how to shoot spatial videos on your iPhone 15 Pro or 15 Pro Max running iOS 17.2 and get ready for Apple's Vision Pro headset release in 2024!
Explore how spatial computing is reshaping the world of work, blending AR, VR, and MR to create new immersive experiences. Learn how Qualcomm is leading the charge with AI and 5G technologies.
Just observed morays in the aquarium. They were shy and sleepy until I started recording, then they became extremely active. Could they perceive the infrared spectrum? I set up an experiment to check the use of LiDAR on my iPhone. Maybe we need an "Aquarium Mode" for LiDAR-capable devices. #SpatialComputing #iOS #LiDAR 🐟
It would be quite fascinating to have spatial content support within Safari. For instance, the ability to view spatial video in iCloud Photos. Also, support for spatial audio could enable more accessible interaction with data. Incorporating spatial content into web browsing would significantly improve user experience
#visionOS #Accessibility #Safari #SpatialComputing
Apple's 2nd-gen AR/VR Vision Pro headset, codename Project Alaska, may feature simpler straps & potential price drop. Expected release in late 2025/early 2026.
I tried the iPhone 15 Pro's new spatial video feature, and it will be the Vision Pro's killer app
#Apple #iPhone15Pro #VisionPro #SpatialComputing #SpatialVideo
Can’t view Spatial Video but can record.
iOS 17.2 beta 2 enables Vision Pro spatial video capture on iPhone 15 Pro - 9to5Mac
Vision Pro app developers are getting schooled in the way of Spatial Computing at global Apple HQ sessions — and that's more important than you might think
The videos from the Copenhagen Swift & Cocoa meetup have been released. I highly recommend watching mine to learn more about why Accessible Spatial Computing is such a fundamental use case. But you should also not miss out on the content from Philip Engberg and @esnahel
#accessibility #SpatialComputing #a11y #visionOS
"Spatial computing is a technology that facilitates natural interaction between computers and real-world objects and spaces."
(Lately, Mondays for me involve defining this topic, and this is the approach I take when trying to make it sound interesting)
Berlin is quickly becoming renowned as a center for the growth of Spatial Computing and specifically Vision Pro. ZAUBAR has organized an event with speakers such as @stuffmc and Sebastian Klöß to showcase this. I am thrilled to be invited to present RealityCheck and do some live demonstrations. I look forward to meeting you there.
New UCF project is harnessing virtual reality to teach quantum computing
VoiceOver can use on-device intelligence to describe images. This feature is not available on the visionOS simulator yet, but we can see how it might work with macOS VoiceOver
(I learned this from @jonathanchacon 🙌)
Even if it is not even close to the experience of using the real device, the visionOS simulator is impressive at displaying stereoscopic content 🏙️
#visionOS #SpatialComputing #Stereoscopic
Today’s been an exciting day for #mrjs!
and now they were no longer drowning in admin work, I was able to implement scrolling & touch interactions, as well as UI clipping!
Here's a quick little demo of a mocked up landing page. bonus cheesy magic trick at the end.
Early access on the Patreon! https://www.patreon.com/posts/sggqa-320-apple-90883103
Tech journalists have been promising an Apple AR revolution for over ten years now, while downplaying the accomplishments of real AR and VR competitors. Apple contributed VERY little to this Hype Machine.
How did we get here?
Apple released over 38 sessions in the Spatial Computing category at the WWDC this year, for a total of ~13 hours of content. For context, the original trilogy directors cut from the Lord of the Rings is ~11 hours long.
“Also, don’t ask me to do these numbers for The Hobbit films — my answer will be snarky and mean-spirited. :)”
Spatial Computing: Crafting New Realities in Work, Play, and Beyond - Spatial computing is not merely a technological evolution; it is a paradigm shift ... - https://readwrite.com/spatial-computing-crafting-new-realities-in-work-play-and-beyond/ #spatialcomputing #tech
Und wie war nun die Meta Connect 23? Wir haben gemischte Gefühle, sind aber nicht völlig enttäuscht. Eigentlich war es ganz gut, und dennoch neu. Hört am Besten selbst einmal rein!
We’re chugging along with our MR first UI library. Here’s our built in implementation of hand matting!
A good spatial experience is gives a sense that virtual content is truly in the room. If you put your hand in front of an object and it appears behind it, it instantly breaks the illusion.
Hand matting is key to this. Our implementation isn’t perfect, but a little goes a long way!
Even if they walk it back, the Unity debacle is ultimately good for the XR community. Allowing a game engine to dominate the space has locked out developers who have no interest in game development.
We need to move away from game engines and create new & intuitive tools, designed from the ground up for XR, enabling an untapped community to discover new use-cases.
Humbled that people are getting excited about us this early. Stay tuned as we build!
Hey folks! we’re hiring!
We’re an early stage startup working to build the #spatialweb
We understand that this is a new space, so we encourage everyone to apply regardless of #xr experience. We want a strong engineer first, XR experience is just a plus.
Spatial Video! 🎥
Great #AppleEvent announcement for the new iPhone 15 Pro with a Spatial video recording feature that uses "the ultrawide and main cameras together to create a three-dimensional video" which you can then watch on the Apple Vision Pro in stereo 3D. Sounds like a minor feature but this could actually drive adoption for AVP at some point. ✨
The iPad Mystery That Really Isn’t a Mystery
With new iPhones about to be released why is everyone talking about iPads?
The iPad Mystery That Really Isn’t a Mystery
With new iPhones about to be released why is everyone talking about iPads?
Today I Realized:
Very interesting podcast where Gruber discusses Fantastical developer’s hands-on experience with #visionpro - I honestly believe this platform will be as transformative as the release of the original Mac. Looking forward to the Super Bowl commercial.
Meta i LG podobno rozpoczęły już współpracę nad konkurentem nadchodzącego headsetu Apple Vision Pro.
Szybko poszło, jak to zwykle bywa po wydaniu (a w tym przypadku po zapowiedzi) nowego produktu Apple. Zuckerberg deklaruje, że ma ambitne plany konkurowania z Apple Vision Pro, a nowy raport sugeruje, że Meta współpracuje z LG nad stworzeniem nowego zestawu dedykowanego dla spatial computing.
Raport udostępniony przez UploadVR, łączy Metę i LG, które mają opracowywać przyszłe wersje Meta Quest Pro. Meta prowadzi, na ten moment, rozmowy tylko z LG Display, dostawcą wyświetlaczy zależnym od LG. Jednak nowe informacje sugerują, że partnerstwo będzie poszerzone i obejmie inne spółki LG.
visionOS Beta 3 Release Notes — Apple Developer Documentation
Interesting actions can be found when VoiceOver is navigating containers. For example, in the App Placement Bar, there's “Move to Direct Touch Range” option to bring a window closer, so you can trigger controls directly. You can also move it back using “Indirect Interaction Range”. The default action makes the window face you.
What is the best way to determine where things are from your perspective when you have visual impairments?
It turns out that there is a promising VoiceOver command that attempts to answer that question in the most human terms. When you have something focused with VoiceOver, you can use VO-Shift-D to trigger Describe App Location. This will give information about where your focus is in the space, such as in the distance, partially hidden, behind you, etc
#A11y #visionOS #SpatialComputing
In the past, during the era of Flash®, I used to think that interactivity couldn't evoke the same emotions as other forms of media. I believed that making rational decisions during interactive experiences hindered emotional connection, except for games which had a unique narrative-driven mechanic 🤷
#SpatialComputing #VisionPro #visionOS #Humanism
I am currently preparing a workshop on accessible spatial computing, specifically focusing on visionOS features. As part of the research phase, I've been re-watching and synthesizing the info from the WWDC23 Spatial Computing videos. This process generated some artifacts that I want to share, I call them nanos, which are mind maps containing high-level keywords and concepts of each video.
#A11y #SpatialComputing #visionOS #SpatialSummer #nanos
Jokes aside, Xcode 15 beta 5 in combination with visionOS 1.0 beta 2 simulator is a great release. Firstly, visionOS sample apps once again compile (goodbye Xcode 15 beta 2), but more importantly, VoiceOver starts to behave much better (even in Ventura).
Here's a short recording with VoiceOver preactivated in the simulator because Digital Crown events can't currently be triggered easily, and that's what's needed to get to the accessibility shortcuts.
#visionOS #Accessibility #SpatialComputing
I am not sure how in 2023 we still nave not figured out reliable visio, much less reliable VoIP.
And being able to present the poster/slides just like in real life from home office (or even a local workspace) would be a massive qualitative jump forwards and away from in-person meetings requiring travel.
TIL about HotSauce (“Project X”). 3D Flythrough technology for web Meta-Content created by Apple in 1996
Very interesting observation from @email@example.com who has noticed a significant improvement in their motion sensitivity through the use of VR
I'm just beginning to digest the incredible content of WWDC23's “Spatial Computing” category 🫀
1. Breakthrough of bystanders occurs when they LOOK at you, not just walk by 👍
2. AR remains stable even on a moving plane, lacking a stable inertial frame of ref.
3. ALL #visionOS renders in the keynote were real, generated on-device, EVEN the 3rd-person ones (which were then composited with video of actors). (No foveation in the videos—must not be needed.)
“..,this isn’t a user interface like iOS or iPadOS that has to accommodate big blunt fingers; rather, visionOS’s eye tracking is so accurate that it can easily delineate the exact user interface element you are looking at, which again, you trigger by simply touching your fingers together. It’s extraordinary, and works extraordinarily well.” — Ben Thompson, Stratechery
@davemark I have to agree with Zuck on this one, they have totally different approaches, and even the terms they use to describe what is essentially the same concept of #XR: Meta uses the term #Metaverse because they want it to be an interconnected space where users can get together and play/interact.
Apple uses the term #SpatialComputing as their focus so far is expand your computer use cases to a 3D interactive space - indicating that they see the platform as a next-gen computing experience.
You buy the #AppleVisionPro **because** you don't want a more natural way of interacting with a computer, similar to how you would interact with everyday objects. You don't want this kind of ultimate #skeuomorphism. No, #Apple are selling you **the exact opposite**.
Because staring on various screens for 18 hours a day has actually become your default mode of existence. So this new normal is now able to push the natural 3D world in the background. Your immersion is complete, #spatialcomputing means the 2D desktop metaphor gets awarded the place in your life it already has. But emphasized. Interacting with the natural 3D world is slowly becoming a tedious afterthought to interacting with the computer.
The #VisionPro is easing you into it. 🤿
Mobile Video ▶ AI NeRF 3D ▶ AR HoloLens 2 🚀
This HoloLens 2 Azure Remote Rendering demo is visualizing a 3D model that was created simply from a mobile phone video recording leveraging AI-based Neural Radiance Fields (NeRF). 📱
Note the jitter in the video is only due the MRC recording and not be seen when wearing the HoloLens. 😎
Building Metaverse Apps for Cultural Heritage
I had the pleasure to talk with my fellow MR MVP Zaid Zaim about his story and how he brought the cultural heritage of destroyed sites like the UNESCO city of Palmyra in Syria back to life with Mixed Reality. 👉 https://valoremreply.com/post/meta-minutes-building-metaverse-apps-for-cultural-heritage/?utm_source=social_media&utm_medium=Rene-Reshare&utm_campaign=metaminutes
I'm Avi. I've been working on #SpatialComputing (VR,AR,XR,MR, Metaverse) tech and design since 1992. #Consulting. Also worked at #Microsoft (started #Hololens), #Amazon (#EchoFrames & #PrimeAir), #Apple (NDA), and #Disney. I cofounded #Keyhole (#GoogleEarth) and built parts of #SecondLife.
Hi, I'm René Schulte. 👋
My posts are mainly around innovation in AR/VR, Spatial Computing, Metaverse, AI, Computervision and a (Qu)bit of Quantum Computing. 😁
You can find more about me here 👉 https://about.me/rschu
Please reach out and say hi. 🙌
I'm Blas, a PhD in Computational Ecology and MA in GIS who recently rebranded as a data science and engineering team leader in #agritech.
My list of interests includes #soilscience #analytics #coding #bigdata #spatialcomputing #dataviz #MLops #leadership #climatechange, and in my free time, #climbing #fitness #piano #music #biking #scifi