ARCore Scene Semantics API For Unity Is Now Available!

https://www.youtube.com/watc...
In today's XR video, we will look at a NEW Google feature for Augmented Reality called Scene Semantics API, which is now part of ARCore Extensions for Unity. The Scene Semantics feature provides AR developers with a machine learning model for real-time semantic information. πŸ’‘ The API returns a label for each pixel across a set of useful semantic classes, such as sky, building, tree, road, sidewalk, vehicle, person, and more. In addition to pixel labels, this ARCore feature also offers confidence values for each pixel label and an easy-to-use way to query the confidence value of a given label. πŸ“š ARCore Scene Semantics For Unity Chapters:s 00:03 - Google's ARCore Scene Semantics Introduction 00:17 - Scene Semantics Labels Demos (Sky, Terrains, Vehicles, Person, etc) 00:52 - Creating a brand new Unity scene with ARCore and Scene Semantics 03:50 - Adding a new "Overlay" Semantics Camera for Semantic Images Rendering 07:47 - Adding SemanticsUI to control semantic options 10:05 - AR Semantic Images Manager (Inspector Options Overview) 13:39 - Implementing AR Semantic Images Manager (Semantic Feature Methods) 25:57 - Scene Semantics Unity Demo running on Android 27:31 - What devices are supported with ARCore Scene Semantics? πŸ“’ Watch the previous video on ARCore Streetscape Geometry API from: https://youtu.be/nbH36I18UO8 πŸ“™ Resources used or mentioned on the video: - Geospatial Unity Demo Project shown on this video can be downloaded from: https://github.com/dilmerv/GeospatialCreatorDemos - ARCore scene semantics documentation: https://developers.google.com/ar/develop/scene-semantics - Lightship ARDK semantic segmentation (for iOS and Android): https://lightship.dev/docs/ardk/context_awareness/semantic_segmentation/semantics.html πŸ“Œ Support me by Subscribing to avoid missing future videos! https://www.youtube.com/@dilmerv πŸ“£ Consider becoming a Patreon today: https://www.patreon.com/dilmerv and GET MY β€œFull Source Code” Tier πŸ’‘ What do you get from Patreon ? πŸ‘‰ Access to this video GitHub repo + all code I work on for each video πŸ‘‰ Access to special Patreon discord group where I can answer questions πŸ“Œ Get XR & game development tips from me in Twitter https://www.twitter.com/dilmerv πŸ₯½ Learn & Get my XR Training from: https://www.learnxr.io πŸ‘‰ My Blog / πŸ”₯ Newsletter (Subscribe to get up to date XR news) https://blog.learnxr.io #arcore #metaverse #unity #xr
Home
/
Indie Game Developers
/
Dilmer Valecillos
/
ARCore Scene Semantics API For Unity Is Now Available!