Over the Reality is building the mixed reality spatial web

0:01I'm Ashton Addison from Block West capital for investment pitch media and today on the Crypto Coin Show we have back with us Diego D tommaso co-founder and CEO of over the reality Diego welcome back to the show and it's great to see you again all right always a pleasure to be here thanks for watching me likewise and I'm always fascinated on your insights into

0:21VR and mixed reality and how that's progressing in web 3 in the metaverse which has a lot of strides to take to make it to mainstream adoption but I feel like overreality is putting a good dent in that with the updates that your team is making in mixed reality for those viewers who didn't see our first interview and we've had a few interviews

0:43now as the company continues to grow let's just start off with what is over the reality of working on and then we'll dive into everything mixed reality and metaverse yeah so great so very quick introduction on what we do basically over the reality is a platform to augment the physical world to extend the physical let's say so the way we do it is by

1:10tokenizing physical space so we divided the world in hexagons like the one that you show and that you see behind me and basically those hexagons are Geographic coordinates and are very similar to what purpose in the web so in the web you have a web domain and you publish on the internet in our case you have a spatial domain and you basically edit

1:31the reality so you add AR content to locations so this is the base layer the ownership layer that is similar to the web again and this summer ship is granted by nfds over this layout we have other two layers so one is a matting layer and one is the Builder so the magnetic layer allows us to connect the content very precisely in space because usually if you do geolocalizer mental

1:55reality you use GPS and GPS is fine for some use cases like for example Pokemon go where you don't need precision and especially if you use it indoor where the position is quite good but if you want to mix the physical and the wheel so you need to have something more something more precise and especially also something that works indoor so because of that we built this and that

2:17is called mature I will talk a little bit more about that later and this allows you to locate the assets in space precisely both indoor and outdoor going down to 20 centimeters accuracy and finally we have a builder actually two kind of Builders so a software that is used to upload contents in the meters we have the first one is a no coder software so you just drag and drop 3D

2:41assets to our web Builder and you add it so you added a tester to the location and if you can code if you can call it Unity we also have a Unity SDK so you can embed Logics you can even create the games inside of this AR meters and finally once when you are in over metaverse you are not there as a passive spectator but you are there with your Alter Ego with your avatar and the

3:07server can be used to interact with other people to have AR chats so you can have telepresence to other people in your room for example or you can participate to events like the one that we just concluded yesterday with the century very cool and I'm fascinated on mixed reality because for me at least in the current state of virtual reality I don't foresee myself going into another world

3:32with a headset on my head you know encapsulated for eight hours plus because I really like the real world that we live in but to have a mixed reality where you can sort of augment on top of where you already are I feel like that's a lot more added value because you get the best of both worlds and I'm curious on as your team has been working with mixed

3:55reality for quite a few years now where do you see you know when people hear about the metaverse they often think of the virtual reality how important do you think mixed reality is into this equation to bring adoption into the metaverse overall yeah of course we are kind of biased in this direction but I mean what we believe is that AR will be again changer

4:21for the adoption of what we call broadly the metaverse so of course as you mentioned we are not gonna spend most of our day with some I mean autusive googles on our face because at the end of the day I mean we live in the physical world and so I think that the degree and of course AR I mean is more usable in this direction because it kind of ends that world where you

4:47live I can maybe talk with you and have some notifications on my visual field but without being distracted or looking down to a mobile phone for example so what the will be the real game changer is once we have smart glasses out there that are affordable and well designed so that people will actually want to use it and I mean what I believe that is that

5:09we are very very close to see those devices out there and so going back on the what we use now for AR that is smartphones and the reason why I say that is because of course we are always following the industry but lately three weeks ago it was the Western Journal event that was the journal Tech live in Laguna Beach and I had the opportunity to speak with many Tech

5:32leaders and entrepreneurs in this in this field and I mean there is a there is a consensus on the fact that Apple will release the first version of smart classes the next year and probably will be passed through actually so it's not really smart glasses but we're going that duration but also I see many other technologies that have been developed developed right now so for example I

5:56had opportunity to speak with the guys that are building Mojo contact lenses so this is AR contact lenses and I mean I was mind-blowing about the development they already reached because I knew about that program but I thought that was like five to ten years into the future but it's not really that I mean the contact lenses are already there of course they're waiting for FDA approval

6:18but to me it's not anymore so clear if we will see first adoption with smart glasses or even with smart lenses but anyway I mean there is everybody is researching on that direction and I mean the reason why is very clear I mean also you know if you think about it right now we stare at our phones on average between six hours per day and actually having advice that can mix the reality

6:45so can mix information with the physical world will will be much much more better if you think about it we will stop looking down and we will be at that again watching the reward maintenance version of the world so that's why we dream and we decide to build over because we think that an infrastructure to connect to the assets to geographic location will be critical

7:07in the future that I mean is coming very very fast to us that's incredible to hear about the about the contact lenses and yeah I feel like people have been discussing about the hardware which is a barrier to adoption you know being being too clunky or you know not good enough quality and we've seen as early as the Google Glass almost at its 10-year anniversary

7:33now and we're still not really approaching something that's functional for multiple hours so looking forward to seeing that and you mentioned some of the use cases for the spatial domains and mixed reality one of them which I think is a huge Catalyst for the growth growth of web 3 into other Industries is gaming and entertainment as well as you

7:57just mentioned about the festival which I'd love to dive into but in terms of gaming and you know entertainment versus other use cases like like I feel like mixed reality could also work very well in the workforce or for education do do you see the early use cases or what do you see as the early use cases for this technology in which Industries will

8:21adopt it wholeheartedly first yeah I mean what they mentioned I mean gaming is definitely the first use case and the second one is events probably Live Events so and I mean for AR this is also true if you think about that the first use case of a yard that comes to my to you was a gaping event it was it was a Pokemon go and so the gaming I mean the gamers

8:45are always I mean the early adopters of Technologies but extrapolating from this on what will be the future of AR and VR it's kind of very difficult the way that I see it the way that I see the stage what we are right now with ar and the Metros in general it's like the web in the early 2000s and for example if you think about that the and if you think

9:09about a successful company like Amazon for example the first use case of Amazon was like a low angry fruit so let's distribute books let's take away the problem of the huge catalog that libraries need to maintain and put it digitally and just distribute it mean that was a clear win a clear I mean low any fruits to actually take back then but if you think about this I mean

9:34how big is it right now in the mix of revenues of Amazon just the books it's basically probably you know two to three percent so I believe the use cases that we see right now for the metaverse AR and VR both of them it's just really the top of the iceberg and still is very difficult also to see what will be the others because it's like again in the 2000 saying what we

9:57think the use cases but in general I guess that everything that we do now on the web will be done in a in an augmented version in a virtual I mean AR virtual reality version where basically we have a better sense of the old assembly products we interact with instead of just interacting with text so but anyway this is a very early estimator yeah you're right there I feel like it's

10:24hard to predict you know when Amazon just started selling books you know you could picture you know at the end of the day that they start selling everything but those steps in between are are hard to determine you know what's the what did they sell second and third and sort of what were the industries that adopted on the way to getting everything and

10:44and that I think there's a lot of industries that people might not expect that will probably adopt this mixed reality technology as well and you mentioned at the beginning a comparison to you know like spatial domains to like web domains and you know in the 90s when domains started getting popular people could buy them people used to think well you know I don't have a business selling

11:07something so why would I need a website domain and now as the use cases have grown out we're saying that most people have a website domain and we're also seeing web 3 domains come out which have even more functionality in terms of spatial domain what do you see as sort of the main use cases for somebody who you know is thinking in that same line like well I

11:31don't have a business or I'm not going to start an entertainment company why should I acquire spatial domain well yeah there can be many reasons so one of course is a bet on the future so I mean if people believe that the meet of us will be there and augmented reality will be an important part of part of that of course these partial domains are a big a good probably

11:54spectacular speculative bet but on the other side of many reasons why people for example right now are dying these special domains to use it so there is people that use it for art they want to augment a physical Place showcase their art in another way there's people that want to showcase products there's people that want to create for example virtual events or augmented physical

12:17event with ar assets so the use case is a very a very broad but another one another use case is that we actually thinking about right now so this is the interesting thing that also us we are discovering what could be the use case is also creating and showcasing a digital doing of the physical world and so show the fact that you can actually build I mean

12:42the big dream that what we have right now is to start building a decentralized version a web 3 version of what is Google Maps and if you think about that there was also a great movie I saw it a few months ago on Netflix it was a series called the billion dollar code and the number billion is probably interesting because this is the number of monthly active users that's

13:05Google Maps said so spatial information are so valuable and so being able to connect special information to a special domain that you actually own it's something that I mean even us as a company working this business are starting to understand only right now and only because now we have the opportunity to actually create these digital twins in a very easy way

13:34wow and obviously Google Maps and Google Earth would be a great use case for you know for mixed reality as well and as I mentioned earlier in the interview about you know Google Glass almost coming up on his 10-year anniversary you know I personally haven't heard much about Google working in mixed reality and augmented reality do you know if you know these large

13:59you know Fang companies are are following along with this technology and also experimenting with it in similar ways to what over the reality is doing absolutely absolutely no yeah they're definitely doing that in fact I mean and this is also what actually give gave us confidence and give us confidence on the importance of this of this work so This is Gonna Come I mean if you if you

14:23are in New York for example and you try to use Google Maps it's not going to work because of the GPS problems the signal problems and the phone will ask you to point to the buildings and so we'll use computer vision like we do to actually locate you in space so the 3D structure of the world is a very important piece of information that we will use more and more to actually

14:46augment the physical world so we see some first examples right now but they are definitely working on that Microsoft is working on that Niantic is working on that so webto companies and big incumbents are working on this so we believe that actually providing a web 3 alternative so a different ownership model for this data to what I mean this big Corporation will provide is critical

15:12to maintain also an open access to this information and not having just a big Gatekeepers that we already know to actually deliver the asset the assets to this to these meters and also I would say that of course we are crazy enough to launch a web 3 startup talking about they are on a special domains but we don't think actually that our goal is really for example to map

15:39the world or to map the streets I mean Google is good enough for that and probably there's no way to out complete them but for example for all that is indoor so for the public buildings or malls or your house or whatever I mean they will not stay in their Google cards inside that so also there is a space in that direction that is uncovered by Google so even if we take away the web

16:08position that actually I think that is the more the more important we will still remain with some space that can be covered very efficiently by a web tree based community that is incentivized by tokens that's a great Point Diego and myself being an early adopter and a gamer in the past I actually did sort of help build you know Niantic Labs game that they had built with mixed

16:37reality which then actually turned into the Pokemon Go game you know and I submitted a lot of areas through capturing them and they went into the mixed reality game I feel like especially in public places you know I think taking it in your home might be a little bit further down the road but you know we see the Google car driving around the streets updating and Google

17:01Maps but like to have them actually walk into you know public malls and other buildings I feel like Outsourcing that and sort of tokenizing it or incentivizing it as they do so well to Everyday People to be able to capture the whole world inside every nook and cranny I feel like that's something that they might do to take the next step yeah I mean we never know what the what

17:27they will do let's say that I mean at least for now I mean we are in the position I mean to actually on board the crowd of people that can do this kind of job and in our case I wasn't mentioning before like Pokemon go we have this first use case that we built on over that is a Treasure Run game so a play to earn game where people go around

17:46that world and collect tokens and nfts from other projects so far we had that when under 40 000 people participating to this kind of treasurements and so the idea is really to take this Army of people and telling them look you're maybe you're playing because you're having fun but probably you're also playing because you want to earn something so we give you another

18:06job another opportunity to actually earn in the metaverse by mapping locations and when we say earn that is two ways of earning this Direction first one this program that we have that we call mature consisting the fact that people going places take pictures of these locations and from this pictures we create a point cloud and also a digital twin of this

18:27location so 3D reconstruction of a location and later on I will share with you also some videos so you can have some visuals about what we can achieve right now so in that case people doing this activity first of all they generate an nft that they own so think about owning a piece of Google Maps and it's the same in map locations since you did the job you own the data on that

18:51location and then of course we can incentivize You by buying from you that location because maybe we want to have the ownership of the map of that location but still the day is in here is this web creators so you do an activity you do this permissionless activity that is your job your time and your resources and since you are doing that you are creating the content you automatically

19:16own it and if you think about this is a totally different way of how the works for example for the social media right now you create the content in the social media and you all nothing thing about that content so this is really what we think is important so to create this new ecosystem to augment the world that is basic on an adorato so NATO's that's

19:36basically inspectivizes the people because they own the content they create whether it sees a map so just going around on mapping or maybe creating content so maybe you are a 3D Creator you can actually own your creation through an nft or maybe you are not a Creator you cannot create 3D asset but you still have a mobile phone probably in your pocket so you can still

19:57participate contributing in creating this ecosystem very interesting Diego and how can people go about creating it is that already live like on iPhones and Androids they just take their phone and use an app or where exactly are you at with that yeah so we are now in Alpha we have 300 users that are testing that and basically you just need a smartphone so

20:24no light are needed so any smartphone with an RGB camera is enough both Android and iOS is part of our app so you just take off the phone you will have a user interface that helps you in taking the pictures actually it's like taking a movie but in the background we are taking pictures then you upload these pictures and we crunch the data we generate actually we

20:49generate three outputs so one is a point Cloud so if you're a Creator you will have an idea of what is the 3D structure of that location so you want to for example have an avatar in front of a door will be in front of that door that you see in the point cloud and then it creates what is called a neural audience field so a simulation of a fly through

21:09the location generated by your map and finally the third step is basically that we can actually also create a digital twing on that so digital training is that we have a 3D reconstruction with a location where you can move around so basically you tokenize you create a digital tweet of the location by taking this map and of course once the location

21:29is met also the localization over there will be very precise so you will be able to publish container AR very precisely and we see right now we have I mean this great Alpha tester that have been helping us to make this work because I was quite complex technology we've seen that people actually is even enjoying just using this tech only even only to create a flight through for

21:52example they want to showcase a location and they create a virtual drone flying the location just by taking some pictures so there's many use cases that come out from this mapping activity that probably we do not even Envision totally right now very cool Diego well I'm looking forward to the next steps in the beta and getting involved as well myself because

22:15you know I've done it in the past and it's actually quite fun to be able to customize the space however you'd like so thank you so much for the insights into into mixed reality and where it's at right now with the industry what the big players are doing how over the reality is progressing in this front I would love to get those videos that you mentioned I'll put those

22:36in the description box for the viewers as well I'll also put the Social Links and any other updates that the team is working on and where they can find more about over and let's definitely follow up in the near future you know in the next quarter and see how this technology is progressing absolutely so thank you very much for the opportunity again to be here