Magic Leap
• The Uber-Spatial Web Browser The Clickable World Lightfield • • Medical/Healthcare App Sensoryware Games Cross Platform •
\ • II
1 w w MI I 1 V V Screentm
7 ' '
•••• •
\ • \ • •• \ •• ••••z:`, „.
is, X 0 Yi A„I dra Sp JOM NtON mnototto

\K ::
rr./ 0.
• . ';'•::••••••• ' ' • '' ' ' ' ' ' ' ' . . •

s.s.••••• ••••••• \\,
7


.. • '//
7 .0

.. u 1'4 • • • • • • • • .. • •• • ... ii/1l: min fiiiFi
. .. . . . • ei/
Magic Leap Sensory Weartm Music Venue Applications Our studio will develop initial applications that will show off the capabilities of Magic Leap in the music space. Digital Live Artisttm will "beam" an artists in full scale and digital presence into your home - enabling you and your friends to enjoy a personal concert at home from your favorite band. Digital Music Venuetm will "beam" you and your friends into a amazing digital space it will look and feel as if you are at a live music concert. Magic Leap will also partner with an array of artists, labels, publishers, and managers.

......... ......... fffffffffffffffffffffffff/fffff////, fliYffliiiiYflfiiYff
V = . • \-4
Digital Live Concerttm
a ic Leap Sensory Weartm Systei Beta Applications The technology demonstrated in the Speakbot app (demo) paves the way for Monster Battle and Digital Live Artist. The Development for Wire World & Digital Live Concert paves the way for a multitude of other applications and tools in the SDK.
Our Users: Persona Overview MO
AVERAGE GAMER MMOG EXTREME GAMER COMIC-CON Average Andrew Soda! Sarah Samantha & Greg Taylor the Coe the icd Teena9er • • • Yryry- .. - „•, -- GIRL GAMER COOL KIDS UNDER 18 UNDER 6
TEENAGE GIRL OUTDOOR GAMIFIED ANTI-GAMER TH WORKER- ara the Teenager Outdoor Owen Waiter the Worker ••/////////////////////////////////////////////////////////////////////// • DJ Magic Mix MUSIC CULTURE
Sprint amazon eZz/ 044' ........ ........ ........ informs mm.3 :""""- estg. cont„ &-ftitOr6-'pattheitttottabbratof. •••••••••••••••••••••••••••••••••••••••••••••
Product Overview & Design ///
• • • • • • • §,
Weartm Sensory System Backlit on/off finger slide Molded in textural pattern *:•.•!:4r;$;r:i:%;
Sensory Wear System •Novel technology which "paints" images on to the retina •Reality Engine - Cinematic Realitytm Depth Technology provides for lifelike depth realism • Blends the physical world and the digital world Registers and localizes the world
CLOUD SERVERS Magic Leap Sensory Weartm System Massive Parallel State Computing Cloud & Grid Network Shared Resources To Enable World Platforms MAGIC LEAP • • WORLD OBJECT STATES 0 fr USER GRID • it 0 **E:36*****6004********* 5 04 0 ******0 MAGIC LEAP WORt41.
, v,7, /7/ r „as4 A % iii/. d A J • General Purpose Wearable Computing • Initially Targeting $65b+ Gaming Market • Can Expand To $100b+ Mobile Comm Market • Enabled By Proprietary Scanning Fiber Projector & True3D Technology
Sensorywaretm System: Current Design Families Ma
.......... ......... .......... ........... ............. ......................... 7
, v/‘ y r/ iii/ ' z A A A z owa.
..'‘ -- --- ----
Engineering Program Management • Agile process • Task/ownership assignment • Schedule System & Software Teams • Architecture • Alpha prototypes • Integrate with Dr. G Invaders Alpha Optical Engineering • Benchtop Testbed • Optic System Simulations Industrial Design/Human Factors • ID • Personas • Ergonomics
Preliminary Component Architecture Vniumafrie. Rfinorialc 464.4m000 .;i44W3x0.d...% Scx SX.:10.XX; YI!..14f4Z*% • 11! xv.6.,:ekt no?. • .....
7 r ,/, Volumetric Model OTS ID Model Custom Integrated Components Parts
Design Attributes: Lite, Gamer, Extreme Gamer A Lite Extreme Gamer DESIGN DIRECTION ›), "A THRO"
%:( V ... . /r. / ' ,, ..:!:,:' - /.. ..A IA .d.:i ' •/: :- %:0::.A V :V . Design Attributes: Magic Glass, Organic, Minimal, Human Tec . .. 4:: ....... ...:' ../ .4.V. /..:/:: 0:/':./... A 4" 41;;;0* . • DESIGN DIRECTION ›), THRO CLEAR"
v A Design Attributes: Magic Glass, Organic, Minimal, Human Tech :::::•::"""""""""""""••••••••••••••••••"" 46;7/ DESIGN DIRECTION "CLEAR"

/, , 4f. /, .47 .0 z /W/ 0,/ /
,,,,,,,,,,,,, • ,,,,,,,, ,, ,,,,,, ,,,,,,,,,,,,,,

, „0/ r "1"/


" /7/ .• •. . •:•:... •

f

, - /Z // /r •z%
••••••:!, text"'

,

• ,,,,,,,,,,,,,,,
:%%"/Afe.yhreee4f,
V /:*
/ 40/ „, 4 • / , /4/ / / 0 4 4/i 400 4
ee:
ma ' ( t er n efface
_SIGN • Contents and Organization_ • MX* XS X9 S. WO S. 004 JOGS X* CRS X9 S. VAS. 004.41 Preliminary System Diagram r g. XV VV. S. VV. VSg VS VA.. W. ...A., /A/ IV, /A* VA./. /.4 VA./ IV, 4. We /A* WVA. /A/ IV, VA./ ri..n /4, /4 .1. IV, VA./ e. ENTERTAIIIMEP,I NA:! GAT ON RC:A.)1j( 31' ITY TOOLS 5 ,„„„„„„„„„„„„„„„„„„„„„„„„„„„„„, • • ;••.,:".% y zz /,•;;' ; • ,, •„.,•• 5:;;• X. X. 44.. 5 $ VIDEO 5'7A PY5 , g-p •,.44 HY OM VA ma ve v... me vv. OM VA •• • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • • ••• .ip .0 VV, OM VA Avr ve v.. ve vv. OW VA Avr W. frS, XS VS. SSC XX. XS X. OX XS SS, XS VS. , ,3 • • ,,•;•$: and g p Determine the scope of the systei 5 'v..). •••••••• #4 PHOTO g NEWS 44, g " ••;;;'••.•:,r,•:;y:1 APY el,. Alie HA§ r •••% • ;7, " iteratiVf e,51 e,4%%11 n rn FILE $ VA ma ve v... me vv. OM VA AV VA OA ▪▪ CORE CONTENT
Areas of Focus nformation Architecture / Content Organization Navigation of Content 0 Primary navigation Secondary navigation interaction / Input Styles Direct vs. Indirect / Physical vs. Virtual / Gestural vs. 7"raditiona I Etc. 0 Direct vs Proxy 0 Floating vs. Mapped Scenario Based Brainstorming For Example -3 User wants to connect via video with a friend 0 Context: Standing/sitting/walking 0 Environment: Home/work/public space Social: Open vs. discrete Aesthetics / Visualization . Ul Philosophy
UI Philosophy n./Inr TrA ,T Intelligent / Empathetic (context specific) Fun / Playful interaction (when appropriate) Symbiotic (user aware) Adaptable (system learns, user learns, idea of scaffolding) just because you can do it, doesn't mean you should. o 'wow actor" should not trump usability Aim tor a long "wow"
45xQ . (.; omv0'0%w
Hula-Hoop Interface ........ A 'swipe' hand gesture brings UI 'ring' UI 'ring' presents user with User selects application/menu object into the users field of view, application/menu options (scrollable) to expand experience (experience varies depending on the application) This could be the first step to opening up 'magic rooms'
Magic Portal Interface Gestural interaction used to initiate new 3D portal Portals provide access to system contents (apps, games, tools. etc.) Navigation or method for "drilling down" tbd Portals can be opened on any sized object (or open space), including small pads for discrete interactions
Magic Portal Interface Specific tools can be assigned to specific objects so that they open automatically, eliminating the need to navigate the UI Virtual 3D objects can be removed from the portals and mapped to objects in the room This interaction design principle would enable users to build virtual 'magic rooms' ........... ......... ......... •• ,,,,,,,,,
Expanding Hand Interface Image recognition in the system brings The user can select an item from up the primary navigation menu when the menu or spread fingers to the user holds up his/her hand expand menus
Expanding Hand Interface Alternatively, users can rotate through menus using a circular gesture in the palm of his/her hand
Map to Environment Interface ........ • User pinches virtual object to Holding the gesture, the user User opens hand to map the be mapped and holds gesture moves his/her arm towards the virtual object to the physical environmental object to be environment Objects that can be mapped mapped to to in the environment are illuminated Both objects are highlighted in the same color to confirm action
Exploration of Primary Interaction
Scenario Based Brainstorming • ' '/ //# 1 VA
Content Organization A New Platform • • . • • • • • ..• • ... • • ••.x/Aw'' ......•.• • ..... ' • . . ' .. '
:vvm.,:,0;,•„//..,//w/7/4/ ,W;)4%;,;
MMERS ,ON ,SRRATION Common Interaction & Input Gestures Swipe the side (Sio t Plovement • Spread hands apart ▪▪Bring hands together wrs;t, movements las ),)nosed to rde arm move !• y %, • Al aVe • Puli hand back • we / 6( (“.Ao Swipe to the side (s ow) - Flip hang over • Hip hand over. sz Close hand the ri • Siie to sde fr-"-"a Pinch- thumb to fore lint • Pause (hand, .finger, Stab (Pont) Gesture auidethi Intuitive Ergonomic for a wide variety of body sizes and abilities F"laid Scalable / Discrete (when appropriate- Cufturally accepted
MME, ,SON INSPIRATION The Aeon Project Expanding radio menu Icon based main menu 3d helix content management Pop up 2d alerts VIDEO: h tp,://v ww,yankodestn.comI2011/08/021 ( -)n be% ond-au emented-realit i#1.;14,41:
MK,E, ,S,ON INSPRATION Mediating Mediums — The digital 3d 2d and 3d objects dl splays Mapping to 2d sue faces (real and virtua l Site recognition Visualizing / manipulating virtual objects VIDEO: httgiAwww,yankodesio.com/2011 /09114/virtual- architecture/
MKERSION f IN SP RATION "Sight" r" i ig and mapped interfaces r Site recognition pup tracking as a means of navigation fe, Navigation of content VIDEO: http://www.fa st odestn co mil 670420/watch- what-ha ens-if- oovie-s lasses-are-evi
m , ERS,O Ni i, SP RAT!O N Ringo Holographic Interface Flu a-hoop like interface Navigation of content Data entry / Game play VIDEO I: h 2://vommyoutt be.comiwatch?v=t0H I NiNia6zX
M , E , 3,0, / ,NsPRATION 3D Navigation with 2D platforms 3d storage navigation space Visual grouping by subject and/or color Organic navigation style VIDEO I: • .•4 httg://www.yout be.comiwatch 9 =r0 u4 VIDEO 2: h://www.yo p co m ANa t ?v= , xn ip7r
MN,F S ON / NISPIRATION .g,„„. 4 / `,/„, e 4 3D Organization of 2D Content Organization of 2d icons l content exilD6 ty (maybe too much?) Personalization VIDEO: h tp://www,ted.comitalksianand___a.garawala de nos i bumptop
,soN i INsp RATION The Future of Firefighting ............. Hand mapped interface :~W:1 Layered Content ,/ Constant always availab e, easy o access, corner of user's FOV On Demand — gestural interaction to initiate, menus to dig deeper Alerts — pop-up style icons VIDEO: tapillwww.youtube.comiwatch?v=QQA11122........L WO'
rOE ,a0N INSP RATION Other examples Radial menu Scalable 3d virtualobjects 2d display of information Floating interface VIDEO: h tp:Mmtvw.yo itube,com/wa ch?‘"=Wt,7rnn, .. . ......
r7/777/7 we" PZ4 ''PO,00o0
USER 1NT,„„„RA.CTON "Rooms" Scenario Average Andrew: • 34 years old • Civil Engineer • Sports enthusiast, fantasy football Scenarios: • Working at the office 4 message from co- worker comes in (alert) • Select virtual "room" from living room; change from entertainment room to work room • Open/access specific application from one room while in another room (i.e., open camera ......,:::::::::» app from the entertainment room)
OFF CE ROOM 31 "Rooms
OFF CE ROOM "Rooms" vex'. //// . . . . ... A 4 ,„
OFF CE ROOM "Rooms" *kw
OFF CE ROOM "Rooms ..... . ... • ..stentit e;',ws ori;tfi ...
USER ,NITERA.CTON Navigating Rooms ;mo o Scenarios: Select a room for use ffe Navigate from FrIt rtainment room to Work room
USER ,NTERACT1ON Navigating Rooms SELECT A ROOM FOR US r•//////////////// • •••••••;•,., • • • • • • ,,,,,,,,....... •• • • • • :55,..V.V.V.V., ;:i?:,;i;7;7;7;7;!;!;!: Physical Living Room Virtual Entertainment Room
USER ,NTERACT1ON Navigating Rooms 'AV GATE BETWEEN ROOM ............... Entertainment Room Work Room
7 77777
USER ,NTER, Selecting and/or Navigating Rooms or. Demand: User inout to access menu system o Gesture — i.e., hand motion up o Button on Glasses or Pack o Voice command tye tracking
3D C,„„t„JST,„„„S Gesture to open icon based clusters
3D C,„„t„JST,„„„S Gesture to open icon based clusters Provides quick access to non-functional rooms; different gesture to pull up comprehensive menu
Functional group of room based applications Provides access to functional tools and applications while in another room; mini work station
00 Functional group of room based applications Swipe through context specific rooms
ROOM PREV1E W Swipe to navigate available rooms .. ................................... .. ,,,,,,,,,,,,,,,,,, . . W.+ Location specific rooms; rooms have previously been mapped to physical location
„OOM PREV1E N Swipe to navigate available rooms Navigating aesthetic "skins” that have been mapped to the living room
HIE, ,R „,,HA„„ MENU SYSTEM Virtual touch pads Navigate primary menu to access user defined rooms; rooms are a feature of the primary navigation menu
H1E„RCHAL MENU SYSTEM Input by proxy
7 77777
CONSTANT RADIAL MENU Peripheral vision . . . . . . . . ........ . . Expandable menu always available in the upper right hand corner of user's field of view
CONsTAN7 RADIAL MENU Peripheral vision •• • :, ;;;;skhOiki • • • • • fr Expands to reveal available rooms
PRE-MAPPED ME, S Based on physical location mapping ;0050000' • Projection based proxy input
PRE-MAPPED ME, S Based on physical location mapping • Virtual touch pad
PRE-MAPPED m::, Li Based on physical location mapping More detailed navigation menu appears once the specific room is selected
USER ,NITERA.CTON Navigating Rooms Scenario: Select application for use while in a specific room
USER ,NITERA.CTON Navigating Rooms Work Room at Home Specific Application (i.e., Camera)
DMPREHE„Si fE 'H.„„J,„„A HOOP MENU SYSTEM Open SportsCenter while in 'work' room
Access specific app while in entertainment room „,, Navigate existing rooms to find specific apps
Access specific app while in entertainment room „„. 0•0*. g ;:f • g • Map/copy apps into current room
Access specific app while in entertainment room App becomes permanently mapped to entertainment room
JSE ,PPS Gesture as hot key for the most commonly used apps Define common use apps; unique and intuitive gestures for each 'common use app'
USER 1NTERA.CTON Rooms VVHA SAROOM? A convenient grouping/organization of system tools and applications Thetools/apps have a relationship that makes sense to the user (supports the user's m nta The rooms could be defined by: activity or goal, locationi.e,, work, home, e c. time of day, etc. Rooms are defined (created) by he user to support understandin ease of use, and search efficiency Rooms support navigation of the d iferent system tools and app !cations Tools/apps not located within a specific room" shou d be readily a ai rb e and easy to locate
,NT„„„,R, ,CT1ON Office Room at Home 0: • //Av.
USER ,NTERA...„,./07,0N Entertainment Room at Home ee-- xxxxeeeee effee effeeffeefee xxxxxxeeeee effeeffee ./..W/// '' , iq] •
USER ,NTERA,..,„,07,0N Entertainment Room at Home 4,4><4,4. ,07:W 4a0.44Vejn,444 ?.:40$'44%.,, 4 4;•$-'; 7, POIV4444r!,//n ;41
USER ,NTERA...„,./07,0N Entertainment Room at Home • zezelf/Xeg" r;r4:4,1 emeememeeeee
, "pop V .,,,..•,, A0,,,,,w.,,4,44,,,„,,.,
aSCUSSION Rooms ' ROOMS, EAS: Users create rooms based on how they think features should be grouped eature of the system) - 111 system provides pre-populated rooms based on a theme: activity based, location based, time based, intelligence based, etc. Combination of system and user defined rooms
,,„„,JSSION Next Steps NEXT S i,t5 dREAS OF Fa US: Deeper dive on interaction methods for: Primary and secondary navigation customizatior of menus, dashboards andother content Set a KA "Room setup and e-a-= res Features AND furth r ap enab apps Exploration and definition of toy B Create workflows for primary tasks Determine level of fidelity for next round of deliverables
yew , 'frPAgffw, ;4'%gs%oPot,4%
MMERS ,ON ,SRRATION Common Interaction & Input Gestures Swipe the side (Sio t Plovement • Spread hands apart ▪▪Bring hands together wrs;t, movements las ),)nosed to rde arm move !• y %, • Al aVe • Puli hand back • we / 6( (“.Ao Swipe to the side (s ow) - Flip hang over • Hip hand over. sz Close hand the ri • Siie to sde fr-"-"a Pinch- thumb to fore lint • Pause (hand, .finger, Stab (Pont) Gesture auidethi Intuitive Ergonomic for a wide variety of body sizes and abilities F"laid Scalable / Discrete (when appropriate- Cufturally accepted
MME, ,SON INSPIRATION The Aeon Project Expanding radio menu Icon based main menu 3d helix content management Pop up 2d alerts VIDEO: h tp,://v ww,yankodestn.comI2011/08/021 oin be% ond-au emented-realit- . . :00tifOpAvit 00:::.00fti.
,E, ,,S ON 7 MK INSPRATION Mediating Mediums — The digital 3d 2d and 3d objects dl splays Mapping to 2d sue faces (real and virtua l) Site recognition Visualizing / manipulating virtual objects VIDEO: httgit,„vvywyankodesign.com/2011 /09114/virtual- architecture/
MKERSION f INSP RATION "Sight" =~lo tirng and mapped interfaces * r Site recognition tracking as a means of navigation Navigation of content VIDEO: http://www.fa stcod esigp .co mil 670420/wa tch- what-ha ens-ifµ oovie swryiasses-are-evi
ERSJDN / 4NSP RATION Ringo Holographic Interface Flu a-hoop like interface Navigation of content Data entry / Game play VIDEO I: h 2://vommyoutt be.comiwatch?v=t0H I NiNia6zX OV"
MNE, 3,0, / sPIRATION 3D Navigation with 2D platforms 3d storage navigation space Visual grouping by subject and/or color Organic navigation style VIDEO I: httg://www.you t be.comiwatch ,C4 9 = r 0 % 6 u4 VIDEO 2: h (,.;ortilwatc; ?v=!', , xn ip7r
M ,E, ,S,ON f NSPI RATIO N 3D Organization of 2D Content Organization of 2d icons l content F exilD6 ty (maybe too much?) Personalization VIDEO: h tp://www,ted.comitalksianand_a.garawala de nos .464Y ,zzZ,
,s/oNi INsp RATION The Future of Firefighting Hand mapped interface Layered Content Constant always available, easy to access, corner of user's FOV On Demand — gestural interaction to initiate, menus to dig deeper Alerts — pop-up style icons VIDEO: http://www.youtube.comiwatch?v=QBAnr2g
MK,E,S,ON INSP RATION Other examples Radial menu Scalable 3d virtualobjects 2d display of information Floating interface VIDEO: h tp:Mmtvw.yo itube,com/wa ch?‘"=Wt,7rnn,
7 7 r , 6'6 z 717 Core Technologies Scanning Fiber Projector • 1 mm x 9mm • Low power consumption • Near zero weight • High-resolution RGB • Natural 3D Cinematic Reality • Breakthrough technology solves 100+ year old stereoscopic 3d problem • Proprietary Machine Vision Portfolio • Breakthrough tech developed at NASA confidential draft - not for distribution — property of Magic Leap, Inc. - all rights reserved
nfid 6 sri
A / / / //// / / A e / 4,0 4 //° 0.44 7 / .:..;:. :- ::?.... , '''''' '.. ' '' ... .::. ra .''. ' . /
7. 7 74.: • • / AO 7 • .././##:0 o ••%' 0';,.0 //4.
r 4r „.., r , ,„„/„„ , 7 v„ im , A d A %A /4 A // • z ; , A r/ r4r,r „‹, , '/ SS • M S17•/ V fj2', r,e • % r • 4, J't • • A0 r, , , , , //4 confidential draft - not for distribution — property of Magic Leap, Inc. - all rights reserved
7 ,,„ , 7 r 27//, 7 /77/ A /d z / , M • Complete Wearable Computing Platform & Ecosystem • Magic Glasstm See-Through Display • Focus on Gaming/Entertainment • $500b+ Mobile Computing Market • • Enabled By Proprietary Ultralightweight projection And True Lightfield Technology • Natural Blending Of Digital And Physical Worlds confidential draft - not for distribution — property of Magic Leap, Inc. - all rights reserved
• „, Overview . ................................. confidential draft - not for distribution — property of Magic Leap, Inc. - all rights reserved
confidential draft - not for distribution — property of Magic Leap, Inc. - all rights reserved
Additional Game Applications Ma
4 ,• 4• • /444.4,44.4..../.44/44.4/4, Ak/4/444.y.../~/...; OZ555: ////////: e-55 Z5= 4./ 4/ / • 0* j. . 1 1 0 f'A 4/11 , , . ,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,, ,,,,,,,,,,,,,,,,,,,,, „,„ '' „„,,,„„„„, .„A „. -
•
'''''''''''' ''''''''' ' ''''' '''''''''''''''''''' A '''''' ''''''' '''''''''''''''''''''''''' '''''' •Wee•f(*, /We 7.... .4, V;53., , ;>. , ezeAvir.i.iiikir. 14, ,,totototov.e.ow........" %WV', /A //////////..1.1.14446w. 44 ,97///7• '''''''''''''''''''''''''''''''''''''''''''''''''''' """ ''''''''''''''''''
V" . Virtual Mods Digi/Phys Blend •
Dr. Grordborts Invaders • First ever true 3d/ lightfield interactive game • Existing cult fan base around Dr. G's awesome ray guns • Invaders can expand into massively multi-player franchise (ex: Halo) • Novel Physical/Digital Experience • Virtual Mods • Novel game engine concept virtual bots use real Al in the world • User — character interaction is key • Stress tests and helps develop our SDK!
. . . wz. • • %. nyy, • :4; : • • „ „ . . . . . . . 4 . • • • • • •
ic E P S ENSORY E , TEM VLU N ,,,NsoRywAR • Setmtrywigre System Attd Seasormetre %old briitg ti.> life tile ni4c tha you have tway n't(nit% nrld Ac tleLof your • Rod tfie. Averoto, add have yen,' own! r411.0:,d 6. WEI z. ?;" ENSORYWAIRE rIASS ES
MTN§ IOUS DESIGN STYLE •
/„. /4 r;// „„„„„„„„

\ -....., , \\— •••••••••••...............:::::::.:::::::.:•: \-:. ''\\ \ \ ...;, "%*, i i:::i::::::.:..i.i.R.,:.:::::::.m.: "'" ":,. ..,:. ''''.'•' ' ...: •:: :;?,.,..: \ \ • ..... . ..; '''' s ......,.. :' . 7.::: - ii::.:.
• .5 4'. Strp Oi Rad aloud from your Book Of Spollint Sop Um- Wave &aougyveaNI, Wand % 4.6 dltrigiu motiom SKt Thrtz' Yon •very own tw.,41h wjrat!
The Book Of Spells • Technology is magic • Wands that work! • Huge Magic Leap tentpole franchise potential • "iTunes" store for digital spells create, share, sell • Physical and digital sales • Novel Physical/Digital Experience
USER NT R CI101 magic lea SENSORY shidk
Grocery S opping Scenario Workficr A mother and her child go grocery shopping together, and decide to use Sensoryware to mak.e their experience more efficient, e f•i3ctive and enjoyable. / p. 9 0. „.!. • rAP,S4? ...9* • , ... e ( ...$42 0
Scenario Workflow Morn, with her daughter in tow, grabs a cart from the entrance of the grocery store.. A series of relevant apps launch automatical including: Grocery first (or en zed by user defined criteria, dinner recpes) Coupon book Recipe book. Recipe builder Cost of shopping cart
Scenario Workflow .... . . .. „,. •••:„. .„.„.• .... .... . . . . . . ... . . . . While in the produce section, morn weighs a food item on a scale. The price of the item is automatically entered into the .shopping cart cost totals Additional features of the system are seen in the background The 'smart grocery list is automatically updated based on location (e.g. focused on fruits and vegetables in the produce section). Food items on morn's list are visually hi. hiighted in the scene.
Workflow The child launches a scavenger hunt ,ipp to make b& shopping experience more engaging end educational. The challenge is to locate food items from different countries around the Scene 2b Points are added to the child's score as she dentif food items and her virtLiai / ;••• r;" • 1 %• . •.• • • ;. / • •• • eA % . • / .... . . . . ..... • •"'
Scena10 Workflow 4 In the cereai aisle, mom salads a particular mrea! explore additional meladata, including: Dietary restriction;:i t\lutritional information si.ars) R*of.luct revie, „Ais • odurA comparisons Customer comments Available coupons are pref.iented to her by Tbuc
0 ss•0 ...
Workflow At the end of an aisle; a virtual Mario Bataii demonstrates a simple recipe b custorners the necessary ingredients are available in the end dap, •
Scenario Workflow f f A f .. . • . •••••••••••••••:,:,:••x,x.x.x While in the we section of the grocery store, morn decides to search for a specific wine. A virtual map used to navigate to the desired wine.. While -walkng through the aisles, data appears attached to different wines, including Recommendations from friends Wines that appear on her personal wine list ,,,, .444444444444444444444444444444444444444444444444.144444,,,,,,,,,
Scenario Workflow it it it it it it it it it it it it Morn concludes her sno ping experience by walking onto a Magic Leap checkout map, which rings up all the groceries on her list and mentions any items that may have been for She then czmpletes her check- out through a virtual display ---- no crt:3dit card necessary. ......66666666666666666666666666666666666666666666666666666666666666666666666666666666666e.466666666666.6.10:0" ...... . Me.,..5 666666666666e
vs, • ••••••••• ss• , ,,,,,,,,,,,
AA 7*- Grocery S A A S‘arAi- 0 0." %AI" Scenes inciuded: Virtual bookstore (1 scene) . urgicai procedure (4 scenes) Yoga .1 scene) ) Garnified exercise scene Garnifie worker ( scene)
Workflow 04. Stella operi...3 Up her book totem to reveal an imrnersive virtual bookstore experience. The virtual environment combines the convenience of an online txyAsiore with the experience of e environment. awnwrmw..vz.z.z.z.z.z4mAmr•z4A4.,v,v,vx,,vx.v,z,,v,vx.v..vx,,vx.v..vx,,vx.vx,,vx,
Scenario Workflow A surgeon and his team, including a visiting virtual surgeon, conduct. a pre-operative planning session for an upcomng mitral valve replacement procedure. The patient's pre-mapped anatomy is available in 3D for the teem to analyze during the ;ggittglailik„1„,1_, planning.
Scenario Workflow Duhng the procedure, the surgeon is able to reference the pre-mapped 3D heart for improving placement accuracy. Meanwhile, a medical student is ..... ...... .... able to observe virtually from her classroom.. The patient's information is readily available to confirm the pathology; and avoid any critical errors.
Scenario Workflow • DUring a post-operative meetin the surgeon is able to describe how the surgery went using a cross section of Stella's virtual anatomy. Stella's husband is able to join t meeting virtually whiie et work. 4. • 4444.:
Scenario Workflow When everyone leaves the hospital room, Steile is be to changer her environment to e more comfortable setting, the beach.
Norkflow Stella and a friend join a virtual -oga dx.:;F; from the comfort of her room,
Workflow Stella enhances her indoor training with a virtual bng experience, where she can feet like she's biking outside on her favorite, route,s. She is able to track important stat like ride time, distance traveled, and speed. A virtual avatar allow; her to compete with h& own personal best time,
Workflow A landscaoir enhances hs job with a virtual game, where the is to follow a virtua mapped pattern. F'onts are received .for accurately following the pattern and 'lifting certain score multipliers before he disappear.
.A,,,RY\NA.;\E mactiC. a SEs ‘- ditr4
K EY R D litutefeW &e 5 itelik rte
MC) USE 7;aa . . ........

fjPER STONE .,50-0/1 Wheel
R N GS
4 a wh elahn, AAA/

'TINY TOTEMS" if, - /led
Other ideas • Plants - For high-dimensional representation of information, map content to familiar nature shapes. Natured encodes vast information in trees, grass, etc. Ex. let each person in an organization have a virtual "plant" they can tweak. They give the plant to the leader, and they encode the color, shape, leaves, flowers, etc. of the plant with their status. If overworked, could be withered, if unhappy leaves could fall, if no resources leaves turn brown, etc. Leader can put all the plants in a "garden." He gets high-bandwidth view of organization through general color of garden. Spotting problem/positive groups is easily graphically. The people grow their own plants.
Other ideas, cont'd • Plant as e-mail - Let e-mail be a tree. Branch is a person, leaves are messages. Old messages are brown and eventually fall to ground. Twigs, sub branches are determined by connectivity of CC's or something. User can easily "prune" branches from annoying people, or put those branches on the back of the tree.
Magic Leap: Pocket Totem Concept Virtual Plant Over Time a Virtual Plant will Pocket size grow out (with Sensory Wear) Physical Totem "Mini Pot" "Fr Virtual Plant will response to: Time Day or Night Sun light direction Temperature Attention -Voice -Virtual Water Virtual Fertilizer - --Tweet or Text messages from distance
Magic Leap: Pocket Totem Concept Flower opens with a message when Virtual Plant the product is ready. Builds up anticipation through the process ..„ (with Smart Phone/Tablet) „.. Card Scenario ••••••:‘, Capture Image, on a Card Billboard Scenario 'Building size Giant ee/ Flower blooms Captiitelmage on, a Large fwilding size: """""" rd • , ..... • . Tablet