® sponsored by guiding blind people in indoor space - a use-case of indoorgml 95th ogc technical...

®

Sponsored by

Guiding Blind People in Indoor Space Guiding Blind People in Indoor Space - A Use-Case of IndoorGML- A Use-Case of IndoorGML

95th OGC Technical Committee

Boulder, Colorado USA

Ki-Joune Li

2 June 2015

OGC®

Movie- Her(2013)

2

OGC®

MotivationsMotivations

• Services for visual impaired people.– The services are mostly limited in outdoor space.

Navigation Map Services for Indoor Space

3

OGC®

ContentsContents

– Requirements– Key Design– Data Model– Implementation– Conclusion

4

OGC®

RequirementsRequirements

– Indoor positioning (<30cm)• So far, no Indoor positioning method provides such a high accuracy

• Braille Block as an alternative

– Voice-Oriented Indoor map for navigation– Guide for the visual impaired people– No extra-devices except smartphone– Interoperability and Standards

5

OGC®

Key Design IssuesKey Design Issues

– Braille block for Assisting Indoor Positioning– Movement Patterns of Blind People

• Separation of Stopping and Movement• Straight walking (not walking in curve)

– Landmark Information– Using Smartphone with Voice-based UI– Using IndoorGML as International Standard

6

OGC®

Braille block Braille block for Assisting Indoor Positioningfor Assisting Indoor Positioning

Dot Block

Stripe Block

7

OGC®

Movement Patterns of Blind PeopleMovement Patterns of Blind People

n1 n2

n3

n1 n2

n3

n2

2e1

e2

e11

e12

e22e21

ege e1 is split to e11 and e12

edge e2 is split to e21 and e22

node n2 is split to n21 and n22 n2

1

new edge e3 and e4 are added

e4

e3

8

OGC®

Landmark InformationLandmark Information

n1

n3

n2

2

n2

1

e32

e31

e12 : - B is on your left, - A is on your right, and - C is on your left over the destination

B

A

C

D

(Case 1) : left side on the path(Case 2) : right side on the path(Case 3) : left side over the path(Case 4) : right side over the path(Case

2)

(Case 1)

(Case 1)

(Case 2)

(Case 3)

(Case 4)

(Case 2)

(Case 1)

9

OGC®

Using Smartphone with Voice-based UIUsing Smartphone with Voice-based UI

TextToSpeech

10

OGC®

Using IndoorGML as international Using IndoorGML as international standardstandard

<<Feature>>IndoorCore::SpaceLayer

<<Feature>>IndoorCore::Transition

<<Feature>>IndoorCore::State

<<Feature>>IndoorCore::MultiSpaceLayer

<<Feature>>IndoorCore::InterLayerConnection

0..*

2

connects

2

interConnects

0..* edges

nodes

0..*

1..*

spaceLayers

interEdges 0..*

11

OGC®

Data ModelData Model

– Data model for VIM– Phase of making VIM network– Sample case constructing network

12

OGC®

Data Model for VIMData Model for VIM

<<Feature>>IndoorCore::State

<<Feature>>IndoorCore::Transition

connects

2

Starting Node

Ending Node

0..*

0..*<<Feature>>

VIMNavi::Node0..*

<<Feature>>VIMNavi::Landmark

<<Feature>>VIMNavi::Edge

- Navigation Instruction- Landmark Instruction

0..*

0..*Landmark Topology

<<Enumeration>>Landmark Topology - onLeft - onRight - overLeft - overRight

Located At

1..1

1..*

connects

IndoorGML

VIM

- Topology

13

OGC®

VIM Part

Topographic IndoorGML Layer

Phase of Making VIM NetworkPhase of Making VIM Network

s1 s2s3

s11

s12 s21

s2

2

s`4

n1

n2

n3

n4

n5

n6

n7

n8

IndoorGML Network

Network of considering route of the Visually Impaired

Navigation LayerFor the Visually Impaired

Subspacing

Separating

instructions

Add Landmark Information n9

Braille Block IndoorGML Part Layer

14

OGC®

Sample CaseSample Case

15

OGC®

Network of considering route Network of considering route of the Visually Impairedof the Visually Impaired

s1

s2

s4

s5

s5

s6

v2 v3

v4

v5v1v8 v9

v7

v10

v6 v11

16

OGC®

v2 v3

v4

v5v1v8 v9

v7

v1

0

v6

v1

1

Network of considering route Network of considering route of the Visually Impairedof the Visually Impaired

17

OGC®

v

2

v

3

v

5

v

1

v

8

v

9

v

7

v

10

v

6

v

11

n

1

n

2

Stair Up/Down

n

3

Recognize Stair/Enter braille block

n

4

n

6n

5

v

4

n

7

Navigation Layer For the Visually Impaired

- Separating Instructions

18

OGC®

v5

v8

v9

v7

v1

0

v6

v1

1

n1

n2

n3

n4

n6

n5

n7

n8

n9

n1

0

n1

1

n1

2

n1

3

n1

4

n1

5

n1

6

n1

6

Navigation Layer For the Visually Impaired

- Separating Instructions

19

OGC®

n1

n2

n3

n4

n6

n5

n7

n8

n9

n1

0

n1

1

n1

2

n1

3

n1

4

n1

5

n1

6

n1

6

Navigation Layer For the Visually Impaired- Add Landmark

20

OGC®

ImplementationImplementation

– Operation Flow– Test environment– Video

21

OGC®

Sample of user-interfaceSample of user-interface

22

OGC®

Cheong-gu subway station Seoul

Test environmentTest environment

AB

Find a path from A to B

23

OGC®

Implementing videoImplementing video

24

OGC®

– Indoor navigation using braille block networks– Voice-based instruction by Smartphone Accessibility function– Data Model extended from IndoorGML Core Module– A very beginning prototype

Summary Summary

25