overview: the system contains 3 main components: the tag, the video capturing and processing unit...

1
Overview : The system contains 3 main components: the tag, the video capturing and processing unit (VCPU), and the software. The tag consists of an IRED and a microcontroller; and the VCPU consists of a camera, an FPGA, and a DSP. Local Positioning System Dr. S.S. Fels, J.Ng, D.Tang, D.Chen, E.Lam Purpose : To design a reliable, cost- effective system that accurately locates the positions of objects in real-time in an indoor environment. This complements the Global Positioning System (GPS), which is not suitable for indoor spaces because the satellite signals are not designed to penetrate through construction materials and has limited resolution that is usually too coarse for indoor applications. Advantages : • reliability because there are no multipath problems • no magnetic/electrical interference • accuracy • scalability • cost-effectiveness t a g Y C X C Z C Optica l axis Proje ction cente r Z w X w Y w Rotation & translation M = (X,Y,Z ) (0, 0) u c v c m= (x,y) Department of Electrical & Computer Engineering University of British Columbia x = 100 x = 150 x = 170 Y = 80 Y = 120 Y = 200 x = 100 x = 150 x = 170 Y Y Y x = 100 x = 150 x = 170 Y = 80 Y = 120 Y = 200 x = 100 x = 150 x = 170 Y = 80 Y = 120 Y = 200 x = 100 x = 150 x = 170 Y = 80 Y = 120 Y = 200 x = 100 x = 150 x = 170 Y = 80 Y = 120 Y = 200 C a m e ra C a ptu re s th e im a g e o f the IR E D Tag T h e V ide o P ro c e ss o r id e n tifie s th e lo ca tio n of a llth e ta gs U sin g da ta from m ultip le fra m e s, th e tra cke r id en tifie s th e tag ID T h e lo ca tio n o f th e tag is m ap p ed to th e floor coo rd in a te. T h e re su lt is th en d isp la yed o n th e u se r c o n so le. ta g 1 found Floo r Sc ree n 10,80 1 0 0,8 0 ta g 2 found 1 5,1 7 0 1 5 0,1 2 0 ta g 3 found 9 0,2 0 1 7 0,2 0 0 Specifications : The LPS prototype system achieves the following functional requirements: • Provides the (X, Y, Z) coordinates of a target relative to a fixed world coordinate system Current Competitors : This includes companies such as Pinpoint, Active Badge, and Advanced Position System. Generally, all LPS systems use one of three tracking methods: magnetic, RF, or optical. • Magnetic systems have the problem of interference with electrical systems and metallic surfaces. Tag : The tag uses the IRED to transmit a unique identification code to signal its presence to the system. The on-off sequence of the IRED is controlled by the microcontroller. The tag is powered by a 3V disc battery and is designed to be small, light- weighted, inexpensive, and long- lasting. Video Capturing & Processing Unit : A digital camera is used to capture the IR signals emitted by the tags. An IR-pass filter is mounted on the camera to attenuate background noises. A frame of captured video data is sent to an FPGA and DSP for detection and grouping of bright pixels in the frame. The screen coordinates of the detected bright pixels is then sent to the software in a host PC for further processing. Software : The software is running on a host PC and consists of 3 main modules: • a tag identification module to decode the individual tag IDs • a perspective transformation module to map the 2-D screen coordinates to 3-D world coordinates with respect to a reference point with one camera we calculate 3-D world coordinates using an assumed tag height – with multiple cameras, we do not need this assumption • a Graphical User Interface (GUI) to control the system and • to track and secure valuable assets such as notebook computers • to quickly locate personnel (for example, in healthcare facilities) • interactive art • virtual reality Future Developments : • Line of sight is required for this system, and can be achieved by using multiple cameras • Reflections of IR signals. This can be reduced by using polarizing filters. • The maximum number of tags can be increased by using a faster camera. • RF systems have reflection (multipath) problems which can cause false detection of targets. • Optical systems have the line of sight limitation (transmitter must be seen directly by the receiver), but this can be resolved by using multiple cameras. • Provides a resolution of < 5 cm radius around the target • Detects and tracks multiple targets in real-time (update rate < 0.5 s) • Supports up to 50 targets Applications : • to gather data about the habits or interests of people wearing the LPS tags (for example, to find out which booths were most visited at the ASI Exchange) • to limit the access of personnel to authorized zones • to track visitors and provide them with real-time orientation and company information in a large, and possibly confusing exhibition • to allow parents or pet owners to remotely monitor their baby or pet while leaving them at the sitter’s Funding: This research is completely funded through a grant from the Media Integration & Communications Research Laboratory (MIC) of Advanced Telecommunications Research Laboratories (ATR), Kyoto, Japan.

Upload: steven-craig

Post on 18-Dec-2015

224 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Overview: The system contains 3 main components: the tag, the video capturing and processing unit (VCPU), and the software. The tag consists of an IRED

Overview: The system contains 3 main components: the tag, the video capturing and processing unit (VCPU), and the software. The tag consists of an IRED and a microcontroller; and the VCPU consists of a camera, an FPGA, and a DSP.

Local Positioning SystemDr. S.S. Fels, J.Ng, D.Tang, D.Chen, E.Lam

Purpose: To design a reliable, cost-effective system that accurately locates the positions of objects in real-time in an indoor environment. This complements the Global Positioning System (GPS), which is not suitable for indoor spaces because the satellite signals are not designed to penetrate through construction materials and has limited resolution that is usually too coarse for indoor applications.

Advantages:• reliability because there are no multipath problems• no magnetic/electrical interference• accuracy• scalability• cost-effectiveness

tag

Y

C

X

C

Z

C

Optical axis

Projection

center

Z

w

X

w

Y

w

Rotation & translation

M = (X,Y,Z)

(0,0)

uc

vc

m= (x,y)

Department of Electrical & Computer Engineering

University of British Columbia

x = 100 x = 150 x = 170

Y = 80

Y = 120

Y = 200

x = 100 x = 150 x = 170

Y = 80

Y = 120

Y = 200

x = 100 x = 150 x = 170

Y = 80

Y = 120

Y = 200

x = 100 x = 150 x = 170

Y = 80

Y = 120

Y = 200

x = 100 x = 150 x = 170

Y = 80

Y = 120

Y = 200

x = 100 x = 150 x = 170

Y = 80

Y = 120

Y = 200

C am era C aptu res the im age o f the IR E D Tag

T he V ideo P rocessor iden tifies the loca tion o f a ll the tags

U s ing da ta from m ultip le fram es , the tracker iden tifies the tag ID

T he loca tion o f the tag is m apped to the floo r coo rd ina te . The resu lt is then d isp layed on the use r conso le .

ta g 1 fo und

Flo o rSc re e n

10,80100,80ta g 2 fo und 15 ,170150,120ta g 3 fo und 90 ,20170,200

Specifications: The LPS prototype system achieves the following functional requirements:• Provides the (X, Y, Z) coordinates of a target relative to a fixed world coordinate system

Current Competitors: This includes companies such as Pinpoint, Active Badge, and Advanced Position System. Generally, all LPS systems use one of three tracking methods: magnetic, RF, or optical.

• Magnetic systems have the problem of interference with electrical systems and metallic surfaces.

Tag: The tag uses the IRED to transmit a unique identification code to signal its presence to the system. The on-off sequence of the IRED is controlled by the microcontroller. The tag is powered by a 3V disc battery and is designed to be small, light-weighted, inexpensive, and long-lasting.

Video Capturing & Processing Unit: A digital camera is used to capture the IR signals emitted by the tags. An IR-pass filter is mounted on the camera to attenuate background noises. A frame of captured video data is sent to an FPGA and DSP for detection and grouping of bright pixels in the frame. The screen coordinates of the detected bright pixels is then sent to the software in a host PC for further processing.

Software: The software is running on a host PC and consists of 3 main modules:• a tag identification module to decode the individual tag IDs• a perspective transformation module to map the 2-D screen coordinates to 3-D world coordinates with respect to a reference point

– with one camera we calculate 3-D world coordinates using an assumed tag height– with multiple cameras, we do not need this assumption

• a Graphical User Interface (GUI) to control the system and display the positions of the tags

• to track and secure valuable assets such as notebook computers• to quickly locate personnel (for example, in healthcare facilities)• interactive art • virtual reality

Future Developments:• Line of sight is required for this system, and can be achieved by using multiple cameras• Reflections of IR signals. This can be reduced by using polarizing filters.• The maximum number of tags can be increased by using a faster camera.

• RF systems have reflection (multipath) problems which can cause false detection of targets.

• Optical systems have the line of sight limitation (transmitter must be seen directly by the receiver), but this can be resolved by using multiple cameras.

• Provides a resolution of < 5 cm radius around the target• Detects and tracks multiple targets in real-time (update rate < 0.5 s)• Supports up to 50 targets

Applications:

• to gather data about the habits or interests of people wearing the LPS tags (for example, to find out which booths were most visited at the ASI Exchange)

• to limit the access of personnel to authorized zones• to track visitors and provide them with real-time orientation and company information in a large, and possibly confusing exhibition• to allow parents or pet owners to remotely monitor their baby or pet while leaving them at the sitter’s

Funding:• This research is completely funded through a grant from the Media Integration & Communications Research Laboratory (MIC) of Advanced Telecommunications Research Laboratories (ATR), Kyoto, Japan.