XXXII. International Conference Science in Practice, Osijek 2014

1

3D Flight Path Tracking of Butterflies by Image Processingto

investigate movement in response to condition and environment

Oliver Mitesser, Ádám Kőrösi, Thomas Hovestadt, Peter Möhringer Gunther Bohn,

University of Applied Sciences Würzburg/Schweinfurt GermanyBio Zentrum der Universität Würzburg

XXXII. International Conference Science in Practice, Osijek 2014

2

The problem“there is no information available on navigation abilities of butterflies in small-scale foraging movement and whether and how they might use spatial information

Bio-Zentrum University of Würzburg

XXXII. International Conference Science in Practice, Osijek 2014

3

I. Introduction

Goal of the project:

► Make behavioural experiments on butterflies► Explore sensory abilities ► Identify role of internal status like hunger-level, egg-load etc► Explore memory and learning effects► Butterflies either memorize or mark host plants visited ► Explore inference and anticipation

XXXII. International Conference Science in Practice, Osijek 2014

4

II. Flight cage and cameras:

► Near natural environment in a flight cage► Cameras record movements of the butterflies

XXXII. International Conference Science in Practice, Osijek 2014

5

The test flight cage (8m x 8m x 3m)

XXXII. International Conference Science in Practice, Osijek 2014

6

S3D-HD cameras mounted on top of the flight cage

XXXII. International Conference Science in Practice, Osijek 2014

7

S3D-HD cameras mounted on top of the flight cage

XXXII. International Conference Science in Practice, Osijek 2014

8

The butterfly to be observed Polyommatus Icarus/Common Blue/Hauhechelbläuling/Közönséges Boglárka

malefemale

XXXII. International Conference Science in Practice, Osijek 2014

9

butterflies in transport cages

XXXII. International Conference Science in Practice, Osijek 2014

10

Markers and artificial flowers in the flight cage

XXXII. International Conference Science in Practice, Osijek 2014

11

XXXII. International Conference Science in Practice, Osijek 2014

12

III. Image and data processing

► Image processing detects butterflies and determines flight trajectories► Statistics give insight into the behaviour of the butterflies► Identify decision rules► Create and improve movement model

XXXII. International Conference Science in Practice, Osijek 2014

13

S3D camera

Disparity related to position of object

screen position

object behind the screen

object in front of screen

XXXII. International Conference Science in Practice, Osijek 2014

14

Disparity in front and behind the screen

XXXII. International Conference Science in Practice, Osijek 2014

15

Result of a 3D analysis OMNITEC OTR 1001 TV test system

XXXII. International Conference Science in Practice, Osijek 2014

16

IV. First results

Example video

XXXII. International Conference Science in Practice, Osijek 2014

17

Example of data management and processingpart of x-y trajectory

XXXII. International Conference Science in Practice, Osijek 2014

18

V. Conclusion

Already promising first results:

► Test flight cage and consumer cameras show viability► Image processing is still to be developed ► Explore memory and learning effects (in the future)► Explore inference and anticipation (in the future)► Define and improve movement model (in the future)► Compare model to measured trajectories (in the future)

XXXII. International Conference Science in Practice, Osijek 2014

19

Thanks for paying attention

Questions?