oskar marko - donausoja · oskar marko . about biosense •r&d institute for it in biosystems...

30
Experiences from using big datasets in the American Midwest to optimise variety selection and soybean yield prediction Oskar Marko

Upload: others

Post on 04-Jul-2020

2 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Oskar Marko - DonauSoja · Oskar Marko . ABOUT BIOSENSE •R&D institute for IT in biosystems •Serbia – leader in production of non-GMO soybean •70 permanent staff •Diversified

Experiences from using big datasets in the

American Midwest to optimise variety selection

and soybean yield prediction

Oskar Marko

Page 2: Oskar Marko - DonauSoja · Oskar Marko . ABOUT BIOSENSE •R&D institute for IT in biosystems •Serbia – leader in production of non-GMO soybean •70 permanent staff •Diversified

ABOUT BIOSENSE

•R&D institute for IT in biosystems

•Serbia – leader in production of non-GMO soybean

•70 permanent staff

•Diversified income

•24 ongoing H2020 projects

•No 1 in Eastern Europe

Page 3: Oskar Marko - DonauSoja · Oskar Marko . ABOUT BIOSENSE •R&D institute for IT in biosystems •Serbia – leader in production of non-GMO soybean •70 permanent staff •Diversified

ABOUT BIOSENSE

•R&D institute for IT in biosystems

•Serbia – leader in production of non-GMO soybean

•70 permanent staff

•Diversified income

•24 ongoing H2020 projects

•No 1 in Eastern Europe

Page 4: Oskar Marko - DonauSoja · Oskar Marko . ABOUT BIOSENSE •R&D institute for IT in biosystems •Serbia – leader in production of non-GMO soybean •70 permanent staff •Diversified

ABOUT BIOSENSE

•Antares: €28M, 7 years

•European CoE for Advanced Technologies in Sustainable Agriculture

•People, equipment, accelerator, Sentinel data hub…

Page 5: Oskar Marko - DonauSoja · Oskar Marko . ABOUT BIOSENSE •R&D institute for IT in biosystems •Serbia – leader in production of non-GMO soybean •70 permanent staff •Diversified

ABOUT BIOSENSE

•Antares: €28M, 7 years

•European CoE for Advanced Technologies in Sustainable Agriculture

•People, equipment, accelerator, Sentinel data hub…

Page 6: Oskar Marko - DonauSoja · Oskar Marko . ABOUT BIOSENSE •R&D institute for IT in biosystems •Serbia – leader in production of non-GMO soybean •70 permanent staff •Diversified

2017 WINNERS

Page 7: Oskar Marko - DonauSoja · Oskar Marko . ABOUT BIOSENSE •R&D institute for IT in biosystems •Serbia – leader in production of non-GMO soybean •70 permanent staff •Diversified

FAO: +70% by 2050

Increasing the yield not a problem, but comes at a price

Sustainability

Seed selection is the most efficient way of increasing the yield

AGRICULTURAL CHALLENGES

Page 8: Oskar Marko - DonauSoja · Oskar Marko . ABOUT BIOSENSE •R&D institute for IT in biosystems •Serbia – leader in production of non-GMO soybean •70 permanent staff •Diversified

PROBLEM STATEMENT

•>100,000 samples

•5/180 seed varieties

•Maximise yield

•Minimise risk

Page 9: Oskar Marko - DonauSoja · Oskar Marko . ABOUT BIOSENSE •R&D institute for IT in biosystems •Serbia – leader in production of non-GMO soybean •70 permanent staff •Diversified

DATA

Page 10: Oskar Marko - DonauSoja · Oskar Marko . ABOUT BIOSENSE •R&D institute for IT in biosystems •Serbia – leader in production of non-GMO soybean •70 permanent staff •Diversified

WEIGHTED HISTOGRAMS REGRESSION (WHR)

•System determinative

•Training Dataset: F1-F5

•Evaluation Farm: FE

•Voting

•Votes weighted by similarity

Page 11: Oskar Marko - DonauSoja · Oskar Marko . ABOUT BIOSENSE •R&D institute for IT in biosystems •Serbia – leader in production of non-GMO soybean •70 permanent staff •Diversified

WEIGHTED HISTOGRAMS REGRESSION (WHR)

•System determinative

•Training Dataset: F1-F5

•Evaluation Farm: FE

•Voting

•Votes weighted by similarity

Page 12: Oskar Marko - DonauSoja · Oskar Marko . ABOUT BIOSENSE •R&D institute for IT in biosystems •Serbia – leader in production of non-GMO soybean •70 permanent staff •Diversified

WEIGHTED HISTOGRAMS

PDF of yield at Evaluation Farm for each feature

Page 13: Oskar Marko - DonauSoja · Oskar Marko . ABOUT BIOSENSE •R&D institute for IT in biosystems •Serbia – leader in production of non-GMO soybean •70 permanent staff •Diversified

DEFINING SIMILARITY

Similarity of individual features

Page 14: Oskar Marko - DonauSoja · Oskar Marko . ABOUT BIOSENSE •R&D institute for IT in biosystems •Serbia – leader in production of non-GMO soybean •70 permanent staff •Diversified

COMPARISON OF REGRESSION ALGORITHMS

[bu/ac]

Page 15: Oskar Marko - DonauSoja · Oskar Marko . ABOUT BIOSENSE •R&D institute for IT in biosystems •Serbia – leader in production of non-GMO soybean •70 permanent staff •Diversified

COMPARISON OF REGRESSION ALGORITHMS

[bu/ac]

Page 16: Oskar Marko - DonauSoja · Oskar Marko . ABOUT BIOSENSE •R&D institute for IT in biosystems •Serbia – leader in production of non-GMO soybean •70 permanent staff •Diversified

PORTFOLIO OPTIMISATION

•Objective 1: high yield

•Objective 2: stable yield

•Trade-off

•Tools from economics

•Portfolio optimisation

SEED SELECTION

Page 17: Oskar Marko - DonauSoja · Oskar Marko . ABOUT BIOSENSE •R&D institute for IT in biosystems •Serbia – leader in production of non-GMO soybean •70 permanent staff •Diversified

PORTFOLIO OPTIMISATION IN FOLKLORE

•GER: Man kann nicht auf zwei Hochzeiten tanzen One can’t dance at two weddings

•YU: Ne možeš imati i jare i pare You can't have both the goatling and the money

•ITA: Volere la botte piena e la moglie ubriaca To want the barrel full and the wife drunk

•FRA: Vouloir le beurre et l'argent du beurre (et le sourire de la crémière) To want the butter and the money from the butter (and a smile from the shopkeeper)

•ENG: Don’t put all your eggs in one basket

Page 18: Oskar Marko - DonauSoja · Oskar Marko . ABOUT BIOSENSE •R&D institute for IT in biosystems •Serbia – leader in production of non-GMO soybean •70 permanent staff •Diversified

PORTFOLIO OPTIMISATION

•Harry Markowitz (1952) – Nobel prize (1990)

•Diversification of investments

•Investments = soybean varieties

•Return = yield

•Source of risk?

PORTFOLIO OPTIMISATION

Page 19: Oskar Marko - DonauSoja · Oskar Marko . ABOUT BIOSENSE •R&D institute for IT in biosystems •Serbia – leader in production of non-GMO soybean •70 permanent staff •Diversified

PORTFOLIO OPTIMISATION

•Predicted yields for the next year

•Covariance matrix

PORTFOLIO OPTIMISATION

Page 20: Oskar Marko - DonauSoja · Oskar Marko . ABOUT BIOSENSE •R&D institute for IT in biosystems •Serbia – leader in production of non-GMO soybean •70 permanent staff •Diversified

PORTFOLIO OPTIMISATION

Efficient frontier

PORTFOLIO OPTIMISATION

Page 21: Oskar Marko - DonauSoja · Oskar Marko . ABOUT BIOSENSE •R&D institute for IT in biosystems •Serbia – leader in production of non-GMO soybean •70 permanent staff •Diversified

RESULTS

•Is 5% good enough?

•Average person consumes 1.46 bu/yr

•The US could feed a country the size of Mexico

Page 22: Oskar Marko - DonauSoja · Oskar Marko . ABOUT BIOSENSE •R&D institute for IT in biosystems •Serbia – leader in production of non-GMO soybean •70 permanent staff •Diversified

SYNGENTA SERBIA

“Wrong choice of seeds cannot be compensated later in season“

Additional investment ≈ 0

Page 23: Oskar Marko - DonauSoja · Oskar Marko . ABOUT BIOSENSE •R&D institute for IT in biosystems •Serbia – leader in production of non-GMO soybean •70 permanent staff •Diversified

CROP CHALLENGE 2017

•Farmer’s point of view -> retailers’ point of view

•Right amount of supplies

•Too much – dead stocks

•Too little – missed opportunity

•Minimise transport costs

Page 24: Oskar Marko - DonauSoja · Oskar Marko . ABOUT BIOSENSE •R&D institute for IT in biosystems •Serbia – leader in production of non-GMO soybean •70 permanent staff •Diversified

FEATURE IMPORTANCE

Midwest climate analysis

Weather in the top 5

Page 25: Oskar Marko - DonauSoja · Oskar Marko . ABOUT BIOSENSE •R&D institute for IT in biosystems •Serbia – leader in production of non-GMO soybean •70 permanent staff •Diversified

WEATHER SCENARIOS

•Climate

•15 historical weather instances from Region dataset

•1 WS = solar radiance, temperature, precipitation in 1 year

•Assumptions:

•1. No other weather scenarios

•2. All weather scenarios equally probable

Page 26: Oskar Marko - DonauSoja · Oskar Marko . ABOUT BIOSENSE •R&D institute for IT in biosystems •Serbia – leader in production of non-GMO soybean •70 permanent staff •Diversified

PORTFOLIO OPTIMISATION

Pareto optimal portfolios (blue)

Farmer’s risk profile defined by PI

High PI = ready to take risks

Low PI = not ready to take risks

Page 27: Oskar Marko - DonauSoja · Oskar Marko . ABOUT BIOSENSE •R&D institute for IT in biosystems •Serbia – leader in production of non-GMO soybean •70 permanent staff •Diversified

RESULTS

Strategy Risk Improvement

Choose the best variety for all subregions (benchmark)

7.52 6.72%

Portfolio optimisation based on local PI

7.60 7.91%

Portfolio optimisation based on globally optimal PI (18.25)

7.96 9.53%

Assumptions that farmers will actually buy the optimal seeds

Page 28: Oskar Marko - DonauSoja · Oskar Marko . ABOUT BIOSENSE •R&D institute for IT in biosystems •Serbia – leader in production of non-GMO soybean •70 permanent staff •Diversified

SPATIAL DISTRIBUTION

Page 29: Oskar Marko - DonauSoja · Oskar Marko . ABOUT BIOSENSE •R&D institute for IT in biosystems •Serbia – leader in production of non-GMO soybean •70 permanent staff •Diversified

FUTURE WORK

Page 30: Oskar Marko - DonauSoja · Oskar Marko . ABOUT BIOSENSE •R&D institute for IT in biosystems •Serbia – leader in production of non-GMO soybean •70 permanent staff •Diversified

Thank you for your attention!

Oskar Marko