intelligent systems, interaction and multimedia seminar

38
Daniel Castro Silva [email protected] DEPARTMENT OF INFORMATICS ENGINEERING Intelligent Systems, Interaction and Multimedia Seminar 21/09/2017 Eugénio Oliveira [email protected] MIEIC 2017-18

Upload: others

Post on 08-Apr-2022

4 views

Category:

Documents


0 download

TRANSCRIPT

Daniel Castro [email protected]

DEPARTMENT OF INFORMATICS ENGINEERING

Intelligent Systems, Interaction and Multimedia Seminar

21/09/2017

Eugénio [email protected]

MIEIC 2017-18

SSIM

DEI / FEUP

• Contacts and Resources

• Objectives and Methods

• Assessment

• Program

Agenda

2

SSIM

DEI / FEUP

• Become acquainted with current research topics in the fields of intelligent systems, interaction and multimedia

• “In the long run, we're evolving in computing from a ‘mobile-first’ to an ‘AI-first’ world”– Sundar Pichai (Google CEO)

• “Tell me and I will forget; show me and I may remember; involve me and I will understand”– Chinese proverb

Objectives and Methods

4

SSIM

DEI / FEUP

– Usually in non-traditional Informatics Application Domains

– Application Domains characterized as DDD or of great complexity (quantity or sophistication)• Dynamic

• Distributed

• Decentralized

Objectives and Methods

5

• Intelligent Systems

– Computational systems, based on

• Knowledge (not only data or fixed algorithms)

• Features like Adaptation / Evolution / Learning /

Knowledge Extraction

SSIM

DEI / FEUP

• Choose one topic and take an assignment on

that topic

Objectives and Methods

6

• Classes will be dedicated to (invited) talks

about several topics related to intelligent

systems, interaction and multimedia

– You are required to attend at least 8 classes

– Actively participate in the talk and interact with the

speaker

SSIM

DEI / FEUP

• 25% - Final Presentation

– Week of 2018-01-08

• 50% - Final Report

– Written report (6-8 pages)– Submission up to 2018-01-14

Assessment

7

• 15% - Participatory Attendance

• 10% - Intermediate Report

– Extended abstract (one page)

– Submission by 2017-11-11

SSIM

DEI / FEUP

Assessment

• Participation

– Active participation in classes

• Interact with the speakers, ask questions!

• Don’t spend your time on Facebook! …

• Punctuality

– Be on time!

Participatory Attendance

Absences Max. Grade (20)

0 20

1 19

2 16,5

3 12

8

• Attendance– Maximum of 3 absences

• Increasing penalty

• !

SSIM

DEI / FEUP

Overview of the Subjects

9

• Smart Mobility: Issues and Opportunities

• Autonomous Vehicles and Cooperative Systems

• Air Traffic Control and Air Traffic Flow Management

• Social Network Analysis – Metrics and Communities

• Machine Learning

• Information Visualization

• ArgMine: Argumentation Mining from Text

• Multi-Agent Systems in the Context of Industry 4.0

• A Gameful World

SSIM

DEI / FEUP

• A View of Cloud Computing: Concepts and Challenges

• Intelligent Poker Agents

• Emotional State Regulation in Interactive Environments

10

• Simulation and Development of MAS

• MAS Applications: Disruption Management in Airline Operations Control

• Multi-Modal Interfaces

• Graphics, Interaction and Game Design and Development

Overview of the Subjects

SSIM

DEI / FEUP

The concept of smart cities is presented and the role of citizens in the smartification process is discussed.A special emphasis is given to understanding whether smart mobility and intelligent transportation systems (ITS) are synonymous or there is a dichotomy between the concepts. In addition to being a central concern in ITS, citizens become active participants in smart mobility: issues and opportunities for citizens' engagement in generating disruptive innovation in mobility systems and devising solutions are presented, and particularly motivated and explored within the research agenda of the so-called artificial transportation systems in a rather social perspective. With the advent of autonomous vehicles and the emergence of the concept of cooperative intelligent transportation systems (C-ITS), this session will also introduce such concepts and motivate a reflection on their role in the generation of new transportation paradigms and scenarios towards more efficient, greener, safer, and social mobility solutions.

Smart Mobility: Issues and Opportunities

Rosaldo Rossetti

11

SSIM

DEI / FEUP

The concept of smart cities is presented and the role of citizens in the smartification process

is discussed.

A special emphasis is given to understanding whether smart mobility and intelligent transportation systems (ITS) are synonymous

With the advent of autonomous vehicles and the emergence of the concept of cooperativeintelligent transportation systems (C-ITS),

Smart Mobility: Issues and Opportunities

Rosaldo Rossetti

12

SSIM

DEI / FEUP

• Outline

– Autonomous vehicles

– Joint mission execution by teams of heterogeneous

vehicles

– The platform

developed at LIACC

• Architecture and

components

• Main features

and applications

13

Autonomous Vehiclesand Cooperative Systems

Daniel Silva

SSIM

DEI / FEUP

• Possible topics for course work– Improve the current agent

communication platform• Polling -> event-driven messaging

• Add security layer

14

• Improvements to the existing platform• Adapt air traffic control to

water / land traffic• Real-time visualization and

monitoring• Disturbance simulation and

management

• …

Autonomous Vehicles and Cooperative Systems

SSIM

DEI / FEUP

• Outline

– World Air Traffic Control

– Simulation Environment

– Air Traffic Flow Management

– Some Developed Projects

– Project Proposals

15

Air Traffic Control and Air Traffic Flow Management

Álvaro Câmara

Tiago Neto

SSIM

DEI / FEUP

• Social Network and

Complex Systems Analysis

– Networks and Graphs

– Metrics

– Community Detection

Communities and Dynamics in Social Networks

Francisco Restivo

16

SSIM

DEI / FEUP

• Outline

– Networks are everywhere • Social, biological, financial, etc.

– Complex networks

– Communities reveal properties of networks

– Communities vs. clusters

– Software tools

– Some project ideas

Communities and Dynamics in Social Networks

17

SSIM

DEI / FEUP 18

Machine Learning

Luís Sarmento

SSIM

DEI / FEUP

• Agenda

– Why Information Visualization?

– Brief History

– Current Trends

– Rules for Creating Good Graphics

– Tools and Websites

Information Visualization

Daniel Silva

19

SSIM

DEI / FEUP

– Argumentation Mining in Practice• Corpora

• Machine Learning and NLP

• ArgMine framework

– Annotation platform

– Argumentative Sentence Detection

– ADU Boundary Detection

– Project Proposals

ArgMine: Argumentation Mining from Text

Henrique Cardoso

Gil Rocha

20

• Presentation Outline– Why Argumentation Mining

• At LIACC

• Relevance and Applications

– What is Argumentation Mining• Foundations and definitions

• Issues and tasks

SSIM

DEI / FEUP

ArgMine: Argumentation Mining from Text

Argumentation Mining Tasks

21

SSIM

DEI / FEUP

ArgMine: Argumentation Mining from Text

More Information

https://web.fe.up.pt/~argmine/

22

SSIM

DEI / FEUP

• Agenda

– Industry 4.0

– Multi-Agent Systems (MAS) as a solution

to develop Cyber-Physical Systems (CPS)

– Discussion of MAS applications in

the industry and in R&D projects

– Analysis of barriers for a larger

adoption of MAS by the industry

and future challenges

23

Multi-Agent Systems in the Context of Industry 4.0

Paulo Leitão

cloud computing

fog computing

edge computing

SSIM

DEI / FEUP

Motivation

Games are fun and engaging…

Why isn’t our lives / work /school that fun and engaging?

A Gameful World

António Coelho

24

SSIM

DEI / FEUP

A Gameful World

Finding the fun…

Piano stairs

25

SSIM

DEI / FEUP

• Motivation

• The ludification of culture

• Serious Games

• Gamification

A Gameful World

Outline of the presentation

26

SSIM

DEI / FEUP

• MAS Simulation vs Development

– Multi-Agent based Simulation (MABS)

• Computer simulation where entities

are modeled and implemented as agents

• Agent-based simulation tools

Simulation and Developmentof Multi-Agent Systems

Henrique Cardoso

27

– Multi-Agent System

• System composed of autonomous, intelligent and interacting

agents

• Development tools

– Support for communication, distribution, standards (FIPA)

– Multi-threaded, limited scalability, not appropriate for

simulation

– MABS can be useful while developing MAS applications

SSIM

DEI / FEUP

• Bridge simulation and development of MAS– Develop high-performance simulations using MAS

development features: “MAS-like MABS”

– Convert MABS into MAS automatically (write-once, simulate and deploy)

• Approach– Simple API for JADE-based Simulations (SAJaS)

• Light implementation of most JADE features

• Integration with simulation framework (e.g. Repast)

– MAS Simulation to Development (MASSim2Dev)

• Eclipse plugin conversion tool: JADE SAJaS

Simulation and Development of MAS

SAJaS+MASSim2Dev

28

SSIM

DEI / FEUP

• Coordination and Applications

of Multi-Agent Systems:– Disruption Management in Airline Operations

Control: An Intelligent Agent-Based Approach

MASDIMA

Ana Paula Rocha

29

SSIM

DEI / FEUP

• Proposals:

– Problem Resolution Strategies Applied on Airline

Operations Control Centers (MASDIMA):

• New best strategies (through the use of heuristics or meta-

heuristics) to solve the problems that appear during daily

operations and integrate it in our negotiation protocol.

• Possible methods to use: Ant Colony Optimization (ACO),

Particle Swarm Optimization (PSO), Genetic Algorithms

(GA), others …

• Include Argumentation during Communication

• Additional Information: This work can be used totally or

partially on the dissertation: “Studies of Evolutionary

Computation applied on Operational Control Centers”,

presented by LIACC/NIADR

MASDIMA

30

SSIM

DEI / FEUP

• Proposals: – Study of strategies to solve problems in Airline

Operational Control Centers (OCC)• To solve the problems that arise in airline OCCs (flight delays,

missing crewmember, etc.) by trying diverse solutions using:

– Ant Colony Optimization

– Particle Swarm Optimization (PSO)

– Genetic Algorithms

– Others....

– Learning in Negotiation applied to OCCs• Give existing agents a learning mechanism used in proposal

formulation during negotiation.

• The learning method to use is Q-Learning.

• Q-Learning can be used to:

– Learn the best actions to use (domain operators) in problem solving..

MASDIMA

31

SSIM

DEI / FEUP

• IntellWheels: Realistic Simulation of

an Intelligent Wheelchair, Profiling

and Adapted Command Languages:

– Intellwheels Simulator

– Serious game with the goal of helping patients

learning to drive the wheelchair. Elicitation of user

profiles

– Command Language for driving the wheelchair

– Results of tests with actual patients with cerebral

palsy from APPC.

Intelligent Robotics, Coordination and MAS

Luís Paulo Reis

32

SSIM

DEI / FEUP

• Agenda– Importance of Human-Computer Interaction (HCI)

as a strong area of research

– Resources required to research HCI

– Skills and manufacturing capabilities needed to achieve the required combinations of sensors, actuators and controllers

– Recent technologies in the areas of sensors, actuators and controllers

– Introduction to the area of Physical Computing

– New ways of interacting with data, in terms of operations and the impact results of such operations can have on the physical world

– Common tools, platforms and applications

Graphics, Interaction and Game Design and Development

Rui Rodrigues

33

SSIM

DEI / FEUP

• Agenda:

– Part I: Basic Concepts

• Introduction and Principals Overview

– Part II: Challenges

• Fault Tolerance

• Energy optimization

• Quality of Service (QoS)

• Multi-criteria approach

– Part III: Current Research

A View of Cloud Computing: Concepts and Challenges

Jorge Barbosa

34

SSIM

DEI / FEUP

• Hot Topics in Cloud Research:

• Fault tolerance– Business continuity and service availability

– Autonomic Computing

• Energy efficiency– Optimize energy consumption (ex.: maximize Mflop /

Joule)

– Green cloud computing - minimize operational costs but also reduce the environmental impact

• Quality of Service– Performance unpredictability (ex.: due to sharing of

resources among co-located VMs)

A View of Cloud Computing: Concepts and Challenges

35

SSIM

DEI / FEUP 36

Intelligent Poker Agent

Luís Teófilo

SSIM

DEI / FEUP 37

Emotional State Regulation in Interactive Environments

Pedro Nogueira

SSIM

DEI / FEUP

We hope you enjoy this course!

Good Work!

38

Q & A