toward a generalized notion of audio as part of the ... filemodel of modeling actions event 6. jens...
TRANSCRIPT
Research Group Information Systemsand Enterprise Modeling
Institute for Computer Science and Business Information Systems (ICB)
University of Duisburg-Essen, Germany
Institut für Informatik undWirtschaftsinformatik (ICB)
Making modeling cognitively better manageable by enhancing modeling languages with audible and sensual means of expression
Toward a generalized notion of audio as part of the concrete syntax of business process modeling languages
Dr. Jens Gulden
Jens Gulden | Toward a generalized notion of audio as part of the concrete syntax | 2014-09-08 | BPM 2014, Eindhoven
Agenda
1 Motivation
2 State-of-the-art
3 Enhanced notion of model syntax
4 Configuration approach and prototype
5 Conclusion
2
Jens Gulden | Toward a generalized notion of audio as part of the concrete syntax | 2014-09-08 | BPM 2014, Eindhoven
DSMLs / BPMLs incorporate a semantically rich body of knowledge about the modeled domain
Imaginative capabilities required to understand models, associatively 'feel into' the domain
Assumption: multiple perception channels activate imaginative capabilities better than vision only
Conceptual semantics based on bodily metaphors → Embodied Cognition [JohnsonLakoff1999]
Desirable: more than visual access to models
Multiple perception channels to represent content
Define non-visual presentation syntax, e. g. audio
Related research [HermannRitter1999] [Vickers11] [Hildebrandt13]
1. Motivation
3
Jens Gulden | Toward a generalized notion of audio as part of the concrete syntax | 2014-09-08 | BPM 2014, Eindhoven
Concrete syntax specified as static mapping between model concepts and visual appearance
2. State-of-the-art
Car Wheel3..8
hasWheels
Concepts SymbolsMapping
CarMappingType: NodeSymbol
WheelMappingType: NodeSymbol
HasWheelsMappingType: LineArrow
4
Jens Gulden | Toward a generalized notion of audio as part of the concrete syntax | 2014-09-08 | BPM 2014, Eindhoven
Concrete syntax specified as static mapping between model concepts and visual appearance
2. State-of-the-art
Car Wheel3..8
hasWheels
Concepts SymbolsMapping
CarMappingType: NodeSymbol
WheelMappingType: NodeSymbol
HasWheelsMappingType: LineArrow
4
Eclipse GMF
Jens Gulden | Toward a generalized notion of audio as part of the concrete syntax | 2014-09-08 | BPM 2014, Eindhoven
Concrete syntax specified as static mapping between model concepts and visual appearance
2. State-of-the-art
Car Wheel3..8
hasWheels
Concepts SymbolsMapping
CarMappingType: NodeSymbol
WheelMappingType: NodeSymbol
HasWheelsMappingType: LineArrow
Eclipse GMF
MetaEdit+
4
Jens Gulden | Toward a generalized notion of audio as part of the concrete syntax | 2014-09-08 | BPM 2014, Eindhoven
Concrete syntax specified as static mapping between model concepts and visual appearance
2. State-of-the-art
Car Wheel3..8
hasWheels
Concepts SymbolsMapping
CarMappingType: NodeSymbol
WheelMappingType: NodeSymbol
HasWheelsMappingType: LineArrow
Eclipse GMF
MetaEdit+
XModeler
4
Jens Gulden | Toward a generalized notion of audio as part of the concrete syntax | 2014-09-08 | BPM 2014, Eindhoven
Different mode of perception besides visual impressions
Linear, time-based nature, e. g. audio passively perceived, not actively like visualizations
occurrences at specific events during language use
Syntax as interaction process between user and model
Traditional: ternary relation concept
Enhanced notion: quartary relation concept
Demand for a general model of modeling events
3. Enhanced notion of modeling language syntax
(Type, Instance) → Symbol
(Type, Instance, Event) → Symbol, Sound, …
5
Jens Gulden | Toward a generalized notion of audio as part of the concrete syntax | 2014-09-08 | BPM 2014, Eindhoven
Formally describe events and states that occur during modeling
Events are results of modeling actions performed by humans
Potentially more than one event per action
Each event can be associated with a sensual impression
Suggested dimensions, e. g.:
Type (person, business object, action, ...)
Action (by human modeler during modeling)
Action status (started, pending, success, ...)
Model of modeling actions
Event
6
Jens Gulden | Toward a generalized notion of audio as part of the concrete syntax | 2014-09-08 | BPM 2014, Eindhoven
Model of modeling actions: Many questions
In which situations should the occurrence of audio be actively caused by actions of modelers?
Which model elements should make sound without interaction?
Is audio to be used at design time and/or instantiation time? Can there be a unified view on both?
How can the set of actions be conceptualized that are possibly carried out during modeling?
Which states (emptiness of a model, error states, constraints) should be associated with audio?
7
Jens Gulden | Toward a generalized notion of audio as part of the concrete syntax | 2014-09-08 | BPM 2014, Eindhoven
CRUD actions performed by modelers
CREATE
READ (select)
UPDATE (modify)
DELETE
Action stati, different possible depending on object
STARTED
PENDING
SUCCESSFUL
UNSUCCESSFUL
4. Configuration approach
8
Jens Gulden | Toward a generalized notion of audio as part of the concrete syntax | 2014-09-08 | BPM 2014, Eindhoven
GUI mockup for configuration
9
Jens Gulden | Toward a generalized notion of audio as part of the concrete syntax | 2014-09-08 | BPM 2014, Eindhoven
Prototype for demonstration
Model by D. Zheleva and D. Wojtysiak
10
Jens Gulden | Toward a generalized notion of audio as part of the concrete syntax | 2014-09-08 | BPM 2014, Eindhoven
Concrete audio syntax for modeling languages can formally be described, if notion of syntax definition is widened to a procedural view
Results are generally applicable
Other perception channels (e. g. force-feedback, light/temperature environment, olfactory impression)
Potential for extensions
More complex notion of model concepts to represent, e. g. patterns of multiple objects
More complex notion of actions performed by a user, e. g. compound refactoring actions
5. Conclusion
11
Jens Gulden | Toward a generalized notion of audio as part of the concrete syntax | 2014-09-08 | BPM 2014, Eindhoven
Thank you very much –
Jens [email protected]
Thank you
12
Jens Gulden | Toward a generalized notion of audio as part of the concrete syntax | 2014-09-08 | BPM 2014, Eindhoven
[HermannRitter1999]
Thomas Hermann, Helge Ritter: Listen to your data: Model-based sonification for data analysis. In: G. E. Lasker (ed.), Advances in intelligent computing and multimedia systems, Int. Inst. for Advanced Studies in System research and cybernetics, Baden-Baden, 1999, pp. 189–194
[JohnsonLakoff1999]Mark Johnson, George Lakoff: Philosophy in the Flesh, Basic books, New York, 1999
[GuldenRutz07]
Jens Gulden, Holger Rutz: Proposal for an XML format representing Time, Positions and Parts of Audio Waveforms. In: M. Baalman, S. Schampijer (eds.), Proceedings of the Linux Audio Conference 2007 (LAC'07), Berlin, 2007, pp. 1-12
[Vickers11]
Paul Vickers: Sonification for process monitoring. In: T. Hermann, A. Hunt, and J. G. Neuhoff (eds.), The Sonification Handbook, Logos Berlin, 2011, pp. 455–492
[Hildebrandt13]
Tobias Hildebrandt: Towards Enhancing Business Process Monitoring with Sonification. In: N. Lohmann et al. (eds.), Business Process Management Workshops, BPM 2013 International Workshops, Springer, Berlin, 2013
Literature
13