![Page 1: A Development Environment to Customize Assessment through Students Interaction with Multimodal Applications](https://reader035.vdocuments.mx/reader035/viewer/2022070517/58d052a71a28ab02108b573f/html5/thumbnails/1.jpg)
A Development Environment to Customize Assessment through
Students Interaction with Multimodal Applications
Antonio Balderas AlbericoIván Ruiz Rube
José Miguel Mota MacíasJuan Manuel Dodero
BeardoManuel Palomo-Duarte
[email protected]@[email protected]@[email protected]
International Conference on Technological Ecosystems for Enhancing Multiculturality (TEEM) 2016November 4th, 2016Salamanca
![Page 2: A Development Environment to Customize Assessment through Students Interaction with Multimodal Applications](https://reader035.vdocuments.mx/reader035/viewer/2022070517/58d052a71a28ab02108b573f/html5/thumbnails/2.jpg)
Once upon a time in a mobile world…
![Page 4: A Development Environment to Customize Assessment through Students Interaction with Multimodal Applications](https://reader035.vdocuments.mx/reader035/viewer/2022070517/58d052a71a28ab02108b573f/html5/thumbnails/4.jpg)
Gadgets and wearablesforthcoming…
![Page 5: A Development Environment to Customize Assessment through Students Interaction with Multimodal Applications](https://reader035.vdocuments.mx/reader035/viewer/2022070517/58d052a71a28ab02108b573f/html5/thumbnails/5.jpg)
…in a cyber-physical brave new world
![Page 6: A Development Environment to Customize Assessment through Students Interaction with Multimodal Applications](https://reader035.vdocuments.mx/reader035/viewer/2022070517/58d052a71a28ab02108b573f/html5/thumbnails/6.jpg)
Where is the teacher?
![Page 7: A Development Environment to Customize Assessment through Students Interaction with Multimodal Applications](https://reader035.vdocuments.mx/reader035/viewer/2022070517/58d052a71a28ab02108b573f/html5/thumbnails/7.jpg)
What about assessment?
![Page 8: A Development Environment to Customize Assessment through Students Interaction with Multimodal Applications](https://reader035.vdocuments.mx/reader035/viewer/2022070517/58d052a71a28ab02108b573f/html5/thumbnails/8.jpg)
Learning Analytics
![Page 9: A Development Environment to Customize Assessment through Students Interaction with Multimodal Applications](https://reader035.vdocuments.mx/reader035/viewer/2022070517/58d052a71a28ab02108b573f/html5/thumbnails/9.jpg)
Program or be programmedThe debate over whether the Net is good or bad for us fills the airwaves and the blogosphere. But for all the heat of claim and counter-claim, the argument is essentially beside the point: it’s here; it’s everywhere. The real question is, do we direct technology, or do we let ourselves be directed by it and those who have mastered it? “Choose the former,” writes Rushkoff, “and you gain access to the control panel of civilization. Choose the latter, and it could be the last real choice you get to make.”
![Page 10: A Development Environment to Customize Assessment through Students Interaction with Multimodal Applications](https://reader035.vdocuments.mx/reader035/viewer/2022070517/58d052a71a28ab02108b573f/html5/thumbnails/10.jpg)
Focus
Mobiledevices
Augmentedreality
Gestural interactions
Learninganalytics
![Page 11: A Development Environment to Customize Assessment through Students Interaction with Multimodal Applications](https://reader035.vdocuments.mx/reader035/viewer/2022070517/58d052a71a28ab02108b573f/html5/thumbnails/11.jpg)
Involve teachers in the creation of their own extended {mobile, AR, gestural,…} learning scenarios using creative computing
Motivation
![Page 12: A Development Environment to Customize Assessment through Students Interaction with Multimodal Applications](https://reader035.vdocuments.mx/reader035/viewer/2022070517/58d052a71a28ab02108b573f/html5/thumbnails/12.jpg)
State of the art: e.g. augmented reality toolsFor programmers For non programmers
![Page 13: A Development Environment to Customize Assessment through Students Interaction with Multimodal Applications](https://reader035.vdocuments.mx/reader035/viewer/2022070517/58d052a71a28ab02108b573f/html5/thumbnails/13.jpg)
Visual programming languages can help to develop creative computing abilities to build such extended learning scenarios
General hypothesis
![Page 14: A Development Environment to Customize Assessment through Students Interaction with Multimodal Applications](https://reader035.vdocuments.mx/reader035/viewer/2022070517/58d052a71a28ab02108b573f/html5/thumbnails/14.jpg)
State of the art: Visual Languages
![Page 16: A Development Environment to Customize Assessment through Students Interaction with Multimodal Applications](https://reader035.vdocuments.mx/reader035/viewer/2022070517/58d052a71a28ab02108b573f/html5/thumbnails/16.jpg)
Based on AppInventor
![Page 17: A Development Environment to Customize Assessment through Students Interaction with Multimodal Applications](https://reader035.vdocuments.mx/reader035/viewer/2022070517/58d052a71a28ab02108b573f/html5/thumbnails/17.jpg)
Existing components
![Page 18: A Development Environment to Customize Assessment through Students Interaction with Multimodal Applications](https://reader035.vdocuments.mx/reader035/viewer/2022070517/58d052a71a28ab02108b573f/html5/thumbnails/18.jpg)
ExtensionsAugmented reality
> Marker, text and image recognizing
3D Engine
> 3D interactive objects (.OBJ, .3DS, .MD2, etc.)
Gesture interaction
> Hand gestures
Learning analytics
> Cloud store of interaction data> Queries + datatables + charts
![Page 19: A Development Environment to Customize Assessment through Students Interaction with Multimodal Applications](https://reader035.vdocuments.mx/reader035/viewer/2022070517/58d052a71a28ab02108b573f/html5/thumbnails/19.jpg)
ExtensionsAugmented reality> Marker, text and image recognizing
3D Engine> 3D interactive objects (.OBJ, .3DS, .MD2, etc.)
Gesture interaction> Hand gestures
Learning analytics> Cloud store of interaction data> Queries + datatables + charts
![Page 20: A Development Environment to Customize Assessment through Students Interaction with Multimodal Applications](https://reader035.vdocuments.mx/reader035/viewer/2022070517/58d052a71a28ab02108b573f/html5/thumbnails/20.jpg)
Extension of VEDILS visual language to build learning analytics apps for mobile
devices
Specific Objective
![Page 21: A Development Environment to Customize Assessment through Students Interaction with Multimodal Applications](https://reader035.vdocuments.mx/reader035/viewer/2022070517/58d052a71a28ab02108b573f/html5/thumbnails/21.jpg)
VEDILS LA components
![Page 22: A Development Environment to Customize Assessment through Students Interaction with Multimodal Applications](https://reader035.vdocuments.mx/reader035/viewer/2022070517/58d052a71a28ab02108b573f/html5/thumbnails/22.jpg)
ActivityTracker selectable automatic trackingGlobal Actions Focused action (e.g. button)
![Page 23: A Development Environment to Customize Assessment through Students Interaction with Multimodal Applications](https://reader035.vdocuments.mx/reader035/viewer/2022070517/58d052a71a28ab02108b573f/html5/thumbnails/23.jpg)
ActivityTracker blocks
http://www.eclipse.org/aspectj/
![Page 24: A Development Environment to Customize Assessment through Students Interaction with Multimodal Applications](https://reader035.vdocuments.mx/reader035/viewer/2022070517/58d052a71a28ab02108b573f/html5/thumbnails/24.jpg)
ActivityTracker tracked data
![Page 25: A Development Environment to Customize Assessment through Students Interaction with Multimodal Applications](https://reader035.vdocuments.mx/reader035/viewer/2022070517/58d052a71a28ab02108b573f/html5/thumbnails/25.jpg)
ActivitySimpleQuery design
DistinctResults: To avoid duplicated results.
FieldsToRetrieve:Data to recover from the data storage
TableId:Google Fusion Tables id
![Page 26: A Development Environment to Customize Assessment through Students Interaction with Multimodal Applications](https://reader035.vdocuments.mx/reader035/viewer/2022070517/58d052a71a28ab02108b573f/html5/thumbnails/26.jpg)
ActivityAggregationQuery designGroup By: Fields to group the results
MetricsToRetrieve: aggregations
![Page 27: A Development Environment to Customize Assessment through Students Interaction with Multimodal Applications](https://reader035.vdocuments.mx/reader035/viewer/2022070517/58d052a71a28ab02108b573f/html5/thumbnails/27.jpg)
DataTable & Chart designQuery: Query from which obtain data
Height/width: dimensions in screen
Visible: To show/hide the table/chart
ChartType: (currently) line/bar chart
IndexFor[Category/Value]Axis: data index
[Category/Value]AxisTitle: label
![Page 28: A Development Environment to Customize Assessment through Students Interaction with Multimodal Applications](https://reader035.vdocuments.mx/reader035/viewer/2022070517/58d052a71a28ab02108b573f/html5/thumbnails/28.jpg)
Teacher implementation of Who am I? game in a German language course including augmented reality
Case study: Foreign language learning
![Page 29: A Development Environment to Customize Assessment through Students Interaction with Multimodal Applications](https://reader035.vdocuments.mx/reader035/viewer/2022070517/58d052a71a28ab02108b573f/html5/thumbnails/29.jpg)
Learning analytics capabilitiesGoogle Fusion Tables data> Ejemplo: Wir Ben Ich
Pentaho dashboard> Projects> Users
![Page 30: A Development Environment to Customize Assessment through Students Interaction with Multimodal Applications](https://reader035.vdocuments.mx/reader035/viewer/2022070517/58d052a71a28ab02108b573f/html5/thumbnails/30.jpg)
Interactions Compilation of students’
interactions relevant for assessment : e.g. number of attempts to guess a character, characters that are more difficult to guess, etc.
Learning analytics resultsSurvey> Inside the app to know learners’ opinion
![Page 31: A Development Environment to Customize Assessment through Students Interaction with Multimodal Applications](https://reader035.vdocuments.mx/reader035/viewer/2022070517/58d052a71a28ab02108b573f/html5/thumbnails/31.jpg)
University of Algarve, Mechanical Engineering, “Design I” class
Learn foundations of technical drawing including perspectives
Case study: Technical Drawing
http://vedils.uca.es/web/techDrawing.html
![Page 32: A Development Environment to Customize Assessment through Students Interaction with Multimodal Applications](https://reader035.vdocuments.mx/reader035/viewer/2022070517/58d052a71a28ab02108b573f/html5/thumbnails/32.jpg)
APP BASED ON AUGMENTED REALITYWelcome screen Rendering 3D models Survey on useful of the
application.
![Page 33: A Development Environment to Customize Assessment through Students Interaction with Multimodal Applications](https://reader035.vdocuments.mx/reader035/viewer/2022070517/58d052a71a28ab02108b573f/html5/thumbnails/33.jpg)
Different display types
![Page 34: A Development Environment to Customize Assessment through Students Interaction with Multimodal Applications](https://reader035.vdocuments.mx/reader035/viewer/2022070517/58d052a71a28ab02108b573f/html5/thumbnails/34.jpg)
Extended information
Touching the graph you obtain more detail
information
![Page 35: A Development Environment to Customize Assessment through Students Interaction with Multimodal Applications](https://reader035.vdocuments.mx/reader035/viewer/2022070517/58d052a71a28ab02108b573f/html5/thumbnails/35.jpg)
Ease the registry of user interactions
Visualize assessment information from a dashboard / the app
Conclusions
![Page 36: A Development Environment to Customize Assessment through Students Interaction with Multimodal Applications](https://reader035.vdocuments.mx/reader035/viewer/2022070517/58d052a71a28ab02108b573f/html5/thumbnails/36.jpg)
Actual user testing of new LA authoring tools
Integration with data mining libraries to ease assessment interpretation
Future work
![Page 40: A Development Environment to Customize Assessment through Students Interaction with Multimodal Applications](https://reader035.vdocuments.mx/reader035/viewer/2022070517/58d052a71a28ab02108b573f/html5/thumbnails/40.jpg)
Images from:http://elearningindustry.com/augmented-future-elearning-augmented-reality-elearninghttp://www.educatorstechnology.com/2013/06/20-ways-to-use-augmented-reality-in.html