user-adaptive support for processing magazine style ...dtoker/publications/iui18... · personality...

6
User-adaptive Support for Processing Magazine Style Narrative Visualizations: Identifying User Characteristics that Matter Dereck Toker, Cristina Conati, Giuseppe Carenini Department of Computer Science University of British Columbia, Vancouver, Canada {dtoker, conati, carenini}@cs.ubc.ca ABSTRACT In this paper we present results from an exploratory user study to uncover which user characteristics (e.g., perceptual speed, verbal working memory, etc.) play a role in how users process textual documents with embedded visualizations (i.e., Magazine Style Narrative Visualizations). We present our findings as a step toward developing user-adaptive support, and provide suggestions on how our results can be leveraged for creating a set of meaningful interventions for future evaluation. Author Keywords User study; Narrative visualization; Individual differences; User characteristics; User-adaptation; Personalization. INTRODUCTION As digital information continues to accumulate in our lives, information visualizations have become an increasingly relevant tool for discovering trends and shaping stories from this overabundance of data (e.g., Infographics [26], Timelines [6]). However, visualizations are typically designed and evaluated following a one size-fits-all approach, meaning they do not take into account the potential needs of individual users. There is mounting evidence that user characteristics such as cognitive abilities, personality traits, and learning abilities, can significantly influence user experience during information visualization tasks (e.g., [25,33,38,41]). These findings have prompted researchers to investigate user-adaptive information visualizations, i.e., visualizations that aim to recognize and adapt to each user’s specific needs. Whereas existing work has been mostly limited to tasks involving just visualizations, the aim of our research is to broaden this work to include scenarios where users interact with visualizations embedded in narrative text, known as Magazine Style Narrative Visualization [35], or MSNV for short (e.g., Figure 1). Research has shown that text and graphical modalities are well suited information channels to combine (e.g., [44]). Moreover, the multimedia principle states that “users learn more deeply from words and pictures than from words alone.” [29]. However, an established problem arising from combined modalities is the split-attention effect. Split- attention occurs when users are required to split their attention between two information sources (e.g., text and visualization), which can increase cognitive load and can negatively impact learning [2]. This problem is exacerbated in MSNVs where often there is more than one visual task specified through the narrative text. Multiple visual tasks in MSNVs are captured by references, namely segments of text that specifies a visual task in on an accompanying visualization. An example of a reference is shown in Figure 1, it includes the sentence “An overwhelming majority of chaplains who responded to these questions say that inmates’ requests for religious texts (82%) and for meetings with spiritual leaders of their faith (71%) are usually approved.” plus the two bars outlined in orange. Typically, references are used to support arguments or statements being made in the document text by providing added details or interpretations to an accompanying visualization. As a user reads through a MSNV, they will often encounter a variety of references in the text, each soliciting attention to different aspects of the accompanying visualization. Since visualizations cannot be designed to favor the performance of any particular reference (because favoring one task may hinder the others) it has been proposed by Carenini et al. [8] to address this problem by providing user-adaptive support: highlighting interventions would be provided to relevant aspects of the visualization depending on what part of the text the user is reading and depending on the user’s characteristics that may impact MSNV processing. In this paper we present a first step toward understanding how to provide this adaptive support, by focusing specifically on identifying which user characteristics impact MSNV processing and thus warrant personalization. We conducted an exploratory user study to evaluate a set of 9 different user characteristics that could potentially influence MSNV performance. These include characteristics that were previously found to impact visualization processing (e.g., perceptual speed, spatial memory), plus some that are related to text processing (e.g., reading proficiency, verbal Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]. IUI’18, March 7-11, 2018, Tokyo, Japan © 2018 Copyright is held by the owner/author(s). Publication rights licensed to ACM. ACM ISBN 978-1-4503-4945-1/18/03…$15.00 https://doi.org/10.1145/3172944.3173009

Upload: others

Post on 21-May-2020

8 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: User-adaptive Support for Processing Magazine Style ...dtoker/publications/IUI18... · personality traits, and learning abilities, can significantly influence user experience during

User-adaptive Support for Processing Magazine Style Narrative Visualizations: Identifying

User Characteristics that Matter

Dereck Toker, Cristina Conati, Giuseppe Carenini

Department of Computer Science

University of British Columbia, Vancouver, Canada

{dtoker, conati, carenini}@cs.ubc.ca

ABSTRACT

In this paper we present results from an exploratory user

study to uncover which user characteristics (e.g., perceptual

speed, verbal working memory, etc.) play a role in how

users process textual documents with embedded

visualizations (i.e., Magazine Style Narrative

Visualizations). We present our findings as a step toward

developing user-adaptive support, and provide suggestions

on how our results can be leveraged for creating a set of

meaningful interventions for future evaluation.

Author Keywords

User study; Narrative visualization; Individual differences;

User characteristics; User-adaptation; Personalization.

INTRODUCTION As digital information continues to accumulate in our lives,

information visualizations have become an increasingly

relevant tool for discovering trends and shaping stories

from this overabundance of data (e.g., Infographics [26],

Timelines [6]). However, visualizations are typically

designed and evaluated following a one size-fits-all

approach, meaning they do not take into account the

potential needs of individual users. There is mounting

evidence that user characteristics such as cognitive abilities,

personality traits, and learning abilities, can significantly

influence user experience during information visualization

tasks (e.g., [25,33,38,41]). These findings have prompted

researchers to investigate user-adaptive information

visualizations, i.e., visualizations that aim to recognize and

adapt to each user’s specific needs. Whereas existing work

has been mostly limited to tasks involving just

visualizations, the aim of our research is to broaden this

work to include scenarios where users interact with

visualizations embedded in narrative text, known as

Magazine Style Narrative Visualization [35], or MSNV for

short (e.g., Figure 1).

Research has shown that text and graphical modalities are

well suited information channels to combine (e.g., [44]).

Moreover, the multimedia principle states that “users learn

more deeply from words and pictures than from words

alone.” [29]. However, an established problem arising from

combined modalities is the split-attention effect. Split-

attention occurs when users are required to split their

attention between two information sources (e.g., text and

visualization), which can increase cognitive load and can

negatively impact learning [2]. This problem is exacerbated

in MSNVs where often there is more than one visual task

specified through the narrative text. Multiple visual tasks in

MSNVs are captured by references, namely segments of

text that specifies a visual task in on an accompanying

visualization. An example of a reference is shown in Figure

1, it includes the sentence “An overwhelming majority of

chaplains who responded to these questions say that

inmates’ requests for religious texts (82%) and for meetings

with spiritual leaders of their faith (71%) are usually

approved.” plus the two bars outlined in orange. Typically,

references are used to support arguments or statements

being made in the document text by providing added details

or interpretations to an accompanying visualization. As a

user reads through a MSNV, they will often encounter a

variety of references in the text, each soliciting attention to

different aspects of the accompanying visualization. Since

visualizations cannot be designed to favor the performance

of any particular reference (because favoring one task may

hinder the others) it has been proposed by Carenini et al. [8]

to address this problem by providing user-adaptive support:

highlighting interventions would be provided to relevant

aspects of the visualization depending on what part of the

text the user is reading and depending on the user’s

characteristics that may impact MSNV processing.

In this paper we present a first step toward understanding

how to provide this adaptive support, by focusing

specifically on identifying which user characteristics impact

MSNV processing and thus warrant personalization. We

conducted an exploratory user study to evaluate a set of 9

different user characteristics that could potentially influence

MSNV performance. These include characteristics that

were previously found to impact visualization processing

(e.g., perceptual speed, spatial memory), plus some that are

related to text processing (e.g., reading proficiency, verbal

Permission to make digital or hard copies of all or part of this work for personal

or classroom use is granted without fee provided that copies are not made or

distributed for profit or commercial advantage and that copies bear this notice

and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is

permitted. To copy otherwise, or republish, to post on servers or to redistribute

to lists, requires prior specific permission and/or a fee. Request permissions

from [email protected].

IUI’18, March 7-11, 2018, Tokyo, Japan

© 2018 Copyright is held by the owner/author(s). Publication rights licensed to ACM. ACM ISBN 978-1-4503-4945-1/18/03…$15.00

https://doi.org/10.1145/3172944.3173009

Page 2: User-adaptive Support for Processing Magazine Style ...dtoker/publications/IUI18... · personality traits, and learning abilities, can significantly influence user experience during

IQ). Results from our user study identified five user

characteristics that could be suitable targets for providing

adaptive support. In the remainder of the paper we discuss

related work, followed by a description of the user study.

We then report results, and wrap up with the conclusion.

RELATED WORK

A growing amount of work has linked several user

characteristics to performance and preference with various

information visualizations. For instance, the cognitive

ability perceptual speed has been shown to correlate

negatively with time on task [9,10,41], and can also

influence visualization suitability [1,12]. Users with high

visual working memory were found to have a stronger

preference for radar charts [38], and were shown to prefer

deviation charts over maps [24]. Findings for other

cognitive traits include: disembedding on task accuracy

[41], verbal working memory on response time [9,10], and

spatial memory on performance [12,41] and usability [24].

Locus of control, a personality trait, has also been shown to

play a significant role in determining which type of

visualization a user performs best with [20,33,43].

There are several works that have demonstrated the value of

employing user-adaptive strategies in visualization systems.

For instance, Gotz & Wen [17] reported a significant

reduction in task time and task error-rate, by recommending

an appropriate visualization to users based on patterns

detected in the sequence of actions they performed while

carrying out search and comparison tasks. Grawemeyer [18]

also reported improved task performance with a series of

database queries, by tracking users’ evolving knowledge of

the task domain and recommending visual representations

accordingly. Nazemi et al. [32] improved the performance

of searching bibliographic entries, by tracking users’

interactions and adapting the size, color, and order of the

entries shown across several visualizations. Carenini et al.

[9] evaluated several forms of dynamic highlighting to

guide attention to relevant datapoints within grouped bar

charts, and they reported a significant improvement in task

performance when compared to using no interventions.

Outside of visualization, work has been done on providing

user-adaptive support to text reading/comprehension. For

instance, Lobodoa et al. [27] examined the feasibility of

using eye tracking to infer word relevance during reading

tasks, so that the informational needs of users could be

assessed unobtrusively. Some work in intelligent user

interfaces has looked at automatic generation of text and

graphical presentations [19], but to the best of our

knowledge, no one has focused on designing user-adaptive

support to help users process them.

USER STUDY

Study Procedure

56 subjects (32 female) ranging in age from 19 to 69,

participated in the study. 60% of participants were

university students, and the others were from a variety of

backgrounds (e.g., retail manager, restaurant server,

retired). The experiment was a within-subjects repeated

measures design, lasting at most 115 minutes. Participants

were given the task of reading over a MSNV, and would

signal they were done by clicking ‘next’. They were then

presented with a set of questions designed to elicit their

opinion and to test their comprehension of relevant

concepts discussed in the document. Participants were

required to carry out this task for 15 different MSNVs

(described in the next subsection). Users were not given a

time-limit to read the MSNVs, but we told them that speed

and accuracy would be factors in determining their

performance. Standard tests were used to assess user

characteristics (see Table 1). To reduce fatigue, we split up

the user characteristic tests so that some were done at home

the night before the experiment, and the rest were

Figure 1. One of 15 MSNVs administered in the user study.

*Note: Orange highlighting is shown to illustrate the concept of a reference.

Highlighting was not provided to users in the study.

Figure 2. Comprehension questions presented

to users after reading each MSNV.

Page 3: User-adaptive Support for Processing Magazine Style ...dtoker/publications/IUI18... · personality traits, and learning abilities, can significantly influence user experience during

administered in the lab before and after the set of 15 MSNV

tasks1. Each participant was compensated $45 for the study.

We further incentivized users by offering a $50 bonus to the

top three participants with the best performance, so that

users would be more inclined to put in effort with the tasks.

Study tasks

As we mentioned in the introduction, salient processing

points in a MSNV are solicited by references, namely

segments of text that specify a visual task on an

accompanying visualization. The 15 MSNVs we used for

the study tasks were derived from an existing dataset of

magazine style documents by Kong et al. where the

references in each document were identified via a rigorous

coding process indicating which data points in each

visualization correspond to each reference sentence [23].

All documents in the dataset were extracted from real-world

sources including Pew Research, The Guardian, and The

Economist. The 15 MSNVs in our study were self-

contained excerpts from longer articles, selected to include

one visualization each, and one body of narrative text

ranging between 42 and 228 words (avg. = 91), and 1 to 7

references2 (avg. = 2.6). Number of words and references

were varied to account for the potential influence that these

factors of complexity might have on MSNV processing. All

the visualizations we selected were an assortment of bar

charts (e.g., simple, stacked, grouped [31]).We focused on

one class of visualizations to keep the complexity of study

manageable, and we chose bar-graphs because they are one

of the most popular and effective visualizations.

The aim of our study is to evaluate the impact of user

characteristics on users’ experience with MSNVs, where

experience comprises of both task performance and

subjective measures. These measures were assessed for

each MSNV via a set of questions (see Figure 2) shown to

the user after they read each document. Two subjective

questions measured, respectively, perceived ease-of-

understanding and interest (see top two questions in Figure

2), based on work by Waddell et al. [42]. The remaining

questions measured task performance in terms of document

comprehension, based on the work by Dyson & Haselgrove

[13]. They included:

One title question which asks to select a suitable

alternative title for the MSNV (see question 5, bottom

of Figure 2), and provides a simple way to ensure that

the user had a grasp of the general document narrative.

One or two (depending on document length)

recognition questions asking to recall specific

1 In the future, we plan to predict user characteristics in real-time by

using classifiers based on eye tracking data, as done in [11,39].

2 We also varied the type of references included in the documents,

e.g., references that identify specific datapoints in the visualization;

and references that emphasize comparisons among groups of

datapoints.

information from the MSNV: either a named entity

discussed in the text (e.g., question 3 in Figure 2), or

the magnitude/directionality of two named entities

(e.g., question 4 in Figure 2).

User Characteristics Explored in the Study

The nine user characteristics we investigated in the study

are shown in Table 1. The first seven characteristics consist

of cognitive abilities and traits that we selected because

previous research has shown that they play a significant

role in user experience with visualizations (e.g.,

[9,10,12,24,38,41]). In addition, we included two user

characteristics relating to reading abilities, to account for

the fact that the MSNVs each contain a body of narrative

text. All of the user characteristics were measured with

standard tests in psychology (refer to Table 1 for citations).

Characteristic Definition + Test Source

NEED FOR

COGNITION Extent to which individuals are inclined towards

effortful cognitive activities [7].

BAR CHART

LITERACY

Ability to use a bar chart to translate questions specified in the data domain into visual queries in the

visual domain, as well as interpret visual patterns in

the visual domain as properties in the data domain [5].

VISUAL

WORKING

MEMORY

Part of the working memory responsible for temporary storage and manipulation of visual and

spatial information [16,28].

SPATIAL

MEMORY Ability to remember the configuration, location, and

orientation of figural material [14].

VERBAL

WORKING

MEMORY

Part of the working memory responsible for

temporary maintenance and manipulation of verbal

information [3,40].

PERCEPTUAL

SPEED

Speed in scanning/comparing figures or symbols, or carrying out other very simple tasks involving visual

perception [14].

DISEMBEDDING Ability to hold a given visual percept or configuration

in mind so as to disembed it from other well defined

perceptual material [14].

READING

PROFICIENCY Vocabulary size and reading comprehension ability in English [30].

VERBAL IQ Overall verbal intellectual abilities that measures acquired knowledge, verbal reasoning, and attention

to verbal materials [4,36].

Table 1. User characteristics measured in the study.

RESULTS

To assess the impact of the tested user characteristics on

MSNV processing, we looked at 4 dependent measures:

MSNV Speed: time in seconds that users spent looking

at the document (M = 57.2, SD = 32.9).

MSNV Accuracy: combined score of the objective

comprehension questions (M = 0.69, SD = 0.30).

MSNV Ease-of-Understanding: subjective rating on a

5-point Likert Scale (M = 3.9, SD = 1.0).

MSNV Interest: subjective rating on a 5-point Likert

Scale (M = 3.3, SD = 1.3).

To account for possible redundancies, we carried out a

preliminary check for correlations within the user

characteristics as well as within the dependent measures

Page 4: User-adaptive Support for Processing Magazine Style ...dtoker/publications/IUI18... · personality traits, and learning abilities, can significantly influence user experience during

(Pearson correlation). For both groups, no correlations were

high enough to justify removal. We then ran one path

analysis model3 on each of the 4 dependent measures of

user experience using the lavaan software package in R

[34]. Each path model included the set of 9 user

characteristics as covariates, as well as 5 factors to account

for document complexity (e.g., number of words in the text,

amount of references, number of datapoints in the

visualization). We adjusted for multiple comparison error

using a Bonferroni correction of m = 4 [15]. In terms of

model fit, all four path models yielded a Tucker-Lewis

Index (TLI) = 1.0, which is the best fit possible, and is well

above the minimum acceptable threshold of 0.9 [21]. Due

to space limitations, we report only the statistically

significant findings for which there are obvious

implications for adaptive support.

Table 2. Significant results from our path model analyses.

Beta values reported indicate size and directionality of

standardized regression coefficient.

We found main effects for six user characteristics on

MSNV Speed, but no main effects on MSNV Accuracy (see

Table 2), which indicates that all users were similarly

accurate though some of them likely needed more time to

achieve comparable accuracy. If we look at the results in

more detail, the main effects can be clustered into three

rather different groups.

The first group includes user characteristics (Disembedding,

Verbal WM, and Reading Proficiency) that display a

negative directionality with MSNV Speed (i.e., users with

low abilities spend more time looking at the MSNV). This

is not surprising, as Disembedding relates to visualization

processing, and Verbal WM and Reading Proficiency relate

to text processing, and having low abilities for these

characteristics are plausible causes of slower performance.

The second group of main effects includes user

characteristics (Need for Cognition and Spatial Memory)

3 Path analysis is a more sophisticated model that will facilitate

mediation analysis for future work, but at this stage is equivalent to

using multiple regression analysis [22].

that have positive directionality with MSNV Speed (i.e.,

users with high abilities are the ones spending more time

looking at the MSNVs). This would seem counterintuitive,

if we had not also found that for these same two

characteristics there are main effects on the subjective

measures of MSNV Understanding and/or Interest (see last

two columns of Table 2), indicating that these users with

high abilities are also rating the documents more favorably.

What appears to be happening for this group of users, is that

longer time on task does not translate into higher accuracy,

but it does improve their overall experience, and this could

be beneficial depending on the goals of the system or user.

The third group only includes only Bar Chart Literacy, for

which we also found positive directionality with MSNV

Speed, but no results with the subjective measures. A

possible explanation is that these users linger on the

document because they are more inclined to explore extra

details in the visualizations (i.e., bar charts), but this

unfortunately does not generate any improvement in either

accuracy or user experience.

Discussion

Although our results are quite preliminary, the first two

groups of main effects can viably inform some adaptation

strategies. We have identified characteristics where users

with low abilities were taking longer to achieve comparable

accuracy as their counterparts. Such users could be

supported in completing the task faster by providing

interventions to facilitate visualization processing for users

with low Disembedding, or facilitating text processing for

users with low Verbal WM or Reading Proficiency. In the

second group of main effects, we have identified

characteristics (Need for Cognition and Spatial Memory)

where users with high abilities were spending more time on

task, with no improvement in objective accuracy, but with

higher subjective ratings of document understanding and

document interest. For these characteristics, it may make

sense to focus on engaging users with low abilities to spend

more meaningful time with the MSNVs, which may

consequently improve their attitude towards the documents.

CONCLUSION

In this paper, we conducted an exploratory user study to

investigate which user characteristics play a role in user

experience with Magazine Style Narrative Visualizations

(MSNVs). Results from our analysis identified several

significant main effects of user characteristics that can

inform possible strategies for adaptation. As a next step, we

plan to analyze eye tracking data that we collected in our

study, which can support and further clarify our results in

an objective way. For instance, we expect that users with

low Reading Proficiency spend more time processing the

text in the MSNVs compared to their counterparts. Using

gaze analysis methodology described in [37], we can verify

if our expectation is true, plus we can further evaluate

where within the text users are having difficulty (e.g.,

possibly while they are processing the references).

Page 5: User-adaptive Support for Processing Magazine Style ...dtoker/publications/IUI18... · personality traits, and learning abilities, can significantly influence user experience during

REFERENCES

1. Bryce Allen. 2000. Individual differences and the

conundrums of user-centered design: Two

experiments. Journal of the American society for

information science 51, 6: 508–520.

2. P Ayres and G Cierniak. 2012. Split-Attention Effect.

In Encyclopedia of the Sciences of Learning, ed.

Norbet M. Seel. Springer, 3172–3175.

3. Alan D. Baddeley. 1986. Working memory. Clarendon

Press ; Oxford University Press, Oxford [Oxfordshire] :

New York.

4. Jennifer R. Blair and Otfried Spreen. 1989. Predicting

premorbid IQ: A revision of the national adult reading

test. Clinical Neuropsychologist 3, 2: 129–136.

https://doi.org/10.1080/13854048908403285

5. J. Boy, R.A. Rensink, E. Bertini, and J.-D. Fekete.

2014. A Principled Way of Assessing Visualization

Literacy. IEEE Transactions on Visualization and

Computer Graphics 20, 12: 1963–1972.

https://doi.org/10.1109/TVCG.2014.2346984

6. Matthew Brehmer, Bongshin Lee, Benjamin Bach,

Nathalie Henry Riche, and Tamara Munzner. 2016.

Timelines Revisited: A Design Space and

Considerations for Expressive Storytelling. IEEE

Transactions on Visualization and Computer

Graphics: 1–1.

https://doi.org/10.1109/TVCG.2016.2614803

7. John T. Cacioppo, Richard E. Petty, and Chuan Feng

Kao. 1984. The Efficient Assessment of Need for

Cognition. Journal of Personality Assessment 48, 3:

306–307.

https://doi.org/10.1207/s15327752jpa4803_13

8. Giuseppe Carenini, Cristina Conati, Enamul Hoque,

and Ben Steichen. 2013. User Task Adaptation in

Multimedia Presentations. In Proceedings of the 1st

International Workshop on User-Adaptive Information

Visualization (WUAV 2013), in conjunction with the

21st conference on User Modeling, Adaptation and

Personalization (UMAP 2013).

9. Giuseppe Carenini, Cristina Conati, Enamul Hoque,

Ben Steichen, Dereck Toker, and James T. Enns. 2014.

Highlighting Interventions and User Differences:

Informing Adaptive Information Visualization

Support. In Proceedings of the SIGCHI Conference on

Human Factors in Computing Systems, 1835–1844.

https://doi.org/https://doi.org/10.1145/2556288.255714

1

10. Conati Conati, Giuseppe Carenini, Enamul Hoque, Ben

Steichen, and Dereck Toker. 2014. Evaluating the

impact of user characteristics and different layouts on

an interactive visualization for decision making. In

Computer Graphics Forum, 371–380.

https://doi.org/10.1111/cgf.12393

11. Cristina Conati, Sébastien Lallé, Md. Abed Rahman,

and Dereck Toker. 2017. Further Results on Predicting

Cognitive Abilities for Adaptive Visualizations. In

Proceedings of the 26th International Joint Conference

on Artificial Intelligence.

12. Cristina Conati and Heather Maclaren. 2008.

Exploring the role of individual differences in

information visualization. In Proceedings of the

working conference on Advanced visual interfaces,

199–206. https://doi.org/10.1145/1385569.1385602

13. Mary C. Dyson and Mark Haselgrove. 2001. The

influence of reading speed and line length on the

effectiveness of reading from screen. International

Journal of Human-Computer Studies 54, 4: 585–612.

https://doi.org/10.1006/ijhc.2001.0458

14. Ruth B. Ekstrom, John W. French, Harry H. Harman,

and Diran Dermen. 1976. Manual for kit of factor

referenced cognitive tests. Educational Testing Service

Princeton, NJ.

15. Andy P. Field. 2003. How to design and report

experiments. Sage publications Ltd.

16. Keisuke Fukuda and Edward K. Vogel. 2009. Human

Variation in Overriding Attentional Capture. The

Journal of Neuroscience 29, 27: 8726–8733.

https://doi.org/10.1523/JNEUROSCI.2145-09.2009

17. David Gotz and Zhen Wen. 2009. Behavior-driven

visualization recommendation. In Proceedings of the

14th international conference on Intelligent user

interfaces, 315–324.

https://doi.org/10.1145/1502650.1502695

18. Beate Grawemeyer. 2006. Evaluation of ERST: an

external representation selection tutor. In Proceedings

of the 4th international conference on Diagrammatic

Representation and Inference (Diagrams’06), 154–

167. https://doi.org/10.1007/11783183_21

19. Nancy L Green, Giuseppe Carenini, Stephan

Kerpedjiev, Joe Mattis, Johanna D Moore, and Steven

F Roth. 2004. AutoBrief: an experimental system for

the automatic generation of briefings in integrated text

and information graphics. International Journal of

Human-Computer Studies 61, 1: 32–70.

https://doi.org/10.1016/j.ijhcs.2003.10.007

20. Tear Marie Green and Brian Fisher. 2010. Towards the

Personal Equation of Interaction: The impact of

personality factors on visual analytics interface

interaction. In 2010 IEEE Symposium on Visual

Analytics Science and Technology (VAST), 203–210.

https://doi.org/10.1109/VAST.2010.5653587

21. Li‐tze Hu and Peter M. Bentler. 1999. Cutoff criteria

for fit indexes in covariance structure analysis:

Conventional criteria versus new alternatives.

Structural Equation Modeling: A Multidisciplinary

Journal 6, 1: 1–55.

https://doi.org/10.1080/10705519909540118

22. Rex B. Kline. 2016. Principles and practice of

structural equation modeling. The Guilford Press, New

York.

23. Nicholas Kong, Marti A. Hearst, and Maneesh

Agrawala. 2014. Extracting references between text

and charts via crowdsourcing. In Proceedings of the

Page 6: User-adaptive Support for Processing Magazine Style ...dtoker/publications/IUI18... · personality traits, and learning abilities, can significantly influence user experience during

SIGCHI conference on Human Factors in Computing

Systems, 31–40.

https://doi.org/10.1145/2556288.2557241

24. Sébastien Lallé, Cristina Conati, and Giuseppe

Carenini. 2017. Impact of Individual Differences on

User Experience with a Visualization Interface for

Public Engagement. In Adjunct Publication of the 25th

Conference on User Modeling, Adaptation and

Personalization (UMAP ’17), 247–252.

https://doi.org/10.1145/3099023.3099055

25. Sébastien Lallé, Dereck Toker, Cristina Conati, and

Giuseppe Carenini. 2015. Prediction of Users’

Learning Curves for Adaptation while Using an

Information Visualization. In Proceedings of the 20th

International Conference on Intelligent User

Interfaces, 357–368.

https://doi.org/https://doi.org/10.1145/2678025.270137

6

26. Jason Lankow, Josh Ritchie, and Ross Crooks. 2012.

Infographics: the power of visual storytelling. John

Wiley & Sons, Inc, Hoboken, N.J.

27. Tomasz D. Loboda, Peter Brusilovsky, and Jöerg

Brunstein. 2011. Inferring word relevance from eye-

movements of readers. 175.

https://doi.org/10.1145/1943403.1943431

28. Robert H. Logie. 2009. Visuo-spatial working memory.

Psychology Press, Hove.

29. Richard E. Mayer. 2009. Multimedia learning.

Cambridge University Press, Cambridge ; New York.

30. Paul Meara. 1992. EFL vocabulary tests, second

edition 2010. Lognostics, Swansea: Wales.

31. Tamara Munzner. 2015. Visualization analysis and

design. CRC Press, Taylor & Francis Group, CRC

Press is an imprint of the Taylor & Francis Group, an

informa business, Boca Raton.

32. Kawa Nazemi, Reimond Retz, Jürgen Bernard, Jörn

Kohlhammer, and Dieter Fellner. 2013. Adaptive

Semantic Visualization for Bibliographic Entries. In

Advances in Visual Computing (Lecture Notes in

Computer Science), 13–24.

https://doi.org/10.1007/978-3-642-41939-3_2

33. Alvitta Ottley, Huahai Yang, and Remco Chang. 2015.

Personality as a Predictor of User Strategy: How Locus

of Control Affects Search Strategies on Tree

Visualizations. 3251–3254.

https://doi.org/10.1145/2702123.2702590

34. Yves Rosseel. 2012. lavaan: An R Package for

Structural Equation Modeling. Journal of Statistical

Software 48, 2. https://doi.org/10.18637/jss.v048.i02

35. E Segel and J Heer. 2010. Narrative Visualization:

Telling Stories with Data. IEEE Transactions on

Visualization and Computer Graphics 16, 6: 1139–

1148. https://doi.org/10.1109/TVCG.2010.179

36. Esther Strauss, Elisabeth M. S. Sherman, Otfried

Spreen, and Otfried Spreen. 2006. A compendium of

neuropsychological tests: administration, norms, and

commentary. Oxford University Press, Oxford ; New

York.

37. Dereck Toker and Cristina Conati. 2014. Eye tracking

to understand user differences in visualization

processing with highlighting interventions. In

Proceedings of the 22nd international conference on

User Modeling, Adaptation, and Personalization

(UMAP’14).

https://doi.org/https://doi.org/10.1007/978-3-319-

08786-3_19

38. Dereck Toker, Cristina Conati, Giuseppe Carenini, and

Mona Haraty. 2012. Towards adaptive information

visualization: on the influence of user characteristics.

In Proceedings of the 20th international conference on

User Modeling, Adaptation, and Personalization

(UMAP’12), 274–285. https://doi.org/10.1007/978-3-

642-31454-4_23

39. Dereck Toker, Sébastien Lallé, and Cristina Conati.

2017. Pupillometry and Head Distance to the Screen to

Predict Skill Acquisition During Information

Visualization Tasks. In In Proceedings of the 22nd

International Conference on Intelligent User

Interfaces, 221–231.

https://doi.org/10.1145/3025171.3025187

40. Marilyn L Turner and Randall W Engle. 1989. Is

working memory capacity task dependent? Journal of

Memory and Language 28, 2: 127–154.

https://doi.org/10.1016/0749-596X(89)90040-5

41. Maria C. Velez, Deborah Silver, and Marilyn

Tremaine. 2005. Understanding visualization through

spatial ability differences. In Proceedings of the IEEE

Conference on Visualization, 511–518.

https://doi.org/10.1109/VISUAL.2005.1532836

42. T. Franklin Waddell, Joshua R. Auriemma, and S.

Shyam Sundar. 2016. Make it Simple, or Force Users

to Read?: Paraphrased Design Improves

Comprehension of End User License Agreements. In

Proceedings of the SIGCHI Conference on Human

Factors in Computing Systems (CHI’16), 5252–5256.

https://doi.org/10.1145/2858036.2858149

43. Caroline Ziemkiewicz, R. Jordan Crouser, Ashley Rye

Yauilla, Sara L. Su, William Ribarsky, and Remeo

Chang. 2011. How locus of control influences

compatibility with visualization style. In Proceedings

of the IEEE Conference on Visual Analytics Science

and Technology, 81–90.

https://doi.org/10.1109/VAST.2011.6102445

44. 2008. Human Factors (HF); Guidelines on the

multimodality of icons, symbols and pictograms.

European Telecommunications Standards Institute.