piccolo a head start-university partnership funded by acyf grant # 90yf0050 parenting interactions...

PICCOLOPICCOLO

A Head Start-University Partnership

Funded by ACYF Grant # 90YF0050

Parenting Interactions with Children: Checklist of Observations Linked to Outcomes

EIRIEIRIEIRIEIRI


EIRIEIRIEIRIEIRI


Lori Roggman, Mark Innocenti, Gina Cook, Vonda Jump, & James Akers

Presented at Society for Research in Child DevelopmentBoston, MA

March 31, 2007

What is PICCOLO?An observational instrument we developed for practitioners working with parents of young children to measure positive parenting.

Psychometric data support PICCOLO as a measure that is:

– Easy to use– Reliable– Valid


EIRIEIRIEIRIEIRI


EIRIEIRIEIRIEIRI

Why Measure Parenting?

Development in the early years is linked to certain kinds of interactions with parents and caregivers (Bornstien & Tamis-LeMonda, 1989; Estrada et al., 1987; Harnish et al., 1995; Hart & Risley, 1995; Kelly et al., 1996; NICHD Early Child Care Research Network, 1999).

Programs such as Early Head Start often aim to increase parenting behaviors that support early development.


EIRIEIRIEIRIEIRI


EIRIEIRIEIRIEIRI

Why develop a new parenting measure?

• to identify parenting that predicts child outcomes

• to track positive parenting outcomes in programs.

• to develop a measure practitioners can use - easy to learn, easy to use- psychometrically sound- appropriate for diverse families


EIRIEIRIEIRIEIRI


EIRIEIRIEIRIEIRI

Why a parenting measure for diverse families?

• Most parenting measurement samples are:• European-Americans • Middle socio-economic status.

• Practitioners often work with parents of • Diverse ethnicity/culture • Lower socio-economic status


EIRIEIRIEIRIEIRI


EIRIEIRIEIRIEIRI

Challenges in developing a measure for diverse families


EIRIEIRIEIRIEIRI


EIRIEIRIEIRIEIRI

• Getting a diverse sample: The national EHS study archived videotapes of parent-child interaction in a diverse sample.

• Getting diverse raters: • Latino raters: Latino raters were recruited who were

fluent in both Spanish & English. • African-American raters: Intensive efforts were

required to recruit African-American raters at Utah State.

How did we develop PICCOLO?

Step 1. The Evidence Base

Research team reviewed literature on parenting.

Most studies point to one of 4 main kinds of parenting that supports early development.

Research team selected items to test for PICCOLO in 4 domains.


EIRIEIRIEIRIEIRI


EIRIEIRIEIRIEIRI


EIRIEIRIEIRIEIRI


EIRIEIRIEIRIEIRI

What are the 4 PICCOLO Domains?

Affection & Affect: Showing physical and verbal affection, warmth, positive emotional expressions, and positive statements.

Responsiveness: Reacting to child’s cues, emotions, words, andbehaviors, following child’s lead in play or conversation.

Encouragement: Providing active and non-intrusive support of exploration, effort, initiative, independence, and play.

Teaching: Providing cognitive stimulation, questions, explanations, and conversation; sharing pretend play.


EIRIEIRIEIRIEIRI


EIRIEIRIEIRIEIRI

PICCOLO v3.1 Affect/Affection

Expression of affection and positive emotions is sometimes called “warmth” and is related to

• less antisocial behavior• better adjustment• more compliance• greater cognitive ability• more school readiness

Research by Caspi, et al. (2004),Dodici et al. (2003), Estrada et al. (1987), MacDonald (1992), Petrill et al., (2004), and Sroufe et al. (1990).


EIRIEIRIEIRIEIRI


EIRIEIRIEIRIEIRI

PICCOLO v3.1 Responsiveness

Reacting sensitively to infant cues and expressions of needs or interests is related to

• more secure attachment• better cognitive & social development• better language development• fewer behavior problems• better emotion regulation & empathy

Research by Bornstein & Tamis-LeMonda (1989),Davidov & Grusec (2006), Landry et al. (2001), Spencer & Meadow-Orlans (1996), Tamis-LeMonda et al. (2001), Volker et al., (1999), and Wakschlag & Hans (1999).


EIRIEIRIEIRIEIRI


EIRIEIRIEIRIEIRI

PICCOLO v3.1 Encouragement of AutonomyProviding support for children’s self-

direction and not being too restrictive or intrusive is related to

• greater independence• less negativity• willingness to try challenging tasks• better cognitive & social development• better language development

Research by Frodi et al. (1985), Ispa et al. (2004), Hart & Risley (1995), Landry et al. (1997), and Kelly et al. (2000).


EIRIEIRIEIRIEIRI


EIRIEIRIEIRIEIRI

PICCOLO v3.1 Teaching/Talking

Talking with children about their world, responding to their communications, and playing together is related to

• better cognitive & social development• better language development• more conversation• more emergent literacy skills

Research by Baumwell et al., (1997), Carpenter et al., (1998), Hart & Risley (1995), Hockenberger et al. (1999), Laasko et al. (1999), and Tamis-LeMonda et al., (2001).

How did we test PICCOLO items? Step 2. New Observations

• ~ 4,500 video clips (Early Head Start Evaluation & Research Project)

• Parenting interactions, ages 14, 24, 36 months

• New observers rated items on video clips


EIRIEIRIEIRIEIRI


EIRIEIRIEIRIEIRI


EIRIEIRIEIRIEIRI


EIRIEIRIEIRIEIRI

What were the observations like?

3-bag task (from the national Early Head StartResearch and Evaluation Project):

• 10- min video-recorded observation

• Mother & child on blanket on floor at home

• 3 bagsbag #1 -- bookbag #2 -- pretend toys bag #3 -- other toys

• Parents told to play with child using toys in each bag, dividing time how they wished.

How did we test PICCOLO items?

Observers viewed clips independently got regular feedback on agreement gave regular feedback on items were initially matched for ethnicity


EIRIEIRIEIRIEIRI


EIRIEIRIEIRIEIRI

How did we select PICCOLO items?

Step 3. Item Selection

Used multiple criteria to reduce the number of items based on:

Reliability Validity Sensitivity Practicality


EIRIEIRIEIRIEIRI


EIRIEIRIEIRIEIRI

How many PICCOLO items?


EIRIEIRIEIRIEIRI


EIRIEIRIEIRIEIRI

200

87

4629

Pre-version version 1 version 2 version 3


EIRIEIRIEIRIEIRI


EIRIEIRIEIRIEIRI

PICCOLO v3.1 Affect/Affection

# Parent . . . 1 speaks in a warm tone of voice 2 smiles at child 3 praises child 4 is physically near the child 5 uses positive expressions with child 6 is engaged in interacting with child 7 shows emotional support toward child


EIRIEIRIEIRIEIRI


EIRIEIRIEIRIEIRI

PICCOLO v3.1 Responsiveness

# Parent . . . 1 is attentive to what child is doing 2 changes pace or activity to meet child's interests or needs 3 is flexible about child's changes of activities or interests 4 follows what child is trying to do 5 responds to child's emotional expression or affect 6 looks at child when child is talking or vocalizing 7 replies to child’s words or vocalizations


EIRIEIRIEIRIEIRI


EIRIEIRIEIRIEIRI

PICCOLO v3.1 Encouragement of Autonomy

# Parent . . . 1 waits for child's response after making suggestion 2 encourages child to handle toys 3 supports child’s choices or activity changes 4 supports child in doing things on his/her own 5 verbally encourages child's efforts 6 offers suggestions to help child 7 shows enthusiasm about what child is doing


EIRIEIRIEIRIEIRI


EIRIEIRIEIRIEIRI

PICCOLO v3.1 Teaching/Talking

# Parent . . . 1 explains reasons for something to child 2 suggests activities to extend what child is doing 3 repeats or expands child’s words or vocalizations 4 labels objects or actions for child 5 engages in pretend play with child 6 presents activities in a sequence of steps 7 talks to child about characteristics of objects 8 asks child for information

How reliable is PICCOLO?


EIRIEIRIEIRIEIRI


EIRIEIRIEIRIEIRI

Inter-rater agreement across all items > 70% overall reliability coefficient = .80 2 of 3 raters agree 91% of the time

Internal consistency across all domainsCronbach’s alpha = .73 - .81

Some variation across ethnic/culture groups.

PICCOLO Average Item Agreement by Ethnicity/Culture

0

0.5

1

AffectionResponsive Encouraging Teach/Talk

Euro-AmerLatinoAfrican-Amer

PICCOLO Scale Reliability by Ethnicity/Culture

0

0.5

1



Do PICCOLO Scores Differ by Ethnicity/Culture?

0

0.5

1

1.5

2



Does PICCOLO have construct validity?


EIRIEIRIEIRIEIRI


EIRIEIRIEIRIEIRI

Affection is correlated primarily with ratings of • Positive regard

Responsiveness is correlated primarily with ratings of • Sensitivity

Teaching is correlated primarily with ratings of • Cognitive stimulation

Encouragement is correlated primarily with ratings of • overall supportiveness (combined construct)


EIRIEIRIEIRIEIRI


EIRIEIRIEIRIEIRI

What child outcomes does PICCOLO predict?

Cognitive development • Bayley MDI at 36m • Woodcock Johnson at preK

Vocabulary• Peabody Picture Vocabulary Test at 36m • Peabody Picture Vocabulary Test at PreK

Social behavior • Bayley Behavior Rating Scales at 36m• Leiter Emotion Regulation at PreK

Parenting & Ethnicity/Culture Differences?


EIRIEIRIEIRIEIRI


EIRIEIRIEIRIEIRI

Sampling• Early Head Start sampling• Low-income, minority sampling

Observation Team• background

Parenting values & culture• do same behaviors mean the same thing?

Does PICCOLO have practical validity?


EIRIEIRIEIRIEIRI


EIRIEIRIEIRIEIRI

Practitioners say that PICCOLO helps them• see parenting behavior more distinctly

“I saw things I didn’t see before--I realized how little she actually speaks to her child”

• plan interventions “You see things you might want to work with the parent on the next visit.”

• work with parents“It’s useful for parents to do so they can look at their skills”

Measuring the High Notes

of Parenting Interactions

PICCOLOPICCOLO Parenting Interaction with Children

Checklist of Observations Linked to Outcomes

A Head Start-University Partnership

Funded by ACYF Grant #

90YF0050 Parenting Interactions with Children: Checklist of Observations Linked to Outcomes

EIRIEIRIEIRIEIRI


EIRIEIRIEIRIEIRI

Manual

PICCOLOTraining DVD

Support materials areavailable for PICCOLO

PICCOLO Researchers- Utah State UniversityLori Roggman [email protected]

Mark Innocenti [email protected] Cook

Vonda JumpJim Akers

Katie ChristiansenCora Price

Program PartnersBear River Head Start, Logan, UT

—Sara Thurgood, directorHead Start Parent Child Centers, Layton, UT

—Kathy Shaw Sartor, directorGuadalupe Schools Early Childhood Program, SLC, UT

— Patty Walker, director


EIRIEIRIEIRIEIRI


EIRIEIRIEIRIEIRI

mailto:[email protected]

mailto:[email protected]

Most of the parenting and child video clips and outcome data used for developing PICCOLO were from the Early Head Start Evaluation and Research Project, conducted in collaboration with the Administration for Youth and Families, Mathematica Policy Research, and local research partners at 17 sites. Research institutions in the Consortium (and principal researchers) include ACF (Rachel Chazan Cohen, Judith Jerald, Esther Kresh, Helen Raikes, Louisa Tarullo); Catholic University of America (Michaela Farber, Lynn Milgram Mayer, Harriet Liebow, Christine Sabatino, Nancy Taylor, Elizabeth Timberlake, Shavaun Wall); Columbia University (Lisa Berlin, Christy Brady-Smith, Jeanne Brooks-Gunn, Alison Sidle Fuligni); Harvard University (Catherine Ayoub, Barbara Alexander Pan, Catherine Snow); Iowa State University (Dee Draper, Gayle Luze, Susan McBride, Carla Peterson); Mathematica Policy Research (Kimberly Boller, Ellen Eliason Kisker, John M. Love, Diane Paulsell, Christine Ross, Peter Schochet, Cheri Vogel, Welmoet van Kammen); Medical University of South Carolina (Richard Faldowski, Gui-Young Hong, Susan Pickrel); Michigan State University (Hiram Fitzgerald, Tom Reischl, Rachel Schiffman); New York University (Mark Spellmann, Catherine Tamis-LeMonda); University of Arkansas (Robert Bradley, Mark Swanson, Leanne Whiteside-Mansell); University of California, Los Angeles (Carollee Howes, Claire Hamilton); University of Colorado Health Sciences Center (Robert Emde, Jon Korfmacher, JoAnn Robinson, Paul Spicer, Norman Watt); University of Kansas (Jane Atwater, Judith Carta, Jean Ann Summers); University of Missouri-Columbia (Mark Fine, Jean Ispa, Kathy Thornburg); University of Pittsburgh (Carol McAllister, Beth Green, Robert McCall); University of Washington School of Education (Eduardo Armijo, Joseph Stowitschek); University of Washington School of Nursing (Kathryn Barnard, Susan Spieker); and Utah State University (Lisa Boyce, Lori Roggman). Additional data are from studies conducted by members of the PICCOLO research team at Utah State University in the Department of Family, Consumer, and Human Development and at the Early Intervention Research Institute.Thousands of parents and children in the video clips used to develop the PICCOLO measure have provided a rich opportunity for us to learn more about parenting.

Acknowledgements

piccolo a head start-university partnership funded by acyf grant # 90yf0050 parenting interactions...

Documents

measure parenting

parenting behaviors

positive parenting outcomes

new parenting measure

diverse raters

diverse families

early development

measure practitioners