pose and pathosformel in aby warburg’s bilderatlas · pose and pathosformel in aby warburg’s...
TRANSCRIPT
![Page 1: Pose and Pathosformel in Aby Warburg’s Bilderatlas · Pose and Pathosformel in Aby Warburg’s Bilderatlas Leonardo Impett and Sabine Süsstrunk School of Computer and Communication](https://reader030.vdocuments.mx/reader030/viewer/2022020412/5aff6f997f8b9aa34d90696e/html5/thumbnails/1.jpg)
Pose and Pathosformelin Aby Warburg’s
Bilderatlas
Leonardo Impett and Sabine SüsstrunkSchool of Computer and Communication Sciences
Image & Visual Representation Lab EPFL
1
![Page 2: Pose and Pathosformel in Aby Warburg’s Bilderatlas · Pose and Pathosformel in Aby Warburg’s Bilderatlas Leonardo Impett and Sabine Süsstrunk School of Computer and Communication](https://reader030.vdocuments.mx/reader030/viewer/2022020412/5aff6f997f8b9aa34d90696e/html5/thumbnails/2.jpg)
I - Digital Art History
2
![Page 3: Pose and Pathosformel in Aby Warburg’s Bilderatlas · Pose and Pathosformel in Aby Warburg’s Bilderatlas Leonardo Impett and Sabine Süsstrunk School of Computer and Communication](https://reader030.vdocuments.mx/reader030/viewer/2022020412/5aff6f997f8b9aa34d90696e/html5/thumbnails/3.jpg)
Aby Warburg● 1866-1929● Worked on Bilderatlas from
1926● Kulturwissenschaftliche
Bibliothek Warburg● Memory of the Classical in
the Western world
Image: Kunstkritic.no
3
![Page 4: Pose and Pathosformel in Aby Warburg’s Bilderatlas · Pose and Pathosformel in Aby Warburg’s Bilderatlas Leonardo Impett and Sabine Süsstrunk School of Computer and Communication](https://reader030.vdocuments.mx/reader030/viewer/2022020412/5aff6f997f8b9aa34d90696e/html5/thumbnails/4.jpg)
Pathosformel
4
![Page 5: Pose and Pathosformel in Aby Warburg’s Bilderatlas · Pose and Pathosformel in Aby Warburg’s Bilderatlas Leonardo Impett and Sabine Süsstrunk School of Computer and Communication](https://reader030.vdocuments.mx/reader030/viewer/2022020412/5aff6f997f8b9aa34d90696e/html5/thumbnails/5.jpg)
Pathosformel
5
The expression of pathos; pathetic
emotions; passion
A repeatable formula
![Page 6: Pose and Pathosformel in Aby Warburg’s Bilderatlas · Pose and Pathosformel in Aby Warburg’s Bilderatlas Leonardo Impett and Sabine Süsstrunk School of Computer and Communication](https://reader030.vdocuments.mx/reader030/viewer/2022020412/5aff6f997f8b9aa34d90696e/html5/thumbnails/6.jpg)
6Detail of vase from Nola. Paris, Louvre
![Page 7: Pose and Pathosformel in Aby Warburg’s Bilderatlas · Pose and Pathosformel in Aby Warburg’s Bilderatlas Leonardo Impett and Sabine Süsstrunk School of Computer and Communication](https://reader030.vdocuments.mx/reader030/viewer/2022020412/5aff6f997f8b9aa34d90696e/html5/thumbnails/7.jpg)
7After vase from Chiusi, from Annali, 1871
![Page 8: Pose and Pathosformel in Aby Warburg’s Bilderatlas · Pose and Pathosformel in Aby Warburg’s Bilderatlas Leonardo Impett and Sabine Süsstrunk School of Computer and Communication](https://reader030.vdocuments.mx/reader030/viewer/2022020412/5aff6f997f8b9aa34d90696e/html5/thumbnails/8.jpg)
8Woodcut from Ovid, Metamorphoses, Venice 1497
![Page 9: Pose and Pathosformel in Aby Warburg’s Bilderatlas · Pose and Pathosformel in Aby Warburg’s Bilderatlas Leonardo Impett and Sabine Süsstrunk School of Computer and Communication](https://reader030.vdocuments.mx/reader030/viewer/2022020412/5aff6f997f8b9aa34d90696e/html5/thumbnails/9.jpg)
9
Northern Italian engraving, 1470-90, School of MantegnaHamburg, Kunsthalle
![Page 10: Pose and Pathosformel in Aby Warburg’s Bilderatlas · Pose and Pathosformel in Aby Warburg’s Bilderatlas Leonardo Impett and Sabine Süsstrunk School of Computer and Communication](https://reader030.vdocuments.mx/reader030/viewer/2022020412/5aff6f997f8b9aa34d90696e/html5/thumbnails/10.jpg)
10
Albrecht Dürer, Death of Orpheus, 1494Hamburg, Kunsthalle
![Page 11: Pose and Pathosformel in Aby Warburg’s Bilderatlas · Pose and Pathosformel in Aby Warburg’s Bilderatlas Leonardo Impett and Sabine Süsstrunk School of Computer and Communication](https://reader030.vdocuments.mx/reader030/viewer/2022020412/5aff6f997f8b9aa34d90696e/html5/thumbnails/11.jpg)
11
![Page 12: Pose and Pathosformel in Aby Warburg’s Bilderatlas · Pose and Pathosformel in Aby Warburg’s Bilderatlas Leonardo Impett and Sabine Süsstrunk School of Computer and Communication](https://reader030.vdocuments.mx/reader030/viewer/2022020412/5aff6f997f8b9aa34d90696e/html5/thumbnails/12.jpg)
Nachleben der AntikeThe afterlife of classical antiquity - resurgence and persistance
“In a number of ways, the Death of Orpheus serves to clarify this emotive, rhetorical current within the reawakening of antiquity…
[this method] lays bare certain phenomena, hitherto unnoticed, that cast a more general light on the circulation and exchange of expressive forms in art”
12
![Page 13: Pose and Pathosformel in Aby Warburg’s Bilderatlas · Pose and Pathosformel in Aby Warburg’s Bilderatlas Leonardo Impett and Sabine Süsstrunk School of Computer and Communication](https://reader030.vdocuments.mx/reader030/viewer/2022020412/5aff6f997f8b9aa34d90696e/html5/thumbnails/13.jpg)
Aby Warburg’s Bilderatlas
13
63 panels1230 paintings103-104 bodies?
![Page 14: Pose and Pathosformel in Aby Warburg’s Bilderatlas · Pose and Pathosformel in Aby Warburg’s Bilderatlas Leonardo Impett and Sabine Süsstrunk School of Computer and Communication](https://reader030.vdocuments.mx/reader030/viewer/2022020412/5aff6f997f8b9aa34d90696e/html5/thumbnails/14.jpg)
II - Operationalisatingthe Pathosformel
14
![Page 15: Pose and Pathosformel in Aby Warburg’s Bilderatlas · Pose and Pathosformel in Aby Warburg’s Bilderatlas Leonardo Impett and Sabine Süsstrunk School of Computer and Communication](https://reader030.vdocuments.mx/reader030/viewer/2022020412/5aff6f997f8b9aa34d90696e/html5/thumbnails/15.jpg)
Pathos?
15
Phobic impressions - Expressive values - Interior emotion -
Passionate experience - Pagan exaltation - Orgiastic
experience - Boundless unleashing - Expressive
manifestations - Phobias - Interior abandon - Murderous
drunkenness - Paroxystic fervour - Nouvelle gestuelle
pathetique
![Page 16: Pose and Pathosformel in Aby Warburg’s Bilderatlas · Pose and Pathosformel in Aby Warburg’s Bilderatlas Leonardo Impett and Sabine Süsstrunk School of Computer and Communication](https://reader030.vdocuments.mx/reader030/viewer/2022020412/5aff6f997f8b9aa34d90696e/html5/thumbnails/16.jpg)
OperationalisationThe conversion of pathos into pose. Operationalisation forces us:
● Remain conscious of what we lose - movement of hair, wind, limbs, hands● Look more closely but also more critically at the concept itself
First digital encoding of pose in an art database:
Da Silva, Nuno Pinho, et al. "Explaining scene composition using kinematic chains of humans: application to Portuguese tiles history." Computer Vision and Image Analysis of Art II, SPIE, 2011.
16
![Page 17: Pose and Pathosformel in Aby Warburg’s Bilderatlas · Pose and Pathosformel in Aby Warburg’s Bilderatlas Leonardo Impett and Sabine Süsstrunk School of Computer and Communication](https://reader030.vdocuments.mx/reader030/viewer/2022020412/5aff6f997f8b9aa34d90696e/html5/thumbnails/17.jpg)
Collecting a Dataset
● Bilderatlas is of art-historical interest but also an excellent training set for
computer-vision (stylistically heterogeneous)
● The scale of the problem:
○ 103-104 bodies in 1,200 images (and annotate each body thrice!)
● Which bodies to annotate?
● Crowdsourcing annotations
17
![Page 18: Pose and Pathosformel in Aby Warburg’s Bilderatlas · Pose and Pathosformel in Aby Warburg’s Bilderatlas Leonardo Impett and Sabine Süsstrunk School of Computer and Communication](https://reader030.vdocuments.mx/reader030/viewer/2022020412/5aff6f997f8b9aa34d90696e/html5/thumbnails/18.jpg)
Aby Warburg’s Bilderatlas
18
63 panels1230 paintings103-104 bodies?
![Page 19: Pose and Pathosformel in Aby Warburg’s Bilderatlas · Pose and Pathosformel in Aby Warburg’s Bilderatlas Leonardo Impett and Sabine Süsstrunk School of Computer and Communication](https://reader030.vdocuments.mx/reader030/viewer/2022020412/5aff6f997f8b9aa34d90696e/html5/thumbnails/19.jpg)
Aby Warburg’s Bilderatlas
19
63 panels21 panels
1230 paintings313 paintings
103-104 bodies?1,665 bodies
![Page 20: Pose and Pathosformel in Aby Warburg’s Bilderatlas · Pose and Pathosformel in Aby Warburg’s Bilderatlas Leonardo Impett and Sabine Süsstrunk School of Computer and Communication](https://reader030.vdocuments.mx/reader030/viewer/2022020412/5aff6f997f8b9aa34d90696e/html5/thumbnails/20.jpg)
20
![Page 21: Pose and Pathosformel in Aby Warburg’s Bilderatlas · Pose and Pathosformel in Aby Warburg’s Bilderatlas Leonardo Impett and Sabine Süsstrunk School of Computer and Communication](https://reader030.vdocuments.mx/reader030/viewer/2022020412/5aff6f997f8b9aa34d90696e/html5/thumbnails/21.jpg)
III - Analysis
21
![Page 22: Pose and Pathosformel in Aby Warburg’s Bilderatlas · Pose and Pathosformel in Aby Warburg’s Bilderatlas Leonardo Impett and Sabine Süsstrunk School of Computer and Communication](https://reader030.vdocuments.mx/reader030/viewer/2022020412/5aff6f997f8b9aa34d90696e/html5/thumbnails/22.jpg)
Normalising body poses
11-D angles22
Flip, rotate
Right hand higher, spine vertical
Normaliselengths of limbs
Convert vectors (limbs) to angles
24-D (x,y)-coordinates
![Page 23: Pose and Pathosformel in Aby Warburg’s Bilderatlas · Pose and Pathosformel in Aby Warburg’s Bilderatlas Leonardo Impett and Sabine Süsstrunk School of Computer and Communication](https://reader030.vdocuments.mx/reader030/viewer/2022020412/5aff6f997f8b9aa34d90696e/html5/thumbnails/23.jpg)
Two-stage Clustering
Morphological similarity is meaningless over large differences (but useful over small ones).
Two-stage clustering:
1. Rotational K-means: 1,665 poses into K stable clusters2. Rotational Hierarchical Clustering: phylogenetic tree of the morphological
structure within each cluster
23
![Page 24: Pose and Pathosformel in Aby Warburg’s Bilderatlas · Pose and Pathosformel in Aby Warburg’s Bilderatlas Leonardo Impett and Sabine Süsstrunk School of Computer and Communication](https://reader030.vdocuments.mx/reader030/viewer/2022020412/5aff6f997f8b9aa34d90696e/html5/thumbnails/24.jpg)
24
![Page 25: Pose and Pathosformel in Aby Warburg’s Bilderatlas · Pose and Pathosformel in Aby Warburg’s Bilderatlas Leonardo Impett and Sabine Süsstrunk School of Computer and Communication](https://reader030.vdocuments.mx/reader030/viewer/2022020412/5aff6f997f8b9aa34d90696e/html5/thumbnails/25.jpg)
25
![Page 26: Pose and Pathosformel in Aby Warburg’s Bilderatlas · Pose and Pathosformel in Aby Warburg’s Bilderatlas Leonardo Impett and Sabine Süsstrunk School of Computer and Communication](https://reader030.vdocuments.mx/reader030/viewer/2022020412/5aff6f997f8b9aa34d90696e/html5/thumbnails/26.jpg)
Identifying Pathosformeln
Pathosformeln identified in the literature:
Nymph / Perseus / Proserpina / Orpheus / Menead / Fortuna / Laocoön
26
![Page 27: Pose and Pathosformel in Aby Warburg’s Bilderatlas · Pose and Pathosformel in Aby Warburg’s Bilderatlas Leonardo Impett and Sabine Süsstrunk School of Computer and Communication](https://reader030.vdocuments.mx/reader030/viewer/2022020412/5aff6f997f8b9aa34d90696e/html5/thumbnails/27.jpg)
27
![Page 28: Pose and Pathosformel in Aby Warburg’s Bilderatlas · Pose and Pathosformel in Aby Warburg’s Bilderatlas Leonardo Impett and Sabine Süsstrunk School of Computer and Communication](https://reader030.vdocuments.mx/reader030/viewer/2022020412/5aff6f997f8b9aa34d90696e/html5/thumbnails/28.jpg)
28
![Page 29: Pose and Pathosformel in Aby Warburg’s Bilderatlas · Pose and Pathosformel in Aby Warburg’s Bilderatlas Leonardo Impett and Sabine Süsstrunk School of Computer and Communication](https://reader030.vdocuments.mx/reader030/viewer/2022020412/5aff6f997f8b9aa34d90696e/html5/thumbnails/29.jpg)
29
![Page 30: Pose and Pathosformel in Aby Warburg’s Bilderatlas · Pose and Pathosformel in Aby Warburg’s Bilderatlas Leonardo Impett and Sabine Süsstrunk School of Computer and Communication](https://reader030.vdocuments.mx/reader030/viewer/2022020412/5aff6f997f8b9aa34d90696e/html5/thumbnails/30.jpg)
30
![Page 31: Pose and Pathosformel in Aby Warburg’s Bilderatlas · Pose and Pathosformel in Aby Warburg’s Bilderatlas Leonardo Impett and Sabine Süsstrunk School of Computer and Communication](https://reader030.vdocuments.mx/reader030/viewer/2022020412/5aff6f997f8b9aa34d90696e/html5/thumbnails/31.jpg)
Identifying Pathosformeln
Pathosformeln identified in the literature:
Nymph / Perseus / Pentheus / Proserpina / Orpheus / Menead / Fortuna / Laocoön
31
Clustered almost exclusively together.
Strong morphological similarity between different formulae for the representation of (different) emotions.
![Page 32: Pose and Pathosformel in Aby Warburg’s Bilderatlas · Pose and Pathosformel in Aby Warburg’s Bilderatlas Leonardo Impett and Sabine Süsstrunk School of Computer and Communication](https://reader030.vdocuments.mx/reader030/viewer/2022020412/5aff6f997f8b9aa34d90696e/html5/thumbnails/32.jpg)
Nachleben der Antike
The Rebirth of Classical Antiquity: different clusters have different classical membership (20-50%).
Our strongest (preliminary) results: the exiled Nymph has (almost) no antique presence.
32
![Page 33: Pose and Pathosformel in Aby Warburg’s Bilderatlas · Pose and Pathosformel in Aby Warburg’s Bilderatlas Leonardo Impett and Sabine Süsstrunk School of Computer and Communication](https://reader030.vdocuments.mx/reader030/viewer/2022020412/5aff6f997f8b9aa34d90696e/html5/thumbnails/33.jpg)
ConclusionsOur operationalisation gives us surprising results even with a small dataset:
● Evidence to support the existence of Pathsoformeln and their renewal from
antiquity.
● Pathosformeln can be characterised by body-pose: they’re all similar in
pose-space
● The figure of the Nymph has no classical referent in the Bilderatlas
● Limitations on the reduction itself; the principle of Antithesis, and motion.
33
![Page 34: Pose and Pathosformel in Aby Warburg’s Bilderatlas · Pose and Pathosformel in Aby Warburg’s Bilderatlas Leonardo Impett and Sabine Süsstrunk School of Computer and Communication](https://reader030.vdocuments.mx/reader030/viewer/2022020412/5aff6f997f8b9aa34d90696e/html5/thumbnails/34.jpg)
Current and Future Work● Full annotation of the Bilderatlas to take place in the next ~6 months
(public data release). Large-scale pose dataset for computer-vision in
paintings.
● From ‘% Antique’ to Nachleben
● 3D pose estimation and encoding - bodies in motion
● Automatic recognition of pose in paintings
● Automatic identification of Pathosformeln
34
![Page 35: Pose and Pathosformel in Aby Warburg’s Bilderatlas · Pose and Pathosformel in Aby Warburg’s Bilderatlas Leonardo Impett and Sabine Süsstrunk School of Computer and Communication](https://reader030.vdocuments.mx/reader030/viewer/2022020412/5aff6f997f8b9aa34d90696e/html5/thumbnails/35.jpg)
Questions
35
Leonardo Impett, Sabine Sü[email protected]
ivrl.epfl.ch
With thanks to:Franco Moretti, EPFL
José Emilio Burucùa, Nantes Institute for Advanced StudyJohn Robb & Robin Osborne, University of Cambridge
Isabella di Lenardo, EPFL
![Page 36: Pose and Pathosformel in Aby Warburg’s Bilderatlas · Pose and Pathosformel in Aby Warburg’s Bilderatlas Leonardo Impett and Sabine Süsstrunk School of Computer and Communication](https://reader030.vdocuments.mx/reader030/viewer/2022020412/5aff6f997f8b9aa34d90696e/html5/thumbnails/36.jpg)
Two-stage annotation
36
1: Separate bodies
2: Annotate poses
![Page 37: Pose and Pathosformel in Aby Warburg’s Bilderatlas · Pose and Pathosformel in Aby Warburg’s Bilderatlas Leonardo Impett and Sabine Süsstrunk School of Computer and Communication](https://reader030.vdocuments.mx/reader030/viewer/2022020412/5aff6f997f8b9aa34d90696e/html5/thumbnails/37.jpg)
37
10 Samples (Gaussian) Ideal-type
InsignificantSignificant
![Page 38: Pose and Pathosformel in Aby Warburg’s Bilderatlas · Pose and Pathosformel in Aby Warburg’s Bilderatlas Leonardo Impett and Sabine Süsstrunk School of Computer and Communication](https://reader030.vdocuments.mx/reader030/viewer/2022020412/5aff6f997f8b9aa34d90696e/html5/thumbnails/38.jpg)
Two-stage Clustering
38