spectra - australian network for art and technology · spectra: images and data in art/science...

180
SPECTRA SPECTRA IMAGES AND DATA IN ART/SCIENCE The currency of images in the studio and the laboratory Edited by Mary Rosengren and Cris Kennedy IMAGES AND DATA IN ART/SCIENCE The currency of images in the studio and the laboratory Edited by Mary Rosengren and Cris Kennedy

Upload: phamthien

Post on 24-Jan-2019

216 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: SPECTRA - Australian Network for Art and Technology · SPECTRA: images and data in art/science Proceedings from the symposium SPECTRA 2012 The book and the conference that begat it,

S P EC T R AS P EC T R A

IMAGES AND DATA IN ART/SCIENCEThe currency of images in the studio and the laboratory

Edited by Mary Rosengren and Cris Kennedy

IMAGES AND DATA IN ART/SCIENCEThe currency of images in the studio and the laboratory

Edited by Mary Rosengren and Cris Kennedy

Page 2: SPECTRA - Australian Network for Art and Technology · SPECTRA: images and data in art/science Proceedings from the symposium SPECTRA 2012 The book and the conference that begat it,

SPECTRA: images and data in art/scienceProceedings from the symposium SPECTRA 2012

Published by: Australian Network for Art and Technology (ANAT) Lv 2 142 North Tce Adelaide SA 5000 www.anat.org.au

Copyright Copyrightofthisoverallpublicationrestswiththepublishers ANAT.Individualchaptersarewrittenandcopyrightisheldby therespectiveauthors.Photographsarereprintedhereby permission.

Citation: Kennedy,C.&Rosengren,M.(eds)2014;SPECTRA: images and data in art/science. Proceedings from the symposium SPECTRA 2012.AustralianNetworkforArtandTechnology(ANAT), Adelaide,SA.

ISBN: 978-1-4863-0290-1 (ONLINE)

Printedby: Trendsetting

Date: March 2014

Cover image: SPECTRA (2011) Mary Rosengren. Digital image.

Page 3: SPECTRA - Australian Network for Art and Technology · SPECTRA: images and data in art/science Proceedings from the symposium SPECTRA 2012 The book and the conference that begat it,

SPECTRA: images and data in art/scienceProceedings from the symposium SPECTRA 2012

Thebookandtheconferencethatbegatit,SPECTRA2012,originatedintheANATSynapseresidencyartistMaryRosengrenenjoyedamongsttheNationalCollectionsCSIROmanageshere on Black Mountain in Canberra.

AmongourCollectionitemsarethematerialsgatheredbyJosephBanksandDanielSolanderon the Endeavour voyage. I am struck with a sense of pride and awe whenever I am able to accessandshowofftheseitemstovisitorstoourorganization.Theseobjectsarepricelessnationaltreasures.YetdailyinthecorridorsofourlaboratoriesIwalkpasthundredsofimagesonpostersandscreensproducedbyourcontemporaryresearchers.Specifically,whatcurrencydotheyhave,andwhowillcuratethemandproudlyshowthemoffintwocenturiestime?Generally,canweplaceaculturalvalueandhowdoweassessandinterprettheartisticnatureofscientificdataandimagery?

Weareallconsciousoftheincreasingsignificanceoftechnologyinshapingallculturalpractices.Changecreatestension,ofcourse,andweareseeingbothalliancesandtensionsbetweenspecialistfieldsofartsciencepracticesandknowledge.Thesearebothcreativefields,and the barriers that have separated them are coming down.

WhileMaryRosengren,throughherANATSynapseresidency,beganhertimeamongtheCSIROCollectionsthinkingabouthowtheseideascouldinfluenceherpractice,shefounditwasthedialoguewithresearchersandacademicsthatwasmorefascinating,andmorethanwefeltshouldbeconstrainedtotheoutputofjustoneartist.

ThefocusoftheresultingSPECTRAprogramwaslessaboutscience-artasaspectacle,morehowcontemporaryvisualisingtechnologiesandtechniquesforanalysis,datamanagementandimaginghaveradicallychangedthenatureofartandsciencepracticesandthestatusofimagesinbothfields.

Theartistsandscientistswhosethoughtsinthisareaarechronicledwithinthesepagesdemonstrateadefiningculturalforceandwearebothgratefulforandinspiredbytheirideas.

We’renotsurewe’veansweredanyofourquestionsbutwe’reenjoyingtheconversation.

Cris Kennedy and Mary RosengrenMarch 2014

Dedicated to the memory of Scottish engineer/designer and mountaineer Hugh McNicholl 1945-2012

Page 4: SPECTRA - Australian Network for Art and Technology · SPECTRA: images and data in art/science Proceedings from the symposium SPECTRA 2012 The book and the conference that begat it,

Contents

Introduction by Vicki Sowry 6

Vision’s evolutionary history by Andrew Parker 8

The Intersection of Art and Neuroscience: The Case of Visual Awareness byBarbaraMariaStafford 18

True Stories-seeing and believing: the spectra of images and data in the digital aesthetic by Mary Rosengren 21

Colliding lightby Chris Henschke 32

GROW: an investigation of 4D Micro-CTby Erica Seccombe 38

Speculative Objects: Visual Arts and Science Fiction Futures byLizzieMuller 46

Learning through drawing in art and science byJamesMcArdleandRussellTytler 56

Technology, Illustration and Scienceby Andrew Howells 64

Consciousness, quantum mechanics and the Metaphase Typewriter revival projectby Lynden Stone 71

Geology, art and imagination: creative propositions for visual representation and cultural narrativesbySuzetteWordenandPerditaPhillips 78

Imaging the Seasons: Objects and the Almanac FormbyJoLaw 88

The Anonymous Photographers of Animal EcologybyDustinWelbourne 96

Page 5: SPECTRA - Australian Network for Art and Technology · SPECTRA: images and data in art/science Proceedings from the symposium SPECTRA 2012 The book and the conference that begat it,

Learning Science in School through Constructing Representationsby Vaughn Prain and Russell Tytler 104

The Montage: a working space for interdisciplinary discourseby Victoria Cooper 110

TWITCH: translating microscopic fast motion to a musical composition by Roger Alsop 123

A Feeling for the Image: Hands, Body and Visualisation of the Invisibleby Ian Gibbins 129

Dancing up a Storm: Interactions Between a Dancer and the Surrounding Fluid MediumbyJohnYoung,HaraldKleineandLizLea 135

StellrScopeby Eleanor Gates-Stuart 139

Oneby Rebecca Cunningham 146

Innovation synapses: transgressive movements in working with knowledgeby Lorraine White-Hancock 151

References and endnotes 161

About the authors and author acknowledgements 174

Page 6: SPECTRA - Australian Network for Art and Technology · SPECTRA: images and data in art/science Proceedings from the symposium SPECTRA 2012 The book and the conference that begat it,

Introduction

If we knew what it was we were doing, it would not be called research, would it?Albert Einstein

Imagine,ifyouwill,achoreographiclanguagederivedfromdatareceivedfromtheMagellanicClouds–andthenperformedtoreal-timedataoutput.Orasuiteofmusicalcompositionscreated and performed for cochlear implant wearers. Or biofeedback-driven artworks that help children undergoing painful medical procedures to learn self-calming techniques. Perhaps the writtenwordismoreyourthing…whatmighthappenwhentwowritersleavebehindtherealworldtospendaweekinasleepresearchcentretotesttheimpactofdiurnaldisruptionandconstantsurveillanceontheircreativeoutput?Theseandmanyotherscenarioshavebeenrealised over the past 15 years through the support of the Australian Network for Art and Technology (ANAT) in partnership with the Australia Council for the Arts and a host of academic,governmentandprivatesectorpartners.

Sowhydowedothis?Becausewebelievethatcollaborationsbetweentheartsandscienceshavethepotentialtocreatenewknowledge,ideasandprocesses,becauseartistsandscientistsapproachcreativity,explorationandresearchindifferentwaysandfromdifferentperspectives.Bringingthemtogethercanleadtonewexperiencesandinterpretationsoftheworld,nowandinto the future.

Weliveinaneraofincreasinglycomplexproblems,challengeddailybyissuesthatcanonlybenefitfrommultifacetedandmultidisciplinaryapproaches.Byencouragingbreachesbetweenthesilosoftheartsandsciences,wehopetoencourageotherdisciplinestoseethebenefitsofcollaboratingacrossandbetweenknowledgesystemsinordertofindnewsolutionsandnewways of doing things.

Speculativeresearchallowsartistsandscientiststofollowtheirnoses,totraverseunchartedpathsinthepursuitoftheunknown.Sometimestheyfindusefulthings,sometimestheyfindbeauty,sometimestheyfindthemselvesinentirelynewplaces,sometimestheyfindnothingatall.Thejourneybackandforthbetweendisciplinesisparamount–itopenseyesandears,heartsandmindstothepossibleandtonewwaysofapproachingthosethingsthat,fornow,remain impossible.

Vicki SowryDirectorAustralianNetworkforArt&Technology

Opposite: BrightHearts app (iOS), heart rate controlled interactive artwork, 2011-2014, George Khut and Sensorium Health Pty Ltd

6 SPECTRA: Images and Data in Art/Science .

Page 7: SPECTRA - Australian Network for Art and Technology · SPECTRA: images and data in art/science Proceedings from the symposium SPECTRA 2012 The book and the conference that begat it,

6 SPECTRA: Images and Data in Art/Science .

Page 8: SPECTRA - Australian Network for Art and Technology · SPECTRA: images and data in art/science Proceedings from the symposium SPECTRA 2012 The book and the conference that begat it,

ThefirstopticaldevicesinanimalsevolvedintheCambrianperiod.Thefirstcolouredreflectorknowndatesfromaround508millionyearsago(Ma);thefirsteyeswithlenses evolved at around 521 Ma. Considerationoftheintroductionofvisionleads to a hypothesis for the cause of evolution’sBigBang–theCambrianexplosion.Suddenly,andfornoobviousreason,therangeandvarietyoflife-formserupted somewhere around 520 million years ago.AtnoothertimeinEarth’shistoryhastherebeensuchaprofusion,suchanexuber-ance,andsuchanoverwhelmingdiversityinsoshortatime,withinaroundonemillionyears.PriortothisCambrianexplosionevent,allanimalsweresoft-bodiedandmainlyworm-like,astheyhadbeenformillionsofyears before that. But during the Cambrian explosionmanyofthemajoranimalgroupson Earth today independently evolved their hardbodypartsforthefirsttime.Followingtheappearanceofthefirsttrilobites,someanimalsevolvedshellsandspines,somewithbrightcolours,tovisuallywarnoftheirnew armour. Others evolved streamlined appearances and swimming oars to advise trilobites that they could not be caught. The LightSwitchTheoryprovidesanexplana-tionforwhattriggeredthisevent–thatitwastheevolutionofvision(intrilobites);theintroductionoflightasauniversalstimulusfor animal behaviour. Once visual capability arose,itallowedpredatorstoidentifyprey,triggeringanarmsrace.Fromhereon,visionbecameadominantforceofevolutionandresulted in the eyes and colours we have in naturetoday.Aconsiderationofwherevisionandcolourfirstbegancouldproveinterestingtotheartist.

Optical devices in living animals

Therangeofopticaldevicesintheformofreflectors(causing“structuralcolour”)and

8 SPECTRA: Images and Data in Art/Science .

Vision’s Evolutionary History

Andrew ParkerDepartmentofLifeSciences,NaturalHistoryMuseum,LondonSW75BD,UK

antireflectorsfoundinnaturewasrevealedin2006 [1],althoughthefunctionsthatcoveredthesehadbeensummarizedin2000[2]. Since then,thebiomimeticmanufactureandapplicationsforreflectingopticshasbeendemonstrated through the study of living cells thatmakereflectors[3].

Multilayerreflectors,diffractiongratings,liquidcrystalsandstructuresthatscatterlighthave been found in animals with a diversity of designs.Forexample,diffractiongratingsinostracods (seed shrimps) produce iridescence thatfunctionsasacourtshipdisplay[4] (Fig. 1).Morerecently,followingtheidentifica-tionofphotonicbandgapsinphysics,naturalphotoniccrystalshavebeenidentifiedwitharangeofarchitectures,includingtheopalandinverse opal structures [5].

Eyes,ontheotherhand,havelongattractedsignificantattention.Eyespossessarangeoflenses,includingthecompoundeyesofinsectsandthegraded-refractive-indexlensesoffishes[6].Thelatterpreventssphericalaberrationbyfocusingbeamsenteringdifferentregionsofthelensontothesamefocalplane–theretina.Someeyescontaincomplexopticalmechanisms,suchasinthemirror-boxlensesandparabolicreflectorsofsomecrustaceaneyes,andthetelephotolenscomponentinajumpingspidereye[6]. A more recent discovery in eyes is the micro-lens array of the bristle star [7, 8] – closely packed,tinyconvexlensesmadeofcalcite.The bristle star lens is not part of a completevisualsystem;ratheralightsensorthatdeterminesthepreciselightconditionsinitsenvironment.Itisinterestingthattheonlyotheranimalgrouptopossesscalciticlenseswasalsothefirsttopossessafully-focusingeye – that of the trilobites. This will be consideredfurtherinthisarticle.First,however,itisimportanttounderstandtherangeofanimalsthatpossessopticaldevices,

Page 9: SPECTRA - Australian Network for Art and Technology · SPECTRA: images and data in art/science Proceedings from the symposium SPECTRA 2012 The book and the conference that begat it,

and indeed the diversity of animals per se.

The animal phyla

Animalsaremulticelledorganismsthatcanbedividedintoabout37“phyla”(groupsatthefirstlevelofclassification),basedontheirbodyplansorinternalbodyorganization[8a].Theexternalformofananimalhasnorelationshipwithitsbodyplan,andthisisimportantwhenconsideringtheevolutionofthe phyla. This point is well-illustrated in the environment where one can encounter the broadest range of living phyla – the coral reef.

Thevastdiversityofmulti-celledanimallifeforms today quickly becomes apparent in the shallow waters of Australia’s Great Barrier Reef.Theantlers,domes,fans,brainsandpipesofcoralsusuallyarefirsttomanifest.

Polyps,eachonlyafewmillimetresacross,arethelivingpartsofcorals,whichstretchouttheirtentaclestofeedatnight,appearinglike small anemones or even upside-down jellyfish.Regardlessoftheirexternalappearanceandlife-styles,corals,anemonesandjellyfishactuallybelongtothesamephylum – Cnidaria – because they share the same internal body plan. That is they have the samenumberandtypeoftissuelayers,whichare organised in the same way.

The coral skeleton of the reef is decked outwithgardensofsponges,anotheranimalphylum that matches the corals in their diversity of shapes and colours. The sponges provideshelterwithintheirwater-filledpassageways for animals belonging to further phyla. These lodgers include the bristle worms (polychaetes) – a common group of animals that make up the annelid phylum with earthworms and leeches. Some display shimmering opalescent or iridescent colours,likethebizarre-lookingseamouseAphrodita,whosesetaeandspinesarephotoniccrystalfibres[10].

Seagooseberriesorcombjellieslookliketransparentvariantsoftheirfruitnamesakes,flashingwitheightiridescentbands(againduetophotoniccrystalfibres,[11]). These alien-likeblobsofjellyhaveaninternalbodyplan like no other group of animals and so belong to a phylum of their own – the ctenophores.Starfisharenotonlyobviousduring the day but some glow at night with theirbioluminescence.Starfisharerelatedtocommonseaurchinsandbristlestars,belonging to the same phylum called Echindermata.Giantclamsdisplayfluorescentblues,greensandpurples.Theybelongtothemollusc phylum along with another animal rather more infamous for its colour – the blue-ringedoctopus.“Worms”areubiquitous

Fig. 1. (A) Scanning electron micrograph of the diffraction grating on a single halophore of the cypridinid ostracod Azygocypridina lowryi (above, ridge spacing = 600nm). (B) Frame from a video recording of a mating pair of the cypridinid ostracod Skogsbergia sp. The male is above and has released its iridescent hairs (arrowed) from within its shell, and consequently iridescence is displayed to the female (below).

Page 10: SPECTRA - Australian Network for Art and Technology · SPECTRA: images and data in art/science Proceedings from the symposium SPECTRA 2012 The book and the conference that begat it,

were formed underwater hundreds of millions of years ago by sediment in the sea settlingoutontothebottom,forminganewseafloor.Followingcompactiontheywereforced up from below the water and into the air,turninganancientenvironmentupside-down.Butinadditiontopreservingthesedimentsofanancienttime,theRockyMountains entomb another part of ancient history – the biological one. Any organisms thatdiedon,orfelltotheseafloorwouldhavebecomecoveredbythenextlayerofsedimentandpotentiallypreservedasfossils.Butsometimesaparticularlyheavylayering of the sediment itself can be the causeofdeathforananimal,intheformofalive burial.

TheBurgessfaunaandflorawereorganismsthat lived around 508 Ma in a well-lit marine reef,atadepthof70metresorless.OnedayintheCambrian,anabruptinflowofveryfinemudsweptacrossthearea,buryingthelocalreefincludingtheBurgessfaunaandflora.Theywerepreservedinallsortsofpositions.Today the Burgess organisms are found fossilised,albeitflattened,inblocksofCanadian rock formed from the compression ofthatoriginal,fatefulmud.TheyserveasasnapshotofacommunityoflifethatexistedintheCambrian,inthiscasearound508Ma.

TheCambrianisarelativelybriefperiodinthehistoryoftheEarth,yetoutstandinginthehistoryofanimallife.Lastingfrom542to488Ma,itwasaperiodofmonumentalbioticchange.TheBurgessShalefaunaexhibitsa

Fig. 2. An example of animals from the Burgess Shale – a scene of life on a reef environment 507-508 Ma.

10 SPECTRA: Images and Data in Art/Science .

andincludeaplethoraofphyla,suchasthe“ribbons”,“peanuts”,“arrows”andflatworms,some with colours that can shock. Many of thesecolours,however,relyonchemicalpigments(includingfluorescentpigments)[12].

Although very few insects are found in the sea,theircrustaceanrelativesfromthearthropodphylumareoftenattheirmostspectacularontheGreatBarrierReef,andincludethecrabs,lobsters,shrimpsandostracods. Another phylum that is best known for its terrestrial members is the Chordata. This name may sound familiar because it is thegroupcontainingamphibians,reptiles,birdsandmammals,includinghumans.Butthefishesofthereef,alongwithsomelesser-knownanimalssuchasseasquirts,alsobelong to this phylum and were once its only members.

The Great Barrier Reef informs us that animal phyla today have both unique internal organisationsandadiversityofexternalshapes.Butdidtheinternalorganisationsandfirstexternalshapesevolvesimultaneously foreachphylum?Andwhendidtheyevolve?Now the spotlight falls on the Cambrian period in life’s history.

The Cambrian and exceptionally preserved bioatas

As the Earth’s plates moved around through-outgeologicaltime,andslowlycrashedintoeachother,somethingshadtogive.Therocks that now form the Canadian Rocky Mountainsareoneexample.Originally,they

Page 11: SPECTRA - Australian Network for Art and Technology · SPECTRA: images and data in art/science Proceedings from the symposium SPECTRA 2012 The book and the conference that begat it,

Fig. 3. Two versions of the history of animal phyla. From the first, soft-bodied form, evolutionary branching is equivalent in both models. (A) indicates that both internal body plans and external parts diversified throughout this branching, and most theories on the cause of the Cambrian explosion have been based on this model. (B) is the correct model and properly identifies the Cambrian explosion – that it was the simultaneous evolution of external forms in all phyla. These external hard parts became suitable substrates to evolve optical devices.

Page 12: SPECTRA - Australian Network for Art and Technology · SPECTRA: images and data in art/science Proceedings from the symposium SPECTRA 2012 The book and the conference that begat it,

Fig. 4. Burgess Shale stem-group polychaete Canadia spinosa. Micrograph (x4,000) showing the surface of a palea (hair) as removed from the rock matrix, revealing the remnants of a diffraction grating with a ridge spacing of 900nm. Colour picture shows a reconstruction of the animals appearance 515 Ma.

12 SPECTRA: Images and Data in Art/Science .

rangeofexternalshapescomparablewiththerange found in animals today (e.g. Fig. 2),andgenerally we believe that the Burgess Shale animals belonged within today’s 37 phyla [13]. Becauseanimalswithsucharangeofexternalshapes do not appear in the fossil record prior totheCambrian,theideaofa‘Cambrianexplosion’wasconceived(seebelow).TheBurgessShale,however,isMiddleCambrian.FurtherresolutionoftheCambrianperiodisrequired.

TheChengjiangfossils,fromthehillsandlakesofYunnanProvince,southwestChina,haveemergedtoscientificallyrivalthoseoftheBurgessShale.Sincethefirstspecimenwithsoftpartspreservedwasuncoveredin1984,theyhavebeenfoundtobepreservedequallywell,andtorevealeventhefineneedle-like spines of some animals [14]. They also match the Burgess Shale fauna for diversity,andsoprovideanotherexcellentsnapshotoflifeintheCambrian.Thistime,however,thefossilsaredatedataround519Ma [15, 16].

FurtherCambrianfossilassemblagesinvolvingbothsoftandhardparts,allcontaining phyla already known from ChengjiangandtheBurgessShale,havealsobeenfoundinotherlocalities,suchasSiriusPassatinGreenland,datedataround519Ma[15, 16].These,however,cannotmatchthefossilsofChengjiangandtheBurgessShalefor their diversity and snapshots of Cambrian community life.

The Cambrian explosion

TheCambrianexplosion,orBigBanginanimalevolution,wasthemostdramaticevent in the history of life on Earth. During thisblinkofaneyeinsuchhistory,mostphylafoundtodayevolvedtheirfirsthardpartsanddistinctshapesatthesametime.Inotherwords,itistheeventwhereanimalssuddenlytookonverydifferentappearances,intheformtheyexisttoday.Theeventitself,however,occupiedonlyasmallpartoftheCambrianperiod,ataround520Ma.Priortothis,therewereonlythreeanimalphylawiththetypeofexternalshapestheystillpossesstoday.Yetinageologicalinstantlatertherewere at least several more – and perhaps most – of the phyla known today [17].

SotheCambrianexplosionisallaboutexternalbodypartsonly.Thispointisillustrated in Fig. 3.Twoevolutionarytreesarefigured,eachrepresentingaversionofthehistoryofanimalphyla(“phyla”).Thereisamajordifferencebetweenthesetwomodels,whichgreatlyaffectstheinterpreta-tionoftheCambrianexplosion.Fromthefirstworm-likeform,thebranchingprocessisthesame in both models. But the upper model indicates that both internal body plans and externalpartsdiversifiedthroughoutthisbranching process. Nearly all theories on the causeoftheCambrianexplosionarebuiltonthis upper model.

Based on external forms and not internal bodyplans,thetreeofanimallife,whereevolutionarytimeincreaseswithheightofthetree,shouldtaketheformofapalmtree.Not a great deal happens as we travel up the trunkuntilsuddenly,atonepointtheentire mainbranches,representingthephyla,fork

Page 13: SPECTRA - Australian Network for Art and Technology · SPECTRA: images and data in art/science Proceedings from the symposium SPECTRA 2012 The book and the conference that begat it,

Fig. 5. Eyes in the Middle Cambrian period, around 508 Ma. The head of Waptia fieldensis, a shrimp-like arthropod a few centimetres long, showing well developed, stalked compound eyes

12 SPECTRA: Images and Data in Art/Science .

off.ThispointrepresentstheCambrianexplosion.Butwhatcausedtheevolutionarytrunktobranch?

Previousexplanationsputforward [16, 17],suchasanincreaseinoxygenandadecreaseincarbondioxidelevels,ortheevolutionofHoxgenes,havebeenfraughtbyamajorredherring–thewrongdefinitionoftheCambri-anexplosionitself.Originally,itwasthoughtthattheCambrianexplosionwastheevent

where all phyla (i.e. internal body plans) evolved – the top model in Fig. 3.Now,basedon molecular evidence [18],weknowthatthephylaevolvedearlierintraditionalbranchingmanner,andonlytheirhardpartsevolvedin a single event – the lower model in Fig. 3.Otherexplanations,suchastheSnowballEarththeory,sufferfromtimingproblems;inthis case the last Snowball Earth event had finishedatleast32millionyearsbeforetheCambrian period.

Page 14: SPECTRA - Australian Network for Art and Technology · SPECTRA: images and data in art/science Proceedings from the symposium SPECTRA 2012 The book and the conference that begat it,

Someofthebestpreservedopticaldevicesinthefossilrecordarethecalcitic(calciumcarbonate)lensesoftrilobites,distantrelativesofspidersandshrimps(becomingextinct280Ma).Severalspeciesoftrilobites,such as Cambropallas sp. (Fig. 6),suddenlyappearinthefossilrecordatabout521Ma,fromMorocco,SiberiaandWesternNorthUSA.Thesepossessedhard,externalparts.Also,theyallpossesscompoundeyes,althougheyelesstrilobitesdidevolveafterthese [22].

Thecalciticlensesoftrilobites,beingminerals,havepreservedwell.Thereweretwo types of compound eyes in trilobites – holochroal (Fig. 7)andschizochroal[22]. Schizochroaleyeswerelarge,yetcontainedrelativelyfewfacets.Indeed,eachfacetcouldbeupto1millimetreindiameter,adimension not even approached in today’s compound eyes. A boundary region separated eachfacetfromitsneighbours,andthelenseswere either elongated prisms or came in two partsthatlockedtogether,oneabovetheother. This later lens type has an intralensar bowl design (Fig. 8) that enables lightincidentfromobjectsatdifferentdistances to be focused at the same focal plane. This design is similar to that suggested for lenses by Huygens and Descartes in the seventeenth century.

Thefirsttrilobites,however,possessedholochroal type eyes (Fig. 7). Here the lenses weresmallandsimple–thinandbiconvex– and numerous. They were close-packed in squareorhexagonalarrays.Unfortunately,the lenses alone do not provide a complete understanding of holochroal eyes. An additionalfocusingelementisneededtoformanimage,butthismayhavebeenmadeofsoftmaterialthatdidnotpreserve.Similarly,theretinasoftrilobiteeyeshavenotpreserved,althoughinschizochroaleyeswecanreconstructtheseatthepositionofthecalculated focal plane of the many lenses that make up a single compound eye.

Nonetheless,theexcellentpreservationofholochroal eyes in many trilobites (e.g. Fig. 7),andtheirpositionontheheadregionwhere

14 SPECTRA: Images and Data in Art/Science .

The earliest optical devices

Opticaldevicesarephysicalstructures,andassuchcanpotentiallypreserveasfossils,justthesameasthebonesofreptilesandmammalsmayfossilize.Opticalreflectors,however,containsub-microncomponents,andconsequentlypreservationconditionsforfossilizationmustbeexceptional[19]. They needtobeburiedbysedimentrapidly,beforebacteriabreakdowntheanimalbodies,andpreferablypreservedinafine-grainedsediment. A review has been made of opticaldevicesfoundinthefossilrecordthroughtime[20].Usuallytheoriginalmaterialis replaced with a mineral and the animal is fossilized,butsometimestheoriginalmaterialispreserved.Inthispaper,however,weareconcerned only with the earliest of these fossilreflectors–thoseoftheCambrianperiod.

On the broken surfaces of three Burgess Shale speciesexistremnantsofdiffractiongratings(Fig. 4 a) [21]. This means that these species would have appeared highly coloured when they lived around 508 Ma (Fig. 4 b). To make doublysure,theoriginalsurfacesofthesefossilswerereconstructed,usingholographictechniquesonphotoresist,intheirentirety,based on the topography of the remnants that had preserved. The reconstructed surfaces were placed in seawater under sunlight,andthecoloursofthreeBurgessShale species shone spectacularly as they once did some 508 Ma.

Butwhydidtheseanimalsreflectcolour?Atthispoint,studiesofanimalcolourandtheCambrianexplosionbegintocrosspaths.TheobviousanswertothisquestionisthatCambriananimalspossessedefficient,colouredreflectorstobevisuallyadapted;thatis,eyesexistedintheCambrian.Certainly,awholediversityofBurgessShaleandChengjiangandotherCambrianspeciesexistedwithwell-developedeyes(e.g. Fig. 5). Animals living at around 520 Ma interacted using light as they do today. But how far back canwetakethisscenario?Theansweristo521 Ma only.

Page 15: SPECTRA - Australian Network for Art and Technology · SPECTRA: images and data in art/science Proceedings from the symposium SPECTRA 2012 The book and the conference that begat it,

Fig. 7. Micrograph of a holochroal trilobite eye.

14 SPECTRA: Images and Data in Art/Science .

Fig. 6. Eyes in the Lower Cambrian period, around 521 Ma. A Cambropallas trilobite fossil from Morocco, frontal view. Eyes are protruding from the head shield (left eye is casting a shadow) – this was one of the first animals on Earth with eyes.

wewouldexpecttofindeyes(e.g. Fig. 6),suggest that these animals possessed vision. Manyhadalsoevolvedswimmingcapabilitiesandstrong,graspinglimbsandmouthparts:theywerehighlymobile,armouredpredators–infact,thefirsthighlymobilepredators,withvisualsearchcapabilities.

The “light switch theory”

ThecolourandCambrianexplosionpath-crossingoriginatedwhilecontemplatingtheimplicationsofancientcolours.Naturalhistorymuseumsdisplayanarrayofcolours,exhibitedbybirdsandinsectsforexample.Also demonstrated are the variety and incidenceofeyes,andphysicaladaptationstoadiversityoflife-styles.Theinformationgained here can be combined with that from thefossilcollections.Thentheworkingsoftoday’s ecosystems can be applied to ancient environments.

Page 16: SPECTRA - Australian Network for Art and Technology · SPECTRA: images and data in art/science Proceedings from the symposium SPECTRA 2012 The book and the conference that begat it,

or producing sounds was enough to avoid a potentialpredator,unlessitwasbumpedinto.ButlaterintheLowerCambrian,lifewaslitup.Thelightswitchwasturnedon,forthefirstandonlytime–ithasbeenleftoneversince.Withoureyesopenweseethesize,shapeandcolourofanimals,butwealsoseetheirbehaviour–wecanjudgehowfasttheycan move and whether we can catch them.

Allofthesequalitiesofanimalssuddenlymatteredatabout521Ma.Atthatverypointallanimalshadtobecomeadaptedtolight,orrathervision.Unlikesoundsandsmells,ananimalwillalwaysbeleavingapotentialimage in its environment because of the sun’s rays,andtheracetoproduceadaptedimagesbegan at about 521 Ma. The worm-like forms had to display armoured parts or chemical defences,withcomplimentarywarningcolours,camouflageshapesandcolours,orsignsofswimmingcapabilitiestoout-manoeuvre a pursuing enemy. On the other hand they could opt out of the visual environ-ment and evolve bodies capable of burying into rock crevices or other substrates. All oftheseadaptationscreatedanewtypeofevolutionaryarmsrace.Butaftertheinitialchaos,furtheradaptationswouldbecome

16 SPECTRA: Images and Data in Art/Science .

Eyes,andprobablypredators,evolvedfortheveryfirsttimearound521Ma.Thesefactsarerecordedinthefossilrecord,buttheimportantpointisthesignificancegiventothem.Nowthe‘LightSwitchTheory’canbegintounfold.Simply,thetheoryholdsthattheinitialintroductionofvisiontothebehavioural system of animals caused the Cambrianexplosion.Visionwasintroducedwiththeevolutionoftheveryfirsteye,capableofproducingvisualimages,whichtook place around 521 Ma. The visual picture ofanimalsthatlivedjustbeforethistime,asseenbythemostsophisticatedlightreceptorsofthetime,wasthatofablurred“blue”field.However,thesamepictureimagedataround521Ma,againasitwouldhavebeenviewedbyaninhabitantwiththemostsophisticatedlightreceptorsofthetime,wouldhaverevealedalltheanimalssurroundingit.Unlikethereceptorsofothersenses,theeyewouldhavesuddenlyleaptinefficiencythroughoutitsevolutionasalensevolvedwithintheorgan [23] (Fig. 9).

Thedifferencebetweenthesetwoperceivedimages is comparable to our view when we closeandopenoureyesrespectively.Withour eyes closed we can determine the directionofsunlightbutwecannotfindafriendorfoodinafield,forexample.So,usinglight,animalsbeforeabout521Macould have known which way was up in the watercolumn,buttheycouldnothavefoundafriendorfoe.However,intheirfavour,apotentialpredatorcouldnothavefoundthemeither.Hencetherewerenostrongselectionpressures for Early Cambrian or Precambrian animalstobecomeadaptedtolight,whichwastobecomethemostpowerfulstimulusof all. In fact light became the most powerful stimulusofallalmostovernightonthegeologicaltimescale,withtheevolutionofthefirsteyeabout521Ma.

Withoureyesopen,suddenlyweseetheworldcompletelydifferently.Wecanseefoodfromsomedistance,althoughwecanonlysmellitifitproducesasmell,hearitifit produces a sound and touch it if we are very close. So in the Precambrian and earli-estCambrian,notreleasingcertainchemicals

Fig. 8. The intralensar bowl design in the lenses of some trilobites; light rays striking all regions of the lens, from all distances, are focused in the same plane. An identically shaped lens of homogeneous calcite is shown for comparison.

Page 17: SPECTRA - Australian Network for Art and Technology · SPECTRA: images and data in art/science Proceedings from the symposium SPECTRA 2012 The book and the conference that begat it,

colour,bodyshapesandbehavioursfoundinnature today. The Light Switch Theory describes how this all began. It could be usefulbackgroundinformationfortheartist.Artistsmayalsoconsiderthehardwiringofthefirsteyes,whichmayhavebecomefixedinplaceandcouldholdtheexplanationforwhy certain colours combine well or not (possiblythosecommonlyfoundjuxtaposedinnature,suchasthesunnexttothesky,becameselectionpressuresforeyeevolution).

“AsIseeit…apredator(atrilobite)evolvedforthefirsttimeaworkingvisualsystem,andwas so successful that the other organisms hadtoevolvehardpartstosurvive,whichproducedtheso-calledCambrianexplosion,”wrotethelateFrancisCrick,theco-discovererofthestructureofDNA,afterreadingofthetheory.“Yourargumentsseemveryplausibletome,”hecontinued,inaletterfrom2003.“Iwouldhavethoughtthatdetailedgenetic(sequence)studiesshouldsettlethematter.”Butthen,hewouldsaythat.

16 SPECTRA: Images and Data in Art/Science .

gradual–evolutionwouldhavesettleddownto its habitual pace.

Thepicturepaintedabovereflectswhatprobably happened during the course of Cambrianevolution.Thechaoswas the Cambrianexplosion.Theevolutionofadiversityofexternalshapesfromsoft-bodiedwormsexplainswhythefirstfossilswithhardparts – those capable of leaving fossils – appear in Lower Cambrian rocks. Hence the evolutionoftheeye,andactivepredators,canexplainwhyallgroupsofanimalssuddenly changed their appearance in the Lower Cambrian.

Vision remains

SincetheCambrian,visionhasbeenparamounttolife.Today,over95percentofallmulticelledanimalspossesseyes.Walkintoafieldfullofanimalsandveryfewcanbeseen:lifeisadaptedtosight,notjustthesimplelightreceptorsthatexistedbeforetheCambrian,whichcouldnotformanimage.Adaptationstovisionincludethearrayof

Fig. 9. The very approximate evolution of receptors of different sense systems throughout geological time. Vision is the only sense that was introduced rapidly in the history of life. Based on evidence discussed in [17].

Page 18: SPECTRA - Australian Network for Art and Technology · SPECTRA: images and data in art/science Proceedings from the symposium SPECTRA 2012 The book and the conference that begat it,

The Intersection of Art and Neuroscience : The Case of Visual Awareness

BarbaraMariaStafford

My book Echo Objects. The Cognitive Work of Images [2007] and The Field Guide to a New Metafield [2011]-- both published by the UniversityofChicagoPress,proposefundamentalorenduring,ifyoulike,issuesthatequallypreoccupythehumanitiesandtheneurosciences,andwhichrequirebothdisciplinary sides to resolve: moral “grammars”ofexpression;compressivespatialsystems;themimeticimpulse;theroleoftheemotionsinperception, imagination,memory;representationversusmentalrepresentation;andwilledseeing.

Bothvolumesareanoutgrowthofthisefforttofindprecisewaysofbringingneurobiology,cognitivescience,andthenewphilosophyofmind together with cultural phenomena withoutfallingintoreductivismoneitherside.Inthislecture,Itackleacomparativelyunderstudiedandrelativelyunder-researchedarea in the contemporary neurosciences—an area where the imaging side of the humanitieshasmuchtocontribute—istheimportanceofselectiveattention.Whataretheinducementsforattendingcarefullytotheworld?

While researching Echo Objects,Ibecameincreasinglyawareoftheintensescientificfocus (as well as media focus) on the brain asprimarilyaself-organizing,largelyinward-directedautopoieticsystemrecursivelypreoccupiedwithitsownfunctions.Tobesure,GeraldEdelmanandotherneuralDarwinistsandneuralconstructivistsaswellascognitivescientists,suchasAndyClark,whofallonthesideofdistributedcognition,emphasizetheimportanceofreentry, plasticity,andthedynamicsofconnection-making.Nevertheless,itisnotablethatfromtheearlywritingsofFranciscoVarelaandHumberto Maturana to the current publicationsofDouglasHofstadter,what

tendstogetemphasizedarethewaysinwhichthebrain’sactivityisintrinsicallyinphasewiththingsgoingonintheexternalworld largely without our being conscious of it.

As I argue in the concluding chapter of Echo Objects(“ImpossibleWill?”),thereare enormous social consequences (especially whencoupledtothenewrealityof“tailored” medicineandthe“chemicalbrain”)ofthisalmostfatalistic“trappedinillusion” position.(Consider,forexample,whatItermtheextremephenomenologyofThomasMetzingerwhoisnotaloneinholdingthisthesis.)Inthisessay,Iamthusinterested,first,inanalyzingthewaysthatdifferentartformats variously engage and make viewers awareofthefactthatourbrainactivityisbothunpreventablyisomorphic,orinphasewith things going on inside of us and in the outside world and simultaneously capable ofbreakingthatunreflectivealignment.Inshort,Iexploretheintersectionofartandneuroscience at one of its key nodes: attention,attentiveness,self-awareness.

Right above: Iridescent Peacock feathers Right below: Molecular cuisine

18 SPECTRA: Images and Data in Art/Science .

Page 19: SPECTRA - Australian Network for Art and Technology · SPECTRA: images and data in art/science Proceedings from the symposium SPECTRA 2012 The book and the conference that begat it,
Page 20: SPECTRA - Australian Network for Art and Technology · SPECTRA: images and data in art/science Proceedings from the symposium SPECTRA 2012 The book and the conference that begat it,

Right: Damian Ortega Mano (Barbara Maria Stafford) Used by permission of the artist.

Left: Kai and Sunny by Barbara Maria Stafford. Used by per-mission of the artist.

Page 21: SPECTRA - Australian Network for Art and Technology · SPECTRA: images and data in art/science Proceedings from the symposium SPECTRA 2012 The book and the conference that begat it,

True Stories-seeing and believing: the spectra of images and data in the digital aesthetic. Mary RosengrenLaTrobeArtInstitute,LaTrobeUniversity,Victoria,Australia

The Australian Network for Art and Technology (ANAT) Synapse 6 residency in 2011withCommonwealthScientificandIndustrialResearchOrganisation(CSIRO)gave me the opportunity to research CSIRO BiologicalCollections [1] and to work with Cris Kennedy,DirectorofCSIRODiscoveryCentreto develop the art/science symposium SPECTRA 2012.

Thecurrentarrayofart/scienceconferences,publicationsandinstitutional/academicdiscussion on interdisciplinarity is the contextforSPECTRA2012.SPECTRA’sscrutinyoftheart/sciencerelationshipanditsthemeof images and data responds to concerns of bothorganisations(ANATandCSIRO)andthespread of imaging technologies in their areas ofspecialistpractices.Thefocusonimagesanddataalsoextendsmyownareaofvisualart research [2] located in-between art and science,wherehistoricalandcontemporaryapplicationsofoptical,printandcomputa-tionaltechnologiesfortheproductionanduseofimageshaveimplicationsforcontemporaryvisualartpractice(s).

Dialogues about interdisciplinarity [3] raise numerous philosophical and epistemological questionsaboutaestheticsandvisualculture,reflectingwhatWJTMitchell[4] in PictureTheory(1995)referstoas“anxietiesaboutthevisual”and“ashifttowardsthepictorialturn”.Theinterplaybetweenrespectivepracticesthatencompassmethod-ologiesofhypothesising/imagining,collecting/displaying,describing/representing,collaborative/singularinitiatives,observation/immersion,aswellascorrelationsbetweensites(thestudio/laboratory) and spaces of display (gallery/museum);notionsof(visual)accuracyandveracity;experimentation,creationandinvention;demonstrationandspectacle;

educationandentertainment—allindicatethescopeofpossibilitiesandthinkingaboutoverlays of technologies and interdisciplin-arity.

Consideringthere-orientationtowardsacontemporarydigitizedvisualculturethearthistorianandtheoristBarbaraMariaStaffordstressed that:

”We need [therefore] to get beyond the artificial dichotomy presently entrenched in our society between higher cognitive function and supposedly merely physical manufacture of “pretty pictures”. In the integrated (not just interdisciplinary) research of the future, the traditional fields studying the develop-ments and techniques of representation will have to merge with the ongoing inquiry into visualization. In light of the present electronic upheaval, the historical understanding of images must form part of a continuum looking at the production, function, and meaning of every kind of design.”

Barbara Maria Stafford (1997). Artful Science:Enlightenment Entertainment and the Eclipse of

Visual Education. (xxv).

As the power and pervasive presence of digitizedvisualcultureisapprehendedStafford’scallforan“integrated(notjustinterdisciplinary)researchofthefuture”,auguries the rupture and challenge to specialist discipline boundaries is both complexandparadoxical.Thesignificanceofprintandopticsinthehistoryofideas,knowledge and across three centuries of westernscienceisextensivelydocumented.Although the study of Natural History and botany across the seventeenth and nineteenth centuries [5] was characterised by theendeavoursofindividualartist-scientistsandcollaborations,thelensandprintingpressfacilitatedthecommunicationofvisually

Page 22: SPECTRA - Australian Network for Art and Technology · SPECTRA: images and data in art/science Proceedings from the symposium SPECTRA 2012 The book and the conference that begat it,

accurateimagery,whereinsomeinstancesthe image (in the herbarium) could even stand for the real thing. These technologies werecriticalforthedevelopmentofauniversalgraphiclanguageforrepresentingbotanicalsubjectsbyartistandscientists.In Figure 01a-b,JDHooker’s1844Flora Antarctica, WalterHoodFitchincludesthemicroscopic detail of Sphagnum within the table of other whole specimens.

Inpost-naturalhistory,wheremid-nineteenthandtwentiethcenturymicroscopyandbiological science are embedded in the age ofmechanicalreproduction,representingphenomena that occur beyond the visible spectrumnotonlycomplicatesthenotionofvisualaccuracy,itchangestherole,purposeand value of images it produces. In a digital environment such as remote sensing and spectroscopy,techniquesforgathering,processingandpresentingdata(andproducingtheubiquitious“prettypicture”[6]) issimultaneouslyseamlessandauthoritative.Itissignificanttoidentifythisdigitalaestheticand understand ways in which raw data is manipulated,imageandcontextconflate,andmeaning and value is constructed through the extensionofinterchangeableinter/disciplinaryspecialistpractices.

While Michael Lynch (213) contemplates that theideathat“theartist’s(slightof)handembodies all the low disreputable features of thesubjectiveidolsaBaconianscienceaimstoabolish”,healsoacknowledgesthat“the‘low’artofmanualrepresentationcanalsobetransformedintothe‘high’scienceofconceptualunderstanding”.

Fornaturalhistoryartist-scientistsandmuchofpostnaturalhistory,calibratingcolourbetween specimens and images in pigments withpaintorinkwas(andstillremains)problematic.Colourbeingcharacteristicallyfickle,inconsistentandunstableresultedinblack and white images being regarded as morereliableandauthorativeforshowingavisuallyaccurateaccountofasubject’sformand structure.

Wellbeyondthevisiblespectrum,thevisualizationsofdatapresenttheparadoxical

Figure 01a. Walter Hood Fitch Plate LVII. Lithograph from J.D. Hooker, The Botany of the Antarctic Voyage (Flora Antarctica). London, Reeve Brothers, 1844.

Figure 01b (inset). Walter Hood Fitch, Detail of Plate LVII. Fig. VI., Sphagnum, lithograph, from J.D. Hooker, The Botany of the Antarctic Voyage (Flora Antarctica). London, Reeve Brothers, 1844.

natureoftheadigitalaestheticthatnotonlychallengesthegraphicconventionsofusingcolourinscientificimageryithighlightsthecomplete revision of the way images are now regardedandfunctioninscienceandothercontexts.

Colour

“We often assume that mechanical reproduction provides a direct transfer from nature to image, untouched by human hands and uncontaminated by preconceived ideas”

Michael Lynch, Science in the Age of Mechanical Reproduction

Although the challenge of accurately representingandreproducingnaturalisticcolour for sevententh and nineteenth centuryartistslikeMariaSibyllaMerianandFerdinandBauerwassignificant,colourwasnot the concern for showing the structure ofthecellinillustrationsbyRobertHookeinMicrographia 1665 or even in the 1920’s cell diagram of Edmund Beecher Wilson (1856-1939).Thelatter’scellstructuresweredeline-atedinblackandwhite,andarangeoftoneandtexturedefinedthecell’sstructuresandforms with clarity. Colour in the recent twen-tiethandtwenty-firstcenturyvisualizationsofmicroscopicphenomenaisasignificantdeparturefromthenaturalistic“truecolour”[7] ofthevisiblespectrumexperiencedbythehuman eye and replicated as accurately as possiblebyartistsinthebotanicaltreatise.

The use of colour in observing and imaging the microscopic dimension has a range of aestheticandempiricalaspects.Colourisintroducedtospecimenstorevealdifferentcharacteristicsanditisappliedtoimagesinorder to represent these. Some light micro-scope images have natural colour and can appeargreen,othersmaypresentaspink-redwhere colour stain is introduced to the

22 SPECTRA: Images and Data in Art/Science .

Page 23: SPECTRA - Australian Network for Art and Technology · SPECTRA: images and data in art/science Proceedings from the symposium SPECTRA 2012 The book and the conference that begat it,

22 SPECTRA: Images and Data in Art/Science .

Page 24: SPECTRA - Australian Network for Art and Technology · SPECTRA: images and data in art/science Proceedings from the symposium SPECTRA 2012 The book and the conference that begat it,

specimen and it reacts with chemicals (such as lignin molecules). Transmission electron micrographs and scanning electron micrographsarecharacteristicallyblackandwhite showing the electron density of the specimen,andstainsareintroducedtothespecimentohighlight,emphasiseanddefineparticularchemicalsandshowthestructureand form of the cells [8] as in the Scanning Electron Micrograph images that may even resemble highly coloured corals in an underwater vista.

Inconfocalandfluorescencemicroscopyshown in Figure 1a-d (the microscope) is reading,collectingandinterpretingthe(colourof)wavelengthbands,andvisualiza-tionsoftheseareartificiallymodifiedandcolouredbythemicroscopiststodefinestructuresandfunctionsofsubstancesbeingrepresented. Colour is determined and applied by illustrators and animators in developingdigitalandanaloguevisualiza-tions,asinDavidGoodsell’sdrawingsandDrewBerry’srecentanimationsofprocessessuch as DNA unravelling (Figure 2a-c) and Apoptosis 2007.

Thecomplexpurposesofcolourindicatedhere show it can be an empirical and aesthetictoolaswellasaninherentlysubjectiveperception.Asgreaterinsightisachievedsotooits“truefalse”ambiguityreinforcestheparadoxicalnatureofcellimages.Ironically,toproducetheblackandwhite images of cell structures the specimen maybestainedtodefineanddifferentiatethedensityandpropertiesofthespecificparts(such as the nucleus cell wall). [9]

“Thesectionwasreactedwithacriflavine,followingoxidationinperiodicacid,tostaincarbohydrates yellow (e.g. in the cell walls andstarchgrains),andsubsequentimmersionin another yellowish reagent– iodine in potassium iodide–gave a generally stained preparation,bestexaminedusingbluelight.”

Gunning’sprecisedescriptionofthetech-niqueusedtostainthesection(ofcells)toenhancevisualizationinthe1970s(ofacolourless specimen for using in phase contrastmicroscopy),indicateshowcolour

Figure 1(a-d) Confocal microscope monitor images of image specimen Ceratodon purpureus, Confocal microscope Andrew Netherwood Faculty of Biological Science UOW, 2003Confocal microscopy allows for spatial optical sectioning a viewing through layers (rather than physical sectioning which destroys the specimen), allows for processes and functions such occurring within the living cell to be observed. In this example chlorophyll florescence of chloroplasts indicates levels of photosynthesis.

hasacentralroleincreatinganimagethatdifferentiatestone,defines,andhighlightsfeatures of the cells selected by the microscopist. The specimen (and the resultingimage)hasbeenmanipulatedsimilarly to the way in which Wilson in 1925 [10] and Tagawa 1960 [11] emphasised and selectedfeaturesintheirdiagramaticblackand white images of cells.

In common with the EM SEM and TEM images discussed so far - colour is integral to the (monitor) image produced with the confocalmicroscope.Unliketheprocessesofspecimenpreparation:staining,fixing,andembeddingthat(usually)killcells,theconfocal microscope allows for a live specimen to be observed. Readings and measurements of the live specimen show functionsandprocessoccurringwithinthelivingcell.Inthisexample,pigment[12] in particularareasofthespecimenrespondtothe concentrated beam of the laser. [12] The artist-scientist,technician–microscopistisabletoselectspecificareaswithinthespecimenandseethe(cellular)processes,inthisexamplechlorophyllflorescenceofchloroplasts indicates levels of photosynthesis in moss. [14]

In this instance (Figure 1) the images made by AndrewNetherwoodatUniversityofWollongong NSW are evidence of plant health and cell damage. Their value is their relationshipandcontexttowiderresearchwheretheseindicatorscanbeexaminedfurther,usingothertypesoflaboratorytechniques or matched with data collected infieldwork.Theyareaworkingdocumentand tool similar to Robert K. Greville’s 1824 herbarium specimen sheets with their coloured sketches (Figure 3). However these techniques and their images are a radical departurefromthegraphicconventionsthat

24 SPECTRA: Images and Data in Art/Science .

Page 25: SPECTRA - Australian Network for Art and Technology · SPECTRA: images and data in art/science Proceedings from the symposium SPECTRA 2012 The book and the conference that begat it,

24 SPECTRA: Images and Data in Art/Science .

Page 26: SPECTRA - Australian Network for Art and Technology · SPECTRA: images and data in art/science Proceedings from the symposium SPECTRA 2012 The book and the conference that begat it,

Grevilleemployed.MultipleimagesrepresentingtemporalprocessesattheselevelsofresolutionandmagnificationrecallsLynch’s statement of the impossibility and ironyofsomeimages,“In many cases there is no way to compare a representation of a biological phenomenon to the “real” thing, since the thing becomes coherently visible only as a function of the representational work.”

AnneCleary’srecent“researchworkandvisualizations”[15],aswellaselucidatingLynch’sstatement,reiteratestherelationshipofimageswithinthewiderresearchcontext.Her technique of confocal laser scanning microscopy“issignificantforunderstandingcelldivision”.Thevalueofthesequenceofvideoframesfor(cell)researchexemplifiesthecapacityofimagesasmultiplestorepre-sent temporal phenomenon —a technical practicebeyondthescopeofprecedingimaging technology.

Veracity and value of images

“any phenomena which are difficult toconceive in term of any visual image” Crump

Theproliferationofempiricalinformationandobservationaldataproducedbycurrentscientificresearchincreasinglyencodesinthe visual what cannot be presented by other means.Similarly,ourexperienceofitisencodedtoo,presentingasanaturallydigitizedenvironment,ofsimulations,virtualreality,andvirtualtruth.IninterviewingthebiologistandanimatorDrewBerry,Placequoteshis(Berry’s)descriptionoftheparametersthatcharacterizeinvisibledomains“Alotofmolecularactionshappenataspeedscalethatismeaninglesstous”.Thechallengeofcreating,decipheringandinterpretingtheimagesofnaturemediatedtothisleveliscomplex:andwhenartistsandscientistsbegintocontendwiththephenomena of Crump’s post-modern science and combine it with digital imaging tools they arereinterpretingnatureaswellasthenatureofrepresentation.Digitaltechniquesofferavisual empiricism to science through microscopyandspectroscopy,butincontemporaryvisualartpracticethis

veracitycanbeexchangedforverisimilitude.The former is undermined by the tools of imagemanipulationwithitsrelative [16]ease,speed,andaccesstothecomputationaltoolsoftransforming,combiningandseamlesslyaltering material.

InhissystematicstudyofthewayimagesareunderstoodandusedWilliamJ.Mitchellreconsidersphotographictruthinthecontextof new technologies. Photographic manipulationhasalwaysbeenpossiblebutasMitchellstates“extensivereworkingofa photographic image to produce seamless transformationsandcombinationsistechnicallydifficult,timeconsuming,andoutside the mainstream of photographic practice”.

The plethora of images and the ease and speedoftheirproductionisenhancedbydigitalcomputation.Whenthisiscoupledwiththeirveracityasvisualizationsofdata,they are at odds with the readings of nature andthesignificanceofimagesinearliercon-texts.Suchasthesingulardefinitiveicontype-specimen sheet in the herbarium that stands for the real thing [17].Asthe“empiricism”ofvisualizationsofdataonthescaleofnano-technology increases and takes form in virtual worlds,thespectral,spatialanddynamiccharacteristicsarereinterpreted.Simultane-ously,thecredibilityoftheiraestheticandgraphicalpropertiesisalteredanddiminishedintermsoftheconventionsestablishedbyearlierartist-scientists.Whiletheirimagesmayhavebeenlessuniform,reliable,oraccuratethandatabasedvisualizationstheywere generally comprehensible and identifiabletoanon-specialist.

Artist-scientistssuchastheanimator-cellbiologist Drew Berry (b.1970- ) and painter-crystallographer David Goodsell construct visualizationsandfabricatevisualaccountsof phenomenon. Goodsell interprets the gap between (data of) molecular forms of X-ray crystallography and cellular organelle forms ofelectronmicroscopy(Flannery),toproduceworks“ofimaginationgroundedinquantit-ativeanalysisofspecificmoleculesandcelltypes”.

26 SPECTRA: Images and Data in Art/Science .

Page 27: SPECTRA - Australian Network for Art and Technology · SPECTRA: images and data in art/science Proceedings from the symposium SPECTRA 2012 The book and the conference that begat it,

Figure 2(a-c).Drew Berry Digital Animation Stills DNA sequence unravelling. Drew Berry CD WEHI, CD-ROM 2006. Digital animation Stills from Quick Time Movies Chromosome _Coil.mov; DNA_CU.mov; DNA_mov; from Drew Berry WEHI 2006

Conflatingtheempiricalandaesthetic,theseartistsemployarangeofmeansandmedia,what Elkins refers to as “the variety of pictorial means: from photographs to computer graphics to hand-drawn pictures, from geometric abstraction to organic approximations, from scales to perspectival views to projections, [from shaded pictures to wire-frame schemata].”

Goodsellcombinestraditionalandcontem-porarymethods–“Somearecreatedwithcomputers,using3-Dgraphicprograms.Butmanyotherscomeabout…withwatercolorandbrush.Theideaistosynthesizeaviewof something not accessible by any other means.Computergraphics,illustrationandartisticinterpretationprovideawindowintothistinyworld.”;Berrycites“computers,Hollywoodand3Dglasses”ashistools.

WhenFenlynotesthat,“NomicroscopeonearthcanseewhatGoodsellcreates”itisareminderofElkin’ssuggestionthatthesetypesofimagesreconnect“withthewaysthatpictures(ofwesternarthistory?)areusedtotryandseewhatcanneverbeseen”.Berry’scomments(abouthisanimations)align with this too when he makes the followingstatement:“Themolecularworldissosmall,itcan’tbeseen.I’mpaintingpicturesofwhattheworldislikedownthere.”

ExplainingthecentralroleofvisualizationinhisscientificworkGoodselldescribesthatitiscriticalforhimto“see”theshape,structureandcomponentsofthevirus.“It’scompletelyvisual. It’s modelling the 3-D structure of the drugtothe3-Dstructureofthevirus,thengrapplingwiththeessentialcomponents”.Ofhisanimationsforbody code 2003 at the Australian Centre for the Moving Image Berry statesthat“thebiggestbio-moleculesareresolvedasstaticblurryshapes,withscien-tistsrelyingonothertechniquestodeterminehowtheyinteract…Drawinguponthisfragmentaryevidencefromallfieldsofbiomedicalresearch,myquestistoholisticallyconstructthemostaccurateandinsightfulvisualizationsofcellularandmo-lecularworldsthathaveeverbeenproduced,withclarityanddetailneverbeforeseen.”[18]

26 SPECTRA: Images and Data in Art/Science .

Page 28: SPECTRA - Australian Network for Art and Technology · SPECTRA: images and data in art/science Proceedings from the symposium SPECTRA 2012 The book and the conference that begat it,

The clarity and detail Berry seeks are what naturalhistoryartistscientistssuchasMerianand Bauer of the seventeenth and nineteenth centuries wanted: and notwithstanding the centuriesbetweenthemandBerry,someaestheticnotionspersist.

Thestaticdiagrammaticqualityoftheearly-midtwentiethcenturydrawingsbyWilson,TagawaandGunninghaveamechanisticauthority that is accentuated by the simpli-fication,clarityandorderingoftheforms.Whilethevalueoftheseaestheticconsiderationsenablestheimagestofunctionforaspecificpurpose,thecellswerepresentedasuniformstaticentitiesandwerelikened to small machines (Flannery 196). In comparison to these is Goodsell’s three-dimensional black and white drawing of Escherichia coli bacterium [19]magnifiedtoonemilliontimes.Ratherthanthesubjectbeingpositionedwithinawhitedecontextual-izedspacethedrawingresemblesthemicrograph where shapes and forms meet the frame. The interplay of a variety of organic forms and shapes create an interconnectedstructure,offeringadynamicinterpretationofthecell,sothattheimageimplies the processes of a living organism. Flannerydescribesthespacewithinthecellwallsas“Acellularenvironment:moleculesandorganellesarepackedtogether”,andFenlyquotesGoodsellhimselfwhosays,“I’malwaysstruckbytheincrediblecomplexityof cells and yet the inter-connectedness of it all. There’s such detailed structure on the gross scale and such randomness on the small scale”.

As if picking arbitrarily from the array of visualizingtoolsandtechniques,bothGoodsell and Berry have been opportunis-ticintheirchoicesofgraphicalmeansforrepresentationandinterpretationofspectralcharacteristics.Goodsell’scolourclarifies,defines,andsimplifiesthecomplexcolourlessmolecularworld.Flanneryexplains“proteinsinshadesofblues,nucleicacidsinshadesofpurpleetc.Theadditionofcolourmakestheimagemoreinformativeandevenmorevisuallyattractive“.ForDrewBerrythechoiceisunequivocal,“TherearenocolourssoI

Figure 3a. Herbarium specimen sheet. With coloured sketch 1824 Robert K. Greville (1794-1866) Greville Herbarium Specimen sheet, With coloured sketch 1824. moss specimen, drawing of magnified detail partly finished pencil and watercolour sketch. Herbarium RBG Edinburgh Photograph M.Rosengren, 2003.

makethemup.Blueisfordeadthings,greenis for sick. Pink always works for healthy stuff…Imassagethewholethingtomakeitunderstandabletoanaudience.”[20]

Spatialandspectralcharacteristicshighlightthedisparitybetweentheseartistsandthosewho sought to reproduce a visually accurate account of nature such as Maria Sybilla Merian,FerdinandBauer,orWalterHoodFitch.ArthistorianJamesElkinsproposesthat,“asinthehistoryofart,imagesofunrepresentableobjectsputastrainonthepictorialconventionstheyinherit,finallybreakingthemandbecomingdifferentkindsofpictures.”Thegraphiclanguageofthese(NewWorld)artistsatthetimeofburgeoningsciencewasadistinctdeparturefromgraphicalconventionsandmediatechniquesofartistswhohadprecededthem,suchasMatthaiusMerianinthesixteenthcentury.

28 SPECTRA: Images and Data in Art/Science .

Page 29: SPECTRA - Australian Network for Art and Technology · SPECTRA: images and data in art/science Proceedings from the symposium SPECTRA 2012 The book and the conference that begat it,

Overleaf: Vera narrent— True stories. Wallpaper print 3x 1.5 m (repeat).. M.Rosengren 2013

Figure 3b. Herbarium specimen sheet. Detail of With coloured sketch 1824. Robert K. Greville (1794-1866). Greville Herbarium Specimen sheet, With coloured sketch 1824. moss specimen, drawing of magnified detail partly finished pencil and water-colour sketch. Herbarium RBG Edinburgh Photograph M.Rosengren, 2003.

AntonVonLeeuvenhoekhadexpressedincredulity [21] when he glimpsed the microscopic world in the seventeenth century.HisamazementandwondermayhavebeensimilarlyarticulatedbyDrewBerry’s response to what he sees and knows of phenomenon occurring at very high resolutions.“…averyalienworlddownthere–arandom,vibrating,messyplacethat’sjustsointerestingtoportrayandengaging…”

Stafford’sdeliberationregardingthenewopticalinstrumentoftheseventtenthcenturyresonates here.

“The microscope’s mysterious and beguiling images …explode attractive forms into repugnant or non resembling patterns. The equivocal nature of information gleaned from optical apparatus, rendering the insignificant significant and the worthwhile worthless, also reveals how easily the observer’s perception might become confused. What appeared clear and distinct to the naked eye was exposed as chaotic or flawed under the lens.”

WhenStaffordreferestotheincompre-hension and confusion with which the micro-scopic dimensions were received by observersintheseventeenthcentury,itiseasytopositioncontemporaryobserversatthissamejuncture.

Images in natural history and post-natural history (botany and biological science) are characterizedbythetheempiricalandaesthetic.Thefactsofstructure,processandfunctionandthepresenceofartifacts[22] that aresynthesisedincontemporaryvisualiza-tionsobscuretheboundarybetweentruthandinvention,andcontributetomaintainingtheparadoxofmicroscopy.Embeddedinallthese images made through the microscope is the measure of veracity (of the data) that places the invisible into the visible domain. The increasing scope of technology subverts inheritedconventionanddictatesthere-imaging of nature.

Withdevelopmentsofphoto-microscopy,spectroscopy,electronmicroscopyandothertechniques of the mid-nineteenth and twentiethcentury,itbecamepossibletomeasure,knowandvisualizeprocessesandfunctionsofmoleculesandatomsfurtherwithincellstoamuchgreaterextentthantheartists/scientistsofnaturalhistorycouldactually witness. The graphic language and the vocabulary of images is radically revised inthetwenty-firstcentury’sinter/discipli-naryvisualizationsofthedataproduced,using these and other techniques. [23] Spatialresolutions,spectralcharacteristics,andtheveracityofimagesacquired,transmittedandarchived by these instruments have become radicaldeparturesinvisualizingthenaturalworld,whilebuildingontheachievementsofthe early naturalists who used simple magnificationdevicestoobserve.

Page 30: SPECTRA - Australian Network for Art and Technology · SPECTRA: images and data in art/science Proceedings from the symposium SPECTRA 2012 The book and the conference that begat it,
Page 31: SPECTRA - Australian Network for Art and Technology · SPECTRA: images and data in art/science Proceedings from the symposium SPECTRA 2012 The book and the conference that begat it,
Page 32: SPECTRA - Australian Network for Art and Technology · SPECTRA: images and data in art/science Proceedings from the symposium SPECTRA 2012 The book and the conference that begat it,

Colliding Light

Chris HenschkeSchoolofMedia&Communication,RMITUniversity,Melbourne

In2007,IbeganaresidencyattheAustralianSynchrotron through the Arts Victoria and the Australian Network for Art and Technology. The Australian Synchrotron is a source of energy ranging from infrared to hardx-rays.Inthesynchrotron,electronsareaccelerated to more than 99% of the speed of light around a two hundred metre ring (see fig. 1).Beamlinesarepositionedaroundthering to use the energy for various experiments.Baseduponmyobservationsofhowthescientistsworkedwiththelight,andtea-roomdiscussions,Idevelopedmyownexperimentsusingthesynchrotronlightin unorthodoxways,partiallytocollectvisualdatatomakeartworkswith,andpartiallyto test my understanding about how and whythesynchrotrondoeswhatitdoes,andpartiallytoseethescientists’responsestomyimages.Iconductedsuchexperimentsusingtheinfra-red,opticaldiagnosticsandproteincrystallographybeamlines,andthe accelerator itself.

OntheinfraredbeamlineIexperimentallygathered visual data of the beam using digital andfilmSLRcameraswithinfra-redlensesandfilm(see fig. 2).By‘interfering’withthebeamviatheinsertionofaglassobjectinitspath,I“visiblized”theinfra-redlight.Thiswascompositedwiththelightsinparticlebeam’sacceleratorandstoragering,andspectrallinesofthelightfrequencies,whichI recorded as sound with a photodiode. The process I used was a kind of audiovisual analogyofthe“FourierTransform”,a mathematicalprocessesscientistsusetoturnspatialvisualdataintofrequencydata.Asimilarexperimentwasmadewiththeopticaldiagnosticsbeamline.Opticalandultra-violetlightwasdiffractedthroughaglasslightbulband captured as a digital image sequence (see fig. 3).Asthebeamwassobright,directcapture may have caused some of the

32 SPECTRA: Images and Data in Art/Science .

charge-coupled devices on the camera to burnout,sotheexperimenthadtobe carefullysetuptocaptureonlythediffractedlight.

IcreatedaproteincrystallographyanimationfromanexperimentImadewithaninsulincrystal sample placed in the X-ray beam (see fig. 4). Micron-scale protein samples placed onarotatinggoniometerarehitbytheX-raybeam,andtheemittedenergyiscapturedin the detector and reverse engineered in what’s called reciprocal space using Bragg’s equations,whichletstheproteincrystalbedigitally reconstructed. All insulin proteins are thesame-theyallhaveanidentical structure,exceptthisparticularinsulin proteinwasdifferent,ithadaslightkinkinit’scarbonringstructure-thescientistadjustedthissaying‘thisisasubjectivedecision’-theuniquenessofmysampledidn’tfitwithinhisgeneralisedtheoreticalmodel.Iwasinspiredtosubjectivelyprocessmydatathankstoasuddenly eloquent outburst from another usuallyreservedscientist,whotoldmethatseeing the sample on its scale would be likegazingupataninfiniteskyofendlesslyrepeatedelectronconstellations.Myversion,inanempiricalyetscientificallymeaninglessway,soughttocapturethatbeautifulpoeticinsight,usingtherawimagedatatovisuallyrecreate what I felt it would be like to be in such a molecular space.

Myfinalexperimentwaswiththe accelerator itself. I was intrigued by the delicatebalanceofcomplexmagneticandelectricalfieldsandforcesneededtomakethesynchrotronbeamactuallywork,whichiscalledthe“synchrotrontune”,afrequencyofabout13.3MHz.Theideaforthis experimentwasdevelopedoverthecourseoftheresidency,incollaborationwith acceleratorphysicistsMartinSpencerand

Page 33: SPECTRA - Australian Network for Art and Technology · SPECTRA: images and data in art/science Proceedings from the symposium SPECTRA 2012 The book and the conference that begat it,

Figure 1: Photograph of particle beam apparatus at the Australian Synchrotron

Figure 2: Infra-red energy visualisation

Figure 3: Optical diagnostics attraction experiment

Page 34: SPECTRA - Australian Network for Art and Technology · SPECTRA: images and data in art/science Proceedings from the symposium SPECTRA 2012 The book and the conference that begat it,

Mark Boland. Wondering what this might sound like led me (online) to Dr. Andreas Wilde,attheFraunhofer-Institutfuer Integrierte Schaltungen Aussenstelle Entwurf-sautomatisierung,inDresden.Withhis expertiseinacousticmathematics,wewereableto‘pitchshift’thesynchrotrontunedown to a frequency range that is audible tothehumanear(whichwasbasicallyjustasunusoidal tone). Reverse-engineering this process allowed me to put a sound into the synchrotron.

Thedaybeforetheexperimentwastobe undertaken,Iwasoutthefrontofthe synchrotroncomplex,underthehotsummersun,andtheshrillcryofacicadastoppedmein my tracks. The cicada’s deafening high-pitchedtunewasnotonlygeoacousticallyrelevant,italsogavemeaperfect “synaesthetic”pictureoftheenergybeamwhirling around the synchrotron ring. Thus Irecordedit,emailedittoGermanytobeencoded,andgaveittotheacceleratorphysicists.Onthedayoftheexperiment,thesoundfilewaspitchshiftedupfromabasefrequencyof5kHzto1MHztomakethevibrationfastenoughtomodulatethe amplitudeofthebeam,inawaysimilartohowAMradioworks.MartinSpencerputthedata into the control system and tried to oscillate the beam around this frequency.

Figure 4: Protein crystallography data visualisation (still from animation)

34 SPECTRA: Images and Data in Art/Science .

But something went wrong and the beam literally crashed and stopped: I dumped the beam! But then the physicists re-launched particlesintotheaccelerator,pitch-adjustedthedataandputthemaximumenergyintothebeam.Thedatawas‘re-injected’,andthistimeitworked.Thecicadafrequencythistimewasinharmonywiththe‘natural’frequencyofthesynchrotronbeam,andthus the beam vibrated with the sound of thecicadatune.Itwasanexcitingandpoeticmoment. Even though nothing was directly perceivable,justtoknowthattheheartofthehugeandincrediblycomplexfacilityaroundmewaspulsatingwiththesoundofthe cicadathatlivednexttoitsomehow connected the synchrotron back to the world aroundit.Theexperimentrevealeda relationshipbetweensoundandlightandenergyandmatter,thecicadasinginginthesunlight and the light in the synchrotron singing with the cicada’s tune.

Attheendoftheresidency,IdevelopedSynchrotronEye,ananimatedmontagethatcombined all the audio and visual recordings made over the course of the residency program (see fig. 5). This work used the mediatoexpressthenatureofthebeams,throughanintuitiveandchance-basedmethodology,bycombiningalltheaudioandvisual material in a kind of spinning spectral

Page 35: SPECTRA - Australian Network for Art and Technology · SPECTRA: images and data in art/science Proceedings from the symposium SPECTRA 2012 The book and the conference that begat it,

34 SPECTRA: Images and Data in Art/Science .

Figure 5: Still sequence from ‘Synchrotron Eye’ animation

mashup. When viewed from above it appearedlikeaneye,capturingandrevealingthe essence of the device: the synchrotron is aneye,anenhancedhumaneye,itisus lookingbackatourselvesusinganextremely complexlens,thatthroughfundamental aspectsofnature,letsusaskwhatwearemade of.

Inconclusion,myexperiencesand experimentsatthesynchrotronhaveshedlightonbothmypersonalmethodology,andprovided me with insights into the nature ofscientificresearch.Analogoustothewayphysicistsexperimentwithandstudythefundamentalsofmatterandenergyinalaborparticleaccelerator,myworksexperimentwithandstudythenatureofperceivedlight,anditseffectsontheviewer.Physicscanbeveryabstract,andsoabstractiveartworkscan relate to it. In both disciplines research is doneusingreductivefactorsand fundamentalproperties,andtheoriesaboutsuchpropertiesaretestedwithexperiments -thiscreatesatenuousyetpoetic connectionbetweenmyexperimentsandthose undertaken in synchrotrons! In a way perhaps similar to the abstract yet universal propertiesinphysics,suchasthewaylightbehaves,artalsoworkswithsimilaruniversalelementsoflightandspaceandtimeintermsofourperceptionofit.

There is also the cross-disciplinary correlationintheuseofcollageandmontage,and the role of chance. The physicist David Bohm championed the importance of mental “play”inconnectingseeminglydisparate phenomenaorideasinscientificresearch,he described the state of mind in developing newideasinscienceasbeinga‘poetic equatingofverydifferentthings[inwhichthereis]akindoftensionorvibrationinthemind,ahighstateofenergy’[1],whichisequally applicable to many artworks. Physi-cist-cum-anarchistphilosopherPaulFeyera-bendtakessuchnotionsofcreativeplayevenfurther-Feyerabendwasanadvocateofopeningupscientificpracticetonon-scientificmethods,summedupbyhisradicalempiricalprincipleof‘anythinggoes’[2].Thisseemstobe an ideal epistemology for framing my own researchmethods.Theinfluentialphysicistand philosopher of science Karl Popper ques-tionedtheepistemologyofscience,statingthatscientificdiscoveriesarebornfrompro-cessesofstimulationandreleaseofinspira-tion,whichitselfisnotascientificorlogicalprocess. Popper said that every discovery contains‘anirrationalelementoracreativeintuition’[3].Thisisalsowhatsomeofthescientistsatthesynchrotronhavedescribed,intheirqueststosolvecomplexanduniqueresearchproblems.Again,thisisapplicabletoartingeneralandmyworkinparticular.

Page 36: SPECTRA - Australian Network for Art and Technology · SPECTRA: images and data in art/science Proceedings from the symposium SPECTRA 2012 The book and the conference that begat it,

Adistinctionbetween,butalsoananalogicalconnectionacrossthescientistsandartistsworldviews,isthatscienceishighlytechnicalandspecializedanddealswithobjectiveuniversalproperties.Artispersonal but can be universally applicable to all people. And yet both paradigms share formalandabstractproperties,andevenirrationalandindefinableaspects.Experimentingwiththesepropertiesincross-disciplinarycontextsrevealdeepconnectionsexistsbetweenthecreativeandscientificdisciplines,whichcanpropelbothintonewareasofresearchanddiscovery,asbotharecomplementary aspects of how we understand our universe and ourselves.

Opposite: Unnamed artwork by Erica Seccombe. Used by permission of the artist.

36 SPECTRA: Images and Data in Art/Science .

Page 37: SPECTRA - Australian Network for Art and Technology · SPECTRA: images and data in art/science Proceedings from the symposium SPECTRA 2012 The book and the conference that begat it,

36 SPECTRA: Images and Data in Art/Science .

Page 38: SPECTRA - Australian Network for Art and Technology · SPECTRA: images and data in art/science Proceedings from the symposium SPECTRA 2012 The book and the conference that begat it,

GROW: an investigation of 4D Micro-CT

Erica SeccombeDepartmentofPhotographyandDigitalArts,SchoolofArt,CollegeofArts&SocialSciences, AustralianNationalUniversity

Abstract

EricaSeccombeisavisualartistandcurrentlyaPhDcandidateattheANUSchoolofArt.Herresearch is being facilitated and supervised byProfessorTimSenden,HeadoftheDepartmentofAppliedMathematics,ANU.Erica’sinterdisciplinaryprojectGrow, visualising nature at nanoscale,isaninvestigationoftheaestheticpossibilitiesofcomputationalextensionofvisionwithdynamic 3D Microcomputed X-ray Tomography,or4DMicro-CT,aprocesswhichhasanadditionaldimensionoftime(3D+time=4D).Withthisscienceshehascapturedin4DMicro-CTthetransformationofplantseedsastheygerminate,fromembryotofirstleafstage.SheisvisualisingthisdatainascientificvolumeexplorationandpresentationtoolDrishti,acustomdesignedsoftwaredevelopedbyDrAjayLimayeatVizLabintheANUSupercomputerFacility,NCI.Ericaisvisualisingthesevirtualtime-lapsedatasetsofgerminatingseedsandprojectingtheresultinganimationsinimmersivestereoscopicinstallations.

GROW: an investigation of 4D Micro-CT

FortheSPECTRA2012conference,ProfessorTim Senden and I gave a shared presentationtohighlightthecross-disciplinarynatureofmyprojecttovisualisevolumetricdataofgerminatingagriculturalseeds with 4D Microcomputed X-ray Tomography.ForthispaperIwillbewritingsolelyaboutmyprojectfromtheperspectiveofavisualartistandlookatsomeoftheideasthatIaminvestigatingthroughmystudioresearch.AsanartistIaminterestedintheways the augmented lenses of contemporary scientificimagingcanalsoengageuswiththe natural world through both a process of rationalobservationandsubjective

experience.Iamalsocuriousaboutapossibledisjuncturebetweenthephysicalexperiencesof living in a natural world and our becoming more dependent on technology and science tomediateourexperienceandknowledgeofnaturetous.ThereforeIamexploringphenomenological methodologies in my practiceasawayofreflectingonpossibleexperiencesofnatureinatechno-scientificsociety.

Mypractice-ledresearchprojectGrow: visualising nature at nanoscale investigatestheaestheticpossibilitiesofcomputationalextensionofvisionwith4DX-rayMicrocomputed Tomography (4D Micro-CT). 3D Micro-CT is a non-invasive process that usesX-raystocapturecross-sectionsofastaticobjectthatcanthencomputationallysimulatedasahigh-resolutionvirtualmodel.4D Micro CT is the same process that includes anadditionaldimensionoftime,capturingdynamicphenomenaofandaroundanobjectwhileitissubjecttochange.WiththisscienceIhaveattemptedtocapturethetransformationofedibleplantseedsastheygerminate,fromembryotofirstleafstage.Iam visualising this data in a custom-designed scientificvolumeexplorationandpresentationtoolknownasDrishti (meaning insight in Sanskrit),producingvirtualtime-lapsedatasetsthatareexhibitedasimmersivestereoscopicprojectioninstallations.

IproposedtheideaofgerminatingseedswithMicro-CTtoTimSendenafterthesuccessofmyfirstcompletedprojectNanoplastica in 2008 (See fig. 1.) Nanoplastica was result ofmyinitialthree-monthartist-in-residencein the Department in 2006 where I had the opportunity to 3D Micro-CT and visualise a collectionofminiatureplastictoys.Itwasthrough this process that I had became a

38 SPECTRA: Images and Data in Art/Science .

Page 39: SPECTRA - Australian Network for Art and Technology · SPECTRA: images and data in art/science Proceedings from the symposium SPECTRA 2012 The book and the conference that begat it,

38 SPECTRA: Images and Data in Art/Science .

skilled and independent user of Drishti,whichwasatthattimeinaformativestageofdevelopment. I had become interested in the Department’s research into 4D Micro-CT and howthisdatacouldbevisualizedinDrishti. Growing seeds for Micro-CT was not inclued intheDepartment’smajorresearchareasbutI felt this proposal was more aligned to the ongoingpreoccupationsofmyownpracticetoaddressideasofauthenticity,replicationandsimulation.

AsIamexploringfrontierresearchinto4DMicro-CTvisualisationtheresultsofmyprojectareshapedbythepossibilitiesandlimitationsofthescienceandtechnologyIamutilising.However,therationaleforpropagatingseedswith4DMicro-CTisnotjusttotestthecapabilitiesofthismodernscience and technology. I also want to considerquestionssurroundingaculturalrelationshipwiththenaturalenvironmentthroughacontemporaryvisualartpractice.Iaminvestigatingthepotentialformyownwork to meaningfully engage an audience withtheconceptofnature,eventhoughthematerialityofthe‘real-life’phenomenonofagerminatingseedhasbeenrelocatedtoexistinadigitalplatform.

However,itisimportanttoclarifytheideaof‘virtualdata’inmywork.ThedatasetsIamvisualisingofgerminatingseedsarenotderived from fragmentary evidence or rendered through mesh framing techniques usedinconventionalcomputergeneratedimagery,CGI.Thesevolumetricdatasetsareinsteadthealgorithmicrecreationoftheactualreal-lifeseed,eachvolumetric(3D)pixelrepresentingitsreal-lifecounterpartatfivemicrons[see fig. 2.]. With this science I am capturing the most precise virtual model possible of the seeds in the process of germination,simulatingthetextureandmaterial density of both the internal and exteriorstructureastheseedbeginstosprout. It would be impossible to recreate the ambiguoustexturesandtranslucenteffectsofthesegerminatingseedsusingmeshframes.

Mypremiseforgerminatingseedsistocapture a moment that life comes into being

anditismotivatedbymyconcernforthefuture of our planet’s natural resources and biodiversity.Ratherthanusingnativeorendangered species I chose seeds that have shortgerminationperiodsandarefamiliarediblevarietiesthataregrownincrops,indomesticgardensoronwindowsills.Historicallyseedsareasymboloflife,offertility,abundance,goodluckandwerealsoaveryearlyformofcurrency.Harvestingseedscontinuestobeessentialtothesurvivalofnomadicandsettledcommunities,andourmoderncivilizationisfoundedontheabilitytocultivatecrops.Wearenowlivinginanerathatisexperiencingtheriseofmega-farmswithmaximumcropandstockproductionquotasrelyingoninnovativeagriculturalproductiontechnologiesandgeneticengineering.

Ourcarbonfootprintisextensive.Withoutevencalculatingotherpotentialthreatssuchasglobalwarming,thissignificantsurgeinhumanindustry,consumptionandwasteisalreadyhavingamajorimpactontheworld’snatural resources and it is modifying the land-scapeataconsiderablerate.Itisestimatedthat that at least one quarter of the world’s species of plants today is already threatened withimminentextinction,thisbeingprimarilyduetohumanactivity.Thegrowingevidencesuggeststhatthesixthmajormassextinctionof life on Earth is underway and unlike the previousfive,thisoneispredominantlyduetotheimpactofhumanpopulationanditishappening faster than any other mass extinctioninourplanet’shistory.

Tounderstandmoreaboutseedconservationandscientificimagingofseeds,incontextofmyresearchproject,IstayedattheMillenniumSeedBankintheUKasaresidentonaresearchfieldtripfortwoweeksin2012.EstablishedbyKewRoyalBotanicGardens,the Millennium Seed Bank facility is based at Wakehurst Place on 565 acres of natural reserveinarelativelyremotecornerofWestSussex.Inasecurevaultembeddeddeepbeneath the building there is more diversity ofplantspeciesinthisonelocationthananywhere else in the world [see fig. 3.]. Dr WolfgangStuppyisaninternationally

Page 40: SPECTRA - Australian Network for Art and Technology · SPECTRA: images and data in art/science Proceedings from the symposium SPECTRA 2012 The book and the conference that begat it,

40 SPECTRA: Images and Data in Art/Science .

renowned and leading seed morphologist at the Millennium Seed Bank and I was privilegedtospendsometimewithhimduring my residency. Stuppy is a specialist in thefieldofbotanicalevolutionandconservation,whichincludestheunderstandingofthedispersal,anatomyandstructure of seeds and fruits. His full colour publications,suchasSeeds – Time Capsules of Life(FireflyBooks,2009),arebasedonhisresearch and aimed at bringing to the attentionofthegeneralpublictheuniqueandunseen beauty of seeds and pollen as seen under the powerful electron microscope. Stuppy’s electron microscopic images of seedsandpollenareexquisite.Blownupinascalethatiswellbeyondtheproportionoftheoriginalmicroscopicobject,thesedelicately coloured forms are revealed to haveintricatemathematicalsurfacesandhyperbolicstructures.Unlessweareinvolvedinthesciences,veryfewofuswilleverhavefirsthandexperienceofimagingmaterialinthis way.

However,theseimagesarevisualconstructions.Theelectronmicroscopecapturesonlyfractionofthesurfaceoftheseedorpollenatanyonetime.Tocreatethewhole,Stuppystitchestheimagestogetherinagraphicsprogram,cleaning,fixingandcontrastingtheobjecttogivethelaypersonabettervisualunderstandingofthecompleteobject.TherawimagesareingreyscalesothefinalcolouringeffectisalateradditionbytheartistRobKesseler.Whiletheimageexaggeratesthetruthoftheoriginaldata,thesuper-realismofthesefinalimagesaddstothedramaticvisualexperience.Bybringingseedstoourattentioninthishighlyaestheticisedform,Stuppy’sintentionistodraw the viewer in and ignite their imagination,engagingtheminanawarenessof plant life and the importance of conservation.

Stuppy’s images remind me of Susan Sontag’s ideainherbook,On photography,that,‘photographsreallyareexperiencecaptured,and the camera is the ideal arm of consciousnessinitsacquisitivemood.’[1] This notionofthe‘armofconsciousness,’canalso

be applied to the electronic microscopic lens thatDrWolfgangStuppygazesdown.Eveniftheseimagesareareconstructionofthetruth,theyworktoreflecttheexperienceofthe image-maker in the process of consciouslyacquiringscientificknowledge.Italsohighlightsourcontinuingfascinationwiththeinvisibleandourconfidenceinthevisualdataproducedbyscientificimagingtechnologies.

In the laboratory I am not looking down a conventionallenswith4DMicro-CT[see fig. 4.].TheinitialCTscanscanonlybemonitoredthrough two-dimensional black and white radiographs.ItisonlywhenIcanfinallyvisualizethesevolumetricdatasetsinDrishti thatIcanstarttoseethepotentialforthevirtualobjectstocreateatransformativeexperienceforanobserver.Drishtienablesmetovisualizethevolumetricdataofthegerminatingseedsbycontrollingthecolourandlevelofopacityoftheobject’smaterialdensitythroughtransferfunctions.Movementandanimationcanbeexecutedinrealtime,butforfinishedanimations,thetrajectoriesandeffectsaremanuallysetalonga key frame editor. 4D Micro-CT data also providesanadditionalcapacitysothatthesubjectcanbeobservedfromamultitudeofangles,depthsoffieldandpositionsintime.It is unlike the powerful lens of an electron microscope that focuses so close to the subjectthatitprovidesasinglefixedview-pointabstractedfromtherestoftheobject.Inmyprojecttheseedistheobjectinfocusbutthecatalyticforcesofgermination,thechanginginterfacesbetweentheshootingseedanditsimmediateenvironment,andtheinclusionoftimearetheconstituentpartsofthewholesubject.

Acquiring this data through 4D Micro-CT experimentsisnotastraightforwardprocedure as capturing the full process of seedgerminationoveranextendedperiodoftimehaspresentedmanyunforeseenchallenges. Eventually I hope to use a wider range of seeds but for the moment mung-beans and alfalfa are the fastest and the hardiesttouseforthispurpose.Themajorityofmyseedshavefailedjustbeforethefirst

Page 41: SPECTRA - Australian Network for Art and Technology · SPECTRA: images and data in art/science Proceedings from the symposium SPECTRA 2012 The book and the conference that begat it,

Figure 1 (above): Erica Seccombe, Nanoplastica, 2008, (detail) three-channel digital projection installation, first exhibited at Canberra Contemporary Art Space, 2008.

Figure 2: Erica Seccombe, 4D Micro-CT Mungbean sprouting (work in progress), 2011.

40 SPECTRA: Images and Data in Art/Science .

Page 42: SPECTRA - Australian Network for Art and Technology · SPECTRA: images and data in art/science Proceedings from the symposium SPECTRA 2012 The book and the conference that begat it,

42 SPECTRA: Images and Data in Art/Science .

leafdevelops,duemainlyduetotheenvironment of the Micro-CT lab being uncongenialtoplantlife.However,thoughtheprocessoftraillingtheseexperiments,Irealise that the failure of the seeds to grow to leaf stage should also be considered an equallyvitalcomponentofthisproject.Thesedisappointments,thedeathorfailingoftheseeds are equally relevant and add to that operaticnarrativeoflifeanddeath.Ouremotionsaredeeplyembeddedinthehopefornewlife,anewdawn,afuture.Ifournatural environments become inhospitable thenthereisalittlechanceforlifetoflourish.

In2013IcompletedananimationofvirtualseedsgerminatingentitledGrow. The data is fromatightlysownpackofmungbeansandalfalfa seeds. Comprising of 40 volumetric datasets that were acquired over a four-day capture,eachsetisinterpolatedsothatonediscrete moment merges smoothly into the next.Theresultingtime-lapseanimationisjustsixminutesindurationanditrevealsnotonlytheexternalgrowthpatterns,suchasroot length and case swelling but the delicate internalstructuresofthefirstleaf,thecotyledon as it begins to grow. The mung-beansgrewpromisinglyforthemajorityofthiscapture,buttheirdevelopmentstalls,whereas the alfalfa shoot quickly from seed to leaf.

Itintedthisseedballwithalight-bluehuesoastonottotrytoimitatethegreenofplants,but to situate the work with a colour also foundinnature,suchasinblueskyorwater.I then rendered density of the starchy shoots to be as translucent as glass through which incremental stages of growth can be seen to transitionslowlyasthedatarotatesclockwiseonaverticalaxis.Ihavethendividedtheblack frame up with three panels that provide multipleviewpointsoftheonetime-sequenceinthesingleprojection.Therightframeprovidesamoretraditionalviewofobser-vationfromadistance,whereastheothertwo are more abstracted because the eye is placed in the centre of the data looking out [see fig. 5.].

Growisinterestingtowatchwhenviewed

onthescreenofacomputerbutitdefinitelyworksbetterasaworkofartwhenitisprojectedtoproportionallyenlargethegerminatingseeds.Playingwithcomparativescaleintheinstallationprocesshelpstoenhancetheexperienceoftheworkbyshiftingthepositionoftheobserver,placing the viewer within the work. To maximisethissensoryexperienceoflookingatvirtualdataIamalsoexperimentingwithvarious formats for immersive stereoscopic projectioninstallations.ThisyearIhavehadtheopportunityexhibitGrowinanexhibition,‘Synapse: a selection,’atthePowerhouseMuseuminSydney.ForthisexhibitionItrialled a new stereoscopic modulator that projectsa3Dimageontoacircularpreservingpolarizedsilverscreen.Withthistechnologytheaudienceisrequiredtowearpolarizedpaperglassestoexperiencetheprojectioninhighdefinitioncinematic3D.Inadarkspacethestereoscopicillusionappearstofloatinfrontofthescreen,farmoresothaninapublic cinema.

The feedback I received about this installationrelayedtomethattheformatofboththeanimationandthetechnologyworkedwelltocreateameditativeandself-reflectivespace.Someindividualaccountsdescribedthesensoryexperienceasbothmesmerizingandmovingandconnectedthe work with the idea of life as being both exquisiteandfragile.Thereweredifferingopinionsaboutthemultipleviewpointsandpeoplehadtheirowninterpretationsofwhatthey were watching. Many visitors remained forthefulldurationoftheanimationtowatchthevirtualseedsgerminating,orstayedformuchlongerperiodsoftime.Somepeoplepreferredtosittransfixedwhileothersplayedwiththeopticalillusionbymovingtheirbodyfrom side to side or sweeping their hands to try and catch the illusionary image. I like watchingpeopleinteractwiththework,anditisaninterestingimageinitselftowatchgroups of people with black glasses on collectivelylookingatthesamespectacle.

Theseveranceordistancefromthesubjectthrough the use of virtual data would seem tonegateany‘real’ormeaningfulexperience

Page 43: SPECTRA - Australian Network for Art and Technology · SPECTRA: images and data in art/science Proceedings from the symposium SPECTRA 2012 The book and the conference that begat it,

Figure 3 (above): Erica Seccombe Vault Door, Millennium Seed Bank, Royal Botanic Gardens, Kew, Wakehurst Place, Sussex, UK 2012, digital image, 44.4 x 65.5 cm, inkjet print on Canson rag, edition of five 2012.

Figure 4: View of bean germinating while being scanned with Micro-CT, Department of Applied Mathematics XCT Facility, ANU, 2012. Image: Erica Seccombe

Page 44: SPECTRA - Australian Network for Art and Technology · SPECTRA: images and data in art/science Proceedings from the symposium SPECTRA 2012 The book and the conference that begat it,

44 SPECTRA: Images and Data in Art/Science .

of nature that I am proposing in my work. HoweverSueThomaswrites,‘thereisincreasing evidence that we respond very similarlytoa‘natural’environment,whetherit’s real or virtual.’ [2]Encounterswith‘real’nature have long proven already to be psychologicallybeneficial,andThomasexploresthisconceptinherrecentbookTechnobiophilia: nature and cyberspace (2013).Shelooksathowtheexperienceofnatureina‘virtual’situationcanbejustasprofound,andhowourtechnologiesarenamed and evolve in reference to nature. But ourdefinitionofvirtualjustdependsonwhatweunderstandasbeing‘virtualreality’andthis can be confusing.

MarianneKroghJensenexplainsinheressay,‘Mapping virtual materiality’,thatthisconfusionliesinthenotionofvirtualrealityasbeingahighlyabstractedconcept,‘inpartbecauseitimpliestotalintangibility,andinpartbecauseitismostoftenassoci-ated with computers and cyberspace.’[3]ForKroghJensen,thepotentialforrelocatingtherealthroughanimaginativeprocessislinkedinextricablywiththelocationofthebody.KroghJensensuggestsbybeinggroundedinacontinuousreflectivesensationofexperience,andthatphysicallylocatingyourownbodywithintheimaginativeandsensorystatecan,‘becomesomethinghighlymaterial.’[4]

Susan Best proposes that a phenomenol-ogicalapproachtocontemporaryinstallationart can be understood through Maurice Merleau-Ponty’s‘notionofthefleshoftheworld,whichiscontinuouswithandyetmakespossiblesensationandthesensatebody.’ [5]Bestexplainsthattheconceptofthe‘flesh’isaboutthegainingoftruemeaningthroughanindividual’ssensoryexperienceofanobject;anexperiencethatcannotbe,‘reducibletoanarrowlyconceivedlinguisticaccount.’ [6] Best compares this phenomeno-logicalpracticeattheendoftheTwentiethCentury with earlier minimalist approaches to art. Minimalism sought to reduce the engagement of the viewer as a way of creatingacontrolled,self-consciousexperiencethroughalienation.Themoveawayfromconsidering‘affect’asamodeof

distractionordisorganizationbeganwhencontemporaryinstallationartistsbegantoadopt this phenomenological approach. Theseartistsintentionallyengagetheviewerbyexpandingthesensorypropertiesandaffectinthework,asBestwrites,to,‘amplify,intensifyandmotivateaestheticexperience.’[7]

Recentresearchthatinvestigatesthesesamephenomenologicalpracticeslooksathowimmersiveinstallationartcanalsobeusedinmodels for engaging audiences more effectivelywithurgentenvironmentalconcernssuchasglobalwarming,populationcontrol,conservationandcarbonemissions.Attheforefrontofthisresearch,LesleyDuxburyisconcernedwiththissocialcomplexityinunderstandingclimatechangeincontextofartisticpractice.Duxburyinvestigatestheideathatwhererationalismandscientificevidenceisworkingagainstencouraginganysocialandpoliticalchangeinsocietyaddresstheproblemseffectivly,certainartpracticeshavethepotentialtoengage society with the reality of climate changeemotionallyandexperientially.Shewritesthat,‘thenonexpert’sconceptualizations,values,andexperiencesmaybeofsignificantvalue,andartistswhosefieldsofexpertisearetheconceptualizationofexperiencesandemotionshaveanopportunity to come to the fore.’[8]

AsanartistIamunderpinningmystudiopracticewithanartisticresearchquestion,notascientificone,andthisperspectiveshould be considered equally valuable. Ultimatelyhowever,itisnottheroleoftheartisttosolvetheworld’sproblems,yetweareallpartofthesameworld,thesamebiosphere.Collectivelyouremotionsaredeeplyembeddedinthehopefornewlife,renewal,anewdawn,afuture.Itisthroughthis process of interdisciplinary research and themethodologyofmakingandexhibitingthat in turn changes my own viewpoint and helpsmeunderstandthecomplexitiesofoursituation.Inturnmyworkwillpossiblyreflectthis consciousness of being in the world throughtheactofsharingtheexperiencesandobservationsofmyownlifetime.

Page 45: SPECTRA - Australian Network for Art and Technology · SPECTRA: images and data in art/science Proceedings from the symposium SPECTRA 2012 The book and the conference that begat it,

Figure 5: Erica Seccombe, GROW: work in progress, 2012, (detail) duration 7:12 minstereoscopic digital projection installation, first exhibited in Synapse: a selection, Powerhouse Museum, Sydney, 2012.

Page 46: SPECTRA - Australian Network for Art and Technology · SPECTRA: images and data in art/science Proceedings from the symposium SPECTRA 2012 The book and the conference that begat it,

Awfully Wonderful

Thispaperisbasedoncuratorialpractice-basedresearchsurroundingtheexhibitionAwfullyWonderful:ScienceFictioninContemporaryArt,whichtookplaceatPerformanceSpace,Sydneyin2011[1, 2]. This exhibition,whichIco-curatedwithBecDean,broughttogetheraneclecticmixofsciencefictionalartworkswithscientificandtechnologicalobjectsfromthecollectionofthe Powerhouse Museum of Science and Design,Sydney.InthispaperIproposetheideaofthe‘speculativeobject’asawayofunderstanding how both the artworks and artefactsincludedintheexhibitionfunctioninhumanexperienceasphilosophicaltoolsthatprovokereflectionaboutscientificandtechnologicalchange,andtherelationshipofthe present to possible futures and alternate pasts.

Sciencefictionisusuallythoughtofasanarrativegenre,primarilyexperiencedthroughfilm,televisionorprint.Whetherwe locate its origins in the Enlightenment or intheIndustrialRevolution,thereisgeneralagreementthatScienceFictiondramatisesourdeeplyambivalentrelationshiptothediscovery of knowledge about our environ-ment(science),andthemeanstoinfluenceit for our own purposes (technology)[3]. We both fear and revere the immensity of the universe,justaswebothdesireandreviletheaugmentationofourownpowersthroughscienceandtechnology.ScienceFictionhassurfedthewavesofthisoscillation,dramatisingutopiasanddystopias,helpinghuman beings to think through the ontologicalandethicalimplicationsofnewtechno-scientificdiscoveries [4].

ScienceFictiondoesthisthroughextrapolationandspeculation–thatis,itprojectsfromtheknownintotheunknown.It

46 SPECTRA: Images and Data in Art/Science .

Speculative Objects: Visual Arts and Science Fiction Futures

LizzieMullerFacultyofArt,DesignandMedia,COFA,UNSWAustralia

opensupalternativeperspectives–whethertemporal,spatial,political,interspeciesorintergalactic–fromwhichwecanseeandinterrogateourownsituationinanewlight.InthisessayIexaminethewayinwhichsomeobjectsuseoractivatethissamespeculativestructure. I ask what happens when science fictionismaterialized,whenspeculativefictionbecomesspeculativeobjects[5]. To dothisIreflectuponaselectionofobjectsfromtheexhibitionAwfullyWonderful–bothartworksandtechno-scientificartefacts-andtrytoexplainthedifferentwaysinwhichtheygenerateorsupportspeculativethought.

Visualisation and viscerality

Investigatingcontemporaryart(alongsideotherobjectsandartefacts)asamaterializa-tionoftheprocessofspeculationalsorepre-sentsamoveawayfromthequestionofhowsciencefictionvisuallyrepresentsscientificandtechnologicalobjectsandthemes.Butitis not necessarily a move away from the rich visualinheritanceofScienceFictionimagery.CuratorandcriticPatrickGygerwroteintheAwfully Wonderful catalogue of the historic interplaybetweenvisualizationandsciencefiction,andoftheparticularlystrongandlastinginfluenceofthegraphicimageryoftheScienceFictionpulpmagazinesfromthemid 20th Century [6]. In an acknowledgment ofthisinheritancewecommissionedartistDeborah Kelly to make a series of works in responsetothecollectionofScienceFictionpulpsheldintheFisherLibraryoftheUniver-sity of Sydney.

Inhercollage-basedpracticeKellyhasfrequently worked with the imagery of the B movie.HerworkoffersafeministcritiqueofthefuturisticexcessesofourvisualFigure 1:. Deborah Kelly, Dream of a common language in the disintegrating circuit (with thanks to Donna Harraway) (2011) (© Deborah Kelley. Photo © Performance Space.)

Page 47: SPECTRA - Australian Network for Art and Technology · SPECTRA: images and data in art/science Proceedings from the symposium SPECTRA 2012 The book and the conference that begat it,

46 SPECTRA: Images and Data in Art/Science .

Page 48: SPECTRA - Australian Network for Art and Technology · SPECTRA: images and data in art/science Proceedings from the symposium SPECTRA 2012 The book and the conference that begat it,

imagination,withoutsuppressingwhatiscompellingandattractiveintheseimages.Whatwe(andwhatKellyherself)expectedtoemergefromthiscommission,werepop-esque images of alien creatures and womeninseductivespaceoutfits.Theresultshowever were a much more subtle and transformativeresponsetoScienceFiction’sfigurativetradition.Fig1.isoneexampleofaseries of 8 collages Kelly produced for Awfully Wonderful,collectivelytitledDream of a common language in the disintegrating circuit (with thanks to Donna Harraway). They aredelicateandexquisiteconcoctionsformedfromglamourmagazines,erotica,botanicalandaquaticimagery.Kelly’sartist’sstatementaccompanying the collages connects the fetishizedfemalebodyofthepulp–inwhich“lushalienladies”in“skyscraperheelsandskintightspacesuits”teeterintothearmsof“reassuringlyvirile,scientificwhitemen”,toadeephistoryoffemaletransformationandobjectification:

I see fear of monstrous fecundity projected across human millennia from treacherous man-eating seawitch siren lairs through fearsome fairy- and folktales and onto the impossible physiques of fertile future babes.

ThespeculativestructuresofKelly’ssplicedimages,movebothforwardandbackwardsintime.Theypointbackwardstomythsofhumantransformationintootherkindsofcreatures,eitherthroughmagic,ordivineintervention.Theyexplorebiologicalpossibilitiesthatarebothatavisticandfuturistic:invokingourevolutionaryinheritancefromprimordialaquaticforms,andthepotentialtransformationofthehuman to the post-human through bio-technology. Kelly herself describes them as both pre- and post-mammalian.

Kelly’simagesimaginativelymaterialisethepotentialconsequencesofcontemporarybiotechnology,suchasgeneticmodification,biomimicry,andreproductivetechnologies.ApartfromDonnaHarraway,KellycitesShulamithFirestoneasakeyinfluenceinthesevisualexperiments.Firestone’sextremeand controversial vision of female

Figure 1a (above):. Deborah Kelly, Dream of a common language in the disintegrating circuit (with thanks to Donna Harraway) (2011) (© Deborah Kelley. Photo © Performance Space.)

Figure. 2. Barlow’s Wheel Electromagnetism Demonstration Device (date unknown), Dr Bodkin Adam’s Electromassager (c 1930), Collection of the Powerhouse Museum. (Photo © Performance Space)

emancipationentailedthenecessityof“wombless”reproduction.Tobetrulyfree,sheargued,womenwouldhavetojettisonthatreproductiveaspectoffemalebiology.Oneofourinterpretivestrategiesfortheexhibitionwastocreateanaudioguide,basedoninterviewswithscientists,thatwouldexplorethescientificrealitiesconnected with the artworks. In Kelly’s case weinterviewedProfessorStuartBunt,theco-founderofSymbioticAresearchlaboratoryforBio-Art.WhilstFirestone’spositionmayseemextreme,StuartBuntclaimedintheaudioguidethat“wombless”reproductionisasignificantgoalinreproductivescience,andthat current research with calves and mice isrelativelyclosetobringingalivefoetustotermoutsideofthebody.InKelly’scase,andinmanyoftheworksintheexhibition,whatseemslikeextremesciencefictionisactuallysurprisinglyclosetosciencefact,andperhapsmoreimportantly,toscientificdevelopmentsthat are outpacing our capacity for ethical considerationatasocietallevel.

Oneoftherolesofthesespeculativeobjectsistoraisetheseethicalquestionsthatconcern our bodies in a bodily or visceral way. Theirconcretephysicalexistencedemandsaphysicalreaction.Howdowefeelabouttheseobjects,whatdotheymakeuswanttodo?Dowewanttogotowardsthem,ordoweshyawayfromthem?Assuchtheybecometoolsforembodiedreflectiononourownattitudes.Kelly herself described her images as visual scenarios,connectingthemtoinfluentialmethods of strategic future planning used in both business and design [7].Unlikeverbalornarrativescenarios,however,theyemphasiseinstinctandambiguouspossibilityoverexplanatorysequencesofcauseandeffect.

48 SPECTRA: Images and Data in Art/Science .

Page 49: SPECTRA - Australian Network for Art and Technology · SPECTRA: images and data in art/science Proceedings from the symposium SPECTRA 2012 The book and the conference that begat it,

48 SPECTRA: Images and Data in Art/Science .

Page 50: SPECTRA - Australian Network for Art and Technology · SPECTRA: images and data in art/science Proceedings from the symposium SPECTRA 2012 The book and the conference that begat it,

Figure 3. Jo Law, The World of Things (2011) (© Jo Law. Photo © Perforamnce Space.)

Fig. 4. Haines/Hinterding, Cloudbuster Number Three: Orgone Energy Cloud Engineering Device (The Black Ray) 2008/2011. Cloudbuster Number Four: Orgone Energy Cloud Engineering Device (Starlight Driver 3.1) 2008/ 2011 (© Haines/Hinterding, Photo © Performance Space)

The World of Things

Figure 2.showsanotherobjectthatdealswiththeshiftinggroundofscientificknowledge,medicalpracticeandethicsinregardtothehuman,andparticularlyfemalebody.TheobjectontherightisDrBodkinAdam’selectro-massagemachine,c1930,fromthePowerhouseMuseumcollection.This device was widely believed to cure numerousailments,includingfemale“hysteria”,bytheapplicationofvibration.One of the uses of this type of machine was probably as an early portable vibrator. Thisobject,likemanyoftheartefactsintheexhibition,speakseloquentlyofthescientificfictionsofthepast,andthewaythesebeliefsaremanifestedintechnologiesandpracticesthatcancometoseemout-datedatbest,andbarbaricatworst.Italsotellsanother,morepersonal story. Between 40 and 160 of Dr BodkinAdam’spatientsdiedundersuspiciouscircumstances in the 1940s and 50s. He was named in the wills of 132 of them. Recent historians are fairly unanimous in describing him as an unconvicted mass murderer,thoughmanyatthetimebelievedhim to be euthanasiast.

WecommissionedartistJoLaw,whosepracticeengageswiththelegacyoftheCabinetofCuriositiesandthenatureanddisplayofobjects,toarrangethescientificand technological artefacts that appeared in theexhibition.SheplacedDrBodkinAdam’smassagernexttoanelectromagnetismdemonstrationdevicecalledaBarlow’sWheel,whichcanalsobeseeninfigure3.There are numerous resonances and connectionsbetweenthetwoobjects.Likemanyoftheartefactsdisplayed,theysharematerialandformalpropertiessuchastheirpolished metal and wooden parts and elaboratecursiveinscriptions,whichareredolentof“antique”technologies.Lawconstructedbespokecabinetsfortheobjectswithmirroredbasesandsidescreatinginfinitereflectionsthatrecededintothedistance.Thisopticaleffectheightenedtheexperienceoftheformalandvisualechoesthatresonatedbetweenobjectsandartworksintheexhibition.Italsoemphasized,through

itsrepetitiveabstraction,the‘objecthood’ofthe artefacts. Separated from their traditionalexplanatorycontexts(un-labeledanda-historicallyplaced),theobjects’relationshipstofunctionandperiodweremysterious.Intriguing,butopaquetheybecamethefocusofaestheticappreciationandasourceofspeculation.Bybeggingthequestion‘whatmightthisobjectbe?’theartefacts invited audiences to engage their knowledgeofthehistoryofscientificthoughtand technological apparatus.

AswellasarrangingtheobjectswealsoinvitedLawtocreateaninterpretivemap, The World of Things (Fig 3.),whichchartedboththe physical and the metaphysical terrain of theexhibitionand.Themapprovideddetailsoftheofficialprovenanceandpurposeofalltheobjectsintheshow,andalsosituatedtheminaspeculativetaxonomicalstructure.The map moves outwards in concentric circles from the Human Physical Realm at the centre throughtwoaxes:ThePhysicalWorld,TheLimitsofHumanPerception,TheRealmofImperceptibleThingsand,finally,BoundlessImaginationononeaxis,andTheWorldofNon-LivingThings,TheEdgeofHumanPhysicalLimits,LogicsandRationalThoughtsandUtopiasandDystopiasontheother.Thematictrajectoriescriss-crossthemap,connectingdisparateobjects.ThethemeofTechnologies of the Body connects Dr Bodkin Adams’ massager with Deborah Kelly’s collages,andthethemeofElectromagnetismconnects the massager with the Barlow’s Wheel and with The Cloudbusters (Figure 4),artworksbyDavidHainesandJoyceHinterdingthatIwilldiscussnext.

Myth makers and busters

TheCloudbusters,liketheelectromassagerandtheBarlow’swheel,speakoftheprovisionalityofscientifictruth,therole

50 SPECTRA: Images and Data in Art/Science .

Page 51: SPECTRA - Australian Network for Art and Technology · SPECTRA: images and data in art/science Proceedings from the symposium SPECTRA 2012 The book and the conference that begat it,

50 SPECTRA: Images and Data in Art/Science .

Page 52: SPECTRA - Australian Network for Art and Technology · SPECTRA: images and data in art/science Proceedings from the symposium SPECTRA 2012 The book and the conference that begat it,

Fig. 5. Simon Yates, Futura (2011) (© Simon Yates. Photo © Perforamnce Space.)

of performance and belief in science and medicine,andthepowerrelationsbetweenexpert,amateurandaudiencethatareconcentrated around technological artefacts.

TheCloudbustersarere-creationsofanoutlawed technology created by the controversial American Psychiatrist Wilhelm Reich.Reich’spublishedworks,includingTheMassPsychologyofFascism(1933),andTheSexualRevolution(1936),weresignificanttextsinthedevelopmentofleft-wingpoliticalandsocialthought.ReichdevelopedthetheoryofOrgoneEnergy,whichwasbothwidelyinfluentialandalsowidelycondemnedas a fraud. Reich described Orgone energy as a life force that connects all the beings intheuniversetogether.Heattributedtoitpowerfulproperties,includingthecapacitytocureillnessesandinfluencetheweather.TheCloudbusters,whichareintendedtoseedrain,arepartofasuiteofmachinesReichdeveloped,whichweresupposedtoconcentrateOrgoneenergyinparticularwaysforparticularpurposes.TheAmericanFoodandDrugAdministration,adeeplyconservativeorganisationinthe1950s,bannedtheOrgonemachines,burnedthebooksthatcontainedinstructionsofhowtomakethem,andeventuallyprosecutedandimprisoned Reich for contravening an injunctionpreventingthedistributionofthemachines and associated literature.

HainesandHinterding,whosecollaborativepracticeoftenincludesthemanifestationofunseenforces,haverecreatedthesemachinesfrominstructionsandremainingdocumentationoftheorigi-nals. They are to all intents and purposes functioningcloudbusters.Thespeculativecapacityoftheseobjectsderivesinpartfromtheir ambiguous status. Are they tools or sculptures?Aretheyfunctionalorfantastic?Ineludingclearcategoriestheseobjectsquestionfundamentallytheroleofbelief,respectabilityandpoliticsinrelationtoscience and technology. They raise the question:whatareweallowedtobelieve?

AswithKelly’scollages,thequestionsraisedby The Cloudbusters resonate powerfully with

hcontemporarydebatesaboutprogress,science and technological change. The Cloud-bustersspeakparticularlytothepoliticizationof climate change science and the environment. Geo-engineering (the cause ofnumeroussciencefictionapocalypses)is becoming an increasingly likely response to climate change. The idea of engineering interventionstochangeweatherpatternswasparticularlyrelevantinKellerberrinintheWesternAustralianwheatbelt,wheretheseworksweremadein2008,asAustraliawasinthe grip of a long drought. Like Kelly’s collages theseobjectsraisethesefraughtissueswithaprovocativeandproductiveethicalambivalence.

Macguffinsandstoryengines

AlltheobjectsthatIhavedescribedinthispaper vibrate with numerous stories. They act asfulcrumsfortheintersectingnarrativesofscientifichistory,bothpersonalandglobal.This capacity to generate stories is a key featureofthespeculativeobject.Theyoperate,inAlfredHitchcock’sterm,as“Macguffins”the“mechanicalelement”(asHichcockdescribesit),whichpropelsforwardtheactionofanarrative.TheMacguffinhasalways played an important part in Science Fictionnarratives.GenericSciencefictionalMacguffinsincludethe“BDO”orBigDumbObject,athingthatinspiresaweandwonderthroughitspresence,whilstremainingmysterious (the obelisk in Stanley Kubrick’s 2001:ASpaceOdysseyisaclassicexample),andtheNovum[8],afictionalinnovationthatiscognitivelyplausible,andsignalsthenarrative’sinhabitationofaworlddifferentfrom that inhabited by the reader. Some of theobjectsincludedinAwfullyWonderfulwerephysicalexamplesofMacguffinsrelatedtofamoussci-fistories–theCurtaCalculatorandSinclairpersonalcomputer,forexample,arethemainobject-protagonistsinWilliamGibson’snovelPatternRecognition.Itisnotablethatbothoftheseobjectsareassociatedwithrichreal-worldstories,andGibson’sinvocationoftheminhisnovel

52 SPECTRA: Images and Data in Art/Science .

Page 53: SPECTRA - Australian Network for Art and Technology · SPECTRA: images and data in art/science Proceedings from the symposium SPECTRA 2012 The book and the conference that begat it,
Page 54: SPECTRA - Australian Network for Art and Technology · SPECTRA: images and data in art/science Proceedings from the symposium SPECTRA 2012 The book and the conference that begat it,

createdacompellingmixtureoftruthandfictionwithinthetext.

WecommissionedartistSimonYatestomaterialise,throughhissignaturehand-madewoodandpaperrobots,aparticularlyfamousandprovocativesciencefictionMacguffin–Futura,theevil,seductive,femalerobotfromFritzLang’sMetropolis(Fig.5). Supported by heliumballoonsYates’fragileanddelicatecontemporaryversionofFuturadrifted,spectrallyaroundtheexhibition.Thisoncepowerfulandfearfulcreationwasrevivedintheexhibitionaskindofgeriatricghostinthemachine.Herhauntingpresencewasapoignant reminder of the way in which the future age.

Anthropocene

Whilstmanyoftheobjectsandworksdestabilisedourviewofthepast,othersoffereddestabilisingviewsofthefuture.Apocalyptic,dystopianandpost-humanvisionsarefamiliarterraininsciencefictionnarratives,andseveraloftheworksmaterialised this terrain in startlingly physical ways.HaydenFowler’sworkAnthropocene (Figure 4, in background.),speakstothepossibilityofpost-humanconsciousness,andtherelationshipthatsuchaconsciousnessmight have to human beings. The Anthropocene is the name recently given tothegeologicaltimeperiodduringwhichhumanactivityhashadasignificantimpacton the earth’s ecosystems. The very act of namingthisperiodimpliesitsfinitude,andFowler’sinstallationallowsustospeculateon the possible fate of the human. The work consists of an island covered by grass with a rudimentarycaveshelterontopofit.Fowlerinhabitedtheislandduringtheexhibition,wearingapeltandaccompanied,ifyoulookedclosely,bythreerats.

Theinstallationsuggests,atfirst,amuseumdiorama of a pre-historic dwelling. It looks likeanidealisationofapre-technological,pre-modernformofexistence.Whenyougetcloser,however,youcanseethecomplicatedtechnological systems that are maintaining thissimpleinhabitation.ThefoodFowleriseatingcomesfromtincans.CCTVmonitors

showsurveillanceviewsfromwithinhiscave,wirestrailbeneaththeexposedwoodenstructureoftheisland.Thereisacomplextechnological infrastructure that supports this primitivewayoflife.

Therats,whichaudiencesmaycatchaglimpseof,suggestahintofanecosystem,butalsoalaboratoryexperiment.Whetherthisisazoologicalormuseumexhibit,oranexperiment,itsuggeststhatthehumaninhabitingtheislandisthesubjectofscrutiny,perhapseventhecauseofwonderandenjoymentforanotherconsciousness.Whatislookingatthisexhibit?Somethingstandsinrelationtothishumaninthesamepositionthatwehumansstandinrelationtocavemen,zooanimalsorlaboratoryrats.Intermsofspeculativeprojection,thisisanincrediblyhumblingperspectivetoadopt.

From speculative fiction to speculative objects

ConsideringtheexperienceofHaydenFowler’sislandilluminatesoneofthekeyquestionsraisedbytheideaofthespeculativeobjectasamaterialisationofsciencefiction.Istheexperienceoflookingat,smelling,movingaroundandcontemplatingAnthropocenedifferentfromtheexperienceofpsychologicallyinhabitingasciencefictionnarrative?TheMarxistliterarycriticFredericJamesonarguesthatthe“deepestvocation”ofScienceFictiontextsis“overandoveragaintodemonstrateandtodramatiseourincapacitytoimaginethefuture.”This,hesuggests,is“notowingtoanyindividualfailureofimaginationbutastheresultofthesystemic,culturalandideologicalclosureofwhich we are all in one way or another prisoners.”[9].SpeculativeFictionis,forJameson,amirrorreflectingoursituationbutclosedofffromit,unabletopenetrateorshiftour reality [10].

In Awfully Wonderfulsciencefictionmadeathreedimensional,andexperientialentranceintoourownworld.Theexhibitionwasfilledwithobjects,likeAnthropocene,thatsuggestedalternaterealities,butatthesametimeinhabited,withconcretephysicality,ourown. It is not by any means the aim of this

54 SPECTRA: Images and Data in Art/Science .

Page 55: SPECTRA - Australian Network for Art and Technology · SPECTRA: images and data in art/science Proceedings from the symposium SPECTRA 2012 The book and the conference that begat it,

essay to argue for the superiority of physicalovertextualartworks,butitisinterestingtonotethatthenatureoftheexperiencegeneratedbythespeculativeobjectsIhavedescribedoffersapossiblecounterpointtotheimpasseidentifiedbyJameson.Theexperienceofspeculation

54 SPECTRA: Images and Data in Art/Science .

provokedbytheseobjectsisvisceralandambiguous. In the interplay of their impossibility,obsolescenceandliminalitywiththeirtangibleexistence,theseobjectsactnotonlyasmirrorsofourownreality,butalsoasportalsthatallowus,ifonlyfleetingly,to move beyond it.

A. spongiosa. 2006. Mary Rosengren. From the print series fruitingbodies

Page 56: SPECTRA - Australian Network for Art and Technology · SPECTRA: images and data in art/science Proceedings from the symposium SPECTRA 2012 The book and the conference that begat it,

Learning through drawing in art and science

JamesMcArdle1,RussellTytler21.SchoolofCommunicationandCreativeArts,DeakinUniversity,Victoria3125,Australia2.SchoolofEducation,DeakinUniversity,Victoria3216,Australia

Thereisincreasingrecognitionoftheroleofimages,andvisualization,increatingnewknowledgeinscience,indicatingpotentialparallelsbetweencreativeprocessesin science and in art. This chapter presents case studies to illustrate how art has intersected withscienceideas,andthecommonalitiesanddifferencesbetweencreativevisualprocesses in art compared to science. The cases are chosen to illuminate the contribu-tionofarttoscience,theroleofvisualizationin reasoning leading to new theorising in science,andscientificanalysesintheserviceofaestheticprogramsinart.Theconstructofaffordancesisusedtoilluminatethediffer-encesbetweenartisticandscientificendeavour.Weexploreaschoolsciencepedagogy in which students construct visual andembodiedrepresentations,whichmoreauthenticallydemonstratestheimagina-tiveprocessesthroughwhichknowledgeiscreatedinscience,andtheintersectionsbetween these two disciplines in knowledge creation.Wearguethatartandscienceareboth centrally characterised by representa-tionconstruction,butdifferfundamentallyintheirdrivingpurposes,withcorrespondingdifferencesinengagingaffordance,whichwesee as a fundamental construct for under-standing the nature of reasoning and cognizinginbothareas.

Visualization as a major literacy of science

Thereisasubstantialliterature,setbroadlywithinasocio-culturalframework,arguingthat learning and knowing in a disciplinary areainvolvesaprocessofenculturationintoitsdiscursivepracticesshapedaroundasetofdisciplinespecificandgenericliteraciestobuild and validate knowledge [1].Understand-ingandpracticalproblemsolvingcompetencyinscience,involvestheproductionand coordinationofmulti-modalrepresentations

56 SPECTRA: Images and Data in Art/Science .

todevelopexplanationsandsolveproblems[2].Thereisincreasingrecognitionofvisualrepresentationsincludingdrawings,photo-graphs,andanimations,insciencelearningandintheepistemicpracticesofscience. Currentwritingplacesvisualizationandtheroleofvisuo-spatialmodelsasimportantcognitivecatalystsofscientificreasoningandknowledge building [3]. Studies have shown thedefining,ratherthansupportingroleplayedbyrepresentations[4].

Thisgrowingrecognitionoftheroleofvisualandembodiedrepresentationsinthe practiceandlearningofscienceraises interestingquestionsabouttherelationshipandpossibleproductivelinkswithpracticeandlearninginart.Thischapterwillexplorethisrelationship,drawingonexamplesfrombothfields,andonourexperienceofan approach to school science involving student constructionofrepresentations.Inparticularwedrawontheconstructof‘affordances’[5,6] asproviding‘productiveconstraints’on cognition.Wearguethattheroleof affordancesinscience,andinart,offersproductiveinsightsintothedistinctivenessofpracticesinthetwofields,andintothe appropriateroleofimaginationinschool science learning.

Artintheserviceofscience,andscienceusedforart-making,entailprocessesinwhichtechnologyislinkedwithrepresentationconstruction.Casestudiesfromeachareademonstrateparticularinteractionsbetweenvisualrepresentationandideaexplorationandtheorygeneration.

‘Scientific method’, variation and adaptation in art

Examplesintheliterature[7] acknowledge contributionsofarttosciencebutletusfirstexaminetheconverse.CameronRobbins’

Page 57: SPECTRA - Australian Network for Art and Technology · SPECTRA: images and data in art/science Proceedings from the symposium SPECTRA 2012 The book and the conference that begat it,

56 SPECTRA: Images and Data in Art/Science .

methodologymightbe‘scientific’buthis‘sampling’isdistinctlyquixotic.Studied longitudinallyRobbins’productiondevelopsfrominstrumentsthatproducecomplexdrawnformsfromchaoticinputs,to installationselegantintheirsimplicity. Prodigiousfromtheearly1990s,hecreatesand deploys a number of drawing machines torecordphenomenaofwind,tide,and humanmotion.His‘Heath-Robinson’ instruments mimic chart recorders of the kind onceusedforweatherandtideobservations.Darwinianadaptionisthepredominant creativecharacteristicofthisserial production,intheconstructionoflevers, paper drivers and styluses to record the inputsforaspecificproject.Adaptationandevolutionofformsareprocessesofboth scientificandartisticcreation[8]. However not justanyvariationorinnovationmaybe consideredcreativeunlesstheproductisusefultoagoal;‘wildideas’withoutsuchcoherencemaybejudgedinsaneratherthancreative.Creativeeffortisappreciated accordingtopracticaloraestheticstandards.

In Robbins’ case it is not solely the drawing thatdemonstratesthecharacteristic,butrathertheinstrument,itsprocessand producttogetherwhichareaestheticallypleasingtotheartist’saudience.Robbins’ collaborations,involvementinartist-runspaces and community art works are a demonstrationofGruber’s [9] ‘evolving systemsapproach’conceptofcreativeworkthatreflectsthecomplexinteractionsof people,processes,andknowledge.

Figure 1: Robbins’ smoke room

Robbins’ Smoke Room: 26 Surf Street 2007 (Figure 1)reverseshisusualpracticeofemployingrandommeteorologicaleffects;hecontrolsaircirculationinaroomto‘draw’withsmokeastartlingvortexthatappearsand disappears spontaneously.

Adefiningcharacteristicofcreativityis novelty. In art and science this may present as asurprise,revelation,manifestationor apparition.Suchwordsshareassociationsalsowithmagical,superstitiousorreligiousexperienceasbeingonthe‘spooky’outeredgeofawarenessandintuition.

Art in science: Amplification and reception

Charles Darwin [10] defended the argument thatemotionalexpressionsareevolvedandadapted. The book was pioneering in its use of photographs (seven heliotype plates) for thecollectionandanalysisofscientificdataandeffectivelycommunicatedittoa bourgeoisaudience.JuliaVoss[11] argues that Darwin“thoughtwithhiseyes”...“to formulatehistheoriesinthefirstplace.”Darwinusedvisualizations,sketched(poorly,heestimated),collectedengravingsandphotographsexhaustivelyandcommissionedwoodengravings.Evidently,thecompactnessof data contained in the portable and physical formofimages,readilycompared,envisagedthe stages between evolved features.

Figure 2: Rejlander’s Laughing/Crying

ConsiderfirsttheillustrationofacryingbabythatOscarGustavRejlandercontrivedfromahasty,necessarilyunposed,snapshot, enlargingit,redrawingitinchalk,thenrephotographing it (Figure 2).Thistypified

Page 58: SPECTRA - Australian Network for Art and Technology · SPECTRA: images and data in art/science Proceedings from the symposium SPECTRA 2012 The book and the conference that begat it,

Rejlander’sartisticmethodofmontageandimage-manipulationtoproducenarrative,when photography’s technical shortcomings thenexaggeratedthegapbetweenwhataphotographwouldshow,andwhatwethinkwe see. Darwin struggled for records of momentaryexpression.Beingacquaintedwithinnovatorsinartphotography,Darwincouldseeadvantageinemployingartistictalent. Given that he required images that wouldbeboth‘realistic’,andparadigmaticor‘metaphorical’,aphotographerwhosecredo“Inallpicturecompositionsthethoughtshouldtakethefirstplace...allelse[is]thelanguagewhichistogiveitexpression”(Rejlanderquotedin[12]),providedmaterialbetterthanDarwinhimselfcouldproduce.Prodger [13]arguesthatRejlanderwasan appropriatechoiceforDarwin’spurpose,againstpopularmodernexpectationsthatthe use of the medium in science is oriented toward‘objectivity’forscientificillustration,eventhoughaestheticallymediatedand enhanced visual data now necessarily predominates where direct imaging is not possible [14].

Image creation in scientific knowledge building

Imagecreationandmodelingareincreasinglyrecognizedasacruciallyimportantaspectofscientificknowledgebuilding[15]. Michael Faraday’sapproachtoscientificdiscoveryprovidesuswithinsightintotheimaginativeprocessesunderpinningaseminalscientificadvance.Faradaywasacarefuldocumenterofhisexplorationsandideas,andhisdiariesallowusauniqueinsightintoscientific reasoning processes. David Gooding [7] analysedtheroleofFaraday’sdiarized visualizationsingeneratingandestablishingnewtheoreticalperspectivesonelectro- magneticphenomena.Figure 3,basedonGooding,showsaseriesofentriesin Faraday’snotebookentriesoveronedaywherehemovedfromobservationsof patternsofneedleorientationaroundawire,to3Denhancementtoimaginefieldlinesin3D,totheimagingofaprocessintime,andfinallytoaninferenceforconstructionofthefirstelectricmotor.

58 SPECTRA: Images and Data in Art/Science .

Gooding [7] developed a process model to describehowscientistsmanipulatethe dimensionalityofimages,movingfrom particularandsituatedtomorewidely accepted facts and laws. He further argues forthecentralroleofvisualimages,suchasthosegeneratedbyFaraday,inunderpinningtheformal,rational,writtenlanguagethroughwhichscientificknowledgeissecuredasfact,law,andtheory.Thedrawingsderivefrom,butacttochannelperceptionstodrive imaginativeacts.Theywouldseemtohavemuchincommonwithexploratorycreationandinvestigationsofnewvisuallanguagesinart.

FromFeynmann’sdiagramsofparticleinteractions,thedoublehelixstructureofchromosomes,multidimensionalmodelingofgalaxiestocomputergeneratedabstractedgraphics,visuo-spatialimagingplaysacriti-calgenerativeroleinscientificreasoningandknowledge building. Latour ([16], p. 3) argues thattheemergenceofscientificthoughthasdependedondevelopingeffectiverepresen-tationaltools,andthatchangesovertimetoproceduresforwritingandimaginghavealteredthewaysscientistsargueandvalidatetheir case.

Case studies in art: Embodiment and affordance

Depictionsofmotion(time/space)are problematicinthestillimage.Human vision,throughbinocularandstereo perception,aswellasthroughallotherembodiedmeans,enablescomprehensionofspatial/motionrelationstothelevelof engagement encompassed in Gibson’s term ‘affordance’[5] and as something which ‘pointstwoways’betweenobserverand environment.Heseespictorial,planar imageryasaconstructionintowhichwecanbuildarepresentationornotationoftheserelationshipswithmathematicalformulae,orbysectioningspaceaswithawindow,sothatastillpicturemightyieldanexperienceofmotionandcomprehensionofspatial/motionrelations.

Thestereoscopere-positionstheobserverinvisualrepresentation.Theobserverisno

Page 59: SPECTRA - Australian Network for Art and Technology · SPECTRA: images and data in art/science Proceedings from the symposium SPECTRA 2012 The book and the conference that begat it,

Figure 3: Visual reasoning by dimensional enhancement and reduction - - a day’s work recorded in Faraday’s manuscript for 3 September 1821 ([7], p. 16).

Figure 4: James McArdle Pure Pivot (2001), monochrome digital print from scanned large format sheet negatives, 5m x 1.5m

Page 60: SPECTRA - Australian Network for Art and Technology · SPECTRA: images and data in art/science Proceedings from the symposium SPECTRA 2012 The book and the conference that begat it,

longerseparatefromtherepresentation; fragments from outside assemble within the body of the observer. Wheatstone or Brewster Stereo viewing apparatuses blend humanperceptionandcameralensimaginginauniquewaythatexemplifiesmyconcerns;theblendpermittingtheillusionthatwearelooking at three-dimensional space.

Thestereoscopeconfirmedthatvisionisafunctionasmuchofthemindasoutside stimuli.PatrickMaynardreferstosuch devicesas‘enginesofvisualisation’, industrialising vision and commodifying it [17]. This is useful sociologically and philosophically,andpromptsare-evaluationoftheseinstrumentsfortheircharacteristicsinscientificandaestheticuses.

Letususeanexamplethatinvolvesmove-mentsoftheobserver,theobservedandofthe camera. Ernst Mach [18] would have us understand that with our two eyes we stand attwoplacesattheonetime,whileJohnHerschel [19]observes:“Letanyonetravelingrapidlyalongahighroadfixhiseyesteadilyonanyobject,butatthesametimenot entirelywithdrawhisattentionfromthe generallandscape,hewillsee,orthinkhesees,thewholelandscapethrownintorotation,andmovingroundthatobjectasacentre.”

Onecouldseenewpotentialtobederivedfromthatidea;inmovement,withourtwoeyes,wemightexistintwomomentssimul-taneously.Furtherexperimentationwithphotography (McArdle, Vortex series, opposite page)seekstoevokesensationsofbeinginthelandscape;workingintheenvironmentwiththecameratorenderuniquequalitiesofhumanvisionandperception.(Figure 4) Such phenomenaresultfroman‘opticflow’oflargelysubconsciousvisceralperception arisingfromaconnectionbetweenbodyandenvironment,andasGibsonproposes,theyarealsoasignofmindandattention[5]. Heightenedattentionisnecessaryin observingmotionperspective,anditisaveryhuman sense of the physicality of the environment.Orientationandorderarehere

60 SPECTRA: Images and Data in Art/Science .

acondensationofspacebytime,manifestedasconcentratedstillpointsembeddedwithinthe surrounding confusion by the observer (photographer/viewer) themselves. The preparationfortheconstructionofthese muralscalemontagesinvolvescollectingimages of the landscape seen on the move (Figures 5, 6).Aglanceonsuchajourneymay pick something up and this place is then visited on foot. Moving and swivelling of body and camera in dance-like and manual gesturesre-arrangesthechaoticarrayofnearanddistantforms;theyareregisteredasstreaksandswirls,‘vortices’,thatformintheforegroundandbackgroundaroundstillpointsthatremainsharpanddistinct.

Theprocessentailssystematicinvestigations,motivatedbybothscientificandartistic curiosity,thatreviewerDirkdeBruyn proposes“arenotrandomoperationsbutdocumentabodilyrelationshiptothesespaces....Isthisanindicationofaspentandunsettledlandscape,aspaceincrisisorarethesethetracesofemotionimpartedfromthebodyofthephotographerhimself?”[20].

Drawing in school science, and science

Inourownworkwehaveexploredaschoolsciencepedagogybasedonrepresentationconstruction.Studentsdraw,andmodel,theirinterpretationsofphenomena,supportedbytheteachertoevaluateandrefinethesetoachieveconsensusaroundthescientific representationalcanon.Weadvancedistinct reasonsforactivelydrawinginlearning science [21].Theseargumentsforactive constructionofrepresentationsinschool sciencemirrortheroleofrepresentationsintheknowledge-buildingpracticesofscienceitself [6]. We analyse the process by which two stu-dents in a grade 5/6 class responded to the challengeofrepresentingthemovementofachosen invertebrate. At the start of this lessonIvancarefullyexamined representationsinhisworkbook(Figure 7) ofhowanearthwormmoved,thathehaddrawnathome,anddiscussedthemwithhispartner.

Page 61: SPECTRA - Australian Network for Art and Technology · SPECTRA: images and data in art/science Proceedings from the symposium SPECTRA 2012 The book and the conference that begat it,

Figure 5: James McArdle Glance (2007) Type C photograph

Figure 6: James McArdle 09:13 (2012) Type C photograph

Page 62: SPECTRA - Australian Network for Art and Technology · SPECTRA: images and data in art/science Proceedings from the symposium SPECTRA 2012 The book and the conference that begat it,

Figure 7: Ivan’s workbook entry representing the movement of an earthworm

Theythenselectedmeccanopieces, connects,flexiwireandblutactobuilda“techno-worm”.Theywantedtheirmodelto represent as accurately as possible the amountofextensionand‘retraction’oftheearthworm. They drew up a scale on an A3papertohelpthemrepresenttheexactextensionandretractionastheearthwormmoved along a smooth surface. The boys proceeded to build up a device to enable themtoextendandretracttheflexi-wire (Figure 8). They described the process of refiningtheirmodel,whichinvolvedtryingdifferentmaterialsandconnecting arrangementsuntil‘itstartedtofit…itmadea bit more sense’. They relied on gestures as theydescribedtherelationshipbetweenthestretch,andthethicknessoftheworm‘when itshrivels.[palmsclose]…itgetsfatter[moves the thumb away from the fore fingers]’.Thecasehighlightsthemulti-modalnature of the students’ thinking and reasoning,astheytalk,gesture,draw,usemeasurementartefacts,andconstructthe3Dmodel. Their understanding deepens through successivetransformationsacross representations,whichacttoorganizetheirperceptionsateachstage.Thedrawingsharpensandchallengestheirobservation,themodelforcesattentiononthematerialcharacteristics,andonthemeasurementofretracted/extendedlength.

Weseeinthiscasethesuccessivecreationofrepresentationsinvolvedtheimaginativecreationofnewvisualsymbolictoolsandartifacts,followingtheprocess,described

by Gooding [7],frompatterntostructuretoprocess.

Representing in science and in art: Convergence/divergence

Fromthesecasestudieswearguethatthecoreofthecreativeprocessinbothartandscienceistheconstructionandrefinementofrepresentationstosolveaproblem.Openingupaffordancesthroughtheserepresentationsis key in each case. We can see inspirationandintuitioninthewayacreativemindfromeitherfieldmakesleapsfromonewayofseeingtoanother.Inourexamplesfrom science and art we are dealing with theproblemofrepresentingphenomena,particularlytime;howtorepresenttimeinastillphotographicimage,orinadrawingormodel.Inthesciencelab,andintheart studio,wedistinguishacommonpathwayfrom phenomenon> curiosity>discernment of aproblem>explorationandanalysis> selectionandorchestrationofelementsintoacoherent synthesis.

Figure 8: The ‘techno-worm’ model of the stretch and retraction of an earthworm

62 SPECTRA: Images and Data in Art/Science .

Page 63: SPECTRA - Australian Network for Art and Technology · SPECTRA: images and data in art/science Proceedings from the symposium SPECTRA 2012 The book and the conference that begat it,

whereasitisexplicitlyruledoutofthe scientificendproduct.

Second,inbothartandsciencetheconstructofaffordancesisfruitfulinprovidinginsightinto the nature and purpose of the representationconstruction.Inscience,thedifferentrepresentationsanddifferentmodesofferparticularaffordancesthroughthewaytheyconstrainandfocusattentiononkeyfeaturesofthephenomenon,tobuild conceptualinsight.Each,however,is convergentinitsintent.Inart,bycontrast,theultimatepurposeoftheanalysisistoexploreandrefinethepossibilitiesofthemedium. While these may be employed for scientificends(e.g.DarwinandRejlander),ultimatelyfortheartistthecreationof affordancesisthecorepurpose.

Thegeneration,refinementandorchestrationofvisualandotherrepresentationsiscentraltotheseprocesses,andthepathwaycanbediscernedintheprofessionalpracticeof FaradayandMcArdleasitcaninJesse’sandPaul’sexplorationofcentipedemovementortheartisticrepresentationofaforensicinvestigation.

However,thisrepresentationconstructionprocessdiffersintworespects;first, concerningfundamentalpurpose,andsec-ond,thewayaffordancesoperateinthetwodisciplines.First,thedifferent fundamentalpurposesofrepresentation generation,refinementandorchestrationinthetwodisciplinesaffectthenatureofeachelementintheprocess.Inart,theburdenofthetask,andthefocusoftheanalysis,istocreateanartefactthatfortheparticipant observeroffersinsightorillumination,renewedorenrichedsensibilitiesandnewperceptions.Theprocessaimstoachievenewdiscursivepossibilitiesthatadvancethefield.

Conversely,inscience,theexplorationandanalysisservestobuildexplanationsupportedbyevidenceinanexplicitway.Wewould argue that this is achieved through coordinationofthevisualrepresentationwithinexplanatorynarratives,whichallowlogicalprocessestobeengagedwith,inaformalprocessofargumentation.Theburdenofthescientificanalysisthusrestsonformsofevidencethattestandaffirmthevisualinnovation.

Analysis processes are central to both disciplines. We see in McArdle’s work the generativenatureofanalysisoftheprocessofstereoscopicvisionandhowthisaffectstheimagesacrossthefield.However,whilesuchinsightsmay,inasciencecontext,havefedintoaconvergentexplanatorydepictionofsight,therealaimoftheexplorationistoamoredivergentend–inart,theanalysisfeedsbackintoagenerativeproductandconcernstherefinementofthistoevokeandstimulateinsightintoperceptualprocesses.Thecentralconcernistoexplorethe affordancesofthemediumtoachievethis.Affectisacentralpartoftheprocess,

62 SPECTRA: Images and Data in Art/Science .

Page 64: SPECTRA - Australian Network for Art and Technology · SPECTRA: images and data in art/science Proceedings from the symposium SPECTRA 2012 The book and the conference that begat it,

64 SPECTRA: Images and Data in Art/Science .

Technology, Illustration and Science

Andrew HowellsSchoolofDesign,CommunicationandIT,TheUniversityofNewcastle,Callaghan,NSW2308,Australia

AsaNaturalHistoryIllustrator,itisthe practiceapproachormethodologythat enablesresultingartworks/illustrationstoperformaspecificfunctionasreferenceandresource imagery for the sciences. This type ofpracticeandimage-basedoutcome requiresaperiodofcontextualresearch, consultationandobservationtoinformthestudioexperienceandresultingartworks.Asanoutcomeofresearch,theartwork,orgenerated artefact embodies the knowledge acquiredintheresearchprocess,and communicatestheintendedknowledge,theme or event that was the catalyst for its creation.ItisinthiscontextthattechnologyoffersthecontemporaryNaturalHistory Illustrator considerable scope in studio practice,incollaborativeengagementwiththe sciences and in the diverse forms of publication,exhibitionandinteractionofferedbynewandemergingdigitalmediaplatforms.Thetraditionalcollaborativerelationshipbetween illustrators and the sciences has

changed with digital imaging technologies. Thishasopenedupnewfrontiersfor observing,recordingandrepresentingvisual dataforboththeartistandscientist.Therolesinthisrelationshiphavenotjust changedovertimebutinsomecases dissolved. The danger for the sciences in embracingjustthefunctionalityofimagingtechnologyandnegatingthetacitknowledgeoftheartistvisualmindinconstructingandinterpretingvisualdatacouldpotentiallylimitthe capacity of captured and constructed images,theirinterpretationandabilitytoeffectivelydisseminateknowledge.Itistheroleoftechnologyinpractice-basedresearchasanillustratorforthestudioexperience,researchcollaborationandintendedformsofpublicationandinteractionthatIwilldiscussinthecontextofmyPhDresearchtitled Elephant: Art and Science.

Myresearchwasnotascientificstudy,ratherthedevelopmentofabodyofanillustrative

Figure 1: Asian Elephant anatomical reference, Illustration: A. Howells

Page 65: SPECTRA - Australian Network for Art and Technology · SPECTRA: images and data in art/science Proceedings from the symposium SPECTRA 2012 The book and the conference that begat it,

64 SPECTRA: Images and Data in Art/Science .

and aesthetic skills to portray a subject accurately. Accuracy and communication are essential. Communication of shapes, anatomy, details and concepts that cannot be conveyed via words, forms the essence of this type of art.’[1] It is important to note thatthispracticeisnotdefinedbyaspecificillustrativetechniqueoruseofmaterialsandmedia.Thepractice,althoughassociatedwithtraditionalmediasuchaspencil,penandink,watercolourandscraperboard,itisdefinedbya working methodology that requires periods ofobservation,consultationandstudio experimentationindevelopingvisual solutionsfacilitatingtheproductionof imagerywiththekeyobjectivesofbeing accuracyandeffectivecommunication.

Fieldworkiskeytothispractice;itisthroughtheprocessofobservationalfieldworkthatanobjectbecomesasubject.Observation underpins the ability to create representa-tionalimagery.Inaverysimilarwaytoa portraitartistdevelopingarapportwithasitter,throughfieldwork,observationmovesfromseeingthespatialrelationshipsofform,proportion,structure,andthesurfacequalityofasubjecttoseeingmannerism, personality and intricacies of form and detail that can only be understood and depicted throughperiodsofintensiveobservation.Itisthesubtletiesofweighttransferin movement,lightdescribingformandnaturalposing and stance that needs to been seen andexperiencedforthemtobedescribed.Withouttheseobservationsalikenesscanstillbedevelopedfromstaticreference,butitisthisintimateknowledgeofasubjectthroughfieldworkwhereadimensionalunderstandingofasubjectisgainedtofaithfullyrepresentthatsubjectfrommultipleanglesandinmanycontexts.ItwastheaccurateportrayaloftheAsianElephantsanatomy,itsnaturalform,proportionandstructurethatwascrucialincommunicatingthesubtlevisualchanges betweenbodyconditionsfortheresearch.UnderstandingtheanatomyofAsian Elephantswascrucialtotheirdepiction.

Subsequent knowledge acquired through fieldworkandconsultationwithspecialististhenexploredinthestudioincontextof

resourcebasedoncurrentscientific methodology. My focus was on the developmentofillustrationssuitableforuseasreferenceintheBodyConditionScoring(BCS)ofcaptiveAsianElephants.BCSformedoneaspectofamulti-institutionalstudytitled‘Understanding the interaction between nutrition, activity and reproduction in captive Asian Elephants’.MycontributiontothisresearchwasthroughcollaborationwithveterinaryscienceresearchersatFortWorthZoo,Texas.Myresearchwasfocusedontwospecificlinesofinquiry:1.TheAsianElephantassubjectfor illustrationandartwork;and2. The development of illustrated reference forvisuallyassessingthebodyconditionofcaptiveAsianElephants.

These two lines of enquiry ran concurrently andhadacentralfocusinobserving, contextualisingandaccuratelydepictingtheAsianElephant.TheAsianElephantassubjectforillustrationandartworkrequiredextendedperiodsofobservationandtechnicalstudioexperimentstoarriveataprocessandstylethat would meet the needs of the required illustrativereferenceimagery.Thedevelop-ment of an illustrated resource to convey the rangeofpossiblebodyconditionsdefinedbythevetinaryscientistrequiredcollaborationinunderstandinganddepictingspecific anatomical content consistently in a body of sequentialreferenceimagery.Thisprocessrequiredamulti-disciplinaryapproachtopracticethatenabledtheresulting illustrationstoserveeitherasindividualstaticreferenceoraselementsofaninteractivevisual screen-based tool.

Defining Practice

TogivecontexttomyworkIneedtodefinetheprocessesinvolvedinmypractice,theseprocessesaretechnical,creativeand conceptual.Idefinemypracticeas NaturalHistoryIllustration;thepracticeismore broadly described or understood as Sci-entific,orNaturalScienceIllustration.GoulddescribesScientificIllustratorsas ‘Artists in the service of science. They use specifically informed observational, technical,

Page 66: SPECTRA - Australian Network for Art and Technology · SPECTRA: images and data in art/science Proceedings from the symposium SPECTRA 2012 The book and the conference that begat it,

66 SPECTRA: Images and Data in Art/Science .

thebrief,orresearchobjectives.Technicalexperimentationwithmaterialsandmedia,scaleandcompositionisthenundertakentodeveloptheinitialworksbeforefurther collaborativeengagementandtherefinementandexecutionoffinalillustrations.

Defining the research

Theresearchwasspecificinitsaimto develop a simple system for visually assessingthebodyconditionofcaptiveAsianElephants.TheTexas-basedresearchgrouphaddevelopedanindexedrangeofpossiblebodyconditionsforthespecies.Thisindexrange allocated a numerical value to clusters ofspecificphysicalcharacteristicsassociatedwithobservedbodyconditionsincaptiveAsian Elephants. They had described the observedphysicalattributeswitheachoftheindexedclassificationsandamasseda photographic resource library for each indexedbodycondition.

SowhatisBCS?BCSisasubjectivevisualassessment. BCS is the process of visually assessing a number of anatomical regions of ananimal’sbodyandassigningascore,orindexedvaluebasedonthedescribedrangeofpossiblebodyconditionsforaspecies.BCSeffectivelyidentifiesaparticularanimalsbodyconditioninrelationtoitsspeciesbroaderpopulation.TheBCSmodelusedby researchersforaparticularspecies determines the range of possible body conditions.TotransitionthisunderstandingofBCSinthecontextofAsianElephantsandtodevelopalistofillustrationrequirementstomeettheresearchobjectivesIneededtoredefineBCSintermsthatrelatedtothe observationsIneededtomake,andthepracticemethodsneededindesigningspecificvisual reference.

MyinterpretationofBCSforthepurposesofobserving,planninganddevelopingpractice-basedprocesswas;theobservationofthevariability of visible surface depressions of an animal;visiblesurfacedepressionsare created and vary depending on the level of fat andmuscleconditionbetweenan animal’sskinandskeleton.Itisthisrelation-ship between the skin and the skeleton that

Figure 2: Comparative photographic reference of individual Elephants, Photograph: A. Howells.

becamethefocusofmyfieldworkandthebasis for developing my preliminary illustra-tions.Figure 1isanillustrationIdevelopedasreferenceofthisrelationship,andforcontextwhen observing the visibility of bony structuresasbodyconditiondeclined.

TheexterioroftheAsianElephantanditsinternal structure became the focus of my fieldwork.Thisrequiredlivespecimensandanarticulatedskeletontodevelopreferencematerials and the understanding I needed to depict visually these two elements when the level of muscle mass and fat changed betweendescribedbodyconditions.

IconductedfieldworkatSydney’sTarongaZoo,FortWorthZoo,Texas,theAustralia MuseumandtheSmithsonianNational MuseumofNaturalHistory.DuringthesefieldtripsIspenttimesketching,photographing,videoing and talking with keepers and scientistinanefforttogathertheessential referencematerials,andunderstandingneeded to develop meaningful reference images.Myresearchwasthentransitionedinto the studio to translate my understand-ingofthedescribedindexrangeofbodyconditions,andreferencegatheredthroughfieldworkintoartworks.

Why Draw?

At this stage it is important to address the

Page 67: SPECTRA - Australian Network for Art and Technology · SPECTRA: images and data in art/science Proceedings from the symposium SPECTRA 2012 The book and the conference that begat it,

66 SPECTRA: Images and Data in Art/Science .

representingitanidyllicway.Illustrations being completely constructed visuals providedaplatformforcollaboration,artdirectionandflexibleapplicationforthe development outcomes.

The aim in developing illustrated reference was to address the variability associated with photographic reference. The following are the key areas of variability associated with photographicreferencethatIidentifiedandsoughttoaddresswithillustration.Variancein photographic reference I grouped to two maincategoriesfirstwastheindividual physicalcharacteristicsofdifferentElephantsused to demonstrate the scope of nine possiblebodyconditions.Figure 2 is an exampleofthevariabilityofindividualElephants,thesetwoElephantswerebothsubjectsthatIstudiedinmyfieldworkandwould be assessed using the same reference. The noted variances included the following:•Variationinskinpigmentationofindividual animals•Variationinhaircoverageofindividual animals•Variationinthescaleofindividualanimals•Variationinthestanceofphotographed animals•Variationinthesurroundingenvironments of photographic reference

The second main type of variance in photo-graphic reference was to do with technical aspectsofphotography,including:•Thepositionofthephotographerin relationtotheElephant,thiscreated variationincaptureddetail,distortionof subjectandtheamountofcontextual environmental content captured.•Thetechnicalproficiencyofthe photographer,thiscontributedthe compositionofthecapturedreference,theability to create a focused image and under-standingoflightingtocapturetrueform.•Thevariationinthetechnicalcapacityofthecameraincludingthelightsensors,resolutioncapacityandresultingimagequality.

Centraltoreducingthesubjectivityoftheassessment was strengthening the reference imagery supplied to make the

questionthatImostoftenencounteredwhentrying to describe my research. That questionis,whydraw?Inansweringthisquestionitisbesttounderstandthecontextoftheoriginsofthecollaborativeresearchrelationshipandmydescribedillustrationpractice.ThefollowingisaquotethatIthinkexplainsthestrengthofthecontributionofdrawing to cross-disciplinary research. Although the quote directly relates to designers the term can be term directly substitutedwithdrawers/illustrators. ‘If designers are to play a constructive role in multi-disciplinary enquiry we need to understand what will be different and helpful in their contribution. One feature of a design-based enquiry is that it can generate artefacts; another is that designers are skilled in organising and representing artefacts. This may not appear central to the idea of scientific enquiry, but it might become very significant if we consider the role that systems of representation have played in the development of thought.’[2]

Aswithmanyresearchcollaborationsachanceconversationturnsintoadiscussion,followed by a challenge to see if thinkingaboutaprobleminadifferentwaymayaddressaneed.Inmycase,while paintingaportraitofSydneyUniversity Veterinary Science Lecturer Dr Roy McClementstheconversationmovedtohislatest research and the topic of Elephants. It washisexplanationoftheprocessofvisuallyassessingthebodyconditionofElephantsand the way he had planned to instruct and provide reference for the assessment that raisedquestionsinmymind.Iwasprocessinghisideasfromapurelyvisualperspectiveandattemptingtounderstandhowsomeonewithlimited,tonounderstandingofveterinary science and Elephant anatomy could see specificphysicalindicatorsassociatedwithsubtlevariationsinthephysicalformof Elephants.

BCSbeingasubjectivevisualassessment,theeffectivenessofvisualreferencecouldreducethesubjectivityintheassessmentprocessbyisolatingthekeyvisualinformationand

Page 68: SPECTRA - Australian Network for Art and Technology · SPECTRA: images and data in art/science Proceedings from the symposium SPECTRA 2012 The book and the conference that begat it,

68 SPECTRA: Images and Data in Art/Science .

Figure 3: Animation as illustration process, Illustration: A. Howells.

Figure 4: Morphing body condition of individual animal. Illustration: A. Howells.

Figure 5: The developed illustrated BCS reference set. Illustration: A. Howells.

assessment. It is best understood how this couldbeachievedinthecontextofthe descriptionofBCSthatIconveyedearlier,the observation of the variability of visible surface depressions of an animal; visible surface de-pressions are created and vary depending on the level of fat and muscle condition between an animal’s skin and skeleton.

Controllinglightingwasthemostintegralpartof providing consistent reference imagery that focusesonlyonthevariationofvisiblesurfacedepressionsforeachseparatebodycondition.Whendrawing,lightdepictedthroughtheuseof a tonal range describes form. In a sequence of imagery where the only required visual differenceforeachimageisthedepthofa

Page 69: SPECTRA - Australian Network for Art and Technology · SPECTRA: images and data in art/science Proceedings from the symposium SPECTRA 2012 The book and the conference that begat it,

68 SPECTRA: Images and Data in Art/Science .

transparent overlayed images and as a mor-phinganimationofthesequence.Onthelight-boxanillustrationoftheskeletoncouldbe viewed under the sketch of each body conditionasitwasdrawn,thisprovidedareference for the bony structures appearing as surface depressions as body conditiondeclined.Figure 3 demonstrates the development of individual body conditionillustrationsasoverlayedimageswith the skeletal reference as a point of referenceandregistration.

Animationwasoriginallyusedasawaytoensureconsistencyintheillustrationprocessand to assess the successful morphing of the physicalformbetweenillustrations.The process enabled consistency in developed illustrationsandadditionallyamorphing animationofthepossiblerangeofbody conditions.Theprocessprovidedoutcomesthatcouldbeusedasstatichardcopy reference and played as a morphing animationforscreen-basedmedia.

Additionaltotheroleofanimationasa processforthedevelopmentandrefinementoftheindividualillustrations,graphicssoft-wareprovidedaplatformtocontrolthe consistencyoftone,surfacedetailand physicalfeaturesbetweenillustrations.TheIllustrationprocessneededtobeeconomi-calandeditabletoallowforcollaborationin terms of feedback in the development of eachillustration.Layeredgraphicsfiles providedameanstocontrolscale,andtheemergence and depth of visible surface depressionbetweenillustrations.Figure 5 demonstrated the complete set of BCS reference,Figure 5 also demonstrates with greaterdetailthevariationsurface depressiondepictedusingvariationoftonaldepth registered to a skeletal structure.

The role of technology

Technologyplayedasignificantroleinmyresearch.Thisrolewasnotjustinmy practiceapproach,butalsointhe collaborativeexperienceandapplicationofoutcomes.

Thecontributionoftechnologytomy

visiblesurfacedepression,thenestablishingaconsistent light source enables the controlled use of tone to depict varying surface forms. Depictingasingleanimalinasinglestancewith a consistent rendering style for all images in the sequence would result in images that only demonstrated and communicatedtherequiredobservations.This approach to the development of BCS referenceimageryincontextofaninformedunderstanding of the anatomy demonstrated in Figure 1 was the basis in establishing illustrationrequirements.

Illustrating Outcomes

Transitioningfieldworkandcontextualresearchintoillustrationsrequireddevelop-ing studio process that would facilitate the executionoftheillustrationrequirements.Theillustrationrequirementswerespecificallyfocused on addressing the anomalies associ-ated with the photographic reference noted above.Eachoftherequirementsreflectedaneedforspecificstudiopracticethat cumulativelyformedapracticeapproachto the development of outcomes. The core requirementfortheillustrationswas consistency;thedevelopmentofagenericspecimen that would be illustrated in a mono-chromestyleforallnine-bodyconditionswouldaddressthemajorityoftheanomaliesobserved in photographic reference. This alonewouldhavereducedthesubjectivityofthereference,butitwasthemethodsusedtodevelopthesequenceofbodycondition illustrationsthataddedvalueincontrollingthe anomalies that could be drawn back into the reference unless there was a system in placetocheckthemorphingofspecific physicalcharacteristicsbetweenillustrations.

Animationprovidedaplatformforthe registrationofindividualimagestoeachotherinasequence,andthereforeaplatformtoassess the incremental changes in physicalfeaturesasthebodyconditionchangedbetweenillustrations.Althoughbasedontraditionallight-boxanimationtech-niques,widelyassessableanimationsoftwareprovidedaplatformtocapture,viewandeditthe sequence of images as

Page 70: SPECTRA - Australian Network for Art and Technology · SPECTRA: images and data in art/science Proceedings from the symposium SPECTRA 2012 The book and the conference that begat it,

70 SPECTRA: Images and Data in Art/Science .

research I have categorised into three key areas:

1. Technology and the studio experienceSoftwaretechnologyallowedmetocontrolthemajorityoftheanomaliesassociatedwiththedevelopmentofasequentialbodyoftraditionallyillustratedimages,andtosharetheprogressofindividualillustrationswithcollaborators to ensure accuracy in content. Editableillustrationsfacilitatedongoing collaborationinthere-contextualisationoftheillustrationstoanumberofprintandscreen-basedpublicationforms.

2. Technology and the collaborative experienceInadditiontotheroleofsoftwarein facilitatingcollaborationintheproductionofillustrations,animationsoftwareprovidedaplatformtodemonstratethemorphingoftheBCSillustrationsasanadditionalresourcethataidedincommunicatingtheextentofphysicalchangeintheBCSrange.Animationwasoriginallyafunctionoftheillustrationprocesstoensureconsistency,andthroughcollaborationbecamearesourceonitsown.

3. Technology and the dissemination knowledgeNewmediaplatformsenabledthe publicationofstaticandanimatedcontentincontextofotherresources,including: photographiclibrariestotext-based descriptions.Publishingelectronically provided a more comprehensive resource thatcouldbeexpandedoramendedbasedonthe need of the research.

The historically founded link between art and science has greater scope for inquiry and outcomes through the use of technology. The practice-baseknowledgeoftheNaturalHistoryIllustratoristechnical,creativeand conceptual;thisknowledgeistransferableintotechnologyplatformsforimagecapture,constructionandapplication.ItisintheunderstandingofNHIpracticethatthesciencescanembracethepractitionerandtechnology in cross-disciplinary research.

The Sixth Shore project: baler twine residue on farming property at Lake Clifton: human complexity and waste (detail) © Perdita Phillips. Used by permission

Page 71: SPECTRA - Australian Network for Art and Technology · SPECTRA: images and data in art/science Proceedings from the symposium SPECTRA 2012 The book and the conference that begat it,

70 SPECTRA: Images and Data in Art/Science .

conventionalrealitymustbemorethananobjective,material,mind-independentworld.The‘mindworks’projectsrepresentbothmetaphoricallyand,arguably,literally physicistJohnWheeler’sideaofa ‘participatoryuniverse’;thatweparticipateincreatingtherealityweexperience. [4] In this sense,itcouldbesaidthatconscious observationequatestophysicalmatter.The‘mindworks’projectspresentopportunitiesfortheviewertodirectlyinteractwiththem,allowingexpectationsofconventionalrealitytobepotentiallyruptured.Ihaveundertakenthreeseparate‘mindworks’projects.Thefirstofthese,andthesubjectofthispaper,istheMetaphaseTypewriterrevivalproject.

Background to the Metaphase Typewriter revival project

Quantum mechanics is the fundamental explanationofhowphysicalmatteriscreatedand behaves at the subatomic scale. It is the basisfortheexplanationoftheschemeofthingsinouruniverse.However,itistotallyatoddswithourusualexperienceofa ‘conventionalreality’thatisknowable,mind-independentandobjective. [5] The quantum world forces us to see that reality is a concept much broader than one simply based on our ownperceptions;aworldthatis,possibly,muchmoresubjectiveandrelativethanwerealise and one that may be interconnected in ways that we cannot yet conceive.

Inpart,myresearchintohowvisualartthatengageswithquantumconcepts,might enableaviewertodoubtconventionalreality,aims to respond to a decades-long call from partsofthescientificcommunityfora re-evaluationof‘conventionalreality’. [6] This call is based on the fact that quantum mechanicsconflictswiththenotionofa

I make artwork that engages with quantum mechanics to enable the viewer to doubt conventional reality. Quantum mechanics gives significant cause to doubt conventional reality. Rather than reality being knowable, objective and mind-independent, one quantum theory poses the confronting possibility that reality is brought into existence through observations, even, controversially, by consciousness. My ‘mind works’ projects, one of which is the Metaphase Typewriter revival project, enables a viewer to doubt conventional reality. Specifically, the ‘mind works’ projects do this by providing the viewer opportunities to interact with events of quantum super- position, using only consciousness, to argu-ably affect or even create material reality.

Since2009,Ihavebeenmakingmixed media artworks based on concepts of quantum mechanics. My PhD research examineshowvisualartthatengageswithconcepts of quantum mechanics can enable a viewertodoubtknowable,mind- independent,objectivereality.Asa specificpartofthatresearch,my‘mindworks’projects [1] makeasubstantialassaultonideasofconventionalreality.Theysuggestthe possibility that there is a primary role for theobserverinobtaininginformationabouttheworld.Further,basedonsomeaccounts,they suggest that that the observer’s consciousness could be the agency by which fundamentalquantumparticlesmovefromstatesofsuperpositionintomaterialreality. [2]

Thebasisforthisclaimisthat,theyprovideactual quantum random events [3] with which theviewercaninteracttoaffector,arguably,create material reality. The viewer has an immediate sense that if their own conscious-nesscanaffectorcreatematerialreality,then

Consciousness, quantum mechanics and the Metaphase Typewriter revival project

Lynden StonePhDcandidate,QueenslandCollegeofArt,GriffithUniversity,SouthBrisbane,Queensland,Australia

Page 72: SPECTRA - Australian Network for Art and Technology · SPECTRA: images and data in art/science Proceedings from the symposium SPECTRA 2012 The book and the conference that begat it,

72 SPECTRA: Images and Data in Art/Science .

knowable,mind-independentrealityinfundamental and shocking ways. In contrast tothemacroscopicconventionalrealityIperceive,inthesubatomicquantumworldthereisnophysicalmatterasIunderstandit.Rather,accordingtotheacceptedformulationofquantummechanics,pre-materialstatesofconnectedmultiplepossibilities(statesof‘superposition’)exist.Thesesuperposedstates,accordingtoconventionalviews,arecollapsedandbroughtintodefinitestatesofsingularmaterialrealitythroughobservationor measurement. [7] Rather than reality being knowable,objectiveandmind-independent,quantumtheoriesposetheconfronting possibility that there is a quantum realm imperceptibletoandunknowablebymeandthattherealityIexperienceisbroughtintoexistencethroughmyobservations,even,controversially,bymyownconsciousness. [8]

Inthemacroscopicworldwelivein,wedonotreadilyobservequantumsuperposition;[9] it appears to have collapsed into single material actuality. The process of how and whyquantumsuperpositioncollapses(if,infact,itdoes)isnotpresentlyunderstoodbyscience. Various theories of how the quantumsuperposedstateofmultiple possibilitiesresolvesintoasinglestateofactualitythatweexperiencecanbegroupedintotwopropositions:eitherquantum superpositiondoescollapseoritdoesnot.Themaincompetingcollapsetheories propose that collapse is caused by either the actofmeasurementorobservation(regardedastheorthodoxtheoryofcollapse)[10] or the specificmindorconsciousnessofthe observer,[11] orbymixturewiththemacro-scopic environment (without the necessity for an observer).[12] This last theory of environ-mentalcollapseattemptstoretainsomelevelofphysicalobjectivityintotheideaofquantum mechanics but the mechanism for thiscollapsetheoryisyettobesatisfactorilyexplainedandincreasingexperimentalresultsindemonstratingquantumsuperpositionatscales now readable with the naked eye [13] meansthelinebetweensuperpositionandcollapse is unclear.

Ifobservationormeasurementcauses

Figure 1. Lynden Stone Metaphase typewriter revival project 2012, Geiger counter, gas lamp mantle, laptop, program, Per-spex cover, dimensions variable, installation view. Photograph by Carl Warner.

Figure 2. Lynden Stone Metaphase typewriter revival project 2012, detail of Geiger counter

Figure 3. Lynden Stone Metaphase typewriter revival project 2012, installation view

Page 73: SPECTRA - Australian Network for Art and Technology · SPECTRA: images and data in art/science Proceedings from the symposium SPECTRA 2012 The book and the conference that begat it,

72 SPECTRA: Images and Data in Art/Science .

collapse of pre-material quantum superpo-sitionintophysicalreality,thenquantumtheory is an empirical theory and there is nophysicalrealitybeyondobservationandmeasurement.[14] Somemathematicians, physicistsandtheoristshaveextendedthistheory to suggest that the agency of the observer’s mind or consciousness causes quantum collapse.[15] Furtherstill,ahighlycontroversial theory by a handful of physicists proposes that consciousness is the method by whichquantumsuperpositioncollapsesintosingular material reality.[16] Accordingly,itispossible that through our consciousness we haveafundamentalroleincreatingmaterialreality.

The Metaphase Typewriter revival project

In the Webb gallery at the Queensland CollegeofArt,Brisbane,alaptop,its keyboardcoveredwithblackPerspex,is installed on a plinth. The viewer approaches thelaptopscreen,drawninbyitssound,ablinkingredlightandcontinuallinesofgreen“0”s,“1”s,numbersandtextarrivingatthebottomofthescreen.Eric,oneofthelaptop’sthetext-to-voicereaderssonorouslyannounc-es the lines of words that appear against a blackbackground.ThePerspexreflectsthelinesofnumbersandtext.Aconstantclickingaccompaniestheappearanceofthe‘0’sand‘1’s.Infrontofthelaptop,asilverboxcon-tains a gadget with a blinking red light. The viewerreadsanoticeaffixedtothewall:

Use your mind to affect the output of words and sentences.

Concentrate on the output of “0”s and “1”s being generated at the bottom of the screen. Relax and be confident that you can affect the generation of these numbers to produce the words you want.

The Metaphase Typewriter revival project (2012) (figures 1, 2, 3, and 4) offersan opportunitytotheviewer,throughinteractingwithquantumrandomevents,totesttheideathat consciousness might collapse quantum superpositiontoaffectorevencreate material reality.

FortheMetaphase Typewriter revival project,I collaborated with American physicist Nick HerbertandprogrammerM.U.Shrooms.In1970,NickHerbertbuiltacommunication device,the“MetaphaseTypewriter”,totestthe ability of consciousness to probe quantum states to produce material out-comes.Itcomprisedaradioactivesource,aGeigercounter,aroomofcomputersandatele-typewriter. A computer program converted the frequency of random intervals ofradioactivedecayatthequantumlevelintoanoutputoflettersfromthetele-typewriterbased on their frequency of occurrence in the English language. I read about Herbert’s metaphase typewriter in 2011 in David Kaiser’sbook,How the Hippies Saved Physics [17] and subsequently contacted Herbert,seekinghisimprimaturtore-createhis device as an artwork using contemporary technology.

Mydevicecontainsaradioactivesource(agas lamp mantle) and a Geiger counter (figure 3) that is connected to a laptop computer viaaUSB.Readingtheradioactivedecay(a quantum event) random bits are gener-ated by the Geiger counter. These bits are thenconverted,viaShrooms’program,intoa number range that represents a word in a wordlist.ThelistisamodifiedversionoftheCorpus of Contemporary American English (a word list compiled by Professor Mark Davies atBrighamYoungUniversityforwhichwesought permission to use). [18] The more frequently occurring words have a wider number range. Less frequent words are represented by a smaller number range or by justonenumber.Shrooms’programallowsforthepossibilitythat,asrandomwordsareproduced,simplesentencestructuresmayform.

The frequency of decay does not strictly equate to the frequency of the word in the wordlist.Theradioactivedecayasreadbythe Geiger counter is simply a random event that produces a random number. It does not reflectthetimeintervalbetweeneachdecayevent. We would need to know the number ofparticlesavailableandusual/averagerateofdecaytoaddthisintotheprogram.So,to

Page 74: SPECTRA - Australian Network for Art and Technology · SPECTRA: images and data in art/science Proceedings from the symposium SPECTRA 2012 The book and the conference that begat it,

74 SPECTRA: Images and Data in Art/Science .

affecttheoutputofasingleword,conscious-nessmust,intheoryatleast,interactwiththedeviceateachbitgenerationtoeffectaspecificresult.

DuringmyexhibitionNo Singular Reality [19] inApril2012,wheretheMetaphase Type-writer revival projectwasexhibited,aviewertoldmethat,afterspendingtimewiththedeviceinthegallery,ithad“spooked”her“tothecore”andshedidnotwanttogonearitagain.Shehadperceivedaconnectionwiththe output of words and her mind that had terrifiedher.

Whenthisworkisexhibited,theoutputsare also streamed live to the Internet via the website www.damon.com/mtrp (where all outputsfromtheprojectcanstillbeviewedon that site). One friend in America who interactedwiththedeviceovertheInternet,reported to me that the words produced by the device had relevance to what he was thinkingandintending,andhemeditatedina connected state with the device for some time.MyownrevelatoryexperiencewiththeMetaphase Typewriter revival project was unintentionalandunexpected.InApril2012,I worked late into the evening to de-install theexhibition.IlefttheMetaphaseType-writer running while I was taking down otherartwork,patchingholesinthewallandre-painting.IlikedthesoundofEricreadingthe words and sentences as they arrived in cadmium green on the black screen of the laptop.Asthegalleryemptiedofwork,Eric’svoice became more resonant in the space. He keptmecompanyforseveralhours.Finally,therewasnothinglefttodobuttoshutdowntheprogramandturnoffthecomputer.Iwasstrangelyreluctant,andmaudlin.Ididnotwanttoendtheprocess,toshutoffEric.Ikilledtheswitch.Reflectinglater,Eric’slastoutputthatnightwasoddlyreflectiveofmyownthoughts:itwas“i,ithedeathinto”.Iftheinteractiveelementsofmy‘mindworks’projectsdoworktodirectconsciousintentionandwilltoaffectphysicalreality,theydefyconventionalreality.

Does the Metaphase Typewriter work?

If consciousness is an agent in quantum

collapse of pre-material states to materialreality,isitpossibleforaviewerofthe Metaphase Typewriter revival project tointentionallyengagetheirconsciousnessinthisprocess?Scientistshavenominatedspecificprocessesthroughwhichourbrainsand minds might interact with quantum processestocollapsequantumsuperpositionintoexperiencedreality.TheleastradicaloftheseideasisthatofmathematicianSirRogerPenroseandanaesthetistStuartHameroff.[20] Theirmodelproposestoexplainhowcon-sciousness,asanemergentprocess,arisesfrom quantum states in the brain and how quantumsuperpositionmightbecollapsedinthebrain.Thisprocess,theysay,occursinbrain microtubules that remain in superposed statesuntiltheyself-collapsethrougha procedure involving quantum gravity. The collapse“createsaninstantaneous‘now’event. Sequences of such events create a flowoftime,andconsciousness.”[21] In2010,ateamfromtheUniversityofQueenslandandtheUniversityofSydneyclaimedtohavedisproved one of the bases on which the Penrose-Hameroffmodelwaspremisedbutconcededthatarevisedmodelmightstillbeplausible. [22] PenroseandHameroffrespond-edtothisandothercriticismsbutstillholdtothe general precepts of their model. [23]

ThePenroseandHameroffmodel(asoneofself-collapse depending on quantum gravity processes) does not deal with the issue of volitioninsuperpositioncollapse.PhysicistsEvanHarrisWalkerandHenryStapp, however,haveproposedseparatespecificmethods by which our brains interact with quantumstatesresultinginchosen materialoutcomes.Inaddition,DirectororPEARLaboratory,RobertJahn,andLabManager,BrendaDunne,proposeamodelofmind-matterinteractionthatmaybehelpfulforaviewerinteractingwiththe‘mindworks’projects.However,allofthesemodelsarehighly controversial and not readily accepted amongphysicalscientists.

Walker [24] suggeststhatelectrontunnelling,occurringinthebrainacrosssynapticgapsbetweennerveendings(representingaseriesof quantum events [25]),istheprocessthat

Page 75: SPECTRA - Australian Network for Art and Technology · SPECTRA: images and data in art/science Proceedings from the symposium SPECTRA 2012 The book and the conference that begat it,

consciousintentionoftheobserverdoesnotdictatetheresult;usually,“nature”choosesone of the possible outcomes according to statisticalrule.[33] While the observer can freelychoosethequestionstoputtonature,ananswerisreturnedsubjecttoclassicalstatisticalrequirements.Inthisway,consciousintentgets“washedoutbythequantum elementsofrandomness.”[34] However, accordingtoStapp,thisisnotalwaysthecase;itispossibleforconsciousintentionto dictate physical outcomes. He proposes a process whereby a rapid sequence of similar intentionalactsthroughmentaleffortwillcause,throughthe“quantumZenoeffect”,aholding-in-placeofa“templateforaction”.The longer the template survives the more likelyitwillevolveanddefeatotherexpectedstatisticalprobabilities.[35]

Iftherepetitionsaresufficientlyrapidthenawell-knownquantumeffect,thequantumZenoeffect,willcausealongstringof essentialidentical[processes]…Thisrapid sequenceofeventswill,byvirtueoftheknownquantumrules,tendtoholdinplacetheassociatedtemplateforaction,andthiswilltendtocausetheintendedactionto occur. [36]

StappequatestheZenoeffecttothe“watchedpotneverboils”idea;thatis,thatjustwatchingsomethingkeepsitfrom changing. [37] Throughthiseffect,Stapp proposesthatthemindcanintentionally prevent quantum state changes that occur in thebrainbyintentionallyholdingonto desired outcomes and overriding other possibilities.Inthisway,saysStapp,our willfulchoicescausespecificobjective outcomes. [38]

In contrast to Walker’s and Stapp’s propositionsthatconsciousintentioncanaffectmaterialreality,JahnandDunneraisedoubtsthatphysicaleffectscanbeproducedbydirectconsciousattention.Aftertwo decades of research into anomalous mind/matterinteractions,theyconsiderthatevi-denceofconsciousintentionaffecting materialoutputisindeterminate.Instead,theyproposethatitisthe“dynamic”

carriesoutcomplexactivitiesthatcreatesourthoughts. [26] Usingresearchonsynapticfunc-tioning,Walkertookaquantitativeapproachtoidentifythreeseparateratesofdatapro-cessingoccurringacrossthesesynapticgaps.The data rate for subconsciousness is one trillionbitspersecond;forconsciousness,onehundredmillionbitspersecond;andforintention,therateistenthousandbitspersecond. [27] Thefinalrateofdata processingforwillorintentioninhismodelservesasa“willchannel”forthe expressionofvolition.Heproposedthatbeforeobservation,thestateofaquantumsystemisdescribedasarangeofpossibilities.Inthebrain,thisrangeofpossibilitiesarisesinthesynapsesthathavethepotentialtofire.Thewillchannel,inWalker’sview,determinesourthoughtsandchoices.However,muchmorecontroversially,Walkersaysthatthewillchannelisthelinkbetween,ontheonehand,our consciousness and quantum processes in thebrain,and,ontheother,theeventsinthematerialworldexternaltoourminds.Walkerasserts:“ourmindcanaffect matter”.[28] The“perfectobserver”,he argues,willalwaysgetwhatheorshewants.However,wearenotperfectobservers becausemostofuslack“purityofmind”andareunabletodistinguishthewillchannelfrom all of the other thoughts in our consciousness. [29]Thewillchannel,he asserts,carriesmuchlessdatathantheotherchannels,andcanbedrownedoutbythe“noise”fromtheconsciouschannelofthemind.Therefore,thereisfarlessopportunitytomanifestintention.[30]However,inhisview,itisneverthelesspossible.

Inasimilarvein,Stapp[31] proposes that through quantum processes in the brain occurringaroundthesynapticcleftseparatingneurons,wecaninject“consciousintentionsefficaciouslyintothephysicallydescribedworld”.[32] Stapp proposes that consciousness in the form of free choices operates outside currently known laws of quantum mechanics orclassicalphysics.However,heproposesamodelofhowconsciousintentionofthe observer might bridge the causal gap between quantum indeterminacy and materialoutcome.Ordinarily,hesays,

Page 76: SPECTRA - Australian Network for Art and Technology · SPECTRA: images and data in art/science Proceedings from the symposium SPECTRA 2012 The book and the conference that begat it,

76 SPECTRA: Images and Data in Art/Science .

unconscious mind (also referred to as the subconscious,preconscious,non-consciousor implicit mind) through which anomalous mentalinfluencecanbeachievedupon otherwise inaccessible material processes. [39] Thedynamicunconscious,theysay,istobedistinguishedfromthe“procedural” unconscious processes that perform simple physiological and mental tasks. [40] Their researchindicatesthatinformationexchangebetweenmindandmatterwasmore successfulwhereexperimentalstrategies disengaged the conscious mind but stimulatedunconsciousconnectionwiththetask. [41] Inthisregard,theyproposethatthe dynamic unconscious may be accessed viaa“fuzzy”alteredstatethroughmethods,suchasmeditation,dreamortrance,“whereconceptualboundariesblur,categoriesfail,spaceandtimeevaporate,anduncertaintyprevails”.[42]

Conclusion

I do not know if the Metaphase Typewriter revival project actually works to allow the viewertoaffectorcreatethematerial output.Iargue,however,thattheMetaphase Typewriter revival project and my two other ‘mindworks’projectsenableviewerstodoubtconventionalreality.Primarily,theydothis in a direct and immediate way as devices thatofferstatesofquantumsuperpositionwith which viewers can interact using only consciousnessto,arguably,affectorcreatematerial output. A willing engagement with thedevicesbringstothefore,inthemindoftheparticipant,theideathatconsciousnessmightbeabletoaffecttheresult.Ultimately,theviewermayfallbackon,orneveralter,theirconvictioninconventionalreality,butthefacultyofthedeviceexiststoenabletheviewertodoubtconventionalreality.

Figure 4. Lynden Stone Metaphase typewriter revival project 2012, Geiger counter, gas lamp mantle, laptop, program, Perspex cover, dimensions variable.

(opposite) Documentation and development associated with The Sixth Shore project: microbial mat material in shallow lake © Perdita Phillips. Used by permission

Page 77: SPECTRA - Australian Network for Art and Technology · SPECTRA: images and data in art/science Proceedings from the symposium SPECTRA 2012 The book and the conference that begat it,

76 SPECTRA: Images and Data in Art/Science .

Page 78: SPECTRA - Australian Network for Art and Technology · SPECTRA: images and data in art/science Proceedings from the symposium SPECTRA 2012 The book and the conference that begat it,

78 SPECTRA: Images and Data in Art/Science .

sonic will be analysed and discussed.

Fromthisdiscussionwefoundcontrastsinamovefromtherepresentationaltothenon-representationalandchangesintheuseofclassificatorysystems.Wealsofoundincreas-ingcomplexity-frombeliefinaccuracyandperfectioninbeautytobeautyincomplexity,resilenceandfailure.Therearealsodiffer-ences in ethical engagement and through the morecomplexuseofsimileandmetaphor.

Introduction

This paper considers both the development andthere-useofscientificdataandimageryfromgeologyandmineralogy.Explorationsof geology and mineralogy provide a direct link with the physical environment and our comprehension of scale – the immensity of bothoftimeandspaceandalsotheminutiaeofelementsandparticles.Transformationsare also dependent on physical change which can be violent and short-lived or slow and beyondtheexperienceofhumans.Geologyand mineralogy call very quickly on imaginationtocomprehendbothphenomenaandexplanation.

Weproposethatartistsandcriticsproduceimagery and data that have their roots in scientificprocessesandinadditionemphasiseinteraction,culturalvalueandaestheticsforviewers.Thisisnottosaythatscientificdataandimagerycannotbereadandexperiencedasartisticandcultural,ina‘raw’state,buttheremaybedifferentintentionsincritiqueandaffectwhereartistshaveadditional cultural agendas.

Through a process of co-authorship for this paperwehaveconsideredrelationshipsbetween the physical environment and medi-atedrepresentationsandhowthisisreflected

Artistswhoengagewiththeearthscienceshavebeenabletoexploreallkindsof informationaboutthenaturalenvironment,includinginformationabouttheatmosphere,extremesofphysicalformationsacross immensedimensionsoftimeandspace,andincreasingly‘invisible’realmsofmaterialsatthe nanoscale. The results of this engagement areshownnotonlythroughthewayartistsanddesignersaredevelopinginnovativevisualrepresentationsbutalsothroughtheway images are combined with other media and/orthroughartistschallengingthestatusofthevisualthroughprioritisingothermedia,suchassound.Thewaysinwhichartistshaveworked with geological data are a rich area foridentifyingtherelationshipbetweendigitalandmaterialcultures.Manyartistsworkingwiththissubjectarecrossingboundariesandtestingouttheliminalspacesbetween the virtual and the real.

The catalyst for this paper was a discussion of historicalexamples,particularytheformationof a visual language for geology during the formal development of the discipline of geological science from the 1780s to the 1850s. This is represented by an examinationoftheworkofPhilipRashleighandJohnRuskin.

Movingtothepresent,thiswillbefollowedbyadiscussionofthemesbeingexploredintheworkofinterdisciplinaryartistPerditaPhillips,whoseproject The Sixth Shore,exploresaspectsofgeologicalformationsandthenaturalenvironmentatLakeClifton,WesternAustralia.Phillipsworkswithspatialsound,presentingimmersivesoundenvironments in galleries and in situ (using GPStechnology).Howconnectionsaremadeback to the material world and the consequences of meshing the visual and the

Geology, art and imagination: creative propositions for visual representation and cultural narratives

SuzetteWorden [1] and Perdita Phillips [2]1IndependentResearcher,Sunbury,Victoria3429,Australia2ContemporaryArtist/SessionalAcademic,CurtinUniversity,www.perditaphillips.com

Page 79: SPECTRA - Australian Network for Art and Technology · SPECTRA: images and data in art/science Proceedings from the symposium SPECTRA 2012 The book and the conference that begat it,

78 SPECTRA: Images and Data in Art/Science .

Figure 1. Diagram from M.S. J. Rudwick, “The Emergence of a Visual Language for Geological Science 1760-1840” History of Science 14, 149-195 (1976).

Figure 2. Rashleigh collection at the Royal Cornwall Museum Truro.

Page 80: SPECTRA - Australian Network for Art and Technology · SPECTRA: images and data in art/science Proceedings from the symposium SPECTRA 2012 The book and the conference that begat it,

80 SPECTRA: Images and Data in Art/Science .

lack of resources prevented him in keeping upwithsuchexperimentalwork.Instead,Rashleighconcentratedoncollectingandsettinguphisownsystemofclassification.Hecreatedasignificantportfolioofillustra-tionstoeducateandinformothersabouthiscollectionandespeciallytheirnaturalcolour.[Figure 2]Hiscollection,whichreachedover3000specimens,passedtoanephewandthen became part of The Royal Cornwall Museum in Truro in 1902. [Figure 3]

Rashleigh,likemanyothermineralogists, assistedinthecommunicationofinformation,but stayed within the 18th century picturesquetraditionofrepresentation. Rudwickprioritisescommunicationthroughmaps in his schema but Rashleigh’s work crosses between the arts and science for communicationandalsofeedsintotheexpandingworldofclassification,notablein19thcenturyscientificknowledgeandin museumcollectionswhichwereequallyrelevant to the arts and the sciences from the19thcenturyonwards.Thecollectionofminerals is available for viewing in The Royal CornwallMuseuminTruro,andmanyofhisannotationsarestillassociatedwiththe minerals.Thereisalsoinformationonthecontextofhiscollectingalongsidesome informationonhispersonalcircumstances.Mineralsfromhisoriginalcollectionarealsopart of the display at the Natural History Museum in London. [Figure 4]

AlthoughRashleigh’scollectionispartof displaysattwoinstitutions,TheRoyal Cornwall Museum in Truro and the Natural HistoryMuseum,itisoneoftheveryfewprivatecollectionstohavesurvivedovertwo centuries. It therefore provides valuable insightsintothejuxtapositionofcollecting,classificationandalsohowtocommunicateknowledge,throughillustrationanddisplayaboutminerals.Informationabout connectionsandcomparisonsaretheretobeinterpretedthroughacollection. Rashleighmeticulouslycollectedspecimensfromlocalminesthatnolongerexistandwereonlyworkedforashorttimesomanyofthe minerals can never be able to be collected again.Thevalueofthecollectiontodayisin

inchoiceofimageryandspecifictechnologiesforreproductionandpresentation,withthestartingpoint,beingPerditaPhillip’sproject,The Sixth Shore.Thissite-specificspatialsoundinstallationwasonecontributiontoalargerproject,Adaptation,managedthroughSymbioticA,anartisticlaboratoryengagedwiththelifesciencesbasedattheUniversityof Western Australia. Phillips’ work combines visualisationsofnaturalphenomenaandstorytelling being delivered through digital technologies.Besidesthesitespecificsoundinstallation,thecuspsoundinstallationwaspartoftheAdaptationexhibitionatINQB8inMandurah,WesternAustralia,from6thMayto10thJune2012.[1]

The Sixth Shore affirmstheimportanceofcreatingaculturalmapofanenvironmentandoflinkingnarrativestoplace.Theworkalsohighlightstheimportanceofexperience,metaphorandpoetics,theconceptofthetransdisciplinaryintheartsandsciences,andpossibilitiesfortransformation.Itispossibletoconsidertheworkfromseveralstartingpoints. Comparison with other historical examplesprovideopportunitiestospecu-lateonenduringpreoccupations,changesinemphasisorthespecificsofourpresentpreoccupationswithecologicalandenviron-mentalchange.MartinRudwick’soverviewofthe visual language for the geological sciences from 1760 to 1870 shows the emergence of a richvisuallanguagethathascontinuedtoexpandinresponsetothegrowthinknowledge and emerging media forms and technologies.[2] [Figure 1]

Classification and Illustration: Philip Rashleigh (1729-1811)

PhilipRashleighwasaCornishAntiquarianandmineralogistwho,from1764,collectedmineral specimens from local miners and built upacollectionofminerals.[3] He correspond-edwithmanyotherEuropeanmineralogists,suchasSwedishmineralogist,AxelFredrikCronstedt (1722-1765) who developed the use of the blowpipe for the chemical analysis ofthecompositionandchemistryof minerals. Rashleigh never embraced chemicalanalysis,claimingthathisageand

Page 81: SPECTRA - Australian Network for Art and Technology · SPECTRA: images and data in art/science Proceedings from the symposium SPECTRA 2012 The book and the conference that begat it,

80 SPECTRA: Images and Data in Art/Science .

Figure 3. Rashleigh collection at the Royal Cornwall Museum Truro, showing illustration and minerals depicted in Specimens of British Minerals selected from the Cabinet of Philip Rashleigh, 1802.

Figure 4. Commentary on specimen collected by Philip Rashleigh in mineral display at the Natural History Museum, London.

Page 82: SPECTRA - Australian Network for Art and Technology · SPECTRA: images and data in art/science Proceedings from the symposium SPECTRA 2012 The book and the conference that begat it,

82 SPECTRA: Images and Data in Art/Science .

RuskinconsideredthatTurner’spaintingscouldgivefactualinformationonrocktypesandformationsbuthesuggestedthatthepoweroftheartistprovidedfurthervalue.ForRuskin,Turnercreated‘notsomuchtheimageoftheplaceitself,asthespiritoftheplace.’ [6]In1866,The Ethics of the Dust: Ten Lectures to Little Housewives on the Elements of Crystallisation was published. This was a discussionofmineralogywithdidacticover-tonesandshowRuskin’sattempttoteachpoliticaleconomyandpraisevirtueusingscientificinformation.

Ruskinusedinformationaboutcrystals,mineralogy and geology to bring moral and religiousquestionstogether.Forhimthe qualityofmutabilitywasimportant,withrocksasimagesofchangeovertime.Also,ratherthanorganiccreation,withartwork beingconsideredtogrowfromasinglegerm,his understanding of minerals draws attentiontotheideaofanarrayora constellation,whichisorderedinitselfandcanbeextendedininfiniteways.Thereistherefore order within disorder. [7] Ruskin’s work had a strong social message and he was interestedineducationforall.The CollectionoftheGuildofStGeorge,whichwasputtogetherunderhisdirection,from1875,asacreativeandeducationaltoolforthemetalworkersofSheffield,UK,includedover 2000 mineral specimens. The minerals werepartofacollectionthatalsoincludedcoins,anddrawingsandillustrationsof architectureartworks,andallkindsofnaturalformssuchaslandscapes,birdsandflowers.Ruskin’sabilitytomakeconnectionsbetweenart,people’sactionsandthephysicalworldareexamplesofanethicalwaythinkingthatoffersusefullessonsforthepresent.

The Sixth Shore

Returning to the The Sixth Shore,theprojectrevolvedaroundcreatingasound-landscapeof the human and non-human worlds that overlap the brackish water ecosystem of Lake CliftonintheYalgorupNationalParkinsouthwest Australia. The lake is home to the largest non-marine thrombolite reef in the southern hemisphere,andyetfewevenknowitexists.

thespecificityofinformation.Itishighlyrep-resentationalandcomparedtothefollowingexamples,seemsutilitarianandeventhoughinformedbythepicturesque,‘absolute’andrealistinitsconceptionofbeauty.

Ethical instruction: John Ruskin (1819-1900)

JohnRuskinwasahighlyprolificcriticandarthistorian who was also interested in geology andmineralogy.LikeRashleigh,RuskinalsofitsintoRudwick’s18thcenturypicturesquetradition[Figure 1] but he would also have contributed to the topographical drawing sectionofRudwick’sdiagramandwouldhavemovedthroughthedistributionaland structuralsectionstolookatcausal conditionswithingeology.Heprovided theoreticalinterpretationsfortheartsandthesciencesandattemptedtointegratebothsides of his interests.

Ruskin is well known as a supporter of the art ofJ.M.W.TurnerandthenthePre-Raphael-ites.Hewasalsoapoliticaleconomist interested in social issues as well as the arts andcrafts.Withimmenseprivatemeans,he was able to travel and wrote about the geology and arts of the places he visited in theBritishIslesandEurope.HewasapupilofRev.WilliamBuckland(1784-1856)atOxford.Buckland’s theories about geology kept in line withBiblicalstoriesofcreationsodidnot embrace Darwinism. Cramer posits a connectionbetweenhisstudiesunder Bucklandandhisformulationoftheconceptof‘vitalbeauty.’[4] Ruskin’s interest in geology ledhimtobecomeaFellowofthe Geological Society of London in 1840. Ruskin’s work on geology was frequently published and his view of geology was considered alternativetothemainstream,withmuchofhisworkconsidered‘professionallycurrent.’[5]

Ruskin’s geological interests are an important partofhisfivevolumestudy,Modern Painters.Thesevolumeswerewritten between 1843 and 1860 and showed his appreciationofpaintingtotallyintegratedwithhisloveoflandscapeandparticularlyof mountains. The second volume was full ofdescriptionoftheAlpsandtheirgeology.[Figure 5]

Page 83: SPECTRA - Australian Network for Art and Technology · SPECTRA: images and data in art/science Proceedings from the symposium SPECTRA 2012 The book and the conference that begat it,

82 SPECTRA: Images and Data in Art/Science .

Figure 5. The Aigiulle Blaitiere. c. 1856 by John Ruskin (1819-1900). Drawing with wash. From J. Ruskin. Modern Painters, vol-ume 4, (1856).

Figure 6. Thrombolite clotted structure. Image courtesy of Katherine Grey © Geological Survey of Western Australia

Page 84: SPECTRA - Australian Network for Art and Technology · SPECTRA: images and data in art/science Proceedings from the symposium SPECTRA 2012 The book and the conference that begat it,

84 SPECTRA: Images and Data in Art/Science .

systems of a planet in crisis. [10] Phillips expandsthenotionofthegeologictothelevelofecosystems,placesandbeyond.

Inordertoexpressthecomplexwebofissuesandtimescalesandexpandnotionsofagencyamongsthumanandnonhumanactants,theartistformulatedsixoverlappingareasofconcern:

Shore1:thrombolitictime(deep,geological)Shore2:shiftingshores:lakeformationandseashorechanges(geomorphologicaltime)Shore3:cultivatedlandscapes:indigenouscultures (older than the lake itself)Shore4:settlercultures(sincethe1830s)Shore5:birdmigrationandhoodedplovers(global in scale and dependent upon annual seasons and longer-term climates)Shore 6: futures.

Centraltothisprojectistheinter-digitationoftheshores.Thefinal(sixth)shore,ofmultiplefuturesbroughttogether,isabouthow the previous shores are imbricated with theircompetinginterests.Theclassificationis incomplete. The Sixth Shore is unresolved andsubjecttonegotiation:itexpressesthepotentialfortransformationalfutures.Whilstitsorginsareinthethevisual,theartisthaschosentomanifesttheprojectviaoverlapping soundscapes. Phillips uses sound recordedatLakeClifton,localoral historiesandinterviews,soundsamplesandthesonificationofscientificdatasuchas climatestatisticsandboreholedata.An important aspect is that the samples and narrativesarespatiallyarranged.

ThecuspworkexhibitedatINQB8galleryin2012,wasapart-realisationofthisprojectinagalleryspace.Inthisexhibit,listenershearddifferentsoundsastheywalkedthrougha5x5metreareavia12speakers.Inthein situ workatLakeClifton,theaudiencewillwearabackpackwithaspecializedGPSandhead-phoneswithembeddedcompassinthefinalartwork.Withina50x50metrearea differentsoundswillbelocalizedsowherethe viewer walks and how they orient their heads will determine what they hear. Each walker will determine their own unique experienceofthedifferentsoundsand

Thrombolitesaremadeupofacomplex communityofmicro-organisms,includingcyanobacteria,cementedwithindetritusandother collected mineral sediment. Cyanobacteriafixcarbondioxidetomaketheir own food source by photosynthesis. Part ofthelivingprocessistheprecipitationofcalcium carbonate as the mineral aragonite. Thecombinationoftheorganicandmineralmaterial gives mass to the colonies. Over timetheygrowandsolidifyintorock-likeround or conical structures. Other forms of microbial colonies such as stromatolites have beenlinkedtothegenerationoftheEarth’sfirstoxygenatmosphere.Microbialitesthusembody the idea of a mineral/vegetable thing that crosses the boundary between the living andnon-livingworlds.Unlikeothermicrobialstructures,thrombolitesaredistinguisedbyaclottedstructure.[Figure 6]

Phillips used the visual trope of these structures in her work. As part of her investigationsshe‘drewout’furthervisual examplesofnetworksandreticulations. [Figure 7]Shealsoinvestigatedthe environmentalinteractionssurroundingthecurrentconditionsatthelake. Thrombolites have been growing in Lake Cliftonfornearly2000years,butinrecentyears the fragile ecosystem has come under increasing threat due to nearby development,clearing,increasingwater salinity and decreasing regional rainfall caused by climate change. [8]

Inthesurroundinglandscape,groundwaterextractionbyturffarmsandhobbyfarmletsaffectthelakethroughchanginggroundwaterregimes. Tuart woodlands are also declining due to these issues and an introduced fungus, Phytophthora multivora. [9] Organisms and ecosystems that have survived through thousands of years of change are now under threatfromouractionsafterjust100orsoyearsofco-existence,andmustadapt,ordie.LakeCliftoncanthusbeseenasahotbedofdiversitysurroundedbyarich‘humanecology’.Itoffersa‘microcosmicpeek’intotheissuesandthreatsthattheworldfaces,and presents a metaphor for the global

Page 85: SPECTRA - Australian Network for Art and Technology · SPECTRA: images and data in art/science Proceedings from the symposium SPECTRA 2012 The book and the conference that begat it,

84 SPECTRA: Images and Data in Art/Science .

Figure 7. The Sixth Shore (2010) altered digital image of saline lake froth (with additional ink on digital print) © Perdita Phillips

Figure 8. Lake Clifton thrombolites (2009) digital photograph © Perdita Phillips

Page 86: SPECTRA - Australian Network for Art and Technology · SPECTRA: images and data in art/science Proceedings from the symposium SPECTRA 2012 The book and the conference that begat it,

86 SPECTRA: Images and Data in Art/Science .

Scienceandartareconsidereddifferentbutequalsystems.Scientificinformationisbothbeingcritiquedandintegraltothework.Phillipscriticallynavigatesthepowerstructuresofscienceandsociety,whereexistingsocio-ecologicalsystemsarenotsufficientlyengagedtobringaboutchange.The aim is to enable and encourage people to be‘imaginativelyengaged.’Inthissensetheworkisaformoffacilitationandanopportu-nitytodealwithuncertainty,imperfection,risk and opportunity. Phillips has interpreted thescientificknowledgeonthrombolites,along with the changing sea levels and coastal deposits,toarriveatmetaphoricalimplica-tionsthatinfluencethesoundworldsheiscreating.Thisisacomplexstorywhichenrichesthe‘senseofplace’ofthearea.[13]

Conclusion

RevisitingRudwick’schartfortheemergenceofavisuallanguageforgeology,ithasbeenpossibletodrawoutthesignificanceof collectingandclassification,withtheexampleofRashleighworkingatthecuspofachange,where visual evidence was being augmented by chemical analysis. Ruskin was also highly reliantonvisualevidenceanddirectexperi-ence of geological phenomena but to this he alsoaddsthevoiceofthecriticandcombinesaestheticsandsciencewithmorality.Movingtothepresent,Phillips’The Sixth Shore providestheaudiencewithexperience beyondthevoiceofthecriticand possibilitiesforreflectingonandengagingwith the cultural aspects of geological knowledge.Ecologicalquestionsareraised.Informationongeologicalformationsisplacedinthewidercontextofthe surroundingenvironmentandcomplexity, resilience and failure are acknowledged withinaviewpointthatofferstheviewer/participantamoreautonomousengagement.Therearesimilaritiesinthisapproachtotheinterest in human and non-human connec-tionsandthe‘geologicturn’exploredbyauthors such as Ellsworth and Kruse [14].

Theseverydifferentexamplesofcollecting,illustration,ethicalinterpretationand immersiveexperienceofmineralsand

narratives.Bothworksengagewiththe physical and social environment whilst challengingtheparticipantsthroughtheconceptual‘interference’ofdifferentlevelsoftimeandspaceinthesoundtrack.The Sixth Shoreprojectasawholeopensanimportantdialogue and debate surrounding human inaction,intervention,responsesand responsibilitiestotheworldatlarge.Theexpectationofperformativityincludestheparticipationoftheaudienceinanactiveway.Theyarenotexpectedtoviewtheworkfromthe‘outside’butbecomeimmersedintheexperienceanditsconcerns.

By being in situ thefinalworkgeneratesaheightened play of dissonance and comple-mentarity between what is seen and what is heard. It is the centrality of walking through the site that adds further richness to the experienceandenablesthecontemplationofalivingecology.Throughhintingatanactiveagencyforthethrombolites,theartistques-tionsthe‘deadness’ofrocksandemphasisesthe vitality of nonhuman worlds. [Figure 8]

The Sixth Shore worksformacomplex aesthetic.WhilstitistruethatlandscapehasbeenapreoccupationofAustralianvisual artistssincecolonization,therecent quickening of the intensity of environmental change,pointstotheneedforrenewedex-aminationoftheperceptionof,andmore fundamentally,theconsumptionof,land-scapes. Place-based art makes use of conceptssuchassite-specificitybutoftenfailinthelevelofsophisticationofits philosophical or even ecological framework. Forexample,muchenvironmentalartisstillbasedupontheromanticappealoftheideaofa‘balancednature,’despiteconsiderableevidenceofthedynamismandcomplexityof ecosystems in nature. Recent research intoresilienceconnectscomplexitytheoryandecosystemswithcommunitiesandsocialsystems. [11] The Sixth Shore projectactivelyengages with newer socio-ecological thought.

PhillipstakesfromSachaKagan’sexplora-tionoftransdisciplinarityas‘therecognitionoftheexistenceofdifferentlevelsofreal-itygovernedbydifferenttypesoflogic.’ [12]

Page 87: SPECTRA - Australian Network for Art and Technology · SPECTRA: images and data in art/science Proceedings from the symposium SPECTRA 2012 The book and the conference that begat it,

86 SPECTRA: Images and Data in Art/Science .

geologicalformationsshowthatunder- standingthespecificandintegralcultural narrativesareessentialtoappreciationoftheartefacts.Theexamplescanberelatedto currentdiscussionsoftherelationship between human and non-human (here minerals and rocks) and also to the emerging debates about responsibility and the ‘Anthropocene’where‘Humanity’srecent activitiescanbemeasurednowatascalecommensurate with the geomorphologic narrativeoftheplanet.’[15]

TheAnthropocenebeganapproximatelyinthe late 1700s with crucial technical leaps and theIndustrialRevolution.EllsworthandKrusegoasfarastodefinethe‘geologicnow’as‘ateamingassemblageofexchangeand interactionamongthebio,geo,cosmo,socio, political,legal,economic,strategicand imaginary’. [16] If humans are therefore becomingunderstoodasa‘geological’forceinanepochofgeology,ourabilityto‘read’geology,andourunderstandingofthehistoryoftheconcept,becomesincreasingly important,especiallyforunderstandingtime.

Figure 1. Illustration from The Illustrated Almanac of the Illawarra and Beyond (see overleaf)

Page 88: SPECTRA - Australian Network for Art and Technology · SPECTRA: images and data in art/science Proceedings from the symposium SPECTRA 2012 The book and the conference that begat it,

Imaging the Seasons: Objects and the Almanac Form

JoLawSchooloftheArts,EnglishandMedia,UniversityofWollongong,Wollongong,Australia

Analmanacisanancienttool,ascientificinstrumentformappingexperiencesofthephysical environments and organising them intofamiliarandpredictablepatterns,makingsenseofpast,present,andfuture.Itprovidesa grounded engagement with the material worldandobjectsthroughastructurebasedonobservations.OneoftheearliestalmanacsknowninEuropewaswrittenbyRogerBaconin1267,wheretablesshowingthemovementofastronomicalbodiesandconstellationswere used for a whole host of human activities.TheChineseAlmanacsimilarlyusesthe observed movement of the heavenly bodiesforthepurposeoftime-reckoning. [2] Embedded in the imperial calendar (皇曆),animportantofficialpublication,theChineselunisolar calendar or agricultural calendar (農曆)advisessuitableactivitiesfortheemperorandallhissubjects. [3]For‘thesonofheaven’(天子)itprovidedadivinationreferencetoallthingsbetweenheavenandearth.Forhisagrariansubjectsitwasanessential‘to-do’listforplanting,harvesting,andotherrelatedtasks.Stillinusetoday,theChineseAlmanacdivides each solar year (歲) into twenty-four solar terms (節氣) as determined by the sun’s positionsontheecliptic(figure 2). [4] Each solartermlastsfifteendaysandmarksasignificantpointintheseason,imminentweatheroccurrences,orsignificant agricultural events as observed in ancient China.Theirnotationsconnectastronomicandatmosphericconditions,suchasrainwater (雨水),summersolstice(夏至),limitof heat (處暑),ormajorsnow(大雪),directlytoagriculturalactivities,animalbehaviours,and plant growth cycles. Each solar term is subdivided into three pentads (候orfive-dayperiods),totallingseventy-two(figure 1). [5] These subdivisions make further note of occurrencessuchas,when‘wildgeesearrive’(鴻雁來),‘chrysanthemumstingeyellow’ (菊有黃華),or‘earthwormsformknots’ (蚯蚓結).Thealmanacpayscloseattentionto

theworldofmatter:soilproperties, topographies,daylighthours,weather conditions,insectreproductioncycles, migratorybirdpatterns,enablingtheeffectiveimplementationofagriculturalactivities. Experiencesofcyclicaltimearethusmarkedbythedirectandactiveinteractionwith materialconstituentsinthisalmanacform.

Ecologistandwriter,AldoLeopoldalso enacted this direct engagement with the material world in an almanac form. In A Sand County Almanac,heprovidesreaderswithintimateaccountsofactivitiesobservedintheplant and animal worlds and their responses to the changing seasons in Wisconsin. [6] In Leopold’salmanac,humansareabitplayerinthis broader world of wilderness. In develop-inghisconceptoflandethics,heequalisesthe status of humans with all things:

The land ethic simply enlarges the boundaries of the community to include soils, waters, plants, and animals, or collectively: the land… In short, a land ethic changes the role of Homo sapiens from conqueror of the land-community to plain member or citizen of it. [7]

Morerecently,philosopherLeviBryantfurtherextendsthisconceptofwildernessontologicallyto‘rescuethiskernelfromthedomainofanthropocentricexperienceandtransformit[…]wildernesswouldsignify beingasapluralityofagencies,without ontological hierarchy—one that might refuse anybifurcationofbeingintonatureand culture’. [8] Bryant’s aim echoes that of Leopold,hecontinues:

we need to cultivate modes of thinking that help us to become attentive to the alterity of things, the thinglyness of things, and the differences that things themselves contribute independent of social construction, human intention, and human meanings. [9]

88 SPECTRA: Images and Data in Art/Science .

Page 89: SPECTRA - Australian Network for Art and Technology · SPECTRA: images and data in art/science Proceedings from the symposium SPECTRA 2012 The book and the conference that begat it,

88 SPECTRA: Images and Data in Art/Science .

Figure 2. Illustration from The Illustrated Almanac of the Illawarra and Beyond

Myalmanacprojectsdrawattentiontothe‘pluralityofagencies’ineachencounterinthematerialworldbypayingcloseatten-tiontoeverydayobjectsintheirchangingsurrounds.Todatetheseprojectsconsistofthree works: the Autumn Almanac of Tokyo (2008),theSeasonal Almanac of Austinmer (2009) and the Illustrated Almanac of the Illawarra and Beyond (2011 –2012). [10] The earliest work was created during my Australia Council Tokyo studio residency that took place between 5 September and 4 December 2008.AllprojectsadopttheChinese Almanacasastructuringdevicetoaffiliateeach day with reference to seasonal occurrences. Both the Autumn Almanac and

the Seasonal Almanac consist of daily online postcardsforthedurationsoftheprojectswhile one entry of the Illustrated Almanac corresponds to one pentad and seventy-two were posted over one calendar year (from Spring 2011 to Spring 2012). [11] Each post inthesealmanacsiscomposedofanimage,created using selected materials gathered on thedayorpentad:photographs,ephemer-als,audiorecordings,orvideofootage,andatextualexpositionthatdrewuponthings,ob-jects,characters,experiences,questions,andthoughtsencounteredintheperiodoftime.The Autumn Almanac was conceived as a tool to make sense of the encounter with Tokyo beyond the stereotypical imaginings of the

Page 90: SPECTRA - Australian Network for Art and Technology · SPECTRA: images and data in art/science Proceedings from the symposium SPECTRA 2012 The book and the conference that begat it,

90 SPECTRA: Images and Data in Art/Science .

city.Thecombineduseofvisual(sometimesaudioandmoving)imagesandtextsrendersactualexperiencestangibleandexploresthe gaps that arise between the generalised perceptionofseasonsandtheirmaterialisticmanifestationsincontemporaryJapan,whereamodernandmodifiedformoftheChineseAlmanacstillexists.Ratherthanillustratingtheoreticconcepts,thealmanacprojectsmeditate on the materiality of our experiences.Incontrasttoweatherdata-drivenartworks,suchasTimKnowles’ Wind-walk (2008)andCamandYvetteMerton’sThe Little Optimum (2003),thatfeedreal-timeweather data into the works in ways that affecttheartist’soraudience’simmediateexperience,thealmanacprojects’encounterwithmaterialityislessdirect.Rather,theprojectsmakemanifestexperienceasanaes-theticactofperceptionthroughencounteringthe world through things.

ByadoptingtheChineseAlmanacasa structurefordiscursiveentries,thealmanac

Figure 3. The Illustrated Almanac of the Illawarra and Beyond, Minor Heat: Hot Winds Arrive

projectspayattentiontothe‘pluralityofagencies’ in everyday encounters and their zuihitsu(随筆,literallymeaning‘followingthe brush’) approach provides opportunitiestobringoutnarratives immanentwithintheseexperiences.[12] Inthiscontext,zuihitsuasaformofwritingfocusesontheinteractionwithseasonsandsurroundsthroughobservationofobjectsintime,place,andtransition.ThispracticeisexemplifiedbySeiShonagon’sThe Pillow Book andwomen’sdiaristictraditionoftenth-centuryJapan.Shonagon’sworkisbelievedto have been conceived as lists of seasonally andaestheticallyappropriateobjectstobeusedinpoeticcompositions.BylayeringtheChineseAlmanacwiththemodernJapanesesekki (節気) the ninety entries of Autumn Almanacextendancientcategoriesofthingstoincludeobjectslikedaikon,freezingrain,typhoons,kotatsu(atypeofheater),waterpipes,utagoekissa(singingcafes–cafeswhere the customers take turns performing onastage),trains,omurisu(riceomelette),

Page 91: SPECTRA - Australian Network for Art and Technology · SPECTRA: images and data in art/science Proceedings from the symposium SPECTRA 2012 The book and the conference that begat it,

Figure 4. The Seasonal Almanac of Ausitnmer, Start of autumn: cold cicada chirps

postcards,laundry,haircuts,junkstores,art,architecture,andsoon.LikeShonagon’slistsofpoeticobjectsthatsituateherreadersinspecificplacesandtimes,thingsintheAutumnAlmanacanchortheexperienceofcontemporaryTokyofirmlytothetangiblematerials of everyday life through the use of the image.

Here,IturntoWalterBenjamin’s development of Denkbild (thought-image) as a framework for further analysing the role of objectsdepictedinmyonlinealmanacs.Inwhatfollows,IshalldigressbrieflytoexploretheDenkbildformthroughBenjamin’swritings.InOne Way Street,Benjamingraspedtheelusiveexperienceofthemodernmetropolis through the Denkbild where image plays a central but covert part. [14] KarolineKirstwrites,‘Insteadofclarifyingathought by means of an image in linear fashion,orviceversa,theDenkbildpresentsan image as an integral albeit not immedi-atelyrecognizablepartofthethought’.

Benjamin’sliteraryDenkbild alters the Baroqueemblem’stripartitestructurebytransformingthevisualpicturaintoatextualimage. Paul Stephens and Robert Hardwick Westonexplain:

The inscriptio is generally preserved in the form of the italicized title, while the pictura, corresponding to the Denkbild’s anchor in subjective experience, is collapsed into the subscriptio, making the visual imago a com-ponent of the exegetical text that traditionally explained it. On the level of content and style, the collapsing of pictura into subscriptio aims to forge a mental image through persuasive vividness, or anazographesis. [15]

Anazographesis,apracticeofevoking emotionalimpulsethroughimaging (perceivedorimagined),isappositefor framingthecomplexrelationshipbetweenwordandimagewithinBenjamin’s philosophy. [16] Caygill argues that this relationshipisdefinedbyBenjamin’sconceptofexperience.Caygillwrites:

Page 92: SPECTRA - Australian Network for Art and Technology · SPECTRA: images and data in art/science Proceedings from the symposium SPECTRA 2012 The book and the conference that begat it,

92 SPECTRA: Images and Data in Art/Science .

Benjamin’s philosophy of the image is best understood through an examination of its place within the speculative philosophy of experience. Just as the critique of the word was transformed by the speculative concept of experience, so too was the critique of the image. The analysis of the image within a philosophy of speculative experience had considerable implications for the critique of the experience of images in the guise of art criticism and of art history. Benjamin argued that images should be understood as a technology for organising experience, and that visual art was a way of speculating upon the limits of experience from within. However, the technological organisation of experience through the image did not necessarily agree with the political organisation of experience through the word. [17]

Inrelationtothetechnologicalorganisationofexperience,EstherLesliewritesinrefer-encetoBenjamin’s‘WorkofArtintheEpochofTechnicalReproducibility’that,‘The

Figure 5. The Autumn Almanac of Tokyo, Shuubun: Beetles wall up their burrows/ Adzuki beans ripen

photographicobjectbringsobjectscloserforinspection,providinganimprintoftracesofthe world. It reveals traces (Spuren),notofthepotter’shandprint,butoftheobjectivemodernworld’.[18] This imprint is notareflectionbutatrace,atexture,a material presence of the world that remains intheartwork.Thistranslationoftactilityintophotographic form is important in think-ingabouthowimagesfunctionwithinthealmanacprojects.Inwhatfollows,Ianalysethree entries using the Denkbild form as a framework.

In a brief entry in the Seasonal Almanac,the inscriptioreads:‘StartofAutumn:coldcicadaschirp’,‘February15th,2009’.Thepictura shows a pair of dampened shoes in thebottomleft-handcornerstandingonanassortmentofblackpebbles;onthespeckledgroundarerocks,shellfragments,remnantsofbluebottles(jellyfish),strandsofseaweed,flotsamandjetsam;theshoespointtowards the centre of the image where a

Page 93: SPECTRA - Australian Network for Art and Technology · SPECTRA: images and data in art/science Proceedings from the symposium SPECTRA 2012 The book and the conference that begat it,

Figure 6. The Autumn Almanac of Tokyo, Shousetsu: Heaven’s essence rises, earth’s essence sinks/ north wind, freezing rain

deadfishlies(figure 4). The subscriptio speaksoftheexperienceofwalkingonthebeach,theobservationofrain,previoushightide,washed-upstrapweedsandbluebottles.Thediaristicformofanalmanacisconducive to transference of actual experienceintospeculativethoughtsforbothwriters and readers. These thoughts remain unsaidandsubjective.Theymaysuggestmemories or imaginings of an Australian seaside,theweatherofNewSouthWales’SouthCoastinFebruary,oroceantempera-tures that encourage the dominance of jellyfishspecies.Furthermore,thematerialityofobjectsasdepictedwithinthevisualim-agerecallunsaidsensations:thecrunchinessofpebbles,thediscomfortofwearingwetshoes,thetextureofdeadfish,the‘popping’ofbluebottles’swimbladdersunderfoot.Insteadofthe‘collapsingofpictura into subscriptio’,thepictura returns to a visual formandstandsapartfromthetextualinscriptio and subscription. [19] On this open yetconcreteplatform,thepicturabringsout

the alterity of things visually through anazographesis.

In a post from the Autumn Almanac,theinscriptioreads:‘Shuubun:Beetleswalluptheirburrows/Adzukibeansripen,October1st,2008’.[20] The pictura shows a large body offast-flowingwater;itisnight,thewaterisdarkandreflectssurroundingcolouredlights(figure 5). The subscriptio presents a simple scenario in suburban Tokyo as tropical cyclonesdissipated,andanunexpected encounter with an urban animal species— tanuki (Nyctereutes procyonoides viverrinus). [21] Many thoughts emerge from this assemblage that are unsaid. Non-human animals lose their habitats to the encroach-ing suburban development and seek refuge in the human-made environment. During the AutumnalEquinoxinOctober,cyclonesstillpassthroughJapan,bringingwiththemheavyrainfall. Densely built areas need carefully planned drainage to channel storm water quicklyandeffectively.

Page 94: SPECTRA - Australian Network for Art and Technology · SPECTRA: images and data in art/science Proceedings from the symposium SPECTRA 2012 The book and the conference that begat it,

94 SPECTRA: Images and Data in Art/Science .

The Kandagawa provides the main waterway to take the rainwater out to Tokyo Bay.Thetripartitefragmentteasesouttheinterconnectednessoftheweathersystem,geography,andurbanenvironmentsthroughphysicalthings:Cyclones0815and0817,neighbouringChina,theKandagawa,theneighbourhoods of Takadanobaba and Shima-Ochiai,rainfall,drains,busyroads,railway,andtanuki. The gushing water in the visual pictura occupies a central node in this enmeshed network of things. Its pictorial qualities:blackness,glassysurface,patternsofundulations,silence,enhancethe materiality of things and suggest their agency withoutnamingit.Withintheimage,toquotefromJaneBennett’sVibrant Matter,‘objectsappeared as things,thatis,asvividentitiesnotentirelyreducibletothecontextsinwhich(human)subjectssetthem,neverentirelyexhaustedbytheirsemiotics’.[22] The pictura provides an other path for thinking about temporalcontextsframedbytheinscriptio andthesubject’sexperiencesdescribedinthe subscriptio.

In one of the last entries in the Autumn Almanac under the inscriptioof‘Shousetsu:Heaven’sessencerises,earth’sessencesinks/Northwind,freezingrain’dated‘December1st,2008’,thepictura presents an impressivepileofjunkthatfillstheentireframe,litbyastrangelywarmyellow-greenglow. [23] The subscriptio describes a pleasantexpeditiontovisitanew acquaintance in the Akikawa valley of Tokyo’s farwest.Thewrittentextdescribeswhatonemay imagine to be typical of modern Japanesearchitectureanddesign:cleverhouserenovation,stylishJapanese-Italianrestaurantbytheriver,newonsenfacilities,sharplycontrastingthedisorderlyorderlinessofthepileintheimage.Inthelastparagraph,the reader discovers that the astounding pile is,infact,thegoodsofasecond-handstorerun by a Korean migrant. The photographic imagecaptureseachandeveryobjectinsharpfocus:inthebottomleft-handcornerthebronze-colourfoldingchaircasuallyleansonthepile,congregatingnearbylikestacksofkindlingareneatlyfoldedclearplastic umbrellaswithcurvedwhitehandles,around

whitetubwrappedinplasticsitsprominentlyatthebottomcentreoftheframe,toitsrightisanorangeenamelcookpot,aboveisapalebluerectangularwastepaperbasket,toitsleftareanold-fashionedcypressand copper water bucket and its smaller counter-partforrice;therightoftheimageis populatedbyvideotapedecks,discplayers, faxmachines,anddrawersofdifferenttypes,theflatrectangularshapescascadeintoadeepvalleywhereaflattenedwhitesportsshoe with missing laces sits at its base. In the image,theobjectsemanateaninnocence;inretainingtheirpristineappearances,theirfunctionsareclearlydiscernible.These photographedobjectsarenolonger desirablecommoditiesnoraretheyrefuse;theysitsomewhereinbetween,perhapsasdesirable refuse. This clarity of the image capturesthematerialityofthejunkpile.

The visual image in the almanac entries extendsthecontemplativeprocessanddrawsout what is unsaidinthetextualimage.Specifically,thepictura transposes the materialityofobjectsintovisualform, bringingout‘profaneexistence’ofeverydayexperience.[24] Stephen and Weston write:

This element of everyday experience is central both to the Denkbild form and to denkb(u)ilding as discursive practice. As a mode of writing, to denkbild is to build up thought, to construct [bilden] thought, criticism, from the images of everyday life. [25]

Pictura in these almanac entries bring out the‘alterityofthings’throughobserva-tions,estrangement,andambiguities.Theseambiguitiesanduncertaintieswithintheimagemakeroomforspeculations,allowthe‘thinglynessofthings’toproliferateasindi-vidualnarratives.UnlikeBenjamin’sliteraryDenkbild,wherethepictura is collapsed into the subscriptio,thegenerationofemotionsandaffectsthroughwhat is not said in the almanacprojectsputsanemphasisbackontheimage.Thesenarrativesmayilluminatethe‘profaneexistence’ofeverydayexperi-enceandalludetoan‘enigmaticformofsomething[thatis]beyond[their]existence’.Objectswithintheseimagesinthealmanac

Page 95: SPECTRA - Australian Network for Art and Technology · SPECTRA: images and data in art/science Proceedings from the symposium SPECTRA 2012 The book and the conference that begat it,

94 SPECTRA: Images and Data in Art/Science .

Figure 7. Collage of entries from The Illustrated Almanac of the Illawarra and Beyond

projectsrevealedeverydayexperiencesinanew light. As Bryant argues:

art seems to carry the capacity to break with meaning, to bring the alterity and thinglyness of things to the fore, to allow us to see them both form their point of view and independent of our own meanings and intentions’. [26]

Inconclusion,thealmanacprojectsasart-works generate structures that interpret experiencethroughencounterswithobjects.Aspects of these encounters are captured visuallyandtextually.Thisframingde-famil-iarisestheobjectsand‘allowsanencounter[with…]thefamiliarthingsofoureveryday

life in their independent thinglyness’ by bring-ingthemcloserforinspectionand‘seeingthem,perhapsfortheveryfirsttime’.[27] By analysingthealmanacs’entriesusingBenja-min’sDenkbildasaframework,Irevealtheroleofobjectswithinimagesintheseworks.Indoingso,Ihopetorealiseimages’potentialtoilluminatesubjectiveeverydayexperiences.

Page 96: SPECTRA - Australian Network for Art and Technology · SPECTRA: images and data in art/science Proceedings from the symposium SPECTRA 2012 The book and the conference that begat it,

The Anonymous Photographers of Animal Ecology

DustinWelbourneSchoolofPhysical,EnvironmentalandMathematicalSciences,UniversityofNewSouthWales,ACT

Scienceadvancesthroughthecombinationoftheoryanddata;yet,itisoftentechnologicaladvancementthatfacilitatesthisrelationship.When Galileo Galilei turned his telescope toSaturnin1610,heclaimedtohaveseenthree bodies rather than a planet with rings. AlthoughGalileowaslackingtheory,astherewas not a theory of planetary rings at the time,hewasletdownmostbyhisdata.Duetoinadequatetelescopetechnology,Galileosimply could not see Saturn clearly enough. ThirteenyearsafterGalileo’sdeathin1655,ChristiaanHuygensusedasuperiortelescopeto collect clearer data and concluded that Saturn,indeed,hasrings.Thehistoryof science is replete with similar stories of new technologies or methodological advance-ments,whichsubsequentlyleadtothe collectionofsuperiorornewtypesofdatathatinturnconfirmoradvancetheory.

Wildliferesearchhasnotbeenexcludedfromthisnarrative.Inthe18thcentury,the ItalianscientistLazzaroSpallanzanipostulatedthatbatsusedsoundtonavigate;however,itwasnotuntilthe1930sthatDonaldGriffinwasabletodemonstratebatecholocationwith newly available ultrasonic sound detectors. This trend has accelerated over the past 20 years. As the price of robust digital technologyhasdecreased,the modern wildlife researcher has begun to askoldquestionsinnewways,andasknewquestionsthattraditionalmethodswerenotcapableofanswering.Forexample,satelliteremote sensing techniques allow researchers tomapandmodelspeciesdistributionsthatpre-20thcenturynaturalistslikeAlexandervon Humboldt or Alfred Russel Wallace would onlydream,andadvancesingeneticmethodshaveseenthedevelopmentofwholefieldsofscience like phylogeography. While these and many other technologies are great for scientists,onedeviceinparticular,the camera-trap,hasledtochangesthat

transcend wildlife research.

Camera-trapsconsistofacamera,oftenhousedinaweather-proofbox,andatriggermechanismtoactivatethecamera.Theyareslightly misnamed in that camera-traps do not “trap”anything.Instead,thedevicecapturesa picture of whatever animal happens to triggeritwithouttheresearcheractivatingthecameraorevenbeingpresent.Asisoftenthe case when a new piece of technology emerges,itadvancesthefieldofscienceitisappliedto;andthecamera-trapisno exception.Thedifferencewiththecamera-trapcomeswhenweconsiderhowithas,andcontinues,toaffectculturemorebroadly.Thus,inthispaperIwillbrieflydiscusshowthe camera-trap is advancing wildlife research,howitischangingthewaypeopleengagewithscience,andhowits development changed the world.

Advancing Wildlife Research

Answeringquestionsinwildlifeecologyrequiresanobviousthoughoftenchallengingtaskoftheresearcher:to“sample”thetargetspecies.Inthiscontext,“sampling”mayrefertocollectingtissuesamples,recording physical measurements of the limbs and/ or bodyofthetargetanimal,orsimply confirmingthataspecificspeciesis presentataspecificsitethroughobservingthe animal directly or its signs such as scats and tracks. The type of sample required and the technique employed to collect said sampledependsuponthequestionthe

96 SPECTRA: Images and Data in Art/Science .

(Top) Figure 1: Camera-traps allow researchers to peer into the lives of animals and reveal events not captured using tra-ditional techniques. Here a mother Swamp Wallaby “grooms” her joey. (Bottom) Figure 2: The use of camera-traps has traditionally been on mammals and birds, but recent devel-opments have meant that they can now be used to survey reptiles. A major advantage in citizen science programs where potentially dangerous animals, like this Red-Bellied black snake can be encountered.

Page 97: SPECTRA - Australian Network for Art and Technology · SPECTRA: images and data in art/science Proceedings from the symposium SPECTRA 2012 The book and the conference that begat it,
Page 98: SPECTRA - Australian Network for Art and Technology · SPECTRA: images and data in art/science Proceedings from the symposium SPECTRA 2012 The book and the conference that begat it,

investigatorisattemptingtoanswer.Whilethereareoftenmultiplemethodsthatonecouldemploytocollectidenticalor similardata,nosingledeviceexists,includingcamera-traps,whichcancollectalltypesofdatatoanswerallecologicalquestions.Thus,todifferentiatebetweenvariousmethodsthatmayprovidesuitabledata,thewildliferesearchermustassessresourceconstraints,ethicalconsiderations,andmethodologicalassumptionstomaximiseresearchsuccesswhileminimisingfinancialandenvironmentalcosts.

Inlightoftheaforementionedsamplingconsiderations,camera-trapshavebecomean invaluable tool for the wildlife researcher. Firstly,whilesomestudieshaveshownthatthecameraflashcancausesomespeciestoavoid camera-traps [1],theyareethically superior to live-trapping due to the well documented problem of trap mortality associated with live-trapping techniques [2]. Secondly,asanautomateddevice,and despitethehighinitialcost,camera-trapsareless resource intensive than other methods inbothfinancialandpersonnelterms[3],onlyrequiring researchers to deploy and retrieve equipment,andindentifyphotos.Techniquessuchaslive-traps,sand-plots,andactivesearches all require numerous researchers to beinthefieldforthedurationofthestudytocollectdataandmaintainsamplingdevices,whichgreatlyincreasefinancialcosts.Finally,measured in both number of animal detec-tionsandinprovidingpositiveidentificationofwildlife,camera-trapshavebeenshowntobemoreefficientthanalternativemethods[4].Theseadvantageshavesolidifiedtheuseofcamera-trapsinwildliferesearch;yet,itisthe photographic aspect that has opened the wildlife researchers eyes most.

Unlikeallothersamplingmethods,thecamera-trap is the only method that operatesmuchlikeahumanobserverwould;it“watches”theenvironment,recordingevents in the form of images. As we are familiar with photographic technology in the 21stcentury,thisdoesnotsoundthat impressive,buttotheecologist,thisisa majorchangefromtraditionaltechniques.

Inasense,untilthecamera-trap,wildliferesearch has been conducted in the dark. Forexample,usinglive-trapstheresearcherwouldonlymaketheobservationatthetimetheycheckthetrap.But,findingananimalina trap tells us nothing of what happened prior. We do not know whether the animalwasalonewhenitwascaught,ifitwasforagingwithanotherindividual,orifitwas attemptingtoescapeapredator.Similarly,inthecaseofpredationeventsatbirds’nests,predators would be inferred by piecing together the available evidence in and around the nest. Camera-traps cut through much of theuncertaintytorevealexpectedand surprising animal behaviour.

Intheaforementionedcases,camerashaveshownthatlive-trappingdoessometimesseparateadultsfromyoung,asignificantproblem if those young are dependent upon theadult.Birdnestpredationstudieshavegreatlybenefittedfromthecamera-trapasthecameraconfirmsexactlywhichpredatorwasresponsibleandatwhattimeoftheday;onoccasionrevealingunexpectedpredators,like the brushtail possum. Camera-traps even tell us something about our sampling techniquesmorebroadly,suchastheuseofbaits when we are live- or camera-trapping. Baitsareoftenusedinwildliferesearchtobring the target species to the sampling device.Theuseofattractantshaslongbeenunderstood to bias results as some species arepreferentiallyattractedtothesamplingdevice;infact,recentstudieshaveshownthatbaitsaffectdetectionandcaptureratesat the individual level [5].Additionally,ithas long been hypothesised that baits may influencepredatorsoftargetspeciestoo.Byattractingtargetspeciestoalocation, predatorsofthatspeciesmay“stake-out”thebait,waitingforprey.Camera-trapshave revealed that this may be the case with observationsofpredatorssuchassnakesanddogs being present at the bait site for long periodsoftime.

Sampling wildlife is at the heart of wildlife research,andimprovingthewayinwhichresearcherscollectdataoftenleadstomoreethicalandmoreefficientresearchoutcomes.

98 SPECTRA: Images and Data in Art/Science .

Page 99: SPECTRA - Australian Network for Art and Technology · SPECTRA: images and data in art/science Proceedings from the symposium SPECTRA 2012 The book and the conference that begat it,

98 SPECTRA: Images and Data in Art/Science .

Figure 3: As a device, camera-traps are considered far less intrusive than most other methods; still, animals do notice unnatural objects in their environment.

Overthehistoryofwildliferesearch,manytechniques have been developed that have madetheresearcher’sjobeasier,allowedthemtoasknewquestions,andaskoldquestionsinamoreefficientmanner.How-ever,camera-trapsprovideabigger,clearerwindow for the researcher to look through. They,ofcourse,allowecologiststoconductmoreethical,efficientresearch,butcamera-traps also reveal surprising new details about fauna,andabouthowecologistsconductresearch.Whiletherearestillmethodologicalissues to resolve with the deployment and technicalapplicationofcamera-traps; arguably,theyhavebeenoneofthemostimportant methodological developments in the history of wildlife research.

Public Engagement with Science

Asasamplingdevice,camera-trapshavetwoinherent advantages over other sampling methods,beyondtheaforementioned,thatthepubliccantakeadvantageof.Firstly,theraw data from a camera-trapping survey is in the form of images. Almost all other wild-liferesearchmethodssuchaslive-trapping,activesearches,orusingscatsandtrackstosurveywildlifearerecordedonobservationsheets.Dataabouttheevent,suchasthetimeofday,weatherconditions,andrelevantdetailsabouttheanimalarewrittenintoalogbook or digital device. Camera-trap images however,aswillbediscussed,caninspireandbring research to life in many forms of science communication.Secondly,thetechnicalskill

Page 100: SPECTRA - Australian Network for Art and Technology · SPECTRA: images and data in art/science Proceedings from the symposium SPECTRA 2012 The book and the conference that begat it,

required in deploying and retrieving camera-traps,andtoprocessthedata,ismuchlowerthan that of other research methods. This has facilitatedtheriseofcitizenscience programs,whichallowmembersofthepublictodirectlyparticipateinthescientificprocess.

Sciencecommunicationistheprocessof takingresearchorascientificphenomenonand repackaging it in a way that the public can understand and appreciate. In this context,thepubliciseveryonethatisnotaresearcherinthefieldbeingcommunicatedabout.Sciencecommunicationtakestheformoftelevisionprograms,radiobroadcasts,magazinearticles,andlivetalksandforthemostpart,itfallstothecommunicatortodescribe and interpret the data for the audi-ence.Thosefieldsthatcapturedatainimages(e.g.opticalastronomy)clearlymakethecommunicationjobmucheasierastheactualdatacanbepresented,butmoreimportantly,the images connect the public with the scientifictopicinamuchmorevisceralwaythanasimpledescription.Thisiswellunder-stood,whichiswhycommunicatorsofwildlifesciencesoftenuseimagesshotby professional photographers to illustrate the science.However,despitetheseimagesbeingaestheticallybeautiful,thereisoftenan artificialfeeltothefinalproduct,whereasimages from camera-traps present wildlife in araw,almostuntouchedstate.

Animalsincamera-trapimagesdonotoftenappearinterestedinthecamera-trap,so animal behaviour is as close to natural as we can observe. This makes science communicationwithcamera-trapimagesspectacularandpowerful.Onegreatexampleof this took place in 2012 with the capture of close to two minutes of footage of cross river gorillas [6].Atapproximately250individualsthey are the rarest gorilla species and are seldom seen even by wildlife researchers. The camera-traphowever,broughtthis spectacular animal to the smart phones and computers of the public. The footage shows eight individuals moving somewhat leisurely through the forest. A large silverback breaks the serenity by charging past the camera beatinghischest.Afemalegorillahobbles

past;sheismissingahand,likelyaninjurycaused by an animal snare. The footage needs littledescriptiontoenhanceitsworth;view-ing it is all that is needed. Several organisations,suchastheSmithsonian,havetaken advantage of this raw beauty that camera-trapsdeliverbycreatingvirtualzoos,collatingthousandsofcamera-trapimagesand making them available to anyone with an internetconnection.

TheinteractivedocumentaryBear71 takes sciencecommunicationwithcamera-trapimages even further [7]. Bear71 tells the story ofhuman-wildlifeinteractionsbyfollowingagrizzlybearthat,atagethree,wasradiocollared and watched via camera-trap for her entirelife.Thefilmplaysoutonan interactivemapofBanffNationalPark, Canada,thatviewerscannavigatewhilelisteningtonarrationandwatchingsetstorypieces.Acrossthemapvariousicons, representingcamera-trapstations,canbeselected to give the viewer a glimpse of other species that occur in the park. Bear71 is an amazingpieceofworkthathaswon numerousawards;anyfurtherdescriptionofitherewouldnotdoitjustice,Icanonlybeseech you to watch it for yourself. While thisisthefirstdocumentarycreatedalmostentirelyfromcamera-trapimages,itmaynotbe the last. Numerous professional photographers,includingtheNational Geographic photographer Michael Nichols,arenowusingcamera-trapsandothertechnologytobringanewflavourtowildlife photography.

Citizenscienceis,asthenamesuggests, scienceundertakenbycitizens,ornon-experts.Whilearelativelynewterm,itisnota new concept as interested and passionate amateurscientistshavealwaysparticipatedinthescientificendeavour.Infact,pre-20thcenturyscientificinvestigationwasoften undertaken by amateur and self-funded researchers.Inmodernscience,citizen scienceisoftenrestrictedtofieldswhereriskscanbeminimised;thus,wildliferesearchhasgenerallybeenexcluded.Anexceptiontothishas been in ornithological research. Sampling isoftenconductedthroughrecording

100 SPECTRA: Images and Data in Art/Science .

Page 101: SPECTRA - Australian Network for Art and Technology · SPECTRA: images and data in art/science Proceedings from the symposium SPECTRA 2012 The book and the conference that begat it,

100 SPECTRA: Images and Data in Art/Science .

sightingsofbirds,ornotingbirdcalls,at surveylocations;hence,birdwatching interestgroupsoftenprovideinvaluableassistance to academic researchers by providingextrapeopleonthegroundto undertakeobservations.Yet,inwildlife research more broadly where live-trapping andanimalhandlinghasbeenthenorm,theriskofexposingcitizenstoinjuryhasbeenseen as too great of a risk.

Conductingwildlifesurveyswithcamera-trapsposelittlerisktotheresearcher,andso,havemadewayforcitizenscienceprogramstoprogress.Todeploycameras,researchersstakethecameraintothegroundorattachittoatree,pointingitintherequireddirection,then simply turn the device on. At the end of thestudyperiod,camerasareswitchedoffand retrieved and memory cards downloaded sothatimagescanbeidentified.Everypartof this process can be undertaken by amateur scientistsandanumberofprogramshavebeguntoexperimentwithcitizenscience initiativestocollectscientificdata.IntheUnitedStates,researchersfromtheNorthCarolina Museum of Natural Sciences and the NorthCarolinaStateUniversityconductedastudy of backyard predators in 2012 known as The Great Chicken Coop Stakeout [8]. Volunteers from the community were provided with a camera-trap and shown how todeployandoperatethem,withthe researchersbeingresponsibleforidentific-ation.Theprogramwasasuccess,andlessonslearned from it have shaped a new research project,eMammal,whichwillusecloud computingtechnologyandallowvolunteerstoalsoidentifythephotographs [9].

Therearemanyexamplesofcamera-trapsbeingusedinsciencecommunicationandcitizenscienceprojects.Camera-traps,ofcourse,werenotdesignedforthesepurposesbut their ease of use and photographic data collection,whichmaketheminvaluabletoolsforwildliferesearchers,arealsoperfectforpublicengagement.Asourworldcontinuestobecome more technologically connected is it clearthatcamera-trapswillcontinuetoplayavital role in engaging the public with wildlife. Indeed,itiseasytoenvisageatimewhen

images from all forms of camera-trap researchwillbeuploadedtothecloud,andmembersofthepublic,amateurresearchersandprofessionalscientistswillinvestigatethedatatofindwhichanimalsoccuraroundthem,ortoanswernovelquestions.Opendataofthisform,ashastranspiredinotherfieldssuchasgeneticsandastronomy,mayinfactleadtonewtypesofscientificquestionsand drive new ways to engage the public with science.Hence,camera-trapsmaynotonlybea great tool for engaging the public in science,butmayalsoleadtogreatnewformsof public engagement.

The Camera-Trap that Changed the World

Claiming that camera-traps have changed the worldcertainlyseemspretentious,maybeitis,butbearwithme.Considermovie technology. I suspect that you have watched thetelevisionoramovieinyourlife.Infact,justtaketheconsumptionratesofYouTube,avideohostingplatformlaunchedin2005.It has become one of the biggest websites ontheinternet,accordingtoYouTube’svicepresident by early 2013 the site had achieved abillionuniquemonthlyvisitorsresultinginoversixbillionhoursofvideobeing consumed per month [10].YouTubeinfacthasbeenalaunchingplatformforthecareersofnumerous performers like Australia’s Cody Simpson,andofcourse,JustinBieber.WhilewecannotclaimthatYouTubespecificallyisaresultofcamera-traps;surprisingly,the developmentofthecamera-trap,anditsfirstsusesasascientificinstrument,leadus directlytothemovingpicture.And,thereis no denying that movies have had a huge impact upon the world.

Sinceitsemergencein1839,photographyhasbeeninextricablylinkedwithscience.Thephotographofferedscientistsalevelof objectivityandfecunditythatthescientific illustratorcouldnotmatch;andthiswas especially the case with biological organisms. Take Dürer’s rhinoceros as an example.Broadly,itcaptureswhatanIndianrhinoceroswas,butitwasembellishedandexaggeratedbeyondthelivinganimal.Dürerhadneverseenarhinoceros,hiswoodcut

Page 102: SPECTRA - Australian Network for Art and Technology · SPECTRA: images and data in art/science Proceedings from the symposium SPECTRA 2012 The book and the conference that begat it,

102 SPECTRA: Images and Data in Art/Science .

wascreatedfromadescriptionanddrawingprovidedtohim.Indeed,aquicklookatthehistoryofscientificillustrationfindsthatitisfraughtpara-scientificrepresentations.Thisissimplyduetothehumanfilterthat informationpassesthrough.Theobservationbeingmadeisrecordedafterithaspassedthroughtheexperiencesandperceptionsoftheindividualmakingtheobservation.However,thecameraobservesandrecordssimultaneously,andnotjusttheinformationofinterestatthetime,butalldetailwithinitsfieldofview.Thus,oncetechnicalprob-lemsofexposurelengthandportabilitywereresolved,thecamerabecameaninvaluablescientificdevice,andespeciallyforeventstoofast for the human eye.

Inthe1870s,thecamerawasaimedattheproblemofanimallocomotion,and specifically,theissueofwhetherahorses’feet,asitran,werefreefromcontactwiththeground.EadweardMuybridge,aland-scapephotographer,endeavouredtoanswerthequestionbydevisingamechanismthatdid not require a camera operator to manuallyopenandclosetheshutter.Instead,thesubjectofthephotoactivatedthe shutterviaamechanicalandelectro-magnet-ictriggerattachedtothecamera;itwasthefirstcamera-trap.Muybridge,initially,linedupadozencamerasside-by-sidethatwereallactivatedbythehorsetrippingtheshuttermechanismasitranpast,anddemonstratedconclusively that horses are free from the ground at certain parts of the stride. This mightseemtrivial,butatthetime,itwasaquestionthathadnotbeenanswered,thoughit was asked even as far back as the ancient Egyptians.Infact,untilMuybridge,illustratorsandartistswouldoftendepicthorseswithlegsoutstretched,foreandaft,asifleaping.

Eadweard Muybridges work did not stop withjustonehorse,heincreasedthenumberof cameras and went on to have numerous otheranimals,includinghumans,trot,walk,canter,jump,andsoonpasthiscameras.Inordertoviewtheimages,onecouldmerelylookateachphotoindividually,butin1879,Muybridgesolvedthisproblembyinventingthezoopraxiscope.Thezoopraxiscope

wasamodificationtothepraxinoscope,adevice used to animate individual images. Muybridge aligned his images on to the edge ofadiscthat,whenlightwasshonethrough,itwouldprojecttheimagesontoasurface.Byrotatingthedisc,thestillimageswouldcreatetheillusionofasinglemovingimage;andthus,the“movie”wasborn.Muybridge’sworkistheearliestaccountatcreating movingpictures,elevatinghimtothetitleof‘FatherofCinema’.Ifacetiouslysuggestherethat camera-traps changed the world as its inventionledustomovies;butIhavemerelydone this for sake of telling the story of the origins of the camera-trap. Other inventors of Muybridge’s era were close to developing movietechnology,andwouldhavethusbeencrowned as such otherwise. The true value of Muybridge’sworkwasinhiscontributiontoanimallocomotionaslittlehasbeenlearned,eventoday,thathedidnotdiscover.

Conclusion

In many ways the history of the camera-trap repeatsthehistoryofthetelescope.JustasthetelescopeallowedHuygenstoconfirmtheringsofSaturn,camera-trapsareallowingwildlife researchers to make discoveries that othermethodsdidnot.Indeed,itistrueforallofsciencethateverytimeanewwindowontheuniverseisopen,wediscoversome-thing new. Camera-traps duplicate the researcher,allowingher/himtobein multipleplacessimultaneouslyandmakenew discoveries. But its use has also reached beyond the ivory walls. As images from the Hubble Space telescope have given the public a portal upon the visual splendour of the universe,camera-trapsallowthepublictoengagewithwildlifeinasafebutstill spectacular way. It is now possible for people to take part in wildlife research in almostcompletesafety;andithasgivenstorytellers and consumers a taste of nature in the rawest form. Camera-traps have made a tremendous impact upon wildlife research andsciencecommunicationandhavethepotential,withnewtechnologies,tocontinuetoadvancethesefieldsofhumanendeavour.

Opposite: Untitled image from Erica Seccombe

Page 103: SPECTRA - Australian Network for Art and Technology · SPECTRA: images and data in art/science Proceedings from the symposium SPECTRA 2012 The book and the conference that begat it,

102 SPECTRA: Images and Data in Art/Science .

Page 104: SPECTRA - Australian Network for Art and Technology · SPECTRA: images and data in art/science Proceedings from the symposium SPECTRA 2012 The book and the conference that begat it,

Learning Science in School through Constructing Representations

Vaughan Prain 1 and Russell Tytler 21FacultyofEducation.LaTrobeUniversity,Bendigo,Victoria,3552,Australia2FacultyofArtsandEducation,DeakinUniversity,WaurnPonds,Victoria,3216,Australia

Visualizing in Science

Newdiscoveriesinsciencehaveoftendrawnon visual modes and increasingly do so. As noted by Wise [1, p. 75],muchofthehistoryofsciencehasbeenabout“makingnewthingsvisible,orfamiliarthingsvisibleinnewways”.Scientistsuseopticalinstruments,maps,plots,drawings,scans,graphsandsimulationstogenerateimagesthatcanjustifyscientificclaims or argument about new knowledge. ThisisevidenthistoricallyinNewton’sprisms,inBunsenandKirchhoff’sspectrometers,andalsoincurrentuseofX-rays,CATandPETscans,andMRI,whereimages“formbothwhatandhowweknow”[1, p. 82].

However,thiscapacitytothinkwithandthroughimagesisoftendown-playedintraditionalapproachestolearningscienceinschools.Whilestudentsareclearlyexpectedtointerpretandconstructdiagrams,graphs,andcharts,themainfocusisonlearningconceptsthatarecharacterizedinlinguisticterms.Studentsareexpectedtoknowwhat“energy”,“equilibrium”and“adaptation”mean,andbeabletoapplytheseconceptstoexplaindifferentphenomena.Werecognizethat learning science entails verbal reasoning andformallogic,butalsoclaimthatstudentsneedtoengageininformalvisualandcreativereasoningasusedbyscientists.Wereporthere on an approach to science learning in school that seeks to integrate both kinds of reasoning. Our approach focuses on students constructing,justifyingandrefiningtheirownrepresentations,whereteachersguidestudents to develop conceptual understand-ingthroughthisprocess.Wefirstelaborateon what we mean by reasoning.

Reasoning in Science Learning

Werecognizethatanextensiverangeofcognitivetheoriescastshumansasadaptiveinformationprocessors,whouseperception,memory,categorizationagainstnorms,andlogical inferences to reason [2]. We also recognizesocioculturalandembodied- cognitivetheoriesthatcasthumansas players,whoreasonthroughparticipatingincollectiveactivity,simulation,visualization,rehearsal,engagementwithtools,enact-ment,reflection,embodiedunderstandings,pattern-spotting,andaestheticpreferences [3,4,5].

Accounts of reasoning to learn in science havegenerallydrawnonthefirstsetof theories around formal reasoning processes. Forexample,theTrendsinInternationalMathematicsandScienceStudy[6]character-izesreasoningasanalyzing/solvingproblems,integrating/synthesizing,hypothesizing/pre-dicting,designing/planning,drawingconclu-sions,generalizing,evaluating,andjustify-ing. Reasoning can also be understood as a two-step mental process [7],wherethefirststageofimaginingandrepresentingsolutionsisseenasautomated,intuitive,andbasedonpast knowledge and personal preferences. By contrast,thesecondphaseofassessment/judgmentisviewedasanalytical,linguisticandevidence-based,andthusalignedwithformal logical processes outlined in the scienceeducationliteratureonreasoning.Wethink this version of a two-step process over-simplifiesthekindsofreasoningthat occurwhenstudentscreatesolutions,butagreethatbothcreatingandcritiquing representationsarecrucialtorichsciencelearning.

Our approach seeks to focus on informal and formal reasoning processes when students

104 SPECTRA: Images and Data in Art/Science .

Page 105: SPECTRA - Australian Network for Art and Technology · SPECTRA: images and data in art/science Proceedings from the symposium SPECTRA 2012 The book and the conference that begat it,

104 SPECTRA: Images and Data in Art/Science .

Figure 1a and 1b - Student notebook sketches.

construct,justify,assesstheadequacyof,andrefinetheirownrepresentations.Thisapproach aligns with other calls to focus onstudents’representationalcompetence[8,9,10,11]. Reasoning processes/strategies hereincludeinformal,contextualpracticalreasoningbasedonobservationsanddatacollection,perceptualpattern-spotting,objectmanipulation,approximations,enactmentandre-representationofexperiments.Otherprocessesincludeclassroomconversationsandelaborationofcontestedperspectivestoclarifyclaims,inductivereasoningfrom examples,deductivereasoningfrom principlestonewcases,abductivereasoningor“guessing”fromlogicalinferences,logicalanalyses of the adequacy and coherence of students’ownandothers’representationalandre-representationalclaims.

SupportforthisapproachfromscientificpracticeisevidentinGooding’s[12] analysis ofFaraday’snotebooks.Goodingpersuasivelyclaims that science knowledge-making does notproceedsolelybysemanticlogical formulationsbutbuildsheavilyon visualization.AccordingtoGooding [12, p.40],visualizationinscienceinvolvesobjects“thatcombine visual and non-visual elements becausescientificworkrequiresrepresenta-tionsthatarehybrid(thatcombineverbalorsymbolicexpressionswithvisualandothersensorymodalities)”.Thisenablesthe meaningofanimage,wordorsymboltobeatfirstnegotiablebeforeitisfixed.Inthisviewstandard accounts of the nature of science basedonverbalformulations(facts,laws,formulae)thatobeysemanticrules,donotcapture how new knowledge is made. The morecomplexthinkingbasedonperceptual,usuallyvisualpatterns,drawsontwofeaturesofhumancognition:”ourabilitytorecognizeregularityinvisualpatterns,andourabilitytointegratedifferenttypesofsensory informationintoasinglerepresentation”[12, p 42] .

A Representation Construction Approach in Science Classrooms

Inthisapproachtolearningscienceinschool,studentsareexpectedtorespondtoa

Page 106: SPECTRA - Australian Network for Art and Technology · SPECTRA: images and data in art/science Proceedings from the symposium SPECTRA 2012 The book and the conference that begat it,

106 SPECTRA: Images and Data in Art/Science .

representationalchallengewherethey explainfeaturesorchangesinnatural phenomena. This approach entails teachers guiding students through a sequence ofrepresentationsandre-representationsonasciencetopic.Inthefollowingexample,twoyear 5/6 teachers in a shared primary class-roomplanned,implemented,andevaluateda unit on Animals in the School Environment that included a rich range of teacher and student-generatedrepresentational challenges,investigativeactivities,discussion,andre-representation.Majorconceptstobelearntincluded:ecosystem,habitat,diversityofanimalpopulations,interactionsbetweenplantsandanimalsinanecosystem,animalstructureandfunction,andtheadaptive purposes of behaviour. Students were expectedtolearnaboutmethodsforstudyinganimals,andgeneratetheirown representationstoexploreideasanddevelopunderstanding of target concepts.

The students were taught how to sample and drawrepresentationsusingtables,graphs,diagramsandcrosssectionsinrelationto animaldiversityandanimalclassification,which they then applied to studying meal-worms. Students collected data on animals andplantsintheschool-groundhabitat,andgathered animals for small-group study. They were required to describe the diversity of theseanimalsintheirlogbooks,characterisetheirstructureandbehaviours,andexplainhowthesewereadaptivetotheirhabitat(see Figs 1 and 2 for examples).

Thespecificityofdetailintheselogbookspoints not only to the students’ high levelsofengagement,butalsotothewaysinwhichwritingandothermodesare necessarily interdependent in meaning- making and reasoning as the students integratevisual,verbalandmathematicalmodes to clarify and communicate emerging understandings.Thetypesofdrawing,thelevelofdetail,thecountofanimals,andtheuseofagraphtocharacterisethepopulation,all reveal how the students integrate meaning acrossmodes,toreasonaboutanimal diversity. Teacher and peer verbal and other inputsarealsoclearlycriticaltothisprocess.

Figure 2 - Student graphical representation of animal population

Learning the languages and reasoning moves of science is embedded meaningfully in an inquiry where students are addressing the challenge of how to represent adequately their understanding of this diversity. The changingannotationsflaghowthestudentsusedthegraphstoguidebothdatacollectionand to prompt new reasoning processes and conclusions.

Twoboysinthisclassobservedcentipedebehaviour closely and then constructed a jointedmodelwithelasticconnectionstoattempttocapturetheanimal’sundulantmovement.Aswithalltherepresentationalchallengesinthisclass,thestudentswereexpectedtodrawonandextendtheircurrentrepresentationalresourcestoaddressthisproblem. The 3D model that they produced (see Figure 4) indicates a strong understand-ingofthenatureofthejointedbodyandthesequence of leg movement. The two boys made preliminary drawings of the arrangementofthecentipede’slegs,aswell

Page 107: SPECTRA - Australian Network for Art and Technology · SPECTRA: images and data in art/science Proceedings from the symposium SPECTRA 2012 The book and the conference that begat it,

106 SPECTRA: Images and Data in Art/Science .

as a close-up of the animal cleaning its antenna (Figure 3),andtheseobservationsweresubsequentlyreflectedinthe constructedmodel,andintheverbal descriptionsmadebytheboystotheclassinexplainingthismodel.

Figure 4: Centipede model showing elastic attachment of segments

Figure 3: Centipede notebook entry

The two boys drew on many resources to reasonabouthowcentipedesmove,andhowtodesignamodelthatexplainsthismovement. They used past knowledge and experienceinconstructingobjects,theirunderstandingandexperienceoftheirownbodily movement and the movement of other animals,aswellassymbolicresourcessuchaslearntverbal,visualandmathematicalrepresentationsfrompastsciencelessons.Theyalsodrewimaginativelyonperceivedqualitiesintheirrawmaterialsandtheircapacity to visualise a product or a possible outcomeastheytackledthisnon-routinetask. Their reasoning processes varied across differentstagesoftheprocess.Initiallytheirtalk,sketches,anddecisionsonmodeldesignenabledthemtoorganizeperceptionsofthe precise nature of how the legs and body moved.Constructingdrawingsinvolvedidentifyingkeycentipedepartsimportanttomovement,andabstractingtheseelementsinacreativevisualreasoningprocess.This

thenledtosuccessivetransformationsacrossmultiplerepresentations,fromlabelled drawing,ongoingtalk,adesigndrawingfocusingonjoints,modelconstruction,andthenembodiedcharacterizationina spontaneousrole-playofthecentipede’smovement when they later demonstrated their understanding to the class.

Differentrepresentationaltaskswithinthisprocessprovidedifferentaffordancesthatconstrainandproductivelyfocusthe students’attention.Drawingenablesthe relationbetweensegmentsandleg attachmentstobespecified,withthedesigndrawing requiring an account of the characteristicsofthejoints.Annotated writingenablesthemtocategorisepartsandspecifytheexactnatureoftheirclaimaboutthemovement.Creatinga3Dmodelforcesconsiderationofthematerialpropertiesthatwouldallowappropriatemovement,suchasthechoiceofelasticoverhardsections.The 3D model shows the boys’ close awarenessofthenatureofthejointedbodyand the leg movement sequence.

Inpresentingthemodeltotherestoftheclass,oneboymovedthemodelsothatindividualsectionsundulated.Hegestured,

Page 108: SPECTRA - Australian Network for Art and Technology · SPECTRA: images and data in art/science Proceedings from the symposium SPECTRA 2012 The book and the conference that begat it,

108 SPECTRA: Images and Data in Art/Science .

movedthemodel,andcommentedthat “insteadofmovinginstraightlinesitmoveslikeasnake”.Theotherboygesturedto signifytheundulation,andadded,“soweusedelasticsoitcouldmoveproperly”.Their3Drepresentationcombinedwiththeirverbalaccountsfunctionedasreasoningtools.Asone boy said:How we found out, how it moves is (moves the model) it went like (uses right hand to simulate the undulating movement). I also think it did this (moves hands) one set of legs forward and the other (raises both hands and moves them in a left-right, left –right motion). Atthispointhemovedveryclosetoandjustbehind the other boy in order to represent thenextconsecutivesegment.Bothstudentsthenusedtheirhandsandtheirentirebody,gesturing and moving in complete synchronicity as an embodied account of their understanding.

Thisexampleofprimarystudents addressingarepresentationalchallenge highlightsthecomplexityoffactorsand strategies that contribute to quality learninginprimaryschoolscience,wheretalkingandwritingaretwoofmanyresourcesthat contribute to the processes and products oflearning.Thestudents,asinallsciencelearning,havetomakedurablelinksbetweenpastknowledge,newexperiences, manipulationofobjectsandotherinquiryprocesses,astheyinvestalltheiravailablerepresentationalresources,includingwriting,into personal meaning-making about the target concepts. What the students can knoworlearnthroughwritinginthistopic,andfromlinguisticresourcesmorebroadly,dependsontheirability(andmotivation)tomake strong links across all these elements. Whetherstudenttalkandwritingcanserveinformal and formal reasoning processes in thiscontextalsodependsontheselinkages.

Rethinking Reasoning in Science

Our approach to learning in school science alsoraisesinterestingquestionsabouttherelationshipbetweenimage-making, reasoning,andknowledgeproductioninscience. As noted by Wise [1],ratherthan

perpetuate dichotomies between art and science,intuitiveimage-makingandanalyticalabstraction,geometricpicturesandalgebraiclogics,newaccountsofknowledge-makinginscience,andinscienceclassrooms,pointtonecessaryintersectionsbetweentheseapproachesratherthanbinaryexclusions.Gooding [12, p. 60] makes a similar point in his analysesofFaraday’sresearch:

The received view of scientific inference is that it is accomplished in language capable of preserving consistency, both in the use of signs and in relationships between propositions. Does this mean that Faraday’s visual and material manipulations were not really reasoning, or that what these produced was not knowledge? On the contrary, while successful science does require a stable linguistic formulation, creative research cannot be conducted solely with well-formed linguistic representations. There are nonvisual ways of forging an isomorphism of words, images or symbols to what they denote, but images are particularly conducive to the essential dialectical movement between the creative stages of discovery and the deliberative, rational stages in which rules and evaluative criteria are introduced to fix meanings and turn images from interpretations into evidence.

Thisisacompellingattempttoexplaintherelationshipbetweencreatingandcritiquingrepresentationsinmakingknowledgein science,aswellasthecognitive,culturalandmaterial resources that enable this feat. We consider that our research on student science learninginschoolconfirmsthebroad plausibility of this account [13].Inthissense,theevidentiallinguisticpost-hocaccountofanewscientificbreak-throughmasksthemeans by which it has been accomplished. Wealsothink“thecreativestagesof discovery”,tojudgefromourclassroomexampleabove,indicatethatthestudents(aswellasscientists)useinformal,deliberative,inventivereasoningprocessesasthey constructrepresentationstoexplain phenomena.

Byimplication,scienceteachersneedto

Page 109: SPECTRA - Australian Network for Art and Technology · SPECTRA: images and data in art/science Proceedings from the symposium SPECTRA 2012 The book and the conference that begat it,

108 SPECTRA: Images and Data in Art/Science .

recognizethatstudentreasoninginscienceincludesbothformalandinformalprocesses,and that when students are guided to address representationalchallengesbothkindsofreasoning can be developed and integrated. Asnotedinourclassroomexample,studentconstruction,reviewandexplanationof images are crucial to these reasoning processes.Ourresearchpointstoeffectivelearning tasks and teacher/student roles wherestudents’attemptstovisualizeandjustifyaccountsofphenomenacanleadtoquality learning in science.

Below: Spectra 2 (2011) Mary Rosengren

Page 110: SPECTRA - Australian Network for Art and Technology · SPECTRA: images and data in art/science Proceedings from the symposium SPECTRA 2012 The book and the conference that begat it,

The Montage: a working space for interdisciplinary discourse

Victoria CooperArtistandindependentresearcher,Toowoomba,Qld,Australia.

Interdisciplinaryprojectsthatconnecttheartistwiththevisualpotentialofscientificknowledgeandimagesoftenrequirea flexibleandinclusivespaceforthe developmentofvisualconcepts.Using examplesfromherrecentstudy,theartistdiscusses how the photo-montage provided a supple medium to create her visual narrativeswhereimprobablerelationshipswereexplored.Inthiswork,scanningelectronmicroscopeimagesofinvisibleaquaticlifeforms inhabited the larger social spaces of Australian freshwater environments. A featureofthisinvestigationwasthe observationofunexpectedandunnaturalphenomenaarisingfromthisfertilespaceandhowtheseinformedtheartist’swork.Afterreflectingontheresultsofthisworktheartistrecognisedabroaderpotentialforthe montage as a methodology for dynamic thinking processes. This paper seeks to promote the montage as a tool enabling a provocativeandstimulatingvisualparliamentfor interdisciplinary discourse.

Re-colonising the Narrative

Thisresearchexploredthere-contextual-isationandrepurposingofscientificimagestocreatevisualnarrativesoffreshwaterplacesinAustralia.Aquaticfungiwerefeaturedinthesevisualstoriesasarepresentativeforthemore-than-human inhabitants of these aquaticenvironments,thatlie mysteriously,liketheBunyip,beyondnormalhumanperception.Thesefungiandtheirplace in the ecosystem not only underpinned theconstructionthevisualnarrativesbutalsoexpandedthenarrativespacetobeyondthehumanexperienceoffreshwater.Appearingasapparitions,thesenaturalrecyclers metaphorically de-compose the detritus of thecolonialfreshwaternarrativestoassertthe presence of the non-human.

Many issues arose from the interdisciplinary workastheobjectivityofsciencecollidedwithsubjectivityofaphysicalandmeta-physicalexperienceofplace.Inthiscontestedspace,preconceptionsofscientificknowledgeand values were challenged and then reconciled. In this discussion I refer to Gaston Bachelard’sdeliberationsinPoetics of Space [1]andDonnaHaraway’sdiscussion:‘science is cultural practice and practical culture’ [2]. Rather than Edward O. Wilson’s Consilience [3],whereinterdisciplinarydiscourseflowsinunison,Idiscoveredanunpredictableand surprising space. Throughout my visual researchIexploredthenewpathwaysformedarisingfromtheinclusionofdifferentvoicesandlivedexperienceswithinsite-specific,place-narrativesoffreshwater.

The work was created in the inclusive and flexiblespaceofthemontagewhererigidstructures and familiar places were decomposed and recombined into an unexpecteddiversityofideas.Intentionally,thereaderisnotofferedyetanothereco-politicalenvironmentalnarrativeofwaterandrivers.Thesestoriesflowfromonesitetoanother,fromcolonialperceptionsof progressandproductiontoanatural recognitionofabsenceandpresence,andfromscientificfacttomythicalreality.

Thefieldworkwascarriedoutinthreesitesoffresh water:1. Rio Vista,Mildura,Victoria.WilliamandGeorgeChaffey,theengineerswhopioneeredirrigationinthisdistrict,originallyownedthis grand colonial homestead situated near the Murray River. This house is now part of the Mildura Arts Centre and was undergoing renovationduringmyresidency.2. Bundanon,nearNowraNewSouthWales,originallyArthurandYvonneBoyd’s Australianresidenceandstudio,issituatedbeside the Shoalhaven River. In 1993 The

110 SPECTRA: Images and Data in Art/Science .

Page 111: SPECTRA - Australian Network for Art and Technology · SPECTRA: images and data in art/science Proceedings from the symposium SPECTRA 2012 The book and the conference that begat it,

Figure 1 The collection process: Three images showing the collection of leaf litter and foam samples at Bundanon from the Shoalhaven River. The samples were then incubated in an aerated freshwater bath for two weeks. During this time samples from the baths were processed to detect, monitor and photograph the microscopic aquatic fungi from each site.

Figure 2 The specimens were observed and imaged through three different micro-scopic technologies. Top: Samples from the baths were micropore-filtered and placed under a stereo-microscope for initial observations. Middle: After aquatic fungi were observed under the stereo microscope, samples were stained with lacto-phenol cotton blue solution and wet mounted onto slides for viewing and imaging under the compound microscope. Bottom: Many samples were then imaged within an electron microscope. These electron micrographs were found to have the images qualities

Page 112: SPECTRA - Australian Network for Art and Technology · SPECTRA: images and data in art/science Proceedings from the symposium SPECTRA 2012 The book and the conference that begat it,

Boyd’sdonatedalltheirpropertiesinthisregion to the Australian people. Bundanon is nowusedforartistsinresidenceprogrammesandtoconserve,alongwithanextensivecollectionoftheBoydfamilyart;themodernarchitectureandcolonialbuildings;andnativebushland reserves. 3. Myall Park Botanic Garden (MPBG) near Glenmorgan,CentralSouthernQueensland.Situatedneartheconfluenceofthe Condamine,BalonneRiverswithDogwoodcreek,thisbotanicgardenhasareputationforbothitslivingcollectionofAustralianplants,established by David Gordon (1899-2001) and the botanical art of Dorothy Gordon (1928-1985). To ensure that the garden’s legacy and focus on the fostering of the environment and artwouldcontinueDavidGordongiftedthegardenin1994tothecommitteeof volunteers that now keep the dream alive.

OverthedurationofthefieldworkImademany images including: the topographical and architecturalformsofplace;andthe microscopicenvironmentofaquaticfungi.Icollected small samples of water and leaf littertoculture,observeandrecordtheaquaticfungigatheredfromeachsite(Figure 1).FromeachcollectionIwouldcreatelightand electron microscope images as a resource for my photomontages (Figure 2).Thefield-workatthehistorichome,RioVista,ontheMurray River was connected with the collectionofthemicroscopicenvironmentImade at the headwaters of the Condamine River in Queensland. This work brought together two sites separated by over thousand kilometres but connected by the watersoftwogreatAustralianriversystems,theMurray-DarlingRiverBasin.Atthenexttwo sites I collected water samples directly from the Shoalhaven River at Bundanon and at the Condamine River near MPBG.

Inthecreationofthevisualwork,Iutilisedthephotographicdocumentationas‘quotes’ratherthan‘translationsfromappearances’[4].Inthismodetheybecamenarrative elements or language within the compositionalspaceofthephotomontage.Spatialboundariesandsurfacesofeachsitehad to be transgressed in order to widen the

potentialfornewdiscoursesonwater.TherenovationofRioVistahaduncoveredearlyformsofwallpaper,leadlightwindowsandpainteddecorationsfromthecolonialperiod[Figure 3].Therenovationandthestoriesofghostsandapparitionsbecamethe foundationinspirationforincludingtheaquaticfungiintothenarrativeofthissite.Inthe spirit of renewal in the homestead and in mywaternarrative,thefungimetaphoricallyperformedtheirrecyclingrole,deconstruct-ing and reclaiming the space. I created three visualnarrativesintheformofartists’books(Figures 4-6): Book 1: The Apparition,Books2a and 2b: The Excavation and the Restoration and Book 3: The Exploration.

The montage space in these books included scientificimagesandcollections,humanandnon-humanhabitation.Themythical presenceoftheaquaticfungicreatedfromtheMildurasitemotivatedthenextfieldstudy at Bundanon. Much of Arthur Boyd’s work at the Shoalhaven River at Bundanon dealswithhumannaturewithinthecontextof Australian environment. Boyd used the classical and mythical metaphor of Narcissusaspartofacollaborativebookofthe same name with the poet Peter Porter. ThesehauntingimagesalongwithBoyd’sconcern for environmental issues in Australia resonatedwithmyownwork.Theaquaticfungi collected from this river returned again butastheycrossedtheimpossiblespatialboundariesofscale,mythologyandpoetrynow entered the space of the montage. My visual work for this site was again three artists’books(Figures 7-9): Images of Meta-phor, The House and The River. This place and theriverformewillneverbethesame…

Atthefinalsite,MyallParkBotanicGarden,damsandirrigationpipesarethevisible evidenceoffreshwater.Thecollectionmadeatthenearbyconfluencedidnotyield identifiableformsofaquaticfungi.The narrativeofthissitewasaboutthesearchforthe evidence of the mythical fungi and uncannynatureoftheAustralianexperienceof the bush. The montage space was extendedtoincludetheeverpresentbutnot always visible fungi as a metaphor of the

112 SPECTRA: Images and Data in Art/Science .

Page 113: SPECTRA - Australian Network for Art and Technology · SPECTRA: images and data in art/science Proceedings from the symposium SPECTRA 2012 The book and the conference that begat it,

112 SPECTRA: Images and Data in Art/Science .

Figure 3Rio Vista was a rich visual resource of colonial history and stories of the Murray River its irrigation and the human lived experiences. These examples were inspiration for my visual narratives. The leadlight windows had details of river life, rather like the river had been captured and wrought into the fabric of the building. I observed and documented details from the excavation and renovation (the edges and cracks) of this richly detailed colonial wall decoration.

Page 114: SPECTRA - Australian Network for Art and Technology · SPECTRA: images and data in art/science Proceedings from the symposium SPECTRA 2012 The book and the conference that begat it,

absence and presence of fresh water. This placeisacollaborativespacewhereartandscience,humanandnon-human,mythanddailyexperiencesaredefinedbythenarrativeof water. The three books from this site are (Figures 10-12): Day Garden, Night Garden and 7 Gates.

The Photomontage: Questions of Objectivity

AlthoughIwasopentoanyoutcomes,the resultingcompositeimagesstillchallengedmyscientificconscience.Theyseemedunrealandincongruous.Ibegantoquestionmy intent for this work. As I reassigned the purposeofthescientificdocument,wouldthisconceptthenloseitsnarrativestrength?What was the balance between subjectivityandobjectivitywhenusing photographicinformationinaninter- disciplinarydiscourse?RolandBarthes’criticaldiscussion on photography has a relevance to this contemporary issue. Barthes observes: ‘theimageisnottherealitybutatleastitisits perfect analogon.’ He then adds that the photographinisolationis‘amessagewithouta code’ [5] – its meaning is dependent on the vieweroritscontextexplainedinthe accompanyingtext.Importantlyformy project,Barthesthenquestionsthedualityofthemeaningimpliedinthephotograph:‘Howthen can the photograph be at once “objective”and“invested”,naturaland cultural?’[6].

In Camera Lucida [7],Barthesfurthersuggeststhat rather than looking at the photograph weenterintoasubjectivevisualdiscourse,which is dependent on the viewer’s preferenceorconceptualframework‘sometechnical’,‘othersarehistoricalor sociological’ [8]. So Barthes’ discussion had consequencesformywork,notasacriticismbutasanenabler.Isoughttoutilisethisvisualparadoxtobringtogetherthe‘objective’andthe‘invested’–the‘naturalandthecultural’.Thiswasopen-ended,acollaboration betweenmyscientificandartisticcuriosityandintent.Canbothshareintheinventiveandanunrestrictedplayfulcreationofnewnarrativeswithinthesealternativeormeta-phoricallyuncharteredwaters?

Since the growth of the digital medium these questionsandchallengestothetraditionalnotionofthephotographasacaptured realityhaveonlybeenamplified.Ina publicationcritiquingthehistoryof photographyJoanFontcubertaproposesthatin the digital paradigm:Photographyhasnowbecomeinformationinthepurestate,contentwithoutmatter...Issues of meaning will take precedence over issuesofrepresentation...intherealmofartisticexpressiondigitalphotographyshouldbe unfavourable to certain developments of a formalistnaturewhileaccentuatingothersofanarrativeandconceptualnature.[9]

His salient comment regarding the changed physicalstateandperceptionofphotographyin the digital medium releases the image from its social requirement to record and allows for newpotentialvisualdiscourse;andprovidesfortheauthor/artistthearticulationof methodology. The photomontage thus becameaspacewheretheimaginationcanbefreetoinventnewconceptsandquestionobsoletetraditionalbeliefs.Hereboth subjectivityandobjectivitycanco-existwhereimaginativeororiginalthoughtsare developed and understood. As Gaston Bachelard proposes in his phenomenology of theimaginationthatto‘receivethepsychicbenefitofpoetry’:...[the]twofunctionsofthehumanpsyche—thefunctionoftherealandthefunctionofthe unreal—are made to co-operate. We are offeredaveritablecureofrhythmo-analysisthroughthepoem,whichinterweavesrealandunreal,andgivesdynamismtolanguagebymeansofthedualactivityofsignificationand poetry. [10]

Asvisual‘quotes’madefromthemicroscopicinvestigation,thedocumentaryphotographsweresetfreefromtheirscientificpurpose.The space of the montage enabled a dynamic visual thinking process: the posing andponderingofquestionsandrelationshipsintheresearch.Thenarrativesoffreshwaterthenevolvedthroughthe‘co-operation’ofthe‘real’andthe‘unreal’withinthespaceofphotomontage.

114 SPECTRA: Images and Data in Art/Science .

Page 115: SPECTRA - Australian Network for Art and Technology · SPECTRA: images and data in art/science Proceedings from the symposium SPECTRA 2012 The book and the conference that begat it,

114 SPECTRA: Images and Data in Art/Science .

Figure 4Rio Vista; Aqua Vista. Details from the artists’ book, Book 1: The ApparitionArtists: Victoria Cooper and Doug SpowartCollection: Mildura Arts Centre and The National Library of Australia’s Rare Book and Manu-scripts Collections

Figure 5Rio Vista; Aqua Vista. Details from the artists’ book, Book 2a: The Excavation, Book 2b: The RenovationArtist: Victoria CooperCollection: Mildura Arts Centre and The National Library of Australia’s Rare Book and Manu-scripts Collections

Page 116: SPECTRA - Australian Network for Art and Technology · SPECTRA: images and data in art/science Proceedings from the symposium SPECTRA 2012 The book and the conference that begat it,

One Voice or Many?

Through the montage I created a space for visualthinking,wherescience,natureandculture were equal contributors. This space isametaphorical‘soil’richwithorganicandinorganicmatter.Butthismodeofresearchisopenandchaoticratherthantheconsilienceas Edward O. Wilson presents: The central idea of the consilience world view is that all tangible phenomena, from birth of stars to the workings of social institutions, are based on material processes that are ultimately reducible. [11]

Inthisdiscussion,Wilsonpresentsaninterdis-ciplinarydiscourse,wherethehumanitiesandthe sciences can work together but in terms seeking a targeted result from a mission driven research. As an important part of a knowledgegainingandtestingprocess,thismodelbyitsnaturereducesthepotentialforanarchy and chaos. Although guided by the aimsoftheresearch,Ichosetoextendthefieldtoincludedivergencesandinstabilitiesthat emerged as they also assisted the developmentofanalternativenarrativeoffresh water. As Siân Ede comments in her book Art and Science (2005) that advocates of theidealsofunity,eventhough‘well-

meaning’andpresentcompellingcases,canoverlook the fact that: Very many different groups of people in the world also seek a Unity of Knowledge and a mending of misconceived gaps, but on their own terms, through different religious beliefs, spiritual, fundamentalist or otherwise, or through varieties of totalitarian rule, or paradoxically, through visions of anarchy and disorder. [12]

NotionsofunityandconsensusmayseeminitiallyseductivebutasEdepointsouttherealsoneedstoberecognitionofthe importanceofdiversity,differenceandinstabilityinthisdebate.Socialscientistandtheorist Donna Haraway places science as a culturalpracticewherethereshouldbenohierarchy,nosacredcow:allisopentobequestioned;contextandcontentrequire constantrevision.Thehumanitiesandthesocial sciences are equal partners with the natural and physical sciences in this open epistemologicalenvironment.Here,manynewvoicescanbeheard,asHarawaystates:The fantastic and the ordinary commingle promiscuously. Boundary lines and rosters of actors—human and nonhuman—remain per-manently contingent, full of history, open to change. To be meaningful, the universal must be built of humans and nonhumans. [13]

Figure 6 (below) Rio Vista; Aqua Vista. Details from the artists’ book, Book 3: The Exploration Artist: Victoria CooperCollection: Mildura Arts Centre and The National Library of Australia’s Rare Book and Manuscripts CollectionsFigure 7 (opposite page) Site Bundanon. Details from the artists’ book Images of Metaphor Artist: Victoria CooperCollection: The National Library of Australia’s Rare Book and Manuscripts Collections

Page 117: SPECTRA - Australian Network for Art and Technology · SPECTRA: images and data in art/science Proceedings from the symposium SPECTRA 2012 The book and the conference that begat it,
Page 118: SPECTRA - Australian Network for Art and Technology · SPECTRA: images and data in art/science Proceedings from the symposium SPECTRA 2012 The book and the conference that begat it,

118 SPECTRA: Images and Data in Art/Science .

Thus in my montage spaces voices of the naturalenvironmentwere‘commingling promiscuously’ with the familiar human narrativesofplace.Icreatedspaceswhere: aquaticfungireclaimedtheirhistory,theymovedacrossspatialandecological boundaries,fungiandhumanmergedandthrough this mythical hybrid perhaps the non-human has asserted its presence. Sociologist Bruno Latour’s Steps Toward the Writing of a Compositionist Manifesto (2010) [14] advocatesacompositionalspacethat empowerseachcontributor,however disparateandregional,‘Eventhoughtheword“composition”isabittoolongandwindy,whatisniceisthatitunderlinesthatthings have to be put together while retaining their heterogeneity’. [15]

The Montage: More than just an Image

Themontagesinthework, Viral Landscapes (1991) [16],byBritishartistHelenChadwick(1953-1996) visualises a virus entering the ‘body’ofalandscape.Viewingherphoto-montages was analogous to observing the viral invasion of the landscape though a microscope. Chadwick’s work passes beyond thesuperficialintoaphilosophicalspace.Isthisthenaspatialproposalwherescienceand art appear to cohabit independently in twodistinctspaces?Theuseofmontagethenpresentsthenotionofflowofviraland cellularinformationcrossingboththecellularand the body walls that separate the internal fromtheexternalmetaphoricallandscapes.AustralianartistLinOnus(1948-1996) presents the unseen or hidden Indigenous presence,wherebothhumanandnon- humanarelayeredwithin,andover,apaintedlandscape. By crossing the boundaries of the traditionalEuropeanlandscapetopo- graphicalpaintingwiththeIndigenous landscapenarrative,Onuscreateda montageofvisuallanguagesthatcritiquedthe contemporary cultural landscape of the late 20th century in Australia. Through the layered meanings and visual messages in the paintingsofOnusshowsadifferentwayofunderstanding the Australian landscape [17].

The montage was also used to contrast

conceptsasinthe‘valueadded’landscapes[18] ofAustralianartistIanBurn(1939-1993).InthisworkBurncritiquesthecontextofAustralianlandscapepaintingthroughavisualinterplaytextandimage.Theseinstallationsareacombinationoftextoverlyingthefound-objectamateurlandscapepaintingbothcontestingforspaceinthereader’s imaginationandtheirsearchformeaninginboth. In this way these works challenge the viewer to reconsider the landscape image and thetextinadynamicinterplayofmeaning.Burnstimulatedmyimaginationtoexploreandquestionalternativemeaningsthroughthisvisual‘reading’betweenthelines.

Additionallythedevelopmentofthe contemporary digital environment has providedthetoolssothatartistsand photographers could weave and seamlessly blendunnaturalorunexpectedelementsintothefabricofimageornarrative.Assuchthese elements are naturalised into the image and–ratherthandisruptordisturb,asinthecut or tear of the collage styled montage–have a more subtle and subversive impact onthereadingofthenarrative.Bothformscreatedifferentapproacheseachworkingwith ideas towards a point where space for questioningandthinkingaboutproblems.

There are also emergent forms of the montageintheformofamashuputilisingelementsfrommoviesandvideo,music,nonvisualortextualconceptsfromhumanhistoryandthenaturalenvironment.InJanuary2011Australian and New Zealand libraries opened up part of their archives for a digital mashup competitionwherethegeneralpublicwasinvitedtocreatemontagesofhistory,news,images,textsandnarratives.Thisenabledthebroader community to reinvent themselves andcreatenewhistoriesandidentities

Through my interdisciplinary research into freshwaternarrativesIhavecometoknowthemontageasadynamiccollaborativespace,wherematerialsandmindscontest,contrast and combine to construct and then transform the visual message. More than the familiar interdisciplinary approach I have foundthemontage,asinLatour’s

Page 119: SPECTRA - Australian Network for Art and Technology · SPECTRA: images and data in art/science Proceedings from the symposium SPECTRA 2012 The book and the conference that begat it,

118 SPECTRA: Images and Data in Art/Science .

Figure 8Site Bundanon. Details from the artists’ book The HouseArtist: Victoria CooperCollection: The National Library of Australia’s Rare Book and Manuscripts Collections

Figure 9Site Bundanon. Details from the artists’ book The RiverArtist: Victoria CooperCollection: Bundanon Trust and The National Library of Australia’s Rare Book and Manuscripts Collections

Page 120: SPECTRA - Australian Network for Art and Technology · SPECTRA: images and data in art/science Proceedings from the symposium SPECTRA 2012 The book and the conference that begat it,

120 SPECTRA: Images and Data in Art/Science .

composition,anegalitarianrecombinantspacewherechaosandordercan‘commin-gle’andunexpectedoutcomescanevolve,whiletheindividualparticipationremainsvitalandmethodologies–infinitelyvaried.Although this kind of research is not mission driven,theextendedperceptiongainedcaninmanywaysbemoreproductivethanpursuingoutcomes..Throughthisspacethepotentialofthinkingvisuallycanberealized,asartistGerhard Richter [19] presents:

The thinking that aesthetic presentation can open up for us is thus not meant to explain and, by extension, to explain out of existence, what in fact remains irreducible, singular, and resistant within the work. Rather, learning to think aesthetically, to think with and through

the work of art, means learning to see what exactly the enigma or riddle is . . . We could say that the photograph offers us an unexpected mode of seeing that aids us in our task to learn to see the difficulty of thinking. [20]

Inthepursuitofwiderangingissuesaffectingbroadhumanandnon-human,Ihavefoundthedigitalmontageasaspacenotjustforthevisual arts but as a cultural and social medium wherethe‘difficultyofthinking’and ‘thinkingaesthetically’enablesaprovocativeandstimulatingvisualparliamentofideas.

Figure 10Borderlines. Details from the artists’ book Day GardenArtist: Victoria CooperCollection: The National Library of Australia’s Rare Book and Manuscripts Collections

Figure 11Borderlines. Details from the artists’ book Night GardenArtists: Victoria Cooper and Doug SpowartCollection: The National Library of Australia’s Rare Book and Manuscripts Collections

Figure 12Borderlines. Details from the artists’ book 7 GatesArtist: Victoria CooperCollection: The National Library of Australia’s Rare Book and Manuscripts Collections

Page 121: SPECTRA - Australian Network for Art and Technology · SPECTRA: images and data in art/science Proceedings from the symposium SPECTRA 2012 The book and the conference that begat it,

120 SPECTRA: Images and Data in Art/Science .

Page 122: SPECTRA - Australian Network for Art and Technology · SPECTRA: images and data in art/science Proceedings from the symposium SPECTRA 2012 The book and the conference that begat it,

Rio Vista; Aqua Vista. Detail from the artists’ book, Book 1: The Apparition Artists: Victoria Cooper and Doug SpowartCollection: Mildura Arts Centre and The National Library of Australia’s Rare Book and Manuscripts Collections

Site Bundanon. Details from the artists’ book The River Artist: Victoria CooperCollection: Bundanon Trust and The National Library of Australia’s Rare Book and Manuscripts Collections

Page 123: SPECTRA - Australian Network for Art and Technology · SPECTRA: images and data in art/science Proceedings from the symposium SPECTRA 2012 The book and the conference that begat it,

TWITCH: translating microscopic fast motion to a musical composition

R.Alsop1,P.Myers21SchoolofPerformingArts,VictorianCollegeoftheArtandMelbourneConservatoriumofMusic,MelbourneUniversity,Victoria3006,Australia2 independent researcher

‘TWITCH’isamusicalcompositionderivedfrom two sources: images of the movement ofmonocytes,andtheauthor’saestheticresponse to these images as represented through a musical rendering. It considers microscopicimaging,datasonification,andmathematicalinterpretations/representationsinthecreationofanalgorithmicprocessforgeneratinganindefinitenumberofmusicalworks. This short paper presents a very brief overviewoftheArt/Sciencenexus,themakingofart,andtheprocessesusedbyMyers and Alsop in developing an approach tomusiccreation.

Science/Art - Art/Science

LeonardoDaVinciisattributedasrecommending these principles “for the Development of a Complete Mind: Study the science of art. Study the art of science. Develop your senses- especially learn how to see. Realize that everything connects to everything else.” [1]

Isidor Rabi [2] then Charles Snow [3] consideredart/sciencedifferentlytoDaVinci,seeingthattherewasadivide,notjustoftoolsbutinwaysofthinking,indicatingaschism and consequent dichotomy that is mutuallydetrimentalandneednotexist.Theirpositionshavebeenvigorouslydiscussed,developedandextendedastechnologies have developed [4-8]. These discussions generally focus on the develop-mentofamoreholistic,catholicapproachtoinquiryandsocietaldevelopment,but,asGibsonputsit,the““gulfofincomprehen-sion”notonlygrowsbetweenscienceandnon-science,butitcanalsobeobservedbetween,let’ssay,biochemistryand

astrophysics.”[9].Therearemany,oftensuccessful,effortstobridgethisgulf,theSPECTRA2012symposiaatteststothis.Butperhapsscientistsandartistshavedifferentstyles,thoughtprocesses,andapproachestocreativeandinquisitiveacts.

A search limited to peer reviewed papers between 1924 and 2014 of my university’s on linelibrarycatalogrevealed54,016hitsforthephrase“creativethinking”,23,499for“scientificthinking”,and726for“artisticthinking.Scientificthinkinghaswelldevel-oped histories and methods for developing it in young people [10, 11] and in later educa-tion[12].Artisticthinkinghasmorediversemethods and history regarding developing it inyoungpeopleandlatereducation.Thisisdemonstratedbythemajorityofthe54,016discussionsoncreativitybeingbasedoncreativityinthearts.Balkisetal[13] overview thisregardingvocationandinter-personalattributes,butthemajorityofwritingfocusesoncreativitywithindisciplinesandapproaches [14],andpossiblecross-discipli-naryinteractions[15].

Visualization and Sonification

Much of the Science/art-Art/Science relationshipisexpressedvisually,Figure 1 and Figure 2areexamplesfromtheArtofScience2011Gallery,Princeton,wheretheimagesaredescribedas“notartforart’ssake.Rather,theywereproducedduringthecourseofscientificresearch[and]chosenfortheiraestheticexcellenceaswellasscientificortechnicalinterest.” [16]. Figure 1 shows a simulationofgeomagneticreversals,Figure 2 shows an arsenic sulphide dissolved in solution,andFigure 3showsastillimage

Page 124: SPECTRA - Australian Network for Art and Technology · SPECTRA: images and data in art/science Proceedings from the symposium SPECTRA 2012 The book and the conference that begat it,

fromthemonocytesfilmusedtodevelopTWITCH.DrewBerry’sanimationsoftheextremelysmallandfast [17],Géryk’s[18] and Ruizetal[19] discussion of analysis and educationviacomputeranimation,andHaglund et al’s [20] discussionofpotentialissuesareexamplesofillustrativeusesofvisualisationindifferentdisciplines.Thesearevisualizationsofusuallyinvisibleobjectsordatathatmaybearcaneandesoteric,complex,diverse,orrequireextremelylongorshorttimestogatherandmentallyprocess.Manovich [21] and Marsella [22] encapsulate and comment on these processes.

Currentlysonificationseemslessdiscussed,perhapsduetothecultural“centralityoftheeye”[23].However,itisanequallyusefulprocessinmakinginformationasdiverseastheverylongorshort-termmotionoffluids,behaviour of stock markets or immigrants overtime,thepresenceofdisease [24-27] available through a modality that highlights andgivesaccesstodifferentaspectstothevisual. Both processes use various applied algorithms to translate the data from one formtoanotherviaasetofabstractionsandalgorithms. It is also possible to invert such abstractionsandalgorithmstogenerate,test,andthenexploretheoriesregardingthebehaviourofsuchthings,andtothendevelopnewunderstandings;itisalsopossibletoapply these approaches in ostensibly unrelatedareasforthecreationofnewanddiverse works and understandings.

Authenticities

In The Work of Art in the Age of Mechanical Reproduction,WalterBenjamindiscussedwhatmakesanauthenticartwork,saying“Theauthenticityofathingistheessenceofallthatistransmissiblefromitsbeginning,rangingfromitssubstantivedurationtoitstestimonytothehistorywhichithasexperienced”,whichiseliminatedthroughreproduction.Hecontinues:“Onemightsubsume the eliminated element in the term

Figure 1 (above): Illustrating the geomagnetic reversalsFigure 2 (middle): Arsenic sulphide dissolved in solutionFigure 3 (below): Image from the monocyte film used to develop the musical piece discussed here

124 SPECTRA: Images and Data in Art/Science .

Page 125: SPECTRA - Australian Network for Art and Technology · SPECTRA: images and data in art/science Proceedings from the symposium SPECTRA 2012 The book and the conference that begat it,

“aura”andgoontosay:thatwhichwithersintheageofmechanicalreproductionistheauraoftheworkofart.”[28]. But the age of mechanicalreproductionallowsthesonificationandvisualizationdiscussedabove.

Intheiraccompanyinggallerystatement,Zwicker et al describe the images in Figures 1 and 2as“notartforart’ssake.Rather,theywere produced during the course of scientificresearch[and]chosenfortheiraestheticexcellenceaswellasscientificortechnicalinterest.”[16]. This indicates the applicationofan“aura”totheimages,eventhough the images were not created with a similarintentionorcontexttotheartworksBenjaminwasreferringto.Instead,theimages were seen and then interpreted as havinganaestheticvalueextratoanddistinctfromtheoriginalreasonforcreatingthem.Thisisacaseofan“aura”beingappliedtoaninherently“aura-less”imagebytheperceiverandforthatauratothenbe“reproduced”inthetransmissionsviaamediumextratotheimage.Thisprocessofcreatinganartworkfromanon-artworkisreflectedinDuchamp’sstatementthatthe“creativeactisnotperformedbytheartistalone;thespectatorbringstheworkincontactwiththeexternalworldbydecipheringandinterpretingitsinnerqualificationsandthusaddshiscontributiontothecreativeact”[29]. Duchamp’s Fountainisanexampleoftheartistinstillingavalueor“aura”onanon-

artwork,andthat“aura”beingagreedtobymany.

Thiscreativeactisnotjustthedomainofman-made/contrivedobjectsorevents;thereisasensethatnaturalobjectsorevents,whencontextualizedandinterpretedashavinganextraqualificationorauthenticity,canbeinterpretedashavingthequalitiesofart;thesequalificationsandauthenticitiesareapplied in Zwicker et al’s statements.

Musical structures and Organic structures

Westernmusichastheinbuiltabstractionofmusicalnotation,whichdescribesthetemporal arrangement of sounds in order to createharmonies,melodies,rhythms,andtextures,andnumberofinnovationstothecanoncameaboutinthetwentiethcentury.While keeping relevance to the music and inherentstructures,thechangesthatcameabout were radical. Schoenberg’s twelve-toneapproach‘emancipatedthedissonance’,forming a new way to consider musical structureatthecoreofamusicalcomposition [30, 31]. This approach created a system that allowsalgorithmiccreationandmanipula-tionofharmonies,melodies,rhythms,andtexturesexposingconsequenttensionsandresolutions.Examplesofthiscanbeseeninvariousapproachestocompositionaldesign[32-38], [39-42],howeverthereareanumberofissueswiththisapproachtotheorganisationof sounds [43, 44].

Figure 4: Four pitch sequences

124 SPECTRA: Images and Data in Art/Science .

Page 126: SPECTRA - Australian Network for Art and Technology · SPECTRA: images and data in art/science Proceedings from the symposium SPECTRA 2012 The book and the conference that begat it,

Inthearts,anorganicstructureisoftenfeltto be one in which an ad hoc approach in the processes and development of an outcome isused.Inthesciences,anorganicstructuremaybeamorefiniteandappliedterm.1 In thecreationofTWITCHanorganicstructureisconsideredtobegenerativewithinsetparadigmstoproduceoutcomesrecognizedasfittingthatstructure.

Thebackgroundpitchstructureusedhere,createdbyMyers,isshownonthepreviouspage in Figure 4. It can be accessed and interpretedinmanyways,andwhenusingandadheringtoit,anyhearditerationisredolentofthestructure,regardlessofthesounds heard.

Thesefourpitchsequencesareaarrangedthus:9pitchclassespersequencewithmultipleoctavedoublings,whichresultsinahighlevelofresonance;3unusedpitchespersequence–theset0,4,8,(anaugmentedtriad),thefourcomplementsofwhichconstitutea12-toneaggregate. As we are working in a computer based music system the pitches are represented as MIDI2numbers,seeninFigure 5,above.

Figure 6 (below): Interval sequences of the four sequences

These pitch sequences then form the interval sequences shown Figure 6;theyarearrangedin groups of the seven intervals between eightadjacentpitchesineachofthegroupsseenabove,top.

These interval sequences form palindromes. InSequencesA&Cabove,thefirstcellofseven interval distances (numbers) are 1413121,andthelastcellofsevendistances(numbers)arethereverse,1213141,andthethirdandfifthcellshavethe interval distances of 1 4 1 3 1 2 1 and 1213141;thisissoforall16cells.There-forethesequenceshavemultipleiterationsofthesameset/cell,andmultipleinversionsofsets(forexampletranspositionandthe

intervalretrogradesshownabove),thisresults in palindromes within palindromes. Sequences A and C are related by octave and BandCare4thand5thtranspositionsofA3 formingaclosed,self-referentialstructurefromsimpleexpandingandcontractinginterval sequences.

1 This should be read as coming from an artist’s perhaps ignorant perspective. 2 Musical Instrument Digital Interface, a protocol used to communicate between electronic musical instruments, in which each or 128 attributes are given 128 possible degrees of difference.3 (Seq A - 27 28 32 … + 12 semitones results in, Seq C - 39, 40, 42 …). Sequences B and D are a fifth and a fourth transposi-tions from sequence A (the 5th: + 7 semitones, and 4th: + 5 semitones) transpositions being inversion of each other.

Figure 5: MIDI numbers of note used

126 SPECTRA: Images and Data in Art/Science .

Page 127: SPECTRA - Australian Network for Art and Technology · SPECTRA: images and data in art/science Proceedings from the symposium SPECTRA 2012 The book and the conference that begat it,

Figure 7: Example of the process for forming music from the film

Process of forming music from the monocyte film

Alsop’sprogramforinterpretingMyer’spitchsequencesandthefilmisshowninFigure 7. Thefourgreyboxescontainingnumbersarein the top right contain Myers’ four sequen-ces,andthesearetriggeredsequentiallyatequaldivisionsofthefilmduration4.

AsthefilmisbeingplayedtheaverageRGBvalues of 72 small squares superimposed over themonocytefilmsetthevelocity(orvolumelevel)atwhichapitchisplayed.Thedurationof the pitch is directly related to the pitch MIDI number shown in Figure 5. Looking at the top right hand corner of the right

darkenedareaatthebottomleftofFigure 7,thevelocity,pitch,anddurationplayedisshown,inthisimagethevaluesinareaAare40,17,and1400,causingthepitch40tobeheardatanamplitudeof17,for1400msecs,andinBare40,16,and4400,causingthepitch40tobeheardatanamplitudeof16,for 4400 msecs.

Thespeedatwhichthefilmisplayedinfluencesthenumberofnotesstrucksimultaneously,in Figure 7thefilm,takes1209 seconds to complete triggering each of its 1199 frames. It is also possible to set the

4 When using the program contextual pop help is available for each object on the screen.

Page 128: SPECTRA - Australian Network for Art and Technology · SPECTRA: images and data in art/science Proceedings from the symposium SPECTRA 2012 The book and the conference that begat it,

rateatwhichthefilmisplayed,allowingplayfromparticularframeatacertainspeedandthenrevertormoveontothenextframewhen that frame is triggered. These processes allowagreatdealofflexibilitybythecomposer/programuserininterpretingthefilm,whichoriginallytakes49secondstoplayat 24.5 frames per second.

Itispossibletoblurthefilm,whichcreatesgradualvariationsintheRGBvaluesofeacharea,creatinggradualvariationamplitudesatwhich each note is played.

At the museum by Barbara Maria Stafford

Conclusion

Themonocytefilm,Myers’notesequences,and Alsop’s process are inherently devoid ofBenjamin’s‘aura’orDuchamp’s‘innerqualification’,howevereachcangainthesethroughanartisticintervention.Thisprocessof sonifying a visual image may be used in many formats and for many purposes. The outcomesmayfitexpectedmusictraditionsornot,andthereisthepotentialforcalibrat-ingbothMyersandAlsop’sstructurestofitdesired musical outputs. These approaches toreinterpretingdatashowpossiblewaystore-encounter,andthenre-contextualize,re-understand,theseoranyothervisualevent,throughanactualtransductiveprocess.

128 SPECTRA: Images and Data in Art/Science .

Page 129: SPECTRA - Australian Network for Art and Technology · SPECTRA: images and data in art/science Proceedings from the symposium SPECTRA 2012 The book and the conference that begat it,

A Feeling for the Image: Hands, Body and Visualisation of the Invisible

Ian Gibbins 1,CatherineTruman1,LudyMorris21Anatomy&Histology,andCentreforNeuroscience,FlindersUniversity,Adelaide,Australia1GrayStreetWorkshop,Adelaide,SA5001,Australia2JudyMorrisStudio,Belair,SA5052,Australia

Visualising the Invisible

Afundamentalissueinmuchscientificimagingisthattheobjectofour investigationisinvisibletothenakedeye.Indeed,thewholeaimofdisciplinessuchas microscopy or astronomy is to reveal the appearance of the invisible. In the case of microscopy,theobjectsofinterestaretoosmall to be seen without the aid of some kind ofinstrumentation.Modernmicroscopycannow visualise structures down close to atomic level. Powerful instruments use lasers (confocalmicroscopy),electronbeams (electron microscopy) and even incom-prehensively small inter-molecular forces (atomic force microscopy) to determine the microscopic structure of biological structures such as cells and their intracellular molecular machinery,and,insomecases,themoleculesthemselves.

Sincetheearliestdaysofopticalmicroscopy,microscopists have struggled with the interpretationoftheimagestheygenerate[1].Eveninthecaseofopticalmicroscopy,themagnifiedimageisheavilymediated,generatedbysurprisinglycomplexinteractionsbetweenlight,thespecimen,thewayithasbeenprepared,theopticalsystemitself,and,ultimately,thevisualsystemoftheviewer. When we consider image generationbyascanninglaserconfocalmicroscope,manytypesofmodernelectronmicroscopesoratomicforcemicroscopes,thereisnorawopticalimagetoseedirectly.Theimagesaregeneratedbycomplextechnologycontrolledbysophisticatedcomputersoftware,resultinginadisplaywhereeachpixelrepresentssomeformofinformationencodedintoanvisually-

-appreciatedanalogue.Fromthe beginningsofmicroscopy,thetechnicalliterature has discussed the processes involvedinthetransformationfromoriginalspecimentothemagnifiedimage[2]. Correct interpretationoftheimagerequiresknowledgeofthesourceofthespecimen,howitwasprepared,theviewingconditions,andunderlyingoperationalprinciplesofthemicroscopeanditsimageacquisitionparadigms.

Butsomethingelseisalsogoingon,especiallywithexperiencedmicroscopists,orindeed,the users of any imaging instrument. It is readily apparent that such users develop a deepintuitivefeelforthenatureofthemate-rialtheyareobserving.Suchintuitionarisesfrom two sources: familiarity with the speci-mensunderinvestigation,andfamiliaritywiththemediationprocessesoftheimaging instrument. But how does this intuitive“feelingfortheimage”arise?Mostmicroscopists,ifaskedtoexplainwhattheyhavebeenobserving,willdescribetheirimagesviasomecombinationofdrawingand gesture. Why do they use their hands to configuresomethingthatcannotbeseen,letalonegraspedandmanipulated?Isthisanydifferentfromthewayweexplainanythingwecannotsee,suchastheinternalstructureofourownbodies?

Scanning Laser Confocal Microscopy

Confocalmicroscopyisanopticalmicroscopy technique that became widely available around 20 years ago and is now a mainstay of modern biological research [3]. In the most common form of confocal microscopy,anextremelynarrowlaserbeam

128 SPECTRA: Images and Data in Art/Science .

Page 130: SPECTRA - Australian Network for Art and Technology · SPECTRA: images and data in art/science Proceedings from the symposium SPECTRA 2012 The book and the conference that begat it,

Figure 1: (Left) Computer reconstruction of a confocal microscope image of a single neuron (blue) and its potential synaptic connections (red and green). This image contains several artefacts of the reconstruction process that could not possibly exist in a living neuron. (Right) An electron microscope image of a synaptic connection, outlined in red (from [10]). A synaptic connection is about 1 micrometre in diameter. The electron microscope image shows internal structure that cannot be seen with a confocal microscope.

is scanned across the sample using the same lensthatisusedtocapturelightre-emittedfromthesample.Theopticalpathissetupinsuch a way that only a very thin slice of the specimenisinfocusatanytime(an“opticalsection”).Byscanningthroughthespecimenataseriesofdifferentfocalplanes,themicroscopeproducesaseriesofadjacentopticalsectionsofthespecimen.Themicro-scopesoftwarethencanbuildupadata-settogenerateahigh-resolutionvirtualthree-dimensionalrepresentationthatcanbeviewedandmeasuredinmanydifferentways.

The technology underlying laser scanning confocal microscopy is formidable [3]. Laser sources come in a variety of modes and wave-lengths(colours),withsomecapableofbeingtuned to deliver a variety of wavelengths as required. Control of the laser beam intensity andcolourselectionmaybeachievedusingacoustic-opticalfiltersthatdonotuseanyglass. The laser beam scanning is accom-plished via a pair of mirrors that oscillate up to8,000timespersecond.Detectorscanrespond to single photons of light allowing hardware-softwaremodulescountthem,andassigntheirorigininmulti-dimensionalspace.

Tomaximisetheutilityofaninstrumentlikethis,anexpertoperatorideallyneedsadecent working knowledge of the relevant aspectsofquantummechanics,optics,photo-chemistry,andcomputing,nottomentionallthe biochemistry and cell biology necessary to understand the behaviour of the specimen itself.

Attheextreme,whenonlysinglephotonsarebeinggatheredtogeneratetheimage,thereisnothingtoseeinrealtime.Theimageplaneis sampled for only half a millionth of a secondatatime(ie0.5microsecondsperpixel),andmostsamplesdonotcontainanyphotons.However,whenthisprocessiscontinuedrepeatedlyinspaceandtime,thesingle photon data can be integrated to generateahigh-resolutionimageofthespecimen. But given the large amount of interventionbetweentheoriginalspecimenandthefinalimage,howdoweknowifitis“real”?Ofcoursetheimageitselfisarealobject,oratleastitcanberenderedintoonefrom computer memory. The more relevant questionishowwellthisconstructmirrorstheunderlyingstructureofthespecimen,inparticularthecomponentsofthespecimen

130 SPECTRA: Images and Data in Art/Science .

Page 131: SPECTRA - Australian Network for Art and Technology · SPECTRA: images and data in art/science Proceedings from the symposium SPECTRA 2012 The book and the conference that begat it,

specimenthatwecouldnot“see”otherwise.Theanswerisrelativelysimpleconceptu-ally,althoughitmaybedifficultinpractice.What you observe with the microscope in any specificinstanceiscomparedwithwhatyou(orothers)haveseenpreviously,especiallyifsimilar material has been imaged with a differenttechniqueoratadifferentmagnification.Soyoumightcompareyourconfocalimagesofaparticulartypeoflivingcellwithelectronmicroscopicimages,whichprovidemuchhighermagnifications,albeitnotoflivingtissue(Fig. 1).Youalsomightcompare you confocal images with what you know about the behaviour of comparable cells in intact organisms.

While such comparisons may take consider-abletimeandeffortinarigorousscientificcontext,wedothiskindofmentalprocessingroutinelyintherestofourlives.Whatweknowaboutthenatureofexternalobjectsinourworldsisinformedbymultiplemodalitiesofsensoryinput:typicallyvisual,tactile,auditory,andwhereappropriate,olfactoryorgustatory [4].Remarkably,weareabletovisuallyrecognisefamiliarobjectsintheabsenceoftouch,colour,realisticthree-dimensionality,sound,ormostothersenses,as when we see a black-and-white photograph of our house or dog or sister. The criticalimportanceoffamiliarityisobviousifwearegivenaphotographofanobjectwehave never seen before: not only will we fail torecogniseit,togiveitaname,butwemaynot even know which way the image should be oriented.

Use Your Hands

Mostscientistsaredelightedtoexplaintheirwork to you. If you ask a microscopist to show you what he or she has been observing with theirinstrument,you’llalmostcertainlybegivenalookandanexplanation.Neverthe-less,ifyouarenotamicroscopistyourself,youprobablywillfinditdifficulttounder-stand what is actually before your eyes. What dothecoloursmean?Whichbitiswhich?Howbig(orsmall)isit?Beforelong,mostmicroscopistswillbeexplainingtheimagestoyou,takingadvantageoftwokeysetsof

props,namely,somesortofdrawingimplement,andtheirhands.

There are several remarkable features of such aperformance,yettheyaresonatural,wetake them for granted [5].Yourmicroscopistwillsketchoutlinesofcells,ororgans,ormoleculesasrequired,allwithintheconfinesofthepagethathappenstobeavailable.And,almostcertainly,heorshewillindicatewiththeir hands the general shape of whatever it is,spatialrelationswithitsneighbours,howit interacts with other components of the system.

Inordertodothis,yourmicroscopistclearlymust have an internalised mental image ofwhateverisbeingexplained.Thisimagesomehowexistsinascalablestate:thedrawingswillbedifferentinsomewayiftheywere made on a typical laboratory white-board compared with a sheet of A4 paper. At very least the drawings will be bigger on thewhiteboard,andtheynecessarilywillbeconstructedviaadifferentsetofmusclesandmovements,asbefitsthelargerscaleandstandingposture.Morethanthat,thisinternal image can be represented from differentpointsofview:fromabove,frombelow,azoomedviewofadetail.Howisthisachieved?Whereinthebrainissuchanimagestored?Wewilldiscussthisquestionfurther below.

Under Your Skin

Wehaveinvestigatedacloselyrelatedsetofquestionsinwhatinitiallyseemstobeacompletelydissimilarsituation.Howdostudents studying human anatomy come to form an understanding of the internal structureofthelivingbody?Therelativesizesandpositionsofthevariousinternalorgans,themuscles,bloodvesselsandnerves?

There are many resources available for studentstryingtolearnanatomy,mostnotablywell-illustratedtextbooks,anatomicalatlases,and,increasingly,computer-generated animated virtual models ofthebodyanditsconstituents.Buttheseareallovertlyartificialrepresentations,flaton the page or screen. Regardless of how

Page 132: SPECTRA - Australian Network for Art and Technology · SPECTRA: images and data in art/science Proceedings from the symposium SPECTRA 2012 The book and the conference that begat it,

skillfullyorinteractivelytheillustrationsarerendered,noonecouldeverconfusethemwith the real thing.

AttheFlindersUniversitySchoolofMedicine,we are fortunate to have a well-equipped AnatomyTeachingLaboratory.Here,studentshave the rare opportunity to study directly the three-dimensional topography of the humanbody,eitherusinganatomicalspecimens prepared by our skillful technical staff,orbydoingtheirowndissections,aspart of the medical course. Although learning anatomy at the detail required to practisemedicineisadauntingtask,moststudentsfindtheexperienceenjoyableoverall.

What are the advantages of learning anatomy fromrealspecimens?Themethodbywhichthe specimens are preserved means that they haveneitherthecolournormaterialtextureofthelivingbody.Nevertheless,differencesinelasticity,flexibility,andhardness of the organs and their parts persist inthepreservedspecimens.Unlikeaplasticmodel or a computer-generated representation,arealanatomicalspecimendifferentiallygivesasitishandled:itisdeformable;ithasmassandvolumethatvaryfromregiontoregion,specimentospecimen.Whilesomeofthisinformationcanbe gained by simply looking at the specimens,somuchmoreisobtainedbyphysicallyhandlingthem,exploringthefeel,theheftofthem.Thistactileinformationisgatheredlargelysubconsciously,whilethestudentsareprovidingexplanationstoeachother,lookinguptheirnotesorothernearbyteachingmaterials,orasanelementofcurious enquiry.

Weexpectthestudentstohaveadeepknowledge of human anatomy. But whose bodyhavetheylearnt?Howdotheyrescalebetweenthelife-sizespecimensandthetextbookorsmart-phonediagrams?Clearly,the students (and their anatomist teachers) must form a generalised set of images of the internalstructureofbody.Aspractitioners,they must access this mental model of details they cannot see whenever they physically

examineapatient,reviewaradiograph,orcarryoutanoperation.Andjustlikethemicroscopists,mostwillexplainwhattheyknowwithacombinationofsketchandgesture.

A Model in the Brain

Inrecentyears,therehasbeenastoundingprogress in understanding how the brain formsinternalrepresentationsoftheboththe body itself and the physical world that surroundsit.Asubstantialamountofthecerebralcortex(mostoftheparietalcortex)is devoted to the mapping of sensory infor-mationfromthebody,convertingthatintoknowledgeoftheappearance,massandtextureofthethousandsofexternalobjectswe can recognise and manipulate [4; Fig. 2]. Anotherlargeareaofthecortex(themotorandpremotorregions)develops,storesandcontinuouslyupdatesourknowledgeofhowtomoveourbodyandmanipulateexternalobjects[6].

Severalcorticalareasinteracttogenerateourconsciousexperienceofinhabitingourownbody,mostcritically,theinferiorparietalcortex.Thisconstructissuprisinglymalleable,asseenmostdramaticallyintherubberhandillusion,inwhichasubjectcanbeeasilyconvinced that they can feel an obviously artificallimbasbeingpartoftheirbody[7,8].

Asbizarreasthismayappear,wemakethesemodificationstoourbodyschemaallthetime.Forexample,ifwearewritingwithafamilarpen,weonlythinkaboutthetextwearetryingtogenerate;weareatbestminimallyawareofthepenitself,andthen,probablyonlythepentipasitscrawlsacrossthepage.Inlinewithanecdotalexperience,there is good evidence showing that our knowledgeoffamiliarobjectsbecomesincorporated into our internal body schema. Thus,familiarobjectsfeel“natural”becausetheyareinterpretedtobeextensionsofthebody by the cerebral regions responsible for recognisingandcontrollingtheiractivity [4,6-8].

A Feeling for the Image

Althoughthepreciseexperimentshavenot

132 SPECTRA: Images and Data in Art/Science .

Page 133: SPECTRA - Australian Network for Art and Technology · SPECTRA: images and data in art/science Proceedings from the symposium SPECTRA 2012 The book and the conference that begat it,

beendone,itisclearthatmicroscopistsandanatomists alike must generate detailed internalrepresentationsofwhattheyhaveseen. Notwithstanding inevitable factual errorsandconceptualholes,theserepre-sentationsbecomemore“life-like”,iehavegreaterfidelityandaccuracy,withincreasingfamiliarityandexperience.Theyareatoncebothgeneralisedandparticular:theyprovidea template for commonality and a base level forrecognisingdifference.Theyareintrinsicallyscalable:inprinciple,theycanbedrawnorrecognisedatanysize,buttheyfeelmostcomfortable,mostnatural,whenreproduced at normal body scales.

Butwemustreturntothecriticaldifferencebetween the mental images of a microscopist andananatomist.Whenallelsefails,theanatomistcancheckupwiththerealthing,largelyunmediatedbytechnology,chemistryandphysics.However,themicroscopist’simageisforeverinvisibletothenakedeye;nomatterhowfamiliaritfeels,itisalwaysmediatedbyinstrumentation.Sowhatdoestheinvisiblefeellike?Howcanyoudescribethefamilarityofanobjectyoucannottouch,thathasnoweightortexture,noaroma,nonaturalcolour?Sciencecanprovidesomeformallanguageofanalysis,butultimately,perhapspoetrybestapproachesthe essence of the feeling.

“Thespacebetweenmyhands.

Likewhiskey-tonguedfishermen,shore-boundbyForceTengales,Idreamabouttheonesthatgotaway:snapper,mulloway,oceantrout,hammerhead,finsslicingtheseaintosashimi,carpaccio,butterflyfillets,jettisoned,spinningandflippingandfloatingfarfromanydimlyrecollectedgrasp.

Thegapsbetweenmyfingers,

asiftheywerefeathers,asiftheyshouldspantheimbalancedividingthisupdraughtfromthat,thisdiminishingshadowfromitssource,thisinvisiblecalculationdefiningliftanddrag,streamlinedflightandunrecoverablefreefall,fromthistotal,irredeemable,lossofsensibility.

Thespacebetweenmyhands,thegapsbetweenmyfingers:

onlynowcanIdescribetheshapesthatfillmymemory;onlynowcanIdescribetheholdfasts,thehefts,theweights,thelocksandlatches,thekeysmisplacedforever;onlynow,canIdescribe,foryou,atattooneedle,aweddingring,collisions,inadequatelight,unbidden,insufficientnarcosis.”[9]

Figure 2:. The left side of a human brain, with the brainstem and cerebellum towards the lower right of the image. Area 1 (red) is the superior parietal cortex, which stores information about the physical nature of objects we handle. Area 2 (green) is the inferior parietal cortex, which is essential to forming the feeling of owning our own body. Area 3 (blue) is the temporal cortex, which stores semantic information that we use to verbally describe objects.

Page 134: SPECTRA - Australian Network for Art and Technology · SPECTRA: images and data in art/science Proceedings from the symposium SPECTRA 2012 The book and the conference that begat it,
Page 135: SPECTRA - Australian Network for Art and Technology · SPECTRA: images and data in art/science Proceedings from the symposium SPECTRA 2012 The book and the conference that begat it,

Dancing up a Storm: Interactions Between a Dancer and the Surrounding Fluid Medium

J.Young1,H.Kleine1 and L. Lea21SchoolofEngineeringandInformationTechnology,UniversityofNewSouthWales,Canberra2 Canberra Dance Theatre / CSIRO Discovery

Danceis,initsoutreachtotheaudience,primarilyavisualformofartisticexpres-sion.Thegracefulandaestheticmotionsofadancer can be readily observed and appreciated.Invisibletothenakedeye,however,andthereforeusuallyfarlessappreciated,istheinteractionofthedancer’sbodywiththesurroundingair.Weexploretwoaspectsofthisinteraction.

Anymotionofthedancercreatesmotionintheair,akinematicinteraction.Influiddynamicsparlance,adancermaybeconsidereda“bluffbody”,oranun-stream-linedshape.Thevelocitiesofthedancer’storso and limbs are in general small enough thatthefluidmotionsengenderedfallintotheregimeof“lowReynoldsNumber(Re) aerodynamics”,wheretheflowswillbelaminar or moderately turbulent. Such low Reflowsoverbluffbodiesaredominatedbyvorticalmotions,inwhichtheairswirlsoffthebodyandcontinuestorotateasitmovesaway,in“miniaturetornados”.Thesemotionsoftheaircanalsobeveryaestheticallyappealingwhenmadevisible,asinthesinuous waving of a dancer’s apparel (see Figure 1) or the ribbon in rhythmic gymnastics.

Awell-documentedexamplefromthenaturalworld is in the play of dolphins and whales (cetaceans). They are able to create bubble-filledvortexrings(“bubblerings”)fromtheirblowholes,wherethemanysmallbubblesfromanexhalationmergeintoasinglelargeannular bubble. In this case the rings are clearly visible due to the sharp interface between the air in the bubble and the surroundingwater.Thevortexringsareself-advecting,andarelonglastingandcoherentduetotherelativelylowviscosityofwater,untiltheirvelocityreducesbelowacriticalvalue and they become unstable and break down.Dolphinsandwhalesdonotjustcreatetheserings,butplayandinteractwiththemin a way that could easily be described as dancing.Theringscanbenudged,rotatedandflipped,steeredandpinchedintosmallerrings,andseemtoserveasanaloguesofphysical toys.

Figure 1 (left). The waves that can be seen propagating along a dancer’s apparel (here: white silk) are related to the motion of the dancer. The image shows dancer Alison Plevey in Liz Lea’s InFlight. Photo taken by Lorna Sim.

Figure 2 (below). Beluga whales playing with bubble rings .

Page 136: SPECTRA - Australian Network for Art and Technology · SPECTRA: images and data in art/science Proceedings from the symposium SPECTRA 2012 The book and the conference that begat it,

Themotionofthecetaceanandthemotionofthevortexarebothaestheticwhenconsideredseparately,buttheabilitytoseethefluidflow,bothfortheanimalandforthehumanobserver,maketheeffectgreaterthanthe sum of the parts and quite simply wondrous to behold.

Asecondtypeofinteractionofadancerwiththesurroundingairisviatheheatgivenoffbythedancer’sbody.Aball-parkfigureforthethermalpoweroutputofamoderatelyactivehumanis100watts.Duringstrenuousexercise,thisoutputcanbeseveraltimeshigher.Thisresultsinaheatingoftheairadjacenttothedancer,leadingtoslightlylessdense air which rises in a buoyant plume. The motionofthisplumedependsprimarilyonthedensityratiothatcreatesthebuoyancyand how the buoyancy force compares with theotherforcesthatshapetheflow,primarilyfrictionandinertialforces.Thelattertwoforcesareintroducedbythemotionofthedancer,whichmovesthesurroundingairandasaconsequencemodifiesthethermalplume.Theresultingkinematicinteractionsgenerateaflowshapedbytheinterplayofbuoyancy,frictionandinertialforces.

Avisualisationofsuchaflowcanprovideaninsight into the mechanisms of these interactions,butasairistransparentandthusinvisibletothenakedeye,specialtechniques are required to observe such flows.Fortunately,densitydifferencesinairorother(transparent)fluidscanbedetectedwithrelativeeaseasachangeindensitychangesthespeedoflightthroughthefluid.If the changes are large enough they may be observedwithoutspecialequipment–take,forexample,thedistortionofabackgroundifviewedthroughtheexhaustofanengineor simply through the hot air above a candle –butifthesechangesaresubtle,oneneedsspecialopticalequipmenttodetectthem.One such method used to see and measure density changes in a transparent medium istheso-called“schlieren”technique.Lightis sent through the transparent medium of interest,andifthelightbeamencountersdensityvariations,itisrefractedbydifferentamountsdependingonthesizeanddirection

136 SPECTRA: Images and Data in Art/Science .

ofthevariation.Theserefractionsareopticallyamplifiedandgiverisetopatternsofgreaterorlesserlightintensity(ordifferentcolour) on a viewing screen or camera. This technique was used here to visualise a few small-scaleflowsthatcontainthepreviouslymentionedmotionsofbuoyantplumes.

Figure3showsexamplesofsuchvisualisa-tions:Intheleftimage,atabletennisballbalancing on a gaseous stream (visible in the schlierensystem,butnottothenakedeye)isbeingpushedbythegirl,whichgivesrisetochangesintheflow(incidentally,thegirl’sbreath and the warm air surrounding her face and her hand also become visible inside thevisualisationsystem).Themiddleimageshows how the hot column of air above a candleflameisblockedbyahand.Asaresult,the warm air moves to the side and forms alargervorticalstructureintheprocess–atypical behaviour of a low Reynolds number flowasindicatedabove.Finally,theplumeof warm air surrounding the skin of a hand is seen in the image on the right – note that this airflowisonlyvisibleabovethehandwhileonly a thin layer of warm air can be detected on the lower side of the hand.

Makingvisibleboththekinematicandthermalinteractionsofthedancerwiththesurrounding air provide a heretofore unexploredwayofchangingthevisualexperienceofdance.Oureventualaimistocreateavisualanalogueofthe“lightharp”(where a performer creates sound by interactingwithaseriesoflightbeamslinkedto a synthesiser). In our envisaged system a dancer,beingabletoseetheflowpatternscreatedbytheirmovement,isabletomodifythatmovementtocreateanaestheticflowpatternoraparticulardesiredeffect,andthevisualisationsystemletstheaudienceseethisinteraction.

Figure 3. Colour schlieren flow visualisation with front lighting. Details of the used setup are described in [1]. a) Visualisation of the gas flow keeping a table tennis ball suspended in mid-air. Elements of the girl’s thermal plume from her forehead and breath are also visible.b) Developing vortical structure within the thermal plume of a candle flame blocked by a handc) Warm air rising from a hand

Page 137: SPECTRA - Australian Network for Art and Technology · SPECTRA: images and data in art/science Proceedings from the symposium SPECTRA 2012 The book and the conference that begat it,
Page 138: SPECTRA - Australian Network for Art and Technology · SPECTRA: images and data in art/science Proceedings from the symposium SPECTRA 2012 The book and the conference that begat it,

Fluid flows. Image: Harald Kleine, UNSW

Page 139: SPECTRA - Australian Network for Art and Technology · SPECTRA: images and data in art/science Proceedings from the symposium SPECTRA 2012 The book and the conference that begat it,

StellrScope

Eleanor Gates-StuartAustralianNationalCentreforthePublicAwarenessofScience,AustralianNationalUniversity,ACTComputationalInformaticsCSIRO,ACT,Australia

StellrScopebuildsonastoryconnectingtheCanberraregiontoAustralia’smajorcropindelivering a science artwork for the Centenary of Canberra (2013). It celebrates a 100yearsofwheatinnovationfromthedaysofWilliamFarrerthroughtothepresentdayresearch undertaken at the Commonwealth ScientificandIndustrialResearchOrganisation(CSIRO),namelyintheFutureFoodsFlagshipandComputationalInformatics.Incoiningtheterm,StellrScope (Gates-Stuart, 2012) to describe translating information complexity into a simplistic visual rendering of meaning,itissignificantinsuchaprojectwherethevolumeofscientificinformationispossiblyoverwhelmingfornon-scientistsandrequiresacomprehen-sivevisualinterpretation.Intacklingsuchaproject,theprocessesinvolvedarenotalwayspredetermined and respond much more to thedirectionofideas,contentbuilding,researchingandanaestheticunderstandingandconstructforcreatingtheartwork.Thatbeingsaid,thequestionof“howtorepresent a 100 years of meaningful content inasingularartisticoutcomefortheCentenary of Canberra as well as an artwork with equal value and understanding for CSIRO?”wasthechallenge (Gates-Stuart, 2013).

Figure 1. StellrScope Science Art Commission: the StellrLumé Domes

Context

Commissioned by the Centenary of Canberra(2012),theAustralianCapitalTerritoryGovernment(ACT),theStellrScope projectwasalsothebasisforGates-Stuart’sresidencyasScienceArtFellowattheCSIRO,as the successful recipient of the Science Art Commission. The CSIRO and has a long history of Science Art (C. Kennedy, 2013),theFoodFuturesFlagshipexemplifiesthiskindofeffortwithitsFutureGrainsThemeasakeysupporter of StellrScope.In2008,CSIROinitiateditsTransformationalCapabilityPlatform(TCP)programwiththeexplicitintentoffosteringvitalcross-organisationalscienceareas;theTransformationalBiologyTCP that provided the residency for Gates-Stuart. The CSIRO residency bridged the DivisionsofComputationalInformatics,theFoodFuturesFlagshipandtheAustralianPlantPhenomicsFacility.

The breadth of StellrScope research and the geographic spread of its researchers made thisachallengingaspiration;communica-tionwithintheorganisation,betweentheresearch disciplines and its houses certainly fosteredacreativecatalyst(Gates-Stuartetal.,2013)andwascriticaltoitssuccess.The

Page 140: SPECTRA - Australian Network for Art and Technology · SPECTRA: images and data in art/science Proceedings from the symposium SPECTRA 2012 The book and the conference that begat it,

finalcommissionpiece,StellLumé Domes as shown in Figure 1,respectfullypayshomageto this successful partnership.

Making the work

Uniquely,thepremiseincreatingStellrScope,beyondjustusingofelementsofsciencewithintheworkinthisproject,Gates-Stuartused art to illuminate the science for the purposes of research. This proved to be a modelformutuallybeneficialscience/artexplorationsinrelatedfieldsacrossinter-disciplinarypractice(Gates-Stuart & Nguyen, 2014),particularlyinthiscollaborationbetweenscientistsandartist,andofsignificancewithinanationalresearchorganisation(Gates-Stuart et al., 2013).ThissynergybetweenscientistandartistenvelopedothercollaboratorsatCSIROastheStellrScopeprojectedgeneratedtheopportunity to enhance other research areas. Forexample,whenGates-StuartpresentedimagesataFutureGrainsworkshop,

Dr Sumana Bell (Research Director at the CentreforGrainFoodInnovation)sawthepotentialtoapplytheseideastothe“invisiblebubbles”ofgasinsidebread.Linkswere made to Dr Sherry Mayo who has since used X-ray CT to gain insight into the voids thatformduringdoughdevelopment,andwhichdeterminetexture,consistencyandbakingproperties.Thisjointresearchbetween Bell and Mayo neatly illustrates how Art can catalyse Science and foster interac-tionsacrossresearchdomains(Gates-Stuart et al., 2013)andisjustoneofseveralthroughouttheStellrScopeproject.(See Figure 2)

ItistheseexplorationsthatinformedandledthedirectionoftheStellrScopeScienceArtCommissionartworks,especiallyasthefinalworks were to be shown at the Questacon

Figure 2. Invisible Bubbles: X-Ray Phase Contrast Scanning in collaboration with Dr Sumana Bell and Dr Sherry Mayo

Page 141: SPECTRA - Australian Network for Art and Technology · SPECTRA: images and data in art/science Proceedings from the symposium SPECTRA 2012 The book and the conference that begat it,

(NationalScienceandTechnologyCentre)andat the CSIRO Discovery Centre. The artworks certainlyreflectProfessorDurrant’scataloguestatement;Genuine partnerships between artists and scientists represent a new form of interdisciplinary practice that can have a significant influence on the public’s engage-ment with science. Such partnerships with respectful exchange of ideas and perspectives can also help both artists and scientists see things in new light (Durant, 2013).

Testingthelimitsandextendingthescope,bothincontentandexperimentaltechniqueswere presented in many forums and public exhibitionleadinguptothefinalcorrespond-ingexhibitions,StellrScope,andHot Seeds. An opportunity to discuss the research and preview a live screening of the 3D insects had been presented at Spectra that showed 3D animated insects crawling around the CSIRO Entomology building. The Enlighten Canberra Festival(ACT Government, 2013) included large scalearchitecturalprojectionsonCanberra’s

NationalInstitutionsof3DinsectsandplantsontheQuestaconbuilding,whilstthe3DtitaniumInsects (Davis, 2013) wereexhibitedatEmbracing Innovations Vol. 3 (Hely, 2013) at the CraftACTDesign.Suchinteractionsandpublicartopportunitiesservedasanimportantinformationloopandpositivefeedbackinterms of the research and development of new works. Figure 3 details the images used in these artworks.

Focus on Wheat

ConnectingtheCanberraregiontoAustralia’smajorcrop,celebratinga100yearsofwheatinnovationfromthedaysofWilliamFarrerthrough to the present day research under-takenattheCSIRO,StellrScopetakesastepbeyondthebiologicalfingerprintandisadeepandintensescrutinyoftheremarkable

Figure 3. (Top Left) Animated Bugs at Spectra; (Top Right) 3D Titanium Insects; (Bottom Left) Detail of 3D Mapping on the Questacon Building; (Bottom Right) Wheat Field on Questacon.

Page 142: SPECTRA - Australian Network for Art and Technology · SPECTRA: images and data in art/science Proceedings from the symposium SPECTRA 2012 The book and the conference that begat it,

142 SPECTRA: Images and Data in Art/Science .

physical and biochemical traits of organisms in physical plant structures. Despitefirstappearances,quantitativescienceslikemathematics,informaticsandstatisticshavelong-standinganddeepconnectionstobiologicalscience.Modernmolecular biology is awash with data from instruments that tell us about the DNA of livingorganisms–informatics,particularlycomputationalscience,isanessentialpartofdealing with this deluge of data.

ThisworkisaresultofcollaborationatCSIRO,workingwithscientificleadersDrDavidLovellandDrMatthewMorellincludingmanyothervaluedscientificresearchersandlinkagepartnerssuchastheWilliamFarrerTrust.ThisinnovationofnationalsignificancecertainlyextendstheearlyresearchachievementofWilliamFarrerwhonodoubtwouldbeimmensely proud of this research legacy and inspirationtowardsStellrScope.

The focus of StellrScope has been centred on variousthemes,suchasgrowthanddevel-opment,pestanddisease,technologyandbioinformatics,includinghealthandfuturefood. Situated with the department of computationalInformatics,theinfluenceofusingnumericaldata,orcodeasvisualisationextractedfromdata,suchasalgorithmormoretypically,datasetsisanunderlyingbasisforthetransformationawayfromtraditionaltwodimensionalrepresentation.LovellintroducedGates-Stuarttothemultipledimensionsandmultivariatemethodsunderpinningaspectsofexperimentaldesignandanalysisinfieldtrialsandwheat

breeding. With the help of Abbot (Abbott, 1992) andLovell,thisentréeintothenthdimensionwasmotivationalinexploring2Dvisualsinto3Dinteractiveartworks.Thefirststepsweretoassimilatethenumerousartifacts,dataandscientificcontentreadyforcontentdeliveryandproduction,seeexamplesinFigures 4 and 5.

StellrScope,theStellrLumé Domes,providean opportunity to encompass visual dialogue usingmultiplereferencesandtechnicaldatawithin the artwork itself. These results have in factbeenencodedintotheartwork,embed-dedasvisuallayers,accessibleviahumaninteractionrevealingmultifacetedscientificinformationandhistoricalfindings(includingWilliamFarrer’sfielddiary)thatisthe

Figure 4 (above). ‘Splendour’ by Eleanor Gates-Stuart. X-Ray Phase Scanning by Dr Sherry Mayo

Figure 5 (below). ‘Bio Wheat’ by Eleanor Gates-Stuart. Heat Map Data by Dr David Lovell

Page 143: SPECTRA - Australian Network for Art and Technology · SPECTRA: images and data in art/science Proceedings from the symposium SPECTRA 2012 The book and the conference that begat it,

intentionofartwork.Aswithscience,itisnot always what appears on the surface that tellsthestorybutthemeanstoexploretheevidence,orinthiscase,thevisualnarrativewithinthebeautyoftheaesthetic.StellrScopesimplifiesthiscomplexityintostunningimagesofaestheticanalysisandgraphicalinterface,extractingcomplexvisual-isationdatawithimagetoconstructnarrativeviainteractivehemisphericaldisplays,namedStellrLumé Domesasaninstallationartworkfor the Centenary of Canberra.

Conclusion

Theprocessforeachexhibition,StellrScope and Hot Seeds,wereinterestinginthattheexhibitionswereconnectedincontent,although the environments were very different.TheStellrScopeexhibitionwaskeptunderwrapsuntiltheopeningdayastheworkinvolvedthecommissionpiece,StellrLume Domes,andthreeotherlargepieces,includinganinteractivefloorpiece,nicknamed‘DiscoFloor’becauseeveryonewantedtodanceonit,artworkshownin

Figure 6. (Top) StellrLumé Dome and ‘Spotlight’ interactive floor installation. (Below) Wheatear Plant Section by X-Ray Phase Contrast Scanning

Figure 7. StellrScope Collection: (Listed from the top row) StellrLumé Domes; Wheat Weevils; 3D Holograms; Collection of Prints; Spotlight on Wheat; StellrLume ‘Slices of Man’.

Figure 6.ThisexhibitionatQuestaconemphasised the spirit of play and learning through discovery as key factors to the make and build of the work.

The CSIRO Discovery Centre focused on the images created during the residency as the exhibitionspacesuitslargewallbasedworksandisalsolocatednearthesciencelabs,idealfor linking the artworks as a direct result of workingwithmanyofthescientists.Asasummary to StellrScope and conclusion to theresearchproject,itiscomplimentarytofinishthispaperwithanextractofDrMorell’scatalogue statement:

Eleanor’s contribution has been multi-faceted and challenges us to re-evaluate our subject from a range of perspectives. She undoubt-edly relates to the wheat plant and crop as a source of artistic inspiration, reminding us of the beauty and elegance of the underpinning biology. Eleanor has also challenged us to explain the more abstract aspects of our work. How would you visualise for a lay audience the processes of genetics principles and statistical processes that allow the association of particular regions of the wheat genome with key production traits? Her images seek to capture not only the concrete but the abstract aspects of our science.

Eleanor captures the excitement of the research and of the scientists and makes images that invite enquiry and further engagement. However, in addition to these specific outcomes, an enduring and yet intangible legacy from working with Eleanor has been to explore the similarities and differences between artistic and scientific creativity and expression, and this has been an eye opener for both the scientists and the artist. (Morell, 2013)

Page 144: SPECTRA - Australian Network for Art and Technology · SPECTRA: images and data in art/science Proceedings from the symposium SPECTRA 2012 The book and the conference that begat it,
Page 145: SPECTRA - Australian Network for Art and Technology · SPECTRA: images and data in art/science Proceedings from the symposium SPECTRA 2012 The book and the conference that begat it,

TheStellrScopeprojectincludesthefollowingartworks (Shown in Figure 7):

StellrLumé DomesTheStellrLuméDomesuseSpatialAugmentedReality (SAR) techniques to bring computer graphics into the human-scale physical environment.Inordertofacilitateinteractionbetweenthegraphicsandvisitors,overheaddepthcamerasareusedthatsensered,greenandblueaswellasdistanceforeverypixel.Customsoftwarethenextractsthehumanform,suchashands,overthetopoftheprojectionsurfaceandelementsofthedigitalcontent (video images) are selected and shownbasedonwhere‘virtualshadows’landandacompositevideoisprojectedthroughafish-eyelensontothedome.Thiscreatesatwo-layer,2Dvideoona3Dsurface.

Stellr’LumaraTheStellr’Lumarainstallationisavolumetricdisplayforseeing3Dimagesandmotion.Itconsistsofaframewithmultiplestringsplacedinagridformation.Customsoftwarecreatesanimageinaseriesofverticalstripswhichareafewpixelswideandeachstrip corresponds to a single string on the Stellr’Lumarca. The strings are precisely alignedtotheprojectortocreatethe3Dimagesandmotion.

Spotlight on WheatTheSpotlightonWheatinstallationuseSpatialAugmentedReality(SAR)techniquestobringdigitalvideocontent,awheatfieldandmicroCTseedscans,intothehuman-scale physical environment. In order to facilitateinteractionbetweenthegraphicsandvisitors,overheaddepthcamerasareusedthatsensered,greenandblueaswellasdistanceforeverypixel.Customsoftwarethenextractsthehumanform,bodyshapes,overthetopofthefloorprojectionsurface.Elements of the digital content are selected basedonwhere‘virtualshadows’land.Theaudiencemustbecomeactiveparticipantsinordertoexperiencethefloorspotlights.

StellrLume 3D HologramsThe StellrScope holograms use 3D data as the foundationalcomponentofthehologram.UsingCTscansofwheat,seedsandanimated

images,the3Dmodeldataisbrokendowninto subsets for each hogel (a three dimen-sionalpixel).Eachdigitalhologramiscomposed of thousands of hogels. The hologram of the 3D model is created by recordinginterferencepatternsoftwolaserbeams.Interferencepatternsarecomposedandrecordedinthephotopolymerfilm.Thiscompletestheprocessforjustonehogel,so it is repeated for each subsequent hogel untilthehologramiscomplete.Thehologramrecordsandprocessesthefilmandisreadytobe viewed.

StellrLume Collection of PrintsStellrScope images have been digitally composedfromoriginaldocumentaryvideo,photographs,drawingsandtextproducedduringtheScienceArtresidencyatCSIRO,basedattheComputationalInformaticsDivisionandtheFoodFuturesFlagship.InformationwasdrawnfromtheNationalLibraryofAustralia,theFarrerMemorialTrust,NationalFilmandArchivesofAustraliaandincollaborationwithCSIROscientists.The images are produced with archival inks on Hahnemuhle paper from an a large format printer.Seemore:http://www.stellscope.com

StellrLume ‘Slices of Man’The‘FiveSlicesofMan’wallbasedsculpturesarelifesizeinscaleandconsistoflight resin based material showing large bub-ble type holes. This work relates to the health benefitsofeatingbreadanddrawinterestintheresearchoftextureincommercialbakingprocesses,inparticular,airholes.

Wheat WeevilsA series of 3D Printed Titanium Insects are a result of researching the weevil insect as part of the StellrScope Wheat Science Art Commis-sionatCSIRO.Creatingthe3DinsectsbroughttogetherexpertiseacrossCSIRO,includingtheAustralianNationalInsectCollection,ComputationalInformaticsandFutureManufacturing. The insects were achieved by using advanced scanning techniques and X-Ray Phase Contrast Scanning by Dr Sherry MayoandQuantativeImagingbyDrChoungNguyen,CSIRO.3DTitaniumPrintingbyDrJohnBarnes,Lab22,CSIRO

Page 146: SPECTRA - Australian Network for Art and Technology · SPECTRA: images and data in art/science Proceedings from the symposium SPECTRA 2012 The book and the conference that begat it,

ONE

Rebecca CunninghamArtspractitioner,Brisbane,QLDwww.oneperformance.wordpress.com

ONE is a durational performance by Rebecca Cunningham and “all of you”.

ONE is a performance that may take ONElifetime ONEpersonsittingopposite ONE person thereisONEexchange ONE sample of DNA is collected ifdesiredONEsampleofDNAisexchangedthiswillhappenONEmilliontimes untilONEmillionsampleshavebeencollected once ONE million samples fromONEmillionpeoplehavebeencollected,each DNA sample will be imaged and from ONE million DNA images ONE will be madea composite of all becoming ONE

ONE is a bio portrait of 1 million peopleThis work began in 2010 as an ideaIwillnowcontinuethisworkfortherestofmy life.Iwasthinkingabouttrust,andcommunity.I was wondering what it would look like if we

could get the smallest parts of ourselves and put them as close together as possible.Whatwouldthismean?Whatwouldthislooklike?Woulditbeinteresting?

Page 147: SPECTRA - Australian Network for Art and Technology · SPECTRA: images and data in art/science Proceedings from the symposium SPECTRA 2012 The book and the conference that begat it,

ONEfirstperformedatBrisbaneFestivalUNDERTHERADAR2011image credit: Gerwyn Davis

ONE consists of 2 components1) DNA Collection2) DNA Visualization

1) DNA collection This occurs in a performativecontext:1xtable2xchairs.Wesit,talk,exchangeDNAThe DNA is a hair sample.Iaimtoundertakethisactwith1,000,000,000people.ONEcurrentlyhas120participants.

TheperformancewasfirstmadeinBrisbanein2011,andhasnowbeenpresentedinAustralia,theUSA,withdocumentationpresentedinPoland,andtheworkwilltourtotheUKandEuropeend2012.

EMERGENCYINDEXLAUNCH@THEKITCHEN,NEWYORK20March,2012http://emergen-cyindex.com/index.htmlImagecredit:EmergencyIndex

4FestiwalSztukaiDokumentacja/4thArt&DocumentationFestival12April-May62012Łódź,Polandwww.doc.art.pl

2) DNA visualizationOriginally when I asked“WhatistheBESTwaytoimageDNA?”Theresponse was TEM (Transmission Electron Microscopy)-Althoughthisistrue,TEMdoeshave some setbacksa)Thisprocessisexpensiveandtimeonthesemachines is precious.b) I would require assistance for this process.I thought it would be nice to be able try to findawaytoimagetheDNADIY,sothatonlyIwillcomeincontactwiththesamples,andIcouldhypotheticallydothisimaginginmyhome or studio.

BrisbaneEmergingArtistFestivalMetroArts,18February2012

Page 148: SPECTRA - Australian Network for Art and Technology · SPECTRA: images and data in art/science Proceedings from the symposium SPECTRA 2012 The book and the conference that begat it,

DIY DNA research

InApril–June2012IwasfortunatetobeArtistinResidenceattheQueenslandStateLibrary The Edge. During this residency and withthehelpofmanyfriendlyscientistsaDIYmethodforimagingDNAhasbeencollated,andsoonwillgointoproduction.

ThreestepshavebeenidentifiedfortheDIYDNAvisualizationofahumanhairsample.

Step 1 – DNA extractionFortunatelythereisanexistingprotocoldocumentedonlinehttp://www.protocol-online.org/biology-forums/posts/760.html•Cut10-15hairrootsabout0.5cmintoa 1.5ml eppendorf tube.•Add50ulof200mMNaOHsolution.[sodiumhydroxide]•Boilthetubeinawaterbathat94oCfor 10 minutes.•Coolatroomtemperatureandadd50ulofasolutioncontaining200mMHCL.[hydrochloricacid]+100mMTris-HCLpH8.5.[buffer]•YourDNAisreadyforPCR.

Step 2 – DNA amplificationPCRorPolymerasechainreactionwillmultiplyasequenceofDNAmanymillionsoftimes;makingvisualizationpossible.InitialissuewiththismethodwasthatPCRmachines–thermalcyclers-canbeexpensiveanddifficulttoaccess.ButnotwithOPENPCR.ThankstoBioHackerseverywhere:Youtoo can have your very own PCR machine for $599USD[pluspostageandhandling]Arrivingin‘kit’form,ittakesapprox3hourstoassemble.(http://openpcr.org/)

I purchased my very own OPEN PCR online andtruetoform,itdidtakeabout2hrstoassemble.Ididhavealittlehelp.Therewereafewpartsleftoverwhichwasdisconcertinghowever... It works! PCR success!

TheextractedsamplesareputintoPCRtubes,and a primer is added. The primer tells the PCR which sequence of DNA to amplify. The OPEN PCR device easily connects to a laptop andcomeswithsoftwaresoyoucanprogramits cycles. Once the sample with primer are

148 SPECTRA: Images and Data in Art/Science .

Building the DIY “OPENPCR” machine

Page 149: SPECTRA - Australian Network for Art and Technology · SPECTRA: images and data in art/science Proceedings from the symposium SPECTRA 2012 The book and the conference that begat it,

148 SPECTRA: Images and Data in Art/Science .

Building the DIY “OPENPCR” machine

runintheOpenPRC,approx3hrslateryouhavesamplesreadyforvisualization.

Step 3 – visualization with gel electrophoresisForgelelectrophoresisyouwillneedtogetyour hands on a gel electrophoresis machine andalowvoltagepowersupply.Again,thesecanbeexpensive,butjustkeeplooking.Iboughtmineoffebay–electrophoresischamber$80,powersupply$100ish.Youwillalsoneedaswagofdyes,buffersandagarose;thesearetrickerandfarmoreexpensivetoacquire.

Gel Electrophoresis prep (many of you will be familiar with this process,butforthosewhoarenot).

Firstyoumustmakethegelwithchemicalgradeagarose–madesimilartoregularjelly–withonesignificantdifference.A dye is required so that the DNA will be visible. The common dye used is ethidium bromide[EtBr],however,thisdyeisaknownmutagenandisnotsafetouseinaDIYsetting.ThereisSYBRSafe,howeverIhavebeen unable to access this chemical in Australia.

SYBRGreenisusedcommonlyingelelectro-phoresisandbondstoDNA.SYBRGreenisaknowncarcinogen.AssuchSYBRGGreenisagainprohibitiveinmanyDIYscenarios.SYBRGreenusagerequiresaminimumofa“cleanbench”orLevel1LabSafetyspace,andmustbe kept in refrigerated storage. To remove SYBRGreenitmustbesubjectedtoactivatedcharcoal and disposed of as solid chemical waste.IhavebeenabletoaccessSYBRgreenthroughasupplier.However,itisexpensive-approx$600for5mls.

Oncethegelismadewithdye,itisplacedinto the gel electrophoresis chamber. The chamberisfilledwithbufferwithaph8.5– sort of like sea water. The samples from the PCR are then put into the gel. Low levels of voltage is applied which pushes the DNA through the gel. Small pieces of DNA move faster than large pieces of DNA. This process can take 8 – 12 hours

Oncethegelhascompleteditsrun,itisremoved from the chamber and placed on adarkreader.ThisdevicepushesblueUltraVioletlightthroughthegel,illuminatingeach sample. Dark room and safety glasses must be used for this process. An image of thisilluminationmaynowbetaken.

The pictured mini Dark Reader was purchased fromBioScientificfor$700AUD.

Oncethesampleshavebeenvisualized,eachparticipantreceivesacopyoftheirDNAfortheir interest [along with a sound track as IwillbeconvertingtheimageoftheirDNAinto sound]. The individual images are then compressedandcompiled,compressedandcompileduntilthereare1millionpeople’sDNAvisualizedasasingleimage.

Next steps, hurdles and moving forward

SPACEI am working on making a clean bench so that I may run samples at my leisure. Prior to this Ihopetousealabtopracticeandrefinemyskills on a pilot batch of samples prior to com-mence imaging on ONE samples proper.

Page 150: SPECTRA - Australian Network for Art and Technology · SPECTRA: images and data in art/science Proceedings from the symposium SPECTRA 2012 The book and the conference that begat it,

COSTThecostofimagingeachsampleisapprox$50 per person with the outlined method.$50x1M=averyexpensiveartproject/hobby indeed. As most of the required equipment I now have in my possession [current outlay circa $5K] the primary cost are consumable chemicals. I am looking into and hopingtodevelopinexpensivealternatives.

We know that human DNA is mostly the same. And we have many aspects in common with other species as well. As the outlined methodwouldbelookingataparticularsequenceratherthanthewholeDNAstrand,the outcome of the image is likely to be uniform-whichwouldbeprettyboringforpeople with a science/bio background.

Whatmightbemoreinterestingistoimagenon-coded/regulatory/junkDNAthathasvariationinlength.CodedDNAisrepresentedbyapprox5%ofoursequencewithnon-coded/regulatoryorjunkDNAcomprisingtheremaining 95%

There are 2 obstacles going down this path

1) A primer will need to be designed and created to amplify this non-coded DNA sequence. ENCODE will be an important resourceintheinitialstagesofdesign.Iamnotascientistnorgeneticists,somuchmoreresearchandcollaborationwillberequiredforthisprimerdesignandimplementation.In2007,aftertheHumanGenomewassequence the Encyclopedia of DNA Elements ortheENCODEprojectcommenced.http://genome.ucsc.edu/ENCODE/

2)EthicalandlegalimplicationsIn1989GeneticTechnologies,anAustraliancompanyformedandsoonafterwassuccessfulintheirapplicationtopatentallnon-coded DNA in humans and animals. UnitedStatesPatentnumber5,612,179(‘179)Anypersonorresearcherwantingtoinvesti-gate non-coded DNA must request a licence fromGeneticTechnologiesLtd.Personally,Ifeel it unequivocally unethical that a company may own 95% of every human being’s DNA. Howcantheyownalicencetomybody?

ParticipantsinONEsignadocument–acontract–tosaythattheyareofferingtheirDNAtothisproject.Itisaprojectoftrust,wherebyparticipantsarewillingtotrustmewiththeirmostintimatedata,andIofferthemmineinreturn.Asparticipantsareofferingtheirmaterialtomepersonally,Iamcurrentlyinconversationswithlegalandpatent professionals to see if it is possible to bypass this patent.

Conclusions

ItiscertainlypossibletoimageDNADIY.Howeverthereareconsiderabletechnical,practical,ethical,legalandfinancialissuestobetakenintoconsideration.Ifyouhaveanyquestions,concerns,contributionspleasedofeelfreetofindme.IlookforwardtoworkingwithONEandinthisfieldformanymany decades to come.

www.oneperformance.wordpress.com

150 SPECTRA: Images and Data in Art/Science .

Page 151: SPECTRA - Australian Network for Art and Technology · SPECTRA: images and data in art/science Proceedings from the symposium SPECTRA 2012 The book and the conference that begat it,

150 SPECTRA: Images and Data in Art/Science .

Innovation synapses: transgressive movements in working with knowledge

Lorraine White-HancockFacultyofEducation,MonashUniversity,Clayton,Victoria3800,Australia

The Australian Government’s most recent policyoninnovationoutlinesthereasonsforencouraginginnovationintermsofdecliningproductivityandglobaleconomiccompetitiveness(DIISR, 2009, p. 11). This policy and reports informing it talk about the importanceofcollaboration,knowledgebuildingandcreativitytoinnovation.Reasonsgivenforcollaborationincludebringingtogetherdiverse“perspectives,experience,skillsandknowledge;breakingdownspecialistsilosandrestrictiveorganisationalboundariesandfosteringcross-disciplinaryinteractions;encouragingskillsandknowledgetransfer”(O’Kane, 2008, p. 2). Cutlerarguesagainst“segmentinginnovationinto…silosthatsplitthecreativeartsandhumanitiesfromthephysicalsciences”andcallsforunderstandingthe“connectionsandcommonalities”betweentheartsandscience(Full Report, 2008, pp. 47-48).Yetmuchmoredetailabout mechanisms such as funding for supportinginnovationinscienceandtechnology is provided in the policy document,andthefocusisstilltiedtothesefields.

Moreandmorepeopleworkcollaborativelyacross knowledge boundaries in local and globalcontexts.Yetthereislittleresearchabouttheconditionsthatsupportcross-disciplinary,collaborativeworkorabouttheexperienceandeffectsofinthisway.Theresearchquestionthatguidesmywritingis:What are the features of workplace learning in art-science collaborations that produce innovative and transgressive knowledge practice?

Innovationiscommonlydefinedasbuildingprocessesandproductsanewor“creatingvalue through doing something in a novel way”(Cutler 2008, Overview). Government and business tend to emphasise economic out-

comes.Inthearts,thefocusismoreonsocialvalue and human impacts (White-Hancock 2006).Inthispaper,innovationisconceptu-alizedaslearningthatmoveswaysofthink-inganddoinginnewdirections;innovationchallenges or crosses boundaries and brings change. Thetheoreticalframeworkthatscaffoldsthisstudyisexplainedinthenextsection.TheSynapsecasesarethenintroduced,identify-inghowtheywereinnovative.Thepaperis then organised around three interfacing elements that are found from reviewing lit-eratureacrossdifferentknowledgetraditionstomakeupinnovation:management;innova-tionenablingenvironmentsandlearninginpractice.

Transgressing boundaries and workplace learning

Literatureinformingthisstudyextendsacrossknowledgetraditionsinthesocialsciencesincludingorganisationaldevelopmentandmanagement,workplacelearning,innovation,globalizationandthesocialorganizationofworkandoccupations.DonnaHaraway’swritinginthephilosophyofsciencetraditionandhersocialist-feministperspective,particularlyinformthisstudy.Hernotionofsituatedknowledge(1991) helps meexplainsocial,politicalanddisciplinaryboundaries and hierarchies. Situated knowledge,dealingwiththe‘facts’ofasituation,recognisesthattoothers,thefactsmightbequitedifferent.Thisconcepthelpsme understand how people who work togetherfromdifferentknowledgetraditionsmightseethingsdifferently,andhowthesedifferentperspectivesmightaffecteachother.Theconceptofboundariesisofparticularsignificanceacrossarangeofknowledgetraditionsintheliteraturereviewed.Harawayarguesthatboundariesarelessdistinctthan

Page 152: SPECTRA - Australian Network for Art and Technology · SPECTRA: images and data in art/science Proceedings from the symposium SPECTRA 2012 The book and the conference that begat it,

we think and are permeable surfaces. It is the interactionsbetweenthingsacrossboundariesthatarecrucialforevolutionandinnovation.Harawaychallengestheconceptof‘I’andwrites:

I love the fact that human genomes can be found in only about 10 percent of all the cells that occupy the mundane space I call my body; the other 90 percent of the cells are filled with the genomes of bacteria, fungi, protists, and such, some of which play in a symphony necessary to my being alive at all… (2008).

Haraway’snotionoftransgressionshedslightonthepotentialanddangersofengagementwith other situated knowledges for people who work across disciplinary boundaries. Harawayexplainshowtheprocessoftransferring genes between species in bio-technology is argued by its opponents to be an“actthattransgressesnaturalbarriers,compromisingspeciesintegrity”(1996, p. 60). In otherwords,transgressiveborder-crossingpollutes lineages.

Inasimilarway,cross-disciplinarityistreatedwith some suspicion in academia where disciplinaryknowledgetraditionsareseentobe challenged. Gieryn (1983),writingonthesocialorganizationofwork,suggeststhatasthesincetheindustrialrevolutionthewaywedefineourselves,ouridentities,havebeentiedtodisciplinesandprofessions–Iamadoctor,Iamabaker,andsoon.Globalisationand the world-wide-web are changing that. Multipleidentitiesemergethroughsocialmedia networks and global mobility that breakdowninstitutionalandsocialboundaries across cultures. Disciplinarity with its monocular focus is argued to be inadequateinaworldofcomplexitythatcharacterizescontemporarylife,andcross-disciplinary approaches are needed to solve complexglobalproblems(Land, 2010).

Morerecently,ideasof‘situatedlearning’rather than situated knowledge emerge in relationtoinnovationinworkplaces.Lundvall (2008) argues that knowledge is be-coming obsolete more rapidly than before in theageoftheworld-wide-web,sothat

firmsandemployeesconstantlyhavetolearnand acquire new competencies. This involves formsoflearningthroughexperience,whichare as important as those learnt through exposuretoteachinginformalisedschoolsettings (Lundvall et al, 2008, p. 681).Furthermore,spontaneous learning and the ability to improviseatworkarisefromunexpectedevents and problems and improvising requires situated learning rather than theoretical‘schoollearning’(Høyrup, 2012, p. 22). Recent research on workplace learning which is rooted in the socio-anthropological-cultural traditionfocusesonhowthestructuringofcurrentworkplacesandpracticesimpactsoncollaborativework,learningandoninnovation(Felstead et al, 2009). The authors argue thatdysfunctionsandblockagesintheproductivesystemshapepatternsoflearningatwork,sometimesstiflingit,some-timesleadingpeopletofindinnovativewaysto solve problems. In some workplaces the termsandconditionsofworkallowandevenencourageinnovationsthatrunagainstestablishedrules,conventionsandnorms.Thischaracteristicdescribesan‘expansive’workplace (Felstead et al, 2009).Felstead’sideashelpexplainhowthestructuringoftheSynapseprogramaswellastheprojectworkplacesandpractices,togetherimpactonlearningandinnovation.

Research Design

The broader PhD study employs a comparativeapproach,drawingongroundedtheory.Mystrategyofinquiryisqualitativeandemploysamixed-methodapproach,including:•DiscourseanalysisofAustralian Governmentpoliciesoninnovationandcollaboration.•Auto-ethnography,reflectingonmyexperi-ence of a cross-disciplinary workshop called Crosslife conducted in Malta in 2008. This workshop brought together lecturers and PhD studentsfrom6universitiesfrom6differentcountries. The focus was on cross boundary work,travellingideasandtransformationsinlifelong learning and work that have resulted fromglobalization.Ialsodrawbrieflyfrommy

152 SPECTRA: Images and Data in Art/Science .

Page 153: SPECTRA - Australian Network for Art and Technology · SPECTRA: images and data in art/science Proceedings from the symposium SPECTRA 2012 The book and the conference that begat it,

152 SPECTRA: Images and Data in Art/Science .

ownprofessionalworkasanartistthatledtoacollaborativeprojectwithanexpertinopticsandlaserholographyatRMITUniversity’sPhysicsDepartment.Theselivedexperiencesprovidemewithan‘insider’perspectiveoncross-disciplinary,collaborativeworkandlearning.•Casestudiesof3SynapseResidencyProgramprojectsconductedfrom2010-2011providemewithan‘outsider’perspectiveofcollaborative,cross-disciplinarywork.Casestudymethodologyhighlightsworkpractices,termsandconditionsenablinginnovation.Thisinvolvedconductinginterviewswithartistsandtheirpartnersworkingtogetheroncollaborativeprojects.Audiorecordingsandfulltranscriptionsweremadeofinterviews.ThestudygainedethicscommitteeapprovalfromMonashUniversity.•TheSynapseResidencyprogram,fundedbytheAustralianNetworkforArt&Technology(ANAT)andtheAustraliaCouncilfortheArts,providesgrantsforartiststoundertakeresidenciesinscienceandresearchsettings,bothwithinAustraliaandinternationally.(http://www.anat.org.au/synapse/).

SynapseResidencyprojectsiteswereselectedforinvestigationbecausetheycanbeconsideredas‘hotspotsofknowledgeflow’(Sassen, 2008) or‘liminal’,in-betweenspaces(Durrschmidt&Taylor,2007). They are sites of intersectionforcross-boundary,cross-disciplinary work that reveal evidence of transgressedboundaries,learningandinnovation.

Spaces of innovation

This part introduces the three Synapse projectsselectedascasestudies.Duetospacerestrictions,thispaperfocusesitsreportontheworkofoneprojectconductedby Catherine Truman and Ian Gibbins but also drawsonthestoriesofotherprojectpartners.

Dr Mary Rosengren worked with Cris Ken-nedy,DirectoroftheCSIRODiscoveryCentre(Canberra,ACT)andthescientistswhoman-ageandstudyCSIROcollectionsinorderto“investigateandarticulatetheconnections

betweendifferentaspectsofCSIROresearchandtoextendprofessionalthinkingaboutinterdisciplinarity and the appraisal of images withinscienceandartcontexts”(http://www.anat.org.au/synapse/).

Drawings by Heino Lepp, mycologist. Specimens from Australian National Herbarium’s Cryptogam collection (ferns, mosses, liverworts and lichens, algae and fungi) housed at the Australian National Botanical Gardens. Photograph by Mary Rosengren. http://rosengren2011.anat.org.au/

Theartisthasvisitedanumberofcollections,interviewedthescientistswhoworkwiththem,“findingoutwhatthey’reabout,howthey work and how they could be connected throughtheimagingtechnology”,and identifyinghowvisualisationisusedinthecollections.Thisapproachwasusedinordertoconnect“theoldscienceofclassifying,ordering and organising things with contemporary science methods and processesandtechnology”.TheSynapse programmanagerexplainedinaphoneconversationthatfromANAT’sperspective,RosengrenandKennedy’sprojectwas innovativebecausethereweredifferentdi-mensionsthatweretobeinvestigatedandit

Page 154: SPECTRA - Australian Network for Art and Technology · SPECTRA: images and data in art/science Proceedings from the symposium SPECTRA 2012 The book and the conference that begat it,

wastheinterconnectionsthatwere critical.ForbothKennedyandRosengren,whatisinnovativeabouttheirprojectwastheideaofscience-artcollaborationorworking beyond one’s own disciplinary boundary. Rosengren also considered innovationinherworkintermsof“lookingatnotjustthemethodologybutthewayinwhich the technology and the imaging is utilisedandvaluedwithinboththosedisciplines.Sothisisanattempttoseesciencedifferently”.TheartistinvestigatedCSIROcollectionsasacomplexsystemratherthan bounded categories.

ArtistChrisHenschkeworkedwithscien-tistsatAustralianSynchrotron(Clayton,Melbourne),particularlyDrMarkBoland,PrincipalScientistinAcceleratorPhysics.Thesynchrotronisamachineaboutthesizeofafootballfieldthataccelerateselectronsatalmostthespeedoflighttoexperimentalworkstations.TheirLightbridgeprojectwasconceivedofas“akindofaportal”wheredatathat’susuallyonlyavailabletoscientistsismadeavailabletoanartist (Boland, 2012).

ChrisHenschkecreated100+GBworthofsynchrotron-lightbasedtestanimationsformulti-projectorsetup (15 August, 2010). The animated version can be viewed at http://henschke2010.anat.org.au

Theterm‘lightbridge’suggestsaphenom-enon that links environments. The work is consideredinnovativebecauseitisthefirsttimeinAustraliaanartisthasworkedinthiskind of physics environment. Henschke

wantedtoexperiencethe‘frontier’ofthemachineitselfinthespiritofthepioneer,goingwherenoartisthadgonebefore.InBoland’sview,theprojectisalsoinnovativein its transgressive knowledge sharing across disciplinaryboundariesof“datachannelsthatareusuallyreservedandtightlyguarded”.The concept pushed the boundaries of what waspermissiblebytheorganisationintermsofaccesstodata“that’sjustsolidgold…youdon’tjustgivethataway…that’sakindofaboundarythatscientistswouldn’tcross”.ArtistCatherineTrumanmakesobjectsforand about the body. Her work has been exhibitedwidelyinAustraliaandinternationallyandrecognizedwithanAustraliaCouncilfortheArtsFellowship(2007).

Catherine Truman, Hybrids, 2011, Carved English lime, wood, paint; largest dimension 150mm; wood, paint (http://truman2011.anat.org.au/)

Catherine Truman, The fine bones of the hand. Anatomy Lab, 2011

154 SPECTRA: Images and Data in Art/Science .

Page 155: SPECTRA - Australian Network for Art and Technology · SPECTRA: images and data in art/science Proceedings from the symposium SPECTRA 2012 The book and the conference that begat it,

154 SPECTRA: Images and Data in Art/Science .

SheworkedwithProfessorIanGibbins,Headof Department: Histology and Anatomy at FlindersUniversityinAdelaide.Trumanexplainedthat:We were interested in how the body is learned by medical students, what body is learned by medical students, and the role that the instructor plays, also the role that the objects in the room, the teaching anatomy room, play. That kind of led us into a really distinct interest in the interrelationships that occur between students and the tutor as well in terms of learning the body. So we became fascinated with the role of touch and gesture in learning.

Thiscollaborativeworkisinnovativebecauseit has developed new pedagogical methods andpracticesthathaverefinedthewaymedical students learn about the body at FlindersUniversity.ThesenewapproacheshavebeenrecognizedbytheUniversitywithateachingandlearningInnovationAward.Truman also pointed out that their ability to communicate through shared languages - throughpoetry,writing,imagesandobjects,bothscientificandartistic,andthroughsharedearlierexperience,transgressed the disciplinary divide and was innovative.ItwasTruman’sunderstandingthat“it’sunusualtodeveloparelationshipbetweenamedicaleducatorandanartistinthiscontext...initiallyitwasaboutthiskindofeducation,aboutmedicaleducationandhow science perceives the body and how artistsperceivethebodyorcommunicatethebody.It’saboutcommunication.Gibbinsalso highlighted that that it’s unusual for a scientisttoalsobeapracticingartistasitisforanartisttobefamiliarwith‘thewaytheplace works’ and with some elements of his practice.Infact,TrumanhadjoinedinGibbinsanatomy classes for three years to learn more abouttheareaandGibbinspractice.Gibbinshadabackgroundinwritingpoetry,composing and performing electronic music andsound-scapesandmakingexperimentalfilmpriortohisworkwithTrumanandhasalso produced an impressive body of work duringtheiryearsofcollaborativeengagement.

Both Truman and Gibbins said that what they learned from their partners and their differentdisciplinarypracticeswasthattherewaslessdifferencethantheythought.Ifoundmyselfasking,‘Who is the artist? Who is the scientist? These interviews surfaced the idea andthetraditionoftheartist-scientist.Thereweresimilaritiesinthemethodologicalapproachesoftheartistsandscientistsinterviewed–research,planning,observation,experimentation,documentationandinterpretation.Incontrast,Henschkefoundthedistancebetweendisciplinarylanguages,andaccessing and using technology troublesome barriers.Bolandexplainedhisbeliefthatdespitesimilarities,scientistshavetobemoreoutcomesandevidence-driventhanartists:There are certain beliefs and principles and rules that you have to stick with ... the scien-tists are working in a framework where the fundamental philosophy is that there is an underlying truth that you’re nutting out, and then in order to discover that you can’t go down a linear path. You have to be creative and go all over the place to find the trapdoor that will lead you into the next … So there’s a certain framework or certain mystery that you’re trying to unravel as a scientist that requires similar techniques as an artist [but] the artist framework is far more ephemeral .... So that although similar techniques and similar working environments exists, ultimately they’re poles apart in terms of what they’re trying to achieve or what they do achieve or what comes out of that same approach.

Yettheyarebothcreative.Distinctionsbetweenartistsandscientistsareblurred,yettheframeworkthatartists’workwithinareperceived as being less governed by rules and laws,andhavedifferentaimsandoutcomes.Projectswereinnovativeintheirattemptsto‘seesciencedifferently’,toseeinterconnectionsandtransgressdifferentkinds of boundaries.

Page 156: SPECTRA - Australian Network for Art and Technology · SPECTRA: images and data in art/science Proceedings from the symposium SPECTRA 2012 The book and the conference that begat it,

Thenextthreesectionsconsiderwhatsupportedandconstrainedcollaborative,cross-disciplinarylearningandinnovationinthisproject.

Management

There has been no shortage of products and outcomes from these residencies though they werenotexpectedbyANAT(beyondblogsandaprojectreport)sincetheaimofresidencies is to generate research and share knowledge.Thisapproachdiffersfrommanyotherfundingorganizationsthatexpectproductsinordertofulfillfundingrequirements. The Synapse program manageratANATrecognizesthatoutcomescantakesometimetooccur.Participantsfeltthat this freedom supported their ability to ‘freerange’.ANAThada‘handsoff’approachbeyondtheselectionprocesswhichalsoaf-fordedparticipantsfreedomtoconducttheirworkastheysawfit.However,twoofthethreeorganisationswhereresidenciestookplacehadsomeexpectationofproducts.

SomeinternalorganisationalorbureaucraticobstacleswereexperiencedinTrumanandGibbinsproject.Althoughthesewerenotperceivedasbeingparticularlyproblematic,other partners reported more troublesome issueswiththeirorganisation’smanagementorwithinternalpoliticsbeingplayedoutatthetime.ArtistChrisHenschkedescribedaconfrontation,ora‘blockageinthesystem’(Felstead et al, 2009),thathadquiteanimpactonhim.ItoccurredathismeetingwiththeCo-directoronthefirstdayofhisfirstresidency at Australian Synchrotron:

He said, like totally serious, “So where’s your easel and your paints, paint brushes?” … I pointed at the giant particle accelerator and I said, “Well, you’re right in a sense, but that is my paintbrush.” The Co-director just got bright red in his face and stood up and went, “You’re not going to go anywhere near that bloody thing. If you touch that thing I’ll come after you with a hammer.

NegotiatingthedisciplinarydividewasachallengeforHenschke,restrictingprogressofhisearlierproject.However,heworkedfor the most part with Boland on his second projectwhodealtwithproblems,asdidtheotherartists’projectpartners.BolandlaterfacilitatedHenschke’saccesstotheparticleaccelerator.Theartistspartnerswerecriti-cal‘boundarybrokers’,touseWenger’s(2003) term,withintheirorganisations,negotiatingandenablingaccesstofacilitiesandsmoothing the passage of residencies. Boland explainedtheprocessofgettingtheSynapseapplicationthroughhismanagement:“Iknewmy way through the bureaucracy and I knewenough about the place to not press the wrongbuttonsandsaythewrongthingslikegiveawaydataoraccessbeingmandated”.Theprojectmaynothaveseenthelightofday without Boland who understood the issues,sensitivities,structureandthepersonalitiesinhisworkplace.

Tosummarise,supportstolearningandinnovationintheseprojectsareidentifiedatdifferentlevelsofthesystemfromANATtotheorganizationsinvolved.Projectsweregenerallycharacterisedbyaflatmanagementstructure without interference from the organizationsmanagementorfromtheSynapse program manager. Supports were characterizedbyanemphasisonfreedomsaffordedbytheflatmanagementstructure,discretionindetermininghowandwhatworkwas done and less emphasis on outcomes whichprovidedtheabilityto‘freerange’.Wheretherewereproblems,theseweredealtwithbyGibbinsandtheotherartist’spartners.Thepresenceof‘boundarybrokers’ who understood how their work-placesworked,enabledaccessandsmoothpassageofprojectswassignificant.However,Henschke’s case shows that workplace activitycanonlyrealiseinnovationwhenendorsed by the management that authorises the work.

Thenextsectionexaminestheprojectsinterms of how the workplace environment supportedlearningandinnovation.

156 SPECTRA: Images and Data in Art/Science .

Page 157: SPECTRA - Australian Network for Art and Technology · SPECTRA: images and data in art/science Proceedings from the symposium SPECTRA 2012 The book and the conference that begat it,

156 SPECTRA: Images and Data in Art/Science .

Innovation enabling environments

TheenvironmentofhisorganisationatFlindersUniversity,describedbyGibbinsas‘open’,emphasisingparticipationandfreedomofaccess.Gibbinssaid“Anybodycancome here and work here if they’ve got the rightcredentialsandbackground…goodscienceisopenenvironment”.

Time working together helped to establish trust,respectanda‘safe’environmentforcollaboration.Asafeenvironmentisarguedtobenecessaryforlearningandinnovationtooccur because it is risky to present work that isdifferentortransgressive(Quinlan et al, 2010). Truman commented on the challenges to herpersonalethicsrelatingtothepracticeofvivisectioninscientificresearchandinGibbins’workplace.Howevertheartist’swayofaddressingtheconflictwastostepbackandrespectthescientificapproachoftheworkplacethatshewasinvitedinto,evenifshedidn’tagreewithit.Apartfromthis,Truman felt comfortable in Gibbins environment. Gibbins felt comfortable about Truman’s presence in the department because they had already established a rapportthroughseveralyearsofcollaborativework.Thisisseentobecriticaltothesuccessoftheseshorttermprojectsbyparticipants,and this is also an important criterion for Synapseresidencyselection.

Catherine Truman, Talking hands

Truman showed me the tearoom on my tour ofthefacilityatFlindersUniversity,commentingthatitwasaplacewhereideasemergedandcriticaldiscussionstookplacethroughmoreinformalinteractions.Thiswasa space that supported the openness that Gibbinsandotherparticipantsspokeabout.Physical and intellectual spaces and environmentsthatsupportopenness,freedomofthought,freedomofaccesstoinformationandresources,andspacesforconversationareseentosupportinnovationamongtheartistsandscientistsinterviewed.

Howcollaborativelearningprogressedintheseprojectsisnowconsidered.

Learning in practice

Both Gibbins and Truman pointed to the ne-cessityforfindingsomekindofcommonground,orsharedobject,thatenablescommunicationineffectivecollaborative,cross-disciplinary work. Truman felt that reading some prose called A Morning’s AnatomytoagroupofscientistsincludingGibbins,andwrittenafterobservingoneofhisclasses,wasacriticalcatalystforfindingthatcommonground.Trumansaid“IreadittoIaninparticular.Hedidn’treactallthatmuch,butsinceIdiscoveredthatitwasthefirsttimethatthosekindsofthingshadbeenreflectedbacktohim.Andwejusttookofffromthere”.

Gibbins’teaching‘performances’andtheroleoftouch,gestureandmovementinlearningbecameafocusoftheirrecentprojectwork.

Page 158: SPECTRA - Australian Network for Art and Technology · SPECTRA: images and data in art/science Proceedings from the symposium SPECTRA 2012 The book and the conference that begat it,

The awareness that was surfaced by Truman’s prose,herobservationsanddocumentationledGibbinstohighlightthegesturesheuses,nuancing his approach to teaching the body. Gibbins said:

Over the years I’ve learned a whole bunch of movements to illustrate particular musclesand particular actions. So this year I’ve been much more precise about the way I do those demonstrations, either in a lecture or in a practical class. So much more precision… instead of just putting my hand up and waving it around like that, you know, so this is the flexor digitorum for the third finger… So very decisive.

Gibbinsexplainedthatthisinformationisalsosharedwithstudents,expandingtheirunder-standing and engagement in learning about the body.

Truman’s interest in the way gloves are used both in the teaching classes and in the laboratoryfordifferentpurposesledtoanideaaboutfilmingoneofthelabtechniciansdissectingaglovefromherhandwithapairof scissors. She then got Gibbins to perform thesameprocedure.Thefilmwasreversedinfastmotion,givingtheappearanceofthehandbeing‘re-skinned’.Replayingthefilm,Truman observed that people performed the processdifferently,despiteproceduralconventions.TheexperimentshowedTrumanthattherewassubjectivityin‘objective’science,anideatheartistdevelopedthroughherobservationsinherfirstresidencyinaDarwinhospital.Trumanpointedoutthatthisidea“wasavery,verycontroversialthingtosuggestinascientificenvironment”andinthisway,theexperimentwastransgressive.Gibbinssaidthatthisexperiment“triggeredthewritingthatI’vedonesofar”andswitchedthefocusoftheprojectveryclearlyontothehandsasawayofmediatingexperience.Trumancastafresheyeoverthewaythesegloves,suchcommonplace,everydayartefactsinGibbinswork,areusedandwhattheycanmean.Thisideaevolvedfroman‘outsider’,artistperspectiveandgenerateddiscussion,newthinking,learningandworkforbothpartners.Theglovedissectionstoryillustrateshowan

ideatravelledacrossdisciplinaryboundaries,enabling people to reconsider taken-for-grantedassumptionsorroutineprocessesinvolvedintheirworkandhowcollaborativelearning at work progressed.

Ideas evolved and learning occurred not only throughinteractionswithpeoplebutwasalsomediated by an array of technologies and artefacts,or‘boundaryobjects’ (Wenger, 2003; Felstead et al, 2009) used in the workplace. Truman’sobservationswerenotonlyofGibbin’s teaching performances but also the ways both low and high technologies were used.Trumanexplainedwhatshehadlearnedwas that: Science was more about the technology of how we can see things more clearly. By that I literally mean how we can place things in front of our eyes so that we can understand better. So all the technology that gets developed in science is about that; simply for a human being to lay their eyes on something and then understand it.

Theartistlaterelaborated:I’ve been down in the microscope room (on) several occasions with Ian. He’ll be jumping around the room, this dark room with this machine that takes up the whole room which is the microscope, and Ian will be saying, “Nobody’s ever seen anything like this before. It’s so exciting”.

Imaging technologies and artefacts for data visualisationalsoplayedacriticalroleinscience-culture as they mediate knowledge buildingandlearning,enhancingwaysofseeing,makingtheinvisible,visible.ThefocusondatavisualizationiscriticaltoHenscke’sprojectatSynchrotronandRosengren’sworkwithCSIROcollections(http://henschke2010.anat.org.au; http://rosengren2011.anat.org.au/).

AsTrumanhighlightedinherinterview,theirprojectsaredeeplyrootedinthe“burningcuriosity in both of us about each other’s practice.Reallywantingtounderstandabitmore,andnotonlyunderstand,butexperienceit.Sounderstandingthroughexperience”.Thiswasanimportantthemethat emerged from the interviews and supports Lundvall’s (2008) argument. Truman’s needtoexperiencethelabandtheclasseswasforthe“promiseoflearningsomething

158 SPECTRA: Images and Data in Art/Science .

Page 159: SPECTRA - Australian Network for Art and Technology · SPECTRA: images and data in art/science Proceedings from the symposium SPECTRA 2012 The book and the conference that begat it,

158 SPECTRA: Images and Data in Art/Science .

new”,gainingsomeinsightintoanotherpracticeandenvironment.

Participantshadareasonablyclearideaof what they wanted to do but their ideas evolvedorganicallythroughobservation,reflection,andhavingtimeandspaceforongoingconversationsandinteractionsbetweenprojectpartnersandothersworkingwith and around them but all were prepared to‘roam’.Thewaytheseprojectsevolvedwasnotlinear,withpredeterminedoutcomes.Suchopennesstonewpossibilitiesenabled‘expansive’learning(Felstead et al (2009) which involvedexperiential,‘situatedlearning’(Lun-dvall et al, 2008).Theideaof‘notknowing’inaworld that focuses on outcomes and acquiringknowledgeemergedasacriticalway to learn and move forward in these projects.Trumancommentedthat:We’ve often said that it’s more about the stuff we don’t know than the stuff we know. It’s much more about that, the stuff that we don’t know, and the acceptance of not knowing something. That’s what drives both of us in our practices.

Noneoftheartistsorscientistsinterviewedfeltthattheirformaleducationequippedthemparticularlywellwiththeskillsforsteppingintocollaborative,cross-disciplinaryworkpractices;ratherthiswaslearnedthroughpracticeintheworkplace.However,thenatureofscientificresearchrequiresthisway of working and it is performed as a matterofroutineintheworkplace,thoughlessoftenincross-disciplinarysettings.Gibbinsassumedthat“it’smoreofachallengeforartiststoworkcollaborativelythanitisforscientistsbecausewedo(it)allthetime”.

Yetthereisanage-oldtraditionofartistsandcraftspeoplewhoworkcollaborativelythathas been traced to medieval European guilds andclassicalGreekcorporations (Wenger, 2003). TrumannotedtheinfluenceofClementeSusini whose anatomical models made in collaborationwiththeItalianscientistandacademicFeliceFontanainthe1770-90sarerecognisedtodemonstrateextensivescientificknowledge(Riva, 2010). Rosengren

referredtotheworkoftheSwedishbotanist,physician,andzoologist,CarlLinnaeus,attributedwithpioneeringmoderntaxonomyand ecology and who collaborated with the botanist-illustrator Georg Ehret from 1735-36. Kennedy highlighted the work of the English botanist-illustratorJosephBanksonCaptainJamesCook’svoyagefromEnglandontheEndeavour(1768-1771).Morerecently,thestudio-labsofthe1960swhereartistsen-gaged with science and technologies were inspired by the German Bauhaus school (1919-1933) as a model of cross-disciplinary practice(Century, 1999).Suchmodelsinfluencedthe development of programs like the Synapse residencies.

Despitethehistory,theperceptionisthatmuchartisstillstudio-basedwheretheartistworksinisolationinacoldlittlegarret.Projectparticipantswereallwellawareofthemythsandstereotypesof‘bohemian’artistswhoallusebrushesandpaintand‘mad’scientists.Rosengrenspokeofbeing“guidedbypeoplewhohavetheirownprejudiceaboutwhatartistsarereallyinterestedinaswellastheirownperceptionsofwhatthosethingsareaswell”.Collectionsofcolorfulbutterflieswereperceivedassomethingthatwouldappealtoherandthesoilcollectionwasmerely“awholelotofplasticcupswithsoilinit”.Howeverthesoilcollection,Rosengrensaid,“wasso[much]moreinterestingbecauseoftheproblematicofitnotbeing…ahighlyvisualobject.Asoilcollectionisconceptuallyaverydifferentthing because it’s more of a phenomenon. It doesn’t have a boundary usually in your mind”.Soillinksecologies.

Assumptions,mythsandmisconceptionsaboutdifferentdisciplineshadthepotentialtodivertattentionandnarrowthefocusof learning unless those engaging in cross-disciplinarycollaborationaremindfulofthe issue. Truman pointed to the value of cross-disciplinarycollaborationinchangingmisconceptionsthrough“gentleinteractions,dailyinteractions,particularlyinthatcentreroom. Everybody comes there and goes away. Wesitdownatlunchtime,wedocrosswordstogetherandeatandtalk”.

Page 160: SPECTRA - Australian Network for Art and Technology · SPECTRA: images and data in art/science Proceedings from the symposium SPECTRA 2012 The book and the conference that begat it,

160 SPECTRA: Images and Data in Art/Science .

Insummary,‘gentle’interactionininformalsettingshelpedtochangedisciplinarymisconceptionswhichcouldrestrictlearning.Theglovedissectionstoryillustrateshowanideatravelledacrossdisciplinaryboundaries,enabling people to reconsider taken-for-grantedassumptionsaboutroutineprocessesandobjectsinvolvedintheirworkandhowcollaborativelearningatworkprogressed.Understandingthroughexperiencewascriticaltothisprocess.Learningoccurredthroughinteractionwithpeopleandwasmediated by technologies and other artefacts in the workplace. Learning also occurred through‘notknowing’.Ideaswereallowedtoevolveandallparticipantswerepreparedto‘roam’.Formaleducationdidnotpreparepeoplewellforengagingincollaborativeworkpractices,thiswasalsolearnedthroughpracticalworkplaceexperience.

Conclusion

Ideasandknowledgeflowedinnewandtransgressive ways across boundaries in these workplaces and was supported in a number of ways in terms of the workplace environment and learning through work practice.Physicalandintellectualspacesandsafe environments where trust and respect wereestablished,freedomofthoughtandaccesstoinformationandresources,andspacesforconversationandinformalinteractionsupportedinnovationintheseprojects.Expansivelearningoccurredthroughinteractionwithpeopleandwasmediatedbytechnologiesandartefacts.Aflatmanagementstructurewhereparticipantswerealsoaffordeddiscretiontodeterminetheir own work was a key aspect of the organizationalculturethatsupportedinnovationintheseexpansiveworkplaces.However,thisactivitycanonlyrealiseinnovationwhenendorsedbythemanagement system.

Thedistinctivecontributionofartspracticetoinnovationintheseprojectsliesinseeing,interpretingandcommunicatingscienceinauniqueway.Creativeperspectivescanoffernewunderstandingsandinsightsabouttaken-for-grantedpracticesandassumptions.Theprocessesinvolvedcanbetransgressive,challengingandcomplex.Alloftheartistsinterviewedexperiencedpersonalchallengesorconfrontationsatsomestageoftheircross-disciplinarypractices.Yetallchoosetocontinuewiththiswayofworking,arguingthatcollaborative,cross-disciplinaryworkistheirpractice–itistheiridentity. Transgressingpersonalboundaries,puttingherself into what she describes as “challengingsituations”forthepromiseoflearningsomethingnew,isarecurringelement of Truman’s work. It can be argued thatconfrontingandtransgressingboundaries are the very things that enabled unexpected,expansivelearningandwerecriticaltoinnovationinthecasesstudied.

ThefindingsofthisstudyhaveimplicationsforGovernmentpolicyoneducationandtrainingthatneedstopreparepeopleforlearningandworkinnew,complexandre-emergingcross-disciplinarycontexts.Theideaofnotknowingandartspraxisemergeaswaysforwardineducationforinnovationinanerawheremucheducationis knowledge and outcomes-driven. There arerecognizedbenefitsfortheGovernment’sinnovationagendainencouragingcreativityatwork.Thisstudyfindsthatcreativeartsarea valuable but underdeveloped resource for supportingcross-disciplinaryworkplacelearningandinnovation.Furtherresearchneeds to be done to establish the policy settingsthatcanbettersupportcreativeartsinvolvement in cross-disciplinary organisationallearningcontexts.

Page 161: SPECTRA - Australian Network for Art and Technology · SPECTRA: images and data in art/science Proceedings from the symposium SPECTRA 2012 The book and the conference that begat it,

References and EndnotesPage 8 - Andrew Parker

1.Parker,A.R.&Martini,N.2006.Structural colour in animals – simple to complex optics. Optics&LaserTechnology38,315-322.2.Parker,A.R.2000515 million years of structural colourJ.Opt.A:PureApplOpt2,R15-R28.3.Parker,A.R.&Townley,H.E.2007.Biomimetics of aphotonic nanostructures. Nature Nanotechnology,2,347-353.4.Parker,A.R.1995Discovery of functional iridescence and its coevolution with eyes in the phylogeny of Ostracoda (Crustacea) Proc. R. Soc.Lond.B262,349-355.5.Parker,A.R.2006.Conservative photonic crystals imply indirect transcription from genotype to phenotype. Recent Research DevelopmentsinEntomology5,1-10.6.Land,M.F.andNilsson,D.-E.2001AnimalEyes (Oxford:Oxford).7.Hendler,G.&MariaByrne,M.1987Fine structure of the dorsal arm plate of Ophiocoma wendti: Evidence for a photoreceptor system (Echinodermata, Ophiuroidea). Zoomorphology 107: 261-272.8.Aizenberg,J,Tkachenko,A.,Weiner,S.,Addadi, L.andHendler,G.2001Calcitic microlenses as part of the photoreceptor system in brittlestars. Nature412,819-822.9.Neilsen,C.2001Animal Evolution: Interrelationships of the Living Phyla.Oxford UniversityPress,Oxford,578pp.10.Parker,A.R.,McPhedran,R.C.,McKenzie, D.R.,Botten,L.C.andNicorovici,N.-A.P.2001 Aphrodite’siridescence.Nature409,36-37.11.Welch,V.L.,Vigneron,J.P.&Parker,A.R.2006. TheCauseofColourationintheCtenophore Beroëcucumis.CurrentBiology15,R985-986.12.Parker,A.R.SevenDeadlyColours(2005). Simon&Schuster(London),286pp.13.ConwayMorris,S.2006.Darwin’sdilemma: therealitiesoftheCambrian‘explosion’. Phil.Trans.R.Soc.B.361,1069-1083.14.HouXian-guang,Aldridge,R.J.,Bergstrom, J.,Siveter,D.J.,SiveterD.J.&FengXiang-hong, F.2004.TheCambrianFossilsofChengjiang, China:TheFloweringofEarlyAnimalLife. BlackwellScienceLtd,Oxford,233pp.

15.Zhu,M.-Y.,Babcock,L.E.andPeng,S.-C.2006. AdvancesinCambrianstratigraphyand paleontology:Integratingcorrelation techniques,paleobiology,taphonomyand paleoenvironmentalreconstruction. Palaeoworld15,217-222.16.Marshall,C.R.2006.ExplainingtheCambrian “Explosion”ofAnimals.Annu.Rev.EarthPlanet. Sci.34,355-384.17.Parker,A.R.IntheBlinkofanEye(2003). Simon&Schuster(London)/PerseusPress (Cambridge,USA+translations),316pp.18.Briggs,D.E.G.andFortey,R.A.2005.Wonderful strife:systematics,stemgroups,andthe phylogeneticsignaloftheCambrianradiation. Paleobiology31,94-112.19.Davis,P.G.andBriggs,D.E.G.1995.The fossilizationoffeathers.Geology23,783-786.20.Parker,A.R.2005.Ageologicalhistoryof reflectingoptics.J.R.Soc.Lond.Interface2, 1-17.21.Parker,A.R.,ColourinBurgessShaleanimals andtheeffectoflightonevolutioninthe Cambrian.1998.Proc.R.Soc.Lond.B.265, 967-972.22.Clarkson,E.,Levi-Setti,R.andHorvath,G. 2006. The eyes of trilobites: The oldest preserved visual system. Arthropod Structure andDevelopment35,247-259.23.Nilsson,D.-E.andS.Pelger,S.1994.A pessimisticestimateofthetimerequiredforan eyetoevolve.Proc.R.Soc.Lond.B.256,53-58.

Page 21 - Mary Rosengren

1.FortheworkTrueStoriesandtheongoingprojectRe-imagingNature.Rosengren,M.Re-imagingNature.UniversityofWollongong,FacultyofCreativeArts.2008.2.Rosengren,M.Re-imagingNature.UniversityofWollongong,FacultyofCreativeArts.2008.3.Referto“Inter/disciplinarity”CarloGinzberg,JamesD.Herbert,W.J.T.Mitchell,ThomasFReeseandEllenHandlerSpitz.TheArtBulletin Vol 77 (Dec 1995): 534-552. 4.Mitchell,W.J.T.PictureTheory.Chicago:UniversityofChicagoPress.1995.(11-13).5.AntonVonLeeuvenhoek’s(1632-1723),Maria Sibylla Merian (1647-1717) and Robert Hooke (1635-1703),andbycollaborationssuchas Georg Dionysius Ehret (1708-1770) and Carl Linnaeus(1707-1778),RobertBrown(1773-

Page 162: SPECTRA - Australian Network for Art and Technology · SPECTRA: images and data in art/science Proceedings from the symposium SPECTRA 2012 The book and the conference that begat it,

(858)andFerdinandBauer(1760-1826),andforoverfortyyearsWalterHoodFitch(1817-1892)workedwithbothSirWilliamJacksonHooker(1785-1865)andhissonSirJosephDalton Hooker (1817-1911). 6. On Astronomical images produced by NASA seeKessler,ElizabethA.PicturingtheCosmos Hubble Space Telecope Images. Minneapolis: UniversiryofMinnesotaPress,2012.7.Theterms-true/falsecolourandanexamplecanbeviewed<http://www.nasa.gov/mission_pages/voyager/pia00032_prt.htm8.“Cellsmayalsobestainedtohighlightmeta-bolicprocessesordifferentiatebetweenliveand dead cells in a sample. Cells may be enumerated by staining cells to determine biomass in an environmentofinterest.”Bruckner.9.AsinPlate1ThePlantCell(1)inGunning,Brian.S.andSteer,Martin,W.Ultrastructure and the biology of plant cells. London: Edward Arnold,1975)185.10.1920s Cell diagram Edmund Beecher Wilson fromFlannery,MauraC.“ImagesoftheCellinTwentieth-CenturyArtandScience”.Leonardo 31 (1998) No 3: 195-204.11.DrawingeukaryoticanimalcellBunjiTagawaScientificAmerican1961CellDrawingfromFlannery,MauraC.“ImagesoftheCellinTwentieth-CenturyArtandScience”.Leonardo 31 (1998) No 3: 195-204.12.Pigmentationcanbeassessedusingother methods such as High Performance Liquid Chromatography (HPLC) but the sample is dead. 13. A Helium Argon laser 680 nanometres (near infra red).14.Valueofseeinganindicationofspecimens’ health allows for monitoring of environmental conditions–refer“ImpactofchangesinnaturalUVradiationonpigmentcomposition, physiological and morphological characteris-ticsofAntarcticmoss.”SRobinson,JTurnbull, C. Lovelock.15.RefertoConfocalvideomicroscopystillsfromCleary,Anne.“Actininaction.”Biologic:Theinteractivecell.ResearchSchoolofBiologicalSciencesInstituteofAdvancedStudiesANU.No.10,May1995(3-6)16.PhotographicmanipulationhasalwaysbeenpossiblebutasMitchellstates“extensive reworking of a photographic image to produce seamlesstransformationsandcombinationsis

technicallydifficult,timeconsuming,andout-sidethemainstreamofphotographicpractice.”17.ReferChapter3ofRosengren,M.Re-ImagingNature.2008,UniversityofWollongong18.Orinfactheard.DrewBerry’sanimation“Apotosis”hasanaccompanyingsoundtrackbyFrancTetaz,whodoessounddesignforfeaturefilms.19.SeeDavidGoodsell,BlackandWhiteDrawingSimulatedcross-sectionofbacteriumEscherichiacolidrawnatthemagnificationofonemilliontimes“rpt.ALookInsidetheLivingCellFlanneryMauraC.“ImagesoftheCellinTwentieth-CenturyArtandScience”. Leonardo 31 (1998)20.ForGoodsellandBerry,Robertsonandothersartistswowing“theaudience”isalsosignificantintentionandtheyarepartoftheenlightenmenttraditionofcaptivating,enthrallingandeducating.21.“Ican’twonderatit…since‘tisdifficulttocomprehendsuchthingswithoutgettingasightof‘em.”VanLeeuwenhoekinNabors28.22.Anartifactinanimagereferstothepresence of features that result from technical aberra-tions;inabiologicalspecimensomethingthatis not naturally present but has been introduced or produced during a procedure such as staining orsectioning.23.Refertechniques,confocalmicroscopy,also far/near IR- microscopy and other techniques Australian Synchrotron. References and further reading:•Alpers,Svetlana.TheArtofDescribingDutchArtandtheSeventeenthCentury.Chicago:UCP,1983.•Crary,Jonathan.TechniquesoftheObserver:onVision and Modernity in the Nineteenth Century. Massachusetts:MITPress1992.•Cleary,Anne.“Actininaction.”Biologic:Theinteractivecell.ResearchSchoolofBiologicalSciencesInstituteofAdvancedStudiesANU.No.10,May1995(3-6)•Crump,Thomas.ABriefHistoryofScience:asseenthroughthedevelopmentofscientificinstruments.London:Robinson,2001.•Elkins,James.ArtHistoryandImagesthatarenotArt.TheArtbulletin77.4(Dec.1995):553-567.•Fenly,L.“Portraitsinminiature:Painterofcells,viruses and all things small reveals the art in science”Union-Tribune.July25,2001.www.signonsandiego.com/news/

Page 163: SPECTRA - Australian Network for Art and Technology · SPECTRA: images and data in art/science Proceedings from the symposium SPECTRA 2012 The book and the conference that begat it,

•Flannery,MauraC.“ImagesoftheCellinTwentieth-CenturyArtandScience”.Leonardo31(1998) No 3: 195-204.•GinzbergCarlo,JamesD.Herbert,W.J.T.Mitchell,ThomasFReeseandEllenHandlerSpitz.“Inter/disciplinarity”TheArtBulletinVol77(Dec1995): 534-552. •Gunning,Brian.S.andSteer,Martin,W. Ultrastructureandthebiologyofplantcells. London:EdwardArnold,1975)•Hooker,J.D.TheBotanyoftheAntarcticVoyage(FloraAntarctica).London:Reeve,1844•Lynch,Michael.“ScienceintheAgeof MechanicalReproduction:MoralandEpistemicRelationsbetweenDiagramsandPhotographs,”Biology and Philosophy 6.2 (1991): 205-226.•Lynch,Michael,andSteveWoolgar,eds. RepresentationinScientificPractice.London: MIT,1990.•Mitchell,WilliamJ.Thereconfiguredeye:visualtruth in the post-photographic era. Cambridge Mass.&London:MITPress,1994.•Mitchell,W.J.T.PictureTheory.Chicago:UniversityofChicagoPress,1995.•Nabors,MurrayW.IntroductiontoBotany.SanFranciscoCA:Pearson,2004.•PlaceA.“CartoonConnection”.TheAge12Aug.2006,Melbourne:Career27.•Rosengren,M.Re-imagingNature.UniversityofWollongong,FacultyofCreativeArts.2008.•Stafford,BarbaraMaria.ArtfulScience:Enlightenment Entertainment and the Eclipse of VisualEducation.(1997).

Page 32 - Chris Henschke

1.D.Bohm&D.Peat,Science, Order & Creativity, Routledge,1987,p.332.P.Feyerabend,Against Method,Humanities, 1975,p.283.K.Popper,“Selections from The Logic of Discovery”,inR.Boyd,P.Gasper,&J.Trout (eds.),ThePhilosophyofScience,MITPress, 1993,p.106

Page 38 - Erica Seccombe

1.Crary,Jonathan,‘Modernity and the problem of the observer,’inTechniquesoftheObserver, MassachusettsInstituteofTechnology,p.1 (1990).2.Sontag,Susan,On photography,Farrer,Straus andGiroux,,p.3(1977).3.Thomas,Sue.‘Technobiophilia: We surf the net, stream our films and save stuff in the cloud. Can we get all the nature we need from the digital world?’AeonMagazinewww.aeonmagazine. com/nature-and-cosmos/can-we-get-all-the- nature-we-need-from-the-digital-world/ (Published,24September2013)4.Jenson,MarionKrogh,‘mapping virtual materiality’,inOlafurEliasson,Surrounds Surrounded,NeueGallerie,GrazandMITPress, Cambridgeontheoccasionoftheexhibition, p.302 (2000)5.Ibid,p.302.6.Best,Sue,‘What is Affect? Considering the Affective Dimension of Contemporary Installation Art’inAAANZJournalofArt,vol.2, no.2,2001andvol.3,no.1,p.219(2001)7.Ibid,p.219.8.Ibid,p.222.9.Duxbury,Lesley,2010:‘A Change in the Climate: New Interpretations and Perceptions of Climate Change through Artistic Interventions and Representations’.Weather,Climate&Society, Volume2,p.295(2010).(Published,24September2013)4.Jenson,MarionKrogh,‘mapping virtual materiality’,inOlafurEliasson,Surrounds Surrounded,NeueGallerie,GrazandMITPress, Cambridgeontheoccasionoftheexhibition, p.302 (2000)5.Ibid,p.302.6.Best,Sue,‘What is Affect? Considering the Affective Dimension of Contemporary Installation Art’inAAANZJournalofArt,vol.2, no.2,2001andvol.3,no.1,p.219(2001)7.Ibid,p.219.8.Ibid,p.222.9.Duxbury,Lesley,2010:‘A Change in the Climate: New Interpretations and Perceptions of Climate Change through Artistic Interventions and Representations’.Weather,Climate&Society, Volume2,p.295(2010).

Page 164: SPECTRA - Australian Network for Art and Technology · SPECTRA: images and data in art/science Proceedings from the symposium SPECTRA 2012 The book and the conference that begat it,

Page 46 - Lizzie Muller

1. A later version of the paper presented at SPECTRA was presetned at ISEA 2013 in Sydney. This published version contains elements of bothpresentations.2.Foradiscussionofmyparticularapproachtocuratorialpractice-basedresearchseeMuller,Lizzie‘LearningFromExperience:AReflectiveCuratorialPractice’inCandy,L.&Edmonds,E.(Eds),Interacting:Art,ResearchandtheCreativePractitioner,LibriPublishing,Faringdon,Oxfordshire,U.K,pp.94-106(2011)3.SeebothAnneCrannyFrancis(20-24)andAndrewFrost(24-27)inDean,B.andMuller,L.(Eds)AwfullyWonderful:ScienceFictioninContemporaryArt:CatalogueoftheExhibition Performance Space: Sydney (2011)4. My argument here builds on previous work Ihavedoneinexplainingtheaestheticexperienceofinteractivedigitalart,whichdrawsonthepragmatistphilosopherJohnDewey,seeMuller,Lizzie(2009)TheAudienceExperienceofMediaArt:ACuratorialStudy,PhDThesis,UniversityofTechnology,Sydney.5.Theterm“speculativefiction”isusedto describe the family of literature that includes bothsciencefictionandfantasyfiction.Thisessay,andtheexhibitionitisbasedon,areconcernedparticularlywiththenatureofsciencefictionalspeculationthatengageswiththeimplicationsofscientificdiscoveryand technological change. 6.Gyger,Patrick(2011)“InaStrangeLand:ATourThroughtheWorldsofScienceFictionArt”,inDean,B.andMuller,L.(Eds)AwfullyWonderful:ScienceFictioninContemporaryArt:CatalogueoftheExhibitionPerformanceSpace,:Sydney (2011)7.OneofthemostinfluentialusersoffuturescenariosistheShellOilcompany,whohave famously been producing energy related scenarios since the 1970s. Since 2000 the Intergovernmental Panel on Climate Change

(IPCC’s) Emissions Scenarios have been hotly debated,showingspeculationonfutureeventsasapowerfulideologicalbattleground.8.Suvin,DarkoMetamorphosesofScienceFiction:OnthePoeticsandHistoryofaLiteraryGenre,YaleUniversityPress,NewHavenandLondon (1979)9.Jameson,Frederic(2005)ArchaeologiesoftheFuture–TheDesireCalledUtopiaandOtherScienceFictions,Verso,Londonpp.288-28910.Itisperhapsunsurprisingthat,astheembersofMarxistrevolutionarypoliticsfade,Jamesonshouldclaimthatitisstructurallyimpossible,withinafictionaltexttorepresentanalternativefuture.Othercriticshavemorerecentlypointedtothepracticalandmeasurableeffectsofsciencefictiononindividualsandsociety.

I would like to thank the anonymous reviewer who provided feedback on this essay as part of the peerreviewprocessforISEA2013forsuggestingthe following references to support this point: •LinK,Fu-HsingT,Hui-MinC,andLiang-TeC(2013).“Effectsofasciencefictionfilmonthetechnologicalcreativityofmiddleschoolstudents”EurasiaJournalofMathematics,ScienceandTechnologyEducation9(2):191-192•SpicerArwen.(2005).TowardsSustainableChange:TheLegacyofWilliamMorris,GeorgeBernardShaw,andH.G.WellsintheEcologicalDiscourseofContemporaryScienceFiction

Page 58 - James McArdle and Russell Tytler

1.E.Moje,Developing socially just subject-Matter instruction.ReviewofResearchinEducation,31, 1-44 (2007). 2.J.Lemke,Theliteraciesofscience.InE.W.Saul (Ed.),Crossingbordersinliteracyandscience instruction.NewarkDE:IRA&NSTA(2004).3.J.Clement,Model based learning as key research area for science education. InternationalJournalofScienceEducation22(9), 1041-1053 (2000).4.R.Tytler,V.Prain,P.Hubber,&B.Waldrip(Eds.), Constructing representations to learn science. Rotterdam,TheNetherlands:SensePublishers (2013).5.J.Gibson,The ecological approach to visual perception.Boston:HoughtonMifflin(1979).6.V.Prain,&R.Tytler, Learning through constructing representations in science.

Page 165: SPECTRA - Australian Network for Art and Technology · SPECTRA: images and data in art/science Proceedings from the symposium SPECTRA 2012 The book and the conference that begat it,

3. In the Metaphase Typewriter revival project and in the Mind dispenser, quantum random events occur through events of decay of low- levelradioactivity.IntheMind Lamp project events are provided through electron tunnelling.

InternationalJournalofScienceEducation 34(17),2751-2773(2012).7.D.Gooding,Visualization, inference and explanation in the sciences. In G. Malcolm (Ed.) StudiesinMultidisciplinarity,Vol2.Elsevier, 1- 25 (2004).8.D.K.Simonton,Origins of genius: Darwinian perspectives on creativity.NewYork:Oxford UniversityPress(1999).9.H.E.Gruber,The evolving systems approach to creative work,CreativityResearchJournal,1(1), 27-51 (1988).10.C.Darwin,The expression of the emotions in man and animals(Editionof1896/NewYork:D.Appleton).NewYork:AMSPress(1972).11.J.Voss,&L.Lantz(Translator),Darwin’s pictures : Views of evolutionary theory, 1837- 1874. YaleUniversityPress,NewHaven[Conn.] (2010).12.A.H.Wall,Artistic Landscape Photography. Bradford:PercyLund&Co.(1896).13.P.Prodger,Darwin’s camera : Art and photography in the theory of evolution.Oxford, NewYork:OUP(2009).14.C.Tourney,Truth and Beauty at the Nanoscale. Leonardo42(2),151-155(2009).15.J.Elkins,Visual practices across the University: A Report. In O. Grau (Ed.) Imagery in the 21st Century.Cambridge,MA:MITPress(2011).16.B.Latour,Visualization and cognition: Drawing things together. Knowledge and Society6,1-40(1986).17.P.Maynard,The engine of visualization: thinking through photography. Cornell UniversityPress,Ithaca,N.Y.(1997).18.E.Mach,Popular Scientific Lectures, Vol. 1 OpenCourt,Illinois,66-88(1893).19.J.F.W.Herschel,A Treatise on Astronomy, Longman,Rees,Orme,Brown,Green& Longman,London(1833)20.D.DeBruyn,Visceral, Intuition, Critical Thought : On The Power of the Technical Image in‘Azimuth’,realtime83(2008).21.S.Ainsworth,V.Prain,&R.Tytler,Drawing to learn in science.Science,333(26August),1096- 1097 (2011).

Page 64 - Andrew Howells

1.E.Hodges(2003),The Guild Handbook of Scientific Illustration(2nded).JohnWiley& Sons,HobokenNewJersey,p.11.

Mind-BodyQuestion,”inQuantum Theory and Measurement,ed.JohnArchibaldWheelerandWojciechHubertZurek(PrincetonNewJersey:PrincetonUniversityPress[1961]),168(1983);StuartHameroffandRogerPenrose,“Orches-tratedReductionofQuantumCoherenceinBrain Microtubules: A Model for Conscious-ness,”Mathematics and Computers in Simulation,40:453–480(1996);AmitGoswami,“PhysicsWithinNondualConsciousness,” Philosophy East & West,51no.4:535–44(2001);JohnArchibaldWheeler,“LawWithoutLaw,”inQuantum Theory and Measurement ed.JohnArchibaldWheeler&WojciechHubertZurek(Princeton:PrincetonUniversityPress),182–213(1983);HenryStapp,“Quantum InteractiveDualism:anAlternativeto Materialism,”Zygon,41,no.3:599–615(2006),doi:10.1111/j.1467-9744.2005.00762.x;HenryStapp,“QuantumInteractiveDualism:II:TheLibet and Einstein-Podolsky-Rosen Causal Anomalies,”Erkenntnis,65:117–42(2006),doi:10.1007/s10670-006-9017-y;JohnvonNeu-mann,Mathematical Foundations of Quantum Mechanics,trans.RobertT.Beyer(Princeton:PrincetonUniversityPress[1932])(1955);EvanHarrisWalker,The Physics of Consciousness: The Quantum Mind and the Meaning of Life (Cambridge:Perseus)(2000);EugeneWigner, Symmetries and Reflections,(Bloomington, Indiana:IndianaUniversityPress),171–84(1967);DeanRadin,Entangled Minds: Extrasensory Experiences in a Quantum Reality (NewYork:ParaviewPocketBooks)(2006).

2. C. Rust (2004) Design Enquiry: Tacit knowledge and inventioninscienceDesign,Issues20Nov 2004.

Page 71 - Lynden Stone

1.The‘mindworks’projectsare:the Metaphase Typewriter revival project,2012,the Mind Lamp project,2013andthe Mind Dispenser, 2013.2.Forexample:EugeneWigner,“Remarksonthe

Page 166: SPECTRA - Australian Network for Art and Technology · SPECTRA: images and data in art/science Proceedings from the symposium SPECTRA 2012 The book and the conference that begat it,

4.Wheeler,“LawWithoutLaw”,184.5. The commonly accepted understanding of ‘conventionalreality’isthatitisknowable, mind-independentandobjective:Bernard d’Espagnat,“QuantumPhysicsandReality,” Foundations of Physics 41,no.11:1712—13 (November 2011).6.SeeNeilsBohr“QuantumandPhysicalReality,” Physical Review48:697(1935);Werner Heisenberg,Physics and Philosophy: The Revolution in Modern Science(NewYork:Harper Torchbook,[1958]),50—58,particularly54—55 (1962);DavidDeutsch,The Fabric of Reality (NewYork:PenguinBooks),327(1997);Karen Barad,Meeting the Universe Halfway: Quantum Physics and the Entanglement of Matter and Meaning (Durham NC: Duke UniversityPress)24(2007);d’Espagnat, “QuantumPhysicsandReality,”1712—1713.7.Heisenberg,PhysicsandPhilosophy,54—55.8.SeeBruceRosenblumandFredKuttner,“The ObserverintheQuantumExperiment,” Foundations of Physics32,no.8:1273—1293 (August2002);Wigner,“RemarksontheMind- BodyQuestion,”;HameroffandPenrose, “OrchestratedReductionofQuantum Coherence in Brain Microtubules: A Model forConsciousness,”;Goswami,“PhysicsWithin NondualConsciousness,”;Wheeler,“LawWith- outLaw,”;Stapp,“QuantumInteractiveAnAlternativetoMaterialism;Stapp,“Quantum InteractiveDualism:II:theLibetandEinstein- Podolsky-RosenCausalAnomalies;von Neumann,MathematicalFoundationsof QuantumMechanics;Walker,ThePhysicsof Consciousness: The Quantum Mind and the MeaningofLife;Wigner,Symmetriesand Reflections;Radin,EntangledMinds: ExtrasensoryExperiencesinaQuantumReality.9.Howevernotethatin2010,thenPhDstudent Aaron O’Connell demonstrated quantum super- positioninahuman-madeobjectobservable withthenakedeye.Whileinsuperposition, theobjectsimultaneouslyvibratedalittleand alot;seeElizabethPain,“’Breakthroughofthe Year’BridgingtheQuantumandtheClassical Worlds,”Science,(17December2010),http:// sciencecareers.sciencemag.org.libraryproxy. griffith.edu.au/career_magazine/previous_ issues/articles/2010_12_17/caredit.a100012010.Heisenberg,PhysicsandPhilosophy,54—55.

11.JohnArchibaldWheeler,“LawwithoutLaw,”, 182–213;Stapp,“QuantumInteractive Dualism:AnAlternativetoMaterialism,” 599–615;Stapp,“QuantumInteractiveDualism: II: the Libet and Einstein-Podolsky-Rosen Causal Anomalies,”117–142;vonNeumannMathem- aticalFoundationsofQuantumMechanics; Walker,ThePhysicsofConsciousness;Wigner, SymmetriesandReflections,171–84;Goswami, “PhysicsWithinNondualConsciousness,” 535–44.12.GiancarloGhirardi,AlbertoRiminiandTullio Weber“UnifiedDynamicsforMicroscopicand MacroscopicSystems,”PhysicalReview,D34: 470—91 (1986). 13.Pain,“BreakthroughoftheYear.”14.Heisenberg,PhysicsandPhilosophy,54—55.15.Forexample:Wigner,“RemarksontheMind- BodyQuestion,”168;Hameroff,andPenrose, “OrchestratedReductionofQuantum Coherence in Brain Microtubules: A Model forConsciousness”;Goswami,“PhysicsWithin NondualConsciousness”;Wheeler,“LawWith- outLaw”;Stapp,“QuantumInteractive Dualism”;Stapp,“QuantumInteractiveDualism:II”;vonNeumann,MathematicalFoundations ofQuantumMechanics;Walker,ThePhysicsof Consciousness;Wigner,Symmetriesand Reflections;Radin,EntangledMinds.16.JackSarfatti,“Implicationsofmeta-physics forPsychoenergeticSystems,”Psychoenergetic Systems1(1974)citedinKaiser,Howthe HippiesSavedPhysics:Science,Counterculture, andtheQuantumRevival,(NewYork:W.W. Norton&Company)65(2011);Walker,The PhysicsofConsciousness,;Stapp,“Quantum InteractiveDualism”;Stapp,“Quantum InteractiveDualism:II”;ImantsBarušs, “QuantumMind:ConsciousIntentioninthe ContextofQuantumMechanics,”Dydaktyka Literatury,28:31–40(2008);RichardBartlett, MatrixEnergetics:TheScienceandArtof Transformation(NewYork:AtriaBooks)(2007).17.DavidKaiser,HowtheHippiesSavedPhysics: Science,CountercultureandtheQuantum Revival.18.CorpusofContemporaryAmericanEnglish, http://www.americancorpus.org.19.NoSingularReality,asoloexhibitionatthe WebbGallery,QueenslandCollegeofArt, GriffithUniversity,Brisbane,2—14April2012.

Page 167: SPECTRA - Australian Network for Art and Technology · SPECTRA: images and data in art/science Proceedings from the symposium SPECTRA 2012 The book and the conference that begat it,

Page 78 - Suzette Worden & Perdita Phillips

1.http://www.symbiotica.uwa.edu.au/activities/ exhibitions/adaptation.Theexhibitionisnow touring under the auspices of Art on the Move http://www.artonthemove.com.au/content/ Exhibitions/Adaptation/.2.M.S.J.Rudwick,“The Emergence of a Visual Language for Geological Science 1760-1840” HistoryofScience14,149-195(1976).3.R.J.Cleevely,“TrioofCornishGeologists.” TransactionsoftheRoyalGeologicalSocietyof CornwallxxiiPart3,89-120(2000).4.C.ACramer,(2006).Abstractionandthe ClassicalIdeal,1760-1920Plainsboro,New Jersey:AssociatedUniversityPresses.p.109 (2006).5.C.Trowbridge,“SpeakersConcerningtheEarth’: Ruskin’sGeologyafter1860.”Repositioning VictorianSciences:ShiftingCentresin Nineteenth-CenturyThinkingEds.Clifford,D., etal.:AnthemPress.pp.17-30,p.18(2006).6.A.Grieve,“RuskinandMillaisatGlenfinals” TheBurlingtonMagazine138.1117,228-34p. 230 (1996).7.J.Feldman,“Ruskin’sMinerals.”FieldNotes 1(4),Winter12-15(2006).8.Phillips,P.“Thesixthshore2009-2014”(2009, 2014).Retrieved4January,2014,fromhttp://www.perditaphillips.com/portfolio/ the-sixth-shore-2009-2012/9.EnvironmentalProtectionAuthority.(2010). Strategic Environmental Advice on the Dawesville to Binningup Area: Advice of the EnvironmentalProtectionAuthoritytotheMinisterforEnvironmentunderSection16(e)oftheEnvironmentalProtectionAct1986.Perth:EnvironmentalProtectionAuthority.Report1359May2010http://www.epa.wa.gov.au/epadoclib/1359/Rep1359Daw_ Bins16170510.pdf10.Scott,P.M.,Burgess,T.I.,Shearer,B.L.,Barber,P.A.,Stukely,M.J.C.,Hardy,G.E.S.J.,&Jung,T.(2009).Phytophthoramultivorasp.nov., a new species recovered from declining Eucalyptus,Banksia,AgonisandotherplantspeciesinWesternAustralia.Persoonia,22, 1-13.

20.HameroffandPenrose,“Orchestrated ReductionofQuantumCoherenceinBrain Microtubules”.21.Ibid.,456–57.22.LauraK.McKemmish,JeffreyR.Reimers,Ross H.McKenzie,AlanE.MarkandNoelS.Hush, “Penrose-Hamerofforchestratedobjective- reductionproposalforhumanconsciousness isnotbiologicallyfeasible,”Physicalreview80: 021912-1—6 (2009).23.RogerPenroseandStuartHameroff, “ConsciousnessintheUniverse:Neuroscience, Quantum Space-Time Geometry and Orch OR Theory,”JournalofCosmology,14(2011), http://JournalofCosmology.com24.EvanHarrisWalkerwasaphysicistatBallistic ResearchLaboratories,UnitedStatesArmy, AberdeenProvingGround,Maryland.25. Electron tunneling is quantum process wherebyelectronssuccessfullycrossnegatively chargedbarriers,afeatnotpossibleaccording to classical physics.26.Walker,ThePhysicsofConsciousness,72.27.Ibid.,263–64.28.Ibid.,265.29.Ibid.,266.30.Ibid.,265-66.31.HenryStappisaseniorstaffmemberoftheLawrenceBerkeleyNationalLaboratory.32.Stapp,“QuantumInteractiveDualism:AnAlternativetoMaterialism,”601.33.Ibid.,604.34.Ibid.,606.35.Ibid.,607and614.36.Stapp,“QuantumInteractiveDualism:II,”139.37.HenryStapp,“QuantumTheoryandtheRoleofMindinNature,”FoundationsofPhysics31,no.10 (October 2001): 1488.38.Ibid.SeealsoJeffreySchwartz,HenryStappandMarioBeauregard,“QuantumPhysicsinNeu-roscience and Psychology: a Neurophysical Model ofMind–BrainInteraction,”PhilosophicalTransac-tionsoftheRoyalSociety360:1309-1327at1325(2005),doi:10.1098/rstb.2004.1598.39.RobertJahnandBrendaDunne,“AModularModelofMind/MatterManifestations(M5),”JournalofScientificExploration15,no.3,299and308 (2001).40. Ibid.41.Ibid.,323.42.Ibid.,311and323.

Page 168: SPECTRA - Australian Network for Art and Technology · SPECTRA: images and data in art/science Proceedings from the symposium SPECTRA 2012 The book and the conference that begat it,

differentdynastiesinimperialChina.Theverysimilarpronunciationofthetwotermshasblurredtheirdistincthistoriesandbothseemtobeattributedasthepredecessorofthenow common 通勝tongshèng(inMandarin)ortung sing (in Cantonese).4.Asopposedtosuì(solaryear),whichisdefined astheperiodbetweentwoconsecutivevernalequinoxes,alunaryearis(年nián),definedastheperiodbetweentwoconsecutivelunarnewyeardays.Thesolar-basedcalculationsreckonseasonsastronomically;thatis,seasonsaredefinedbyapparentpositionsofthesunontheeclipticratherthanmeteorologicallybyaverage air temperatures. 5.ThiscalendarwasadoptedinJapan,Korea,andVietnam,wherethesolartermsremainunchangedbutthepentadsweremodifiedinaccordancewithlocalobservationsandconditions.6.AldoLeopold,ASandCountyAlmanac,NewYork:Ballantine,1966.7.Leopold,239−40.8.LeviBryant,‘WildernessOntology’inPreternatural.Ed.CelinaJeffery,NewYork:Punctum,2011,p.21.9.Bryant,23.10.TheprojecttitleoftheAutumnAlmanacofTokyoinJapaneseis 東京の秋の生活暦 (www.photonicsmedia.net/about-autumn). Both the Seasonal Almanac and the Illustrated AlmanachaveChinesetitles,whichare季節 年鑑 (http://www.photonicsmedia.net/about- seasonal) and 插圖年鑑(http://almanac. photonicsmedia.net/)respectively.11.ThefirstalmanacprojectaddressesboththeChinesesolartermsandJapanesepentads,whilethesubsequentprojectsusesolartermsandpentadsadjustedforthesouthern hemisphere.12.TheJapanesetechniqueofzuihitsu(or following the brush) developed in tenth-centurywomen’sdiaristicwritings,most notably Sei Shonogon’s The Pillow Book. This wayofwritingrespondstoeverydayeventswithcontemplationintheformofshortprose,oroftenunconnectedfragments.13.WalterBenjamin,OneWayStreetandOtherWritings,tr.EdmundJephcottandKingsleyShorter(London:Verso,1992).14.KarolineKirst,‘WalterBenjamin’s“Denkbild”:

11.B.D.Walker,D.Salt,andW.Reid,Resilience Thinking: Sustaining Ecosystems and People in a ChangingWorld,IslandPress(2006).12.FromtheCharterofTransdisciplinarityquoted inKagan.S.Kagan,“Culturesofsustainability andtheaestheticsofthepatternthatconnects.” Futures42(10),1094-1101p.1097(2010).13.P.Phillips,“ClottedLifeandBrittleWaters.” Landscapes3(2),1-20(2009).14.E.EllsworthandJ.Kruse(Eds.),Makingthe Geologic Now: Responses to Material ConditionsofContemporaryLife.Brooklyn,N.Y.: Punctum Books (2013).15.P.Alberts,“ResponsibilityTowardsLifeinthe EarlyAnthropocene”Angelaki16(4),5-17 (2011).16.E.EllsworthandJ.Kruse,Introduction.InE. EllsworthandJ.Kruse(Eds.),Makingthe Geologic Now: Responses to Material ConditionsofContemporaryLife(pp.5-26). Brooklyn,N.Y.:PunctumBooks.p.23(2013).

Page 88 - Jo Law

1.RolfTiedemann,‘HistoricalMaterialismor PoliticalMessianism?AnInterpretationofthe Theses‘OntheConceptofHistory’,inThe PhilosophicalForum,XV,1-2(fall/winter1983- 1984),80.2. Time-reckoning in ancient and imperial China wasofgreatimportsociallyandpolitically.The Chinese lunisolar calendar combines calendric calculationsforalunaryear(年 nián) with a solar year (歲). Whereas the lunar calendar incorporatescomplexcalculationsbasedonthe movement of the moon (determining both the durationsandthenumberofmonthseach year),thesolarcalendarisbasedonthe apparentpositionofthesunandremains unchanged each year. 3.Imakeadistinctionbetweenhuángli(皇曆) imperial calendar and huánglì (黃曆)‘yellow calendar’.TheYellowCalendarwassaidtohave beenwrittenbyorinthetimesofthemythical YellowEmperorandthereisevidencethatdates ittoaround4000BC.TheYellowCalendarisone of a number of calendars devised in ancient China.Incomparison,theimperialcalendaris anewerformofofficialtime-reckoningissued by the centralised imperial government through

Page 169: SPECTRA - Australian Network for Art and Technology · SPECTRA: images and data in art/science Proceedings from the symposium SPECTRA 2012 The book and the conference that begat it,

EmblematicHistoriographyoftheRecentPast’,Monatshefte,86/4(1994),515.15.PaulStephensandRobertHardwickWeston,‘FreeTime:OverworkedasOntologicalCondition’,inSocialText,26/1(2008),139.16.AnazographesisisdiscussedinrelationtothewritingsofPosidoniusandChrysippus.‘Emotionalimpulse’isalsodescribedasaffectivemovement,anon-rationalresponse.17.HowardCaygill,WalterBenjamin:TheColourofExperience(London:Routledge,1998),80.18.EstherLeslie,‘TracesofCraft’,JournalofDesignHistory,11/1(1998),9.19.StephensandWeston,‘FreeTime:OverworkasanOntologicalCondition’,139.20.Theinscriptiotranslatesasfollows:‘Shuubun’meansAutumnalequinox.‘Beetleswallup their burrows’ is from the Chinese Almanac and ‘Adzukibeansripen’isfromthemodernJapanesealmanac).21. The common name of tanuki in English is Japaneseraccoondog.22. JaneBennett,VibrantMatter:aPoliticalEcologyofThings(Durham:DukeUniPress,2010),5.23.ItisinterestingtonotethataftertheTohokuearthquakeandtsunamion11March2011,thepresentationofthisparticulatehascometobedefinedbythisevent.Thishighlightstheambiguitiesanduncertainiesofimages.24.Tiedemann,80.25.StephensandWeston,138.26.Bryant,24−6.27. Ibid.

Page 96 - Dustin Welbourne

1.J.Schipper,SmallCarnivoreConservation36, 38-41 (2007).2.N.Karraker,WildlifeSocietyBulletin29(4), 1158-1162 (2001).3.N.DeBondi,etal.,WildlifeResearch37(6), 456-465 (2010).4.D.Paull,etal., as above 39(6),546-553(2012).5.J.McCoy,etal.,TheJournalofWildlife Management75(2),472-477(2011).6.www.youtube.com/watch?v=J026R2SLYMA7.//bear71.nfb.ca/#/bear718. //chickencoopstakeout.wordpress.com/9. //emammal.wordpress.com/10.R.Kyncl,YouTubeOfficialBlog,(2013). Available at <youtube-global.blogspot.com. au/2013/05/yt-brandcast-2013.html>

Page 104 - Prain and Tytler

1.Wise,N.,MakingVisible,Isis97(1),75-82(‘06).2.Newell,B.&Broder,A.’Cognitiveprocesses, modelsandmetaphors.JudgmentandDecision Making3(3),195-204(2008).3.Barsalou,L.,Groundedcognition.Annual ReviewofPsychology,59,617–645(2008).4.Tytler,R.&Prain,V.,Aframeworkforre- thinking learning in science from recent cognitivescienceperspectives.International JournalofScienceEducation.32(15),2055- 2078 (2010).5.Prain,V.&Tytler,R.,LearningThrough ConstructingRepresentationsinScience:A frameworkofrepresentationalconstruction affordances.InternationalJournalofScience Education34(17)2751-2773(2012).6.TIMSSTIMSS2007ScienceFramework. AccessedJanuary2014,athttp://timss.bc.edu/ timss2007/PDF/T07_AF_chapter2.pdf(2007)7.Mercier,H.&Sperber,D.,Whydohumans reason?Argumentsforanargumentative theory. Behavioural and Brain Science 34 57- 111 (2011).8.Cox,R.,Representationconstruction, externalisedcognitionandindividual differences.LearningandInstruction9 343-363 (1999).9.Giere,R.&Moffatt,B.,Distributedcognition: Wherethecognitiveandthesocialmerge. SocialStudiesofScience33,301-310(2003).10.Greeno,J.G.,&Hall,R.P.,Practicing representationLearningwithandAbout RepresentationalForms.PhiDeltaKappan, 78(5),361-368(1997).11.diSessa,A.,Metarepresentation:Native competenceandtargetsforinstruction. CognitionandInstruction22(3),293-331 (2004).12.Gooding,D.,FromphenomenologytoField theory:Faraday’svisualreasoning. PerspectivesonScience,14(1)40-65(2006).13.Tytler,R.,Prain,V.,Hubber,P.,&Waldrip,B., Constructingrepresentationstolearnin science.Rotterdam,TheNetherlands:Sense Publishers (2013).

Page 110 - Victoria Cooper

1.G.Bachelard,ThePoeticsofSpace,Beacon Press,Boston(1994).

Page 170: SPECTRA - Australian Network for Art and Technology · SPECTRA: images and data in art/science Proceedings from the symposium SPECTRA 2012 The book and the conference that begat it,

Page 123 - Roger Alsop

1. Vinci LD. [Web Page]. [cited 2013 30 Dec]. Available from: www.goodreads.com/author/quotes/13560.Leonardo_da_Vinci.2. Rabi I. Man’s Right to Knowledge and the Free Use Thereof. Engineering and Science. 1954;17(9):14-22.3.SnowCP.TwoCultures.Science(NewYork,NY).1959;130(3373):419-.PubMedPMID:17817735.4. Christensen B. From Inert Insight to Incendiary Indictment: The Rhetorical History and Future of C.P. Snow’s “Two Cultures”.InternationalJournaloftheHumanities.201105//;9(2):87-95.PubMedPMID: 91797542.5. Day MA. I.I. Rabi: The Two Cultures and the Universal Culture of Science.PhysicsinPerspective.2004;6(4):428-76.PubMedPMID:15431196.6. Thaller M. Controversies around the Digital Humanities: An Agenda. Kontroversen um die DigitalenGeisteswissenschaften:EinArbeitsplan.2012;37(3):7-23.PubMedPMID:77596201.7. England R. Creative Minds: The Search for the Reconciling Principles of Science, the Humanities, Arts and Religion. ForumonPublicPolicy:AJournaloftheOxfordRoundTable.2009;2009(2):1-13.PubMedPMID:59180046.8. Tuana N. Embedding philosophers in the practices of science: bringing humanities to the sciences.Synthese.201307/15/;190(11):1955-73.PubMed PMID: 87846010.9. Gibson I. Agreeing to disagree. theguardiancom [Internet].2002;Thursday28February2002.Available from: www.theguardian.com/educa-tion/2002/feb/28/highereducation.uk.10.KuhnD,PearsallS.Developmental origins of scientific thinking.JournalofcognitionandDevelopment.2000;1(1):113-29.11. Zimmerman C. The development of scientific thinking skills in elementary and middle school. DevelopmentalReview.2007;27(2):172-223.12.BaoL,CaiT,KoenigK,FangK,HanJ,WangJ,et al. Learning and scientific reasoning. Science. 2009;323(5914):586-7.13.BalkisM,IsikerGB.The relationship between thinking styles and personality types. Social Behavior&Personality:AnInternationalJournal.2005;33(3):283-94.PubMedPMID:17041268.14. Gaut B. Creativity and Rationality. JournalofAesthetics&ArtCriticism.2012Summer2012;70(3):259-70.PubMedPMID:78219062.

2.D.Haraway,Modest_Witness@Second_ Millennium.FemaleMan©_Meets_Onco Mouse™,Routledge,NewYork,66(1997).3.EOWilson,Consilience:Theunityofknowledge, AlfredA.Knopf,NewYork(1998).4.J.Berger&J.Mohr,AnotherWayofTelling, WritersandReadersPublishingCooperative SocietyLtd,London,96(1982).5.R.Barthes,ImageMusicText,FontanaPress, London,17(1977).6.ibid.,20.7.R.Barthes,CameraLucida:Reflectionson Photography,FontanaPaperbacks,London (1984).8.ibid.,6-7.9.J.Fontcuberta(ed.),Photography.Crisisof History,Actar,Barcelona,Spain(2001).10.ibid.1,xxxv.11.ibid.3,226.12.S.Ede,Art&Science,I.B.Tauris,London, 193 (2005).13.ibid.2,67-68.14.B.Latour,‘AnAttemptata“Compositionist Manifesto”‘,NewLiteraryHistory,41,471-90 (2010).15.ibid.,473.16.Forimages:http://www.mercerunion.org/ exhibitions/west-gallery-helen-chadwick- viral-landscapeseast-gallery-martin-pearce/ Forfurtherreading:S.Walker,HelenChadwick: ConstructingIdentitiesBetweenArtand Architecture,I.B.TaurisPublishers,London2013).17.Forimagesandfurtherreading: http://www.aboriginalartdirectory.com/art- ists/slideshow/lin-onus/18.Forimagesandfurtherreading: http://www.artgallery.nsw.gov.au/collection/ works/75.2003/19.G.Richter,‘UnsettlingPhotography:Kafka, Derrida,Moses’,TheNewCentennialReview, 7.2,155-73(2007).20.ibid.,169-170.EnvironmentalProtectionAuthority.(2010).Stra-tegic Environmental Advice on the Dawesville to Binningup Area: Advice of the Environmental Pro-tectionAuthoritytotheMinisterforEnvironmentunderSection16(e)oftheEnvironmentalProtec-tionAct1986.Perth:EnvironmentalProtectionAuthority.Report1359May2010http://www.epa.wa.gov.au/epadoclib/1359/Rep1359Daw_Bins16170510.pdf

Page 171: SPECTRA - Australian Network for Art and Technology · SPECTRA: images and data in art/science Proceedings from the symposium SPECTRA 2012 The book and the conference that begat it,

15.CostantinoT,KellamN,CramondB,CrowderI.An Interdisciplinary Design Studio: How Can Art and Engineering Collaborate to Increase Students’ Creativity? ArtEducation.2010;63(2):49-53.Pub-Med PMID: 48343123.16.ZwickerA,FinkelsteinA,RiordanT,DonnellZ,GupfingerC.ArtofScienceGalleryPrinceton:PrincetonUniversity;2011[cited2012Sept9].Available from: www.princeton.edu/artofscience/gallery2011/.17. Berry D. MolecularMovies.org - A Portal to Cell &amp;MolecularAnimation2014.Availablefrom:www.molecularmovies.com/movies/viewanima-torstudio/Drew Berry/.18.GérykJ.Visual Analytics by Animations in Higher Education.ProceedingsoftheInternationalConference on e-Learning. 2013:565-72. PubMed PMID: 91956480.19.RuizJGCDALAJ.Computer animations in medical education: a critical literature review. MedicalEducation.200909//;43(9):838-46.Pub-Med PMID: 45277375.20.HaglundJ,StrömdahlH.Perspective on models in theoretical and practical traditions of knowledge: the example of Otto engine animations.InternationalJournalofTechnology&DesignEducation.2012;22(3):311-27.PubMed PMID: 78163896.21. Manovich L. What is visualisation? Visual Stud-ies.2011;26(1):36-49.PubMedPMID:59329933.22. Marsella S. Real Scientists Do It With Models: The Art of Science Visualization. Teaching Art-istJournal.2008;6(1):5-19.PubMedPMID:31561172.23.JenksC.Visual Culture:PsychologyPress;1995.24.WalkerBN,LaneDM,editors.Psychophysical scaling of sonification mappings: A comparison of visually impaired and sighted listeners. ProceedingsoftheInternationalConferenceonAuditoryDisplay;2001.25.KramerG,WalkerB,BonebrightT,CookP,FlowersJH,MinerN,etal.Sonification report: Status of the field and research agenda. 2010.26.HermannT,RitterH.Listen to your data: Model-based sonification for data analysis. Advancesinintelligentcomputingandmultimediasystems.1999;8:189-94.27.WorrallD,BylstraM,BarrassS,DeanR,edi-tors. SoniPy: The design of an extendable software framework for sonification research and auditory display. Proceedings of the 13th Intl. Conference onAuditoryDisplay,Montréal,Canada;2007.

28.BenjaminW. The Work of Art in the Age of Mechanical Reproduction[Webpage].UCLASchoolofTheater,FilmandTelevision;1936[updated2005;cited2010October15].Availablefrom:www.marxists.org/reference/subject/phi-losophy/works/ge/benjamin.htm.29. Duchamp M. The Creative Act. Art-news. 1957;56(4).30. Schoenberg A. Theory of Harmony. 3 ed. Berkeley,LosAngeles:UniversityofCaliforniaPress;1978.31.SchoenbergA.FundamentalsofMusicalComposition.StrangG,editor.London:Faber&Faber;1985.32.MorrisR.Compositionwithpitch-classes:atheoryofcompositionaldesign.NewHaven:YaleUniversityPress;1987.33.WourinenC.SimpleComposition.NewYork:C.F.Peters;1979.34.HoltzmanS.Using generative grammars for music composition. ComputerMusicJournal.1981;5(1):51-64.35. Laske O. Composition theory: An enrichment of music theory. JournalofNewMusicResearch.1989;18(1):45-59.36. Pone G. Webern and Luigi Nono: The Genesis of a New Compositional Morphology and Syntax PerspectivesofNewMusic.1972;10(2):111-9.37. Winham G. Composition with Arrays. PerspectivesofNewMusic.1970;9(1):43-67.38. Cope D. An Expert System for Computer Assisted Composition.ComputerMusicJournal.1987Winter;11(4):30-1.39.SchenkerH.Harmony:UniversityofChicagoPress;1980.40.SlobodaJA.Music, language and meaning. The MusicalMind.1986;April:11-67.41. Smoliar SW. A Computer Aid for Schenkerian Analysis.ComputerMusicJournal.1980;4(2):41-59.42.LerdahlF,JackendoffR.Toward a Formal Theory of Tonal Music.JournalofMusicTheory.19771977;21(1):111-71.43.BabbittM.Who cares if you listen? HighFidelity.1958;8(2):38-40.44. Ball P. Schoenberg, serialism and cognition: Whose fault if No one listens? Interdisciplinary ScienceReviews.2011;36(1):24-41.PubMedPMID: 59763451.

Page 172: SPECTRA - Australian Network for Art and Technology · SPECTRA: images and data in art/science Proceedings from the symposium SPECTRA 2012 The book and the conference that begat it,

Education/Programs/SCIENCE-ART/CSIRO-and-the-arts.aspx•CentenaryofCanberra.(2012).Centenary Science Art Commission — Canberra 100. RetrievedApril19,2012,fromhttp://www.canberra100.com.au/programs/ centenary-science-art-commission/•CentenaryofCanberra.(2013).StellrScope.InCanberra100Program-CelebratingCanberra’sCentenary1913-2013(Vol.2.,p.63). Centenary of Canberra 100. Retrieved fromhttp://www.canberra100.com.au/storage/1-48235_CMDC100Program-Vol2.pdf•Davis,E.(2013).3DCreepyCrawleyBugs: Behind the News. ABC Behind the News. Retrievedfromhttp://mpegmedia.abc.net.au/abc3/news/BXN_3DBugs.mp4•Durant,G.(2013).Art,scienceandsciencecommunication.InE.Gates-Stuart(Ed.), StellrScope by Eleanor Gates-Stuart. CSIRO.•Gates-Stuart,E.(2012).StellrScope. Mediaesaurus. www.mediaesaurus.com.au/index.php?option=comcontent&view=article&id=562:stellrscope&catid=6:wordmes&Itemid=25•Gates-Stuart,E.(2013).StellrScope.CSIRO.•Gates-Stuart,E.,&Nguyen,C.(2014).UnderstandingInsects:WhyExploreThroughScienceAndArt.InASC(Ed.),2014AustralianScienceCommunicatorsConference.Brisbane, QLD. Brisbane: Australian Science Communicators Conference 2014.•Gates-Stuart,E.,Nguyen,C.,Adcock,M.,Bradley,J.,Morell,M.,&Lovell,D.R.(2013).ArtandScienceasCreativeCatalysts.InIEEEVIS 2013 AP (p. 8). IEEE VIS2013 AP. Retrieved from http://visap2013.sista.arizona.edu/papers/Stuart_CreativeCatalysts.pdf•Hely,P.(2013).EmbracingInnovationVolume3.Retrievedfromhttp://www.craftact.org.au/embracing-innovation•Morell,M.(2013).TheArtofWheatImprovement–FromtheAgeofthe Impressionists to the Digital Era. In E. Gates-Stuart(Ed.),StellrScopebyEleanorGates- Stuart. CSIRO.

Page 146 - Rebecca Cunningham

•http://skepticwonder.fieldofscience.com/2009/10/sunday-protist-diplonemids- -metaboly.html

Page 129 - Ian Gibbins

1.J.Elkins,SixStoriesFromtheEndof Representation.StanfordUniversityPress, Stanford (2008).2.R.Rapport,NerveEndings:theDiscoveryoftheSynapse.W.W.Norton&Co,NewYork(2005).3.J.Pawley(ed),HandbookofBiologicalConfocalMicroscopy,3rded.Springer,NewYork,(2006).4.D.Purves,etal.,PrinciplesofCognitiveNeuroscience.Sinauer,Sunderland(2008).5.SGoldin-Meadow,Gesture:HowOurhandsHelpUsThink.BelknapHarvard,Cambridge, MA (2006).6.M.Jeannerod,MotorCognition:WhatActionsTelltheSelf.OxfordUniversityPress,(2006).7.M.J.Giummarra,etal.,Mechanismsunderlyingembodiment,disembodimentandlossof embodiment. Neuroscience and Behavioural Reviews 32: 143-160 (2008).8.M.R.Longo,etal.,Morethanskindeep:bodyrepresentationbeyondprimarysomatosensorycortex.Neuropsychologia48:655-668(2010).9.I.L.Gibbins,UrbanBiology,WakefieldPress/FriendlyStreetPoets,Adelaide,(2012).10.I.L.Gibbins,etal.,HeterogeneousexpressionofSNAP-25andsynapticvesicle proteins by central and peripheral inputs to sympatheticneurons.JournalofComparative Neurology 459: 25-43 (2003).

Page 135 - Young, Kleine, Lea

•KleineH(2013)Schlierenimagingandtherealworld.JournalofVisualization,vol.16, pp. 193-199.•Imageobtainedfromhttp://commons.wikime-dia.org/wiki/File:Delphinapterus_leucas_Bubble_Ring.JPG,distributedunderGNUFreeDocumentationLicenseversion1.2.

Page 139 - Eleanor Gates-Stuart

•Abbott,E.A.(1992).Flatland:aromanceofmanydimensions.DoverPublications,NewYork.•ACTGovernment.(2013).ArchitecturalProjections|Enlighten.Retrievedfromhttp://enlightencanberra.com.au/event-info/architectural-projections/•C.Kennedy.(2013).CSIROandthearts.CSIRO.Retrievedfromhttp://www.csiro.au/en/Portals/

Page 173: SPECTRA - Australian Network for Art and Technology · SPECTRA: images and data in art/science Proceedings from the symposium SPECTRA 2012 The book and the conference that begat it,

2008:Arguments,recommendationsandchallenges.CHASSOccasionalPapers,7,33.Henschke,C.Retrievedfromhttp://henschke2010.anat.org.auHøyrup,S.(2012).Employee-driveninnovation:Anewphenomenon,conceptandmodeofinnovation.InS.Høyrup,M.Bonnafous-Boucher,C.Hasse,M.Lotz&K.Møller(Eds.),Employee-DrivenInnovation:ANewApproach(pp.3-33).Hampshire,England:Palgrave Macmillan.Land,R.(2010).ThresholdConceptsandIssuesof Interdisciplinarity. Paper presented at the ThresholdConceptsSymposium,UniversityofNewSouthWales,Sydney.Lundvall,B.-Å.,Rasmussen,P.,&Lorenz,E.(2008).EducationintheLearningEconomy:AEuropeanPerspective.PolicyFuturesinEducation,6(6).doi:10.2304/pfie.2008.6.6.681O’Kane,M.(2008).Collaboratingtoapurpose:ReviewoftheCooperativeResearchCentres Program. (9780642726193). Canberra: Dept. ofInnovation,Industry,ScienceandResearchRetrievedfromwww.innovation.gov.au/innov-tionreview/Documents/CRCReviewReport.pdfQuinlan,A.,Farrell,H.,&Hogben,P.(2010,July1-2).Attendingtoliminality:ConstructinganIdentityasaStudentofArchitecturethroughExperientialLearning.PaperpresentedattheThresholdConceptsSymposium,UniversityofNewSouthWales,Sydney.Riva,A.,Conti,G.,Solinas,P.,&Loy,F.(2010).TheevolutionofanatomicalillustrationandwaxmodellinginItalyfromthe16thtoearly19thcenturies.JournalofAnatomy,216(2),209-222.doi:10.1111/j.1469-7580.2009.01157.xRosengren,M.Retrievedfromhttp://rosengren2011.anat.org.au/Sassen,S.(2007).SociologyofGlobalisation.NewYork:Norton&Co.Synapse Residency Program. Retrieved from http://www.anat.org.au/synapse/Truman,C.Retrievedfromhttp://truman2011.anat.org.au/Wenger,E.(2003).CommunitiesofPracticeandSocialLearningSystems.Organization,7(2), 225-246.White-Hancock,L.(2006).Innovation:RhetoricandRealities.UnpublishedMEdthesis.FacultyofEducation,MonashUniversity,Melbourne, Australia.

•http://www.gtglabs.com.au/announcements/genetic-technologies-us-patent-update•http://www.patentlens.net/daisy/junkDNA/681. html•Cleland,K.,Fisher,L.&Harley,R.(Eds.)Proceedingsofthe19thInternationalSymposiumofElectronicArt,ISEA2013,Sydney.http://ses.library.usyd.edu.au/ handle/2123/9475

Page 151 - Lorraine White-Hancock

Century,M.(1999).Culturallaboratories.InC. Brickwood(Ed.),NewMediaCultureinEurope.Amsterdam:DeBalieandtheVirtualPlatform.Cutler,T.(2008).VenturousAustralia:BuildingStrengthinInnovation.Melbourne:Cutler& Company Pty Ltd. Retrieved from www.innovation.gov.au/Innovation/Policy/ Documents/NISReport.pdf DepartmentofInnovation,Industry,Scienceand Research. (2009). Powering Ideas: An InnovationAgendaforthe21stCentury.Canberra,ACT:AustralianGovernment.Retrievedfromhttp://minister.innovation.gov. au /carr/Pages/GOVERNMENTWELCOMESRE-LEASEOFCRCREVIEW.aspxDurrschmidt,J.&.Taylor,G.(2007).Globalisation, modernity and social change: Hotspots of transition.NewYork:PalgraveMacmillan.Felstead,A.,Fuller,A.,Jewson,N.,&Unwin,L. (2009). Improving Working as Learning. London: Routledge.Gieryn,T.F.(1983).Boundary-workandthedemarcationofsciencefromnon-science: strains and interests in professional interests ofscientists.AmericanSociologicalReview,48, 781-795. Haraway,Donna.(1991).“Situatedknowledges:Thesciencequestioninfeminismandtheprivilegeofpartialperspective.”InSimians,CyborgsandWomen:TheReinventionofNature.NewYork:Routledge.Haraway,D.(2008).WhenSpeciesMeet.Minneapolis:UniversityofMinnesotaPress.Haraway,D.J.,&Randolph,L.M.(1997).Modest₋_Witness@Second_Millennium. FemaleMan₋Meets_OncoMouse:feminismandtechnoscience.NewYork,NYandLondon: Routledge.Haseman,B.,&Jaaniste,L.(2008).TheartsandAustralia’sNationalInnovationSystem1994-

Page 174: SPECTRA - Australian Network for Art and Technology · SPECTRA: images and data in art/science Proceedings from the symposium SPECTRA 2012 The book and the conference that begat it,

About our authorsRoger Alsopisasoundandvideoartistworkingacrossallareasofperformance,aswellasteachingSoundattheFacultyofVCAandMCM.HeholdsaMasterofArtsinComposition,aGraduateDiplomainMusicTechnology,andaBachelorofArtsinMusic,fromLaTrobeUniversity.HehasstudiedCompositionforFilmthroughAFTRS,andConductingthroughtheFacultyofVCAandMCM.Hisrecentworkinsounddesignworkincludes:WaitingforGodot,theGOSHOW,theUKperformancegroupGrandUnionOrchestra,andtheAlphingtonWetlandsFestival.Acknowledgements from Roger: Our thanks goes to Assoc Prof Damian Myers (Head of Research, Department of Orthopaedics, St Vincent’s Hospital Principal Fellow, Department of Surgery, St Vincent’s Hospital Faculty of Medicine, Dentistry and Health Sciences, The University of Melbourne) for providing the monocyte footage used in this presentation.

Rebecca Clunningham isanAustraliancurator,sound,andperformanceartist.RebeccaholdsaBachelorofMusic,PerformancefromtheQueenslandConservatoriumofMusic,GriffithUniversityandBachelorofCreativeIndustries2AHonours,InterdisciplinaryfromQUTandiscurrentlyundertakingaPHDinBusiness[GriffithUniversity]exploringtheoperationoftrustintheglobalperformanceartnetwork.Cunninghamisafoundingmemberandco-directoroftheArtistRunInitiative–existhttp://existenceperformanceart.wordpress.com and has curated a number of events in Brisbane includingMUSICIRCUS(2004),FLUX-US(2006)andCHAMBERS(2007),“existin08:aninternationalliveartevent”(2008)and“exist-ence”(Jan&Nov2010,Oct2011,June-July2013).Rebeccahasalsoperformedlocallyandinternationally;mostrecentlyRebeccahasmadeworkfortheDAscieNCEfestival(Canberra,2013),12~12~12Humanity(Manchester,UK2012),DimancheRouge(Paris,France2012),CageinUSfestival(Brisbane,2012),KesherFestival(NewYork,2012),theEmergencyIndexLaunch(NewYork2012),BrisbaneFestival(2008,2011),POW!POW!POW!ACTIONArtFestival,SanFrancisco,USA(2010),IN:ACTfestival,Hanoi,Vietnam(2010),NationalReviewofLiveArt,Glasgow(Feb08&Feb09),IpswichCitySquareMall(2008),TheOtherFilmFestival(Brisbane,Nov07),OnceOnly(Brisbane,Sept07),FetterFieldfestival(Singapore,Sept07)andhaspresenteddigitalworkinarangeofotherevents,fromIndonesiatoRussia.“Iseeperformanceartasawayoflivingutopiainthemoment,offeringaspaceofpause,aplaceforpersonalmeta-physicaltransformation.”http://rebeccacunningham.wordpress.com/.

Victoria CooperisanartistwithaPhDinVisualArtsresearchingtheintersectionsofartandscience.Thisinterdisciplinary research is informed and inspired by her previous career in Human and Plant Pathology along with current interest in local and regional issues of land and water. During her 23-year arts career she has also worked across many forms of photographic technology–analogue to digital imaging;sitespecificdocumentationofperformance;andartists’books.InacollaborativepracticewithDrDougSpowart,sheexplorestheposttechnologicalparadigmofphotographyasaculturalcommunicationandasite-specificvisualmedium.Thismulti-methodologicalapproachisappliedintheircurrentPlaceProjectworkinmanyregionalcommunities.CooperhasexhibitedinAustraliaandinternationallyandherworkhasbeenmuchpublished.Cooper’sartists’booksareheldinmostsignificantnationalandprivatecollectionsincludingtherarebooksandmanuscriptcollectionsoftheNationalLibraryofAustraliaandtheStateLibraryofQueensland.Acknowledgements from Victoria: Dr Doug Spowart – artist and independent researcher, Toowoomba Queensland; Dr Malcolm Ryley and Dr Gary Kong – formerly Principal Plant Pathologists and Dr John Alcorn – Former Curator, BRIP Plant Pathology Herbarium Department of Agriculture, Fisheries and Forestry, Queensland; John Reid, School Of Art – Australian National University; Dr Sally Stowe and the Electron Microscope Unit – Australian Na-tional University; Julian Bowron – Currently Director Bunbury Regional Art Galleries, Western Australia; Bundanon Trust – Nowra, New South Wales; Myall Park Botanic Garden (MPBG) – Glenmorgan, Queens-land; Carol and Ed McCormack – Glenmorgan, Queensland; Kerry Brett – former owner of property locat-ed at The Head Queensland; Les and Penny Sheahan, Rob and Tammy Irons, former and current owners of Balcondo, Queensland; and Dr Felicity Rea - Toowoomba QLD.

Page 175: SPECTRA - Australian Network for Art and Technology · SPECTRA: images and data in art/science Proceedings from the symposium SPECTRA 2012 The book and the conference that begat it,

Ian GibbinsisaneuroscientistandProfessorofAnatomyatFlindersUniversity,internationallyrecognisedforhisworkonthemicroscopicstructureandfunctionofnervessensingandcontrollingthebehaviouroftheinternalorgans.Healsoisawidelypublishedpoetandelectronicmusician.“UrbanBiology”,hisfirstfullpoetrycollectionandaccompanyingCD,waspublishedin2012.Hehasbeencollaboratingwithartist,CatherineTruman,since2007onprojectsinvolvingourfeelingforthebodyanditsvisualisation.HehasbeencollaboratingwithJudyMorrisfornearly40yearsonadiverserangeofartandscienceprojects.Acknowledgements from Ian: IG’s microscopy research has been supported continuously by project grants from the National Health and Medical Research Council of Australia from 1986 to 2011, partly in collaboration with JM; CT was the recipient of an Australian Network for Art and Technology Synapse Residency in IG’s laboratory during 2011 and was supported as Artist-in-Residence with IG by a Flinders University Teaching & Learning Innovation Grant in 2010.

Chris Henschkeisanartistwhoworksintheareasofmediaincludingfineart,illustrationandimaging,interactiveart,videoandanimation,graphicdesign,sounddesign,music,installationartandperformance. Acknowledgements from Chris: The Australian Synchrotron Artist In Residence program was developed by the Australina Network for Art & Technology, and supported by Arts Victoria Arts Innovation. Beamline experiments were conducted with the assistance of Mark Tobin, Mark Boland and Tom Caradoc-Davies.

Dr Andrew HowellsisalecturerinNaturalHistoryIllustrationattheUniversityofNewcastle.Withaprofessionalbackgroundinanimation,graphicdesign,fineartandIllustrationAndrewtakesamultidisci-plinaryapproachtohispractice-basedresearch.Andrew’sresearchfocusisoncontemporaryillustrationpractice,visualresourcedevelopmentandthecollaborationbetweenartandscience.Acknowledgements from Andrew: I would like to acknowledge the contribution of the late Dr Roy McClements to my research and to thank him for his belief in the strength of a cross-disciplinary approach to research between the arts and sciences.

Jo Law lecturesinmediaartsattheUniversityofWollongong,Australia.“Frommyearlyvideosthatdrawoutthelayeringofinterculturalcurrentstomymorerecentonlinealmanacsthatexaminelivedexperiencesintemporalsegments,Ifindmyselfconsistentlyreturningtothetaskofmappingtheeveryday.Iincorporatedivergentmediaandmaterialsinmyworks:films,videos,animations,collages,drawings,diagrams,maps,prints,books,onlineworksandobjects.MyworkshavebeenexhibitedwidelyacrossAustraliaandinternationallyandreceivedawardsincludingtheSilverSpireAwardattheSanFranciscoInternationalFilmFestival.FollowingabookchapterinWalterBenjaminandtheArchitectureofModernity,Icontinuetopublishmyresearchsuchasaforthcomingco-authoredarticleinOzone:TheJournalofObject-orientatedStudies.”

Harald Kleine receivedhisdegreesinMechanical/AeronauticalEngineeringattheTechnicalUniversityofAachen,Germany.Duringhispostgraduatestudieshebegantodesignandbuildadvancedopticalsystemsforthevisualisationofunsteadyhigh-speedgasflowsasobservedinshocktubesandsuper-andhypersonicwindtunnels.HecontinuedtoworkinthisfieldduringapostdoctoralfellowshipatMcGillUniversity,Montreal,Canada(1995-97).Fortwoyears,heworkedonthedesignandtestingofblastprotectionequipmentattheOttawa-basedcompanyMed-EngSystems,andsubsequentlyfollowedaninvitationofTohokuUniversity,Sendai,Japan,tocontinuehisstudiesinhigh-speedflows.AftertheendofhiscontractwithTohokuUniversityin2002,Dr.KleinebecameastaffmemberoftheUniversityofNewSouthWalesattheAustralianDefenceForceAcademyinCanberra,wherehecurrentlyholdsthepositionofAssociateProfessor.Hisworkfocusesonthedevelopmentofimprovedtime-resolvedvisualisationtechniquesandassociatedapplicationsinshockwaveresearch.Onseveraloccasions,hehasalsoengagedwiththeartisticaspectsofflowvisualisation,atopiconwhichhehasgivenafewpresentationsandpublishedtwopapers.Manyofhisimagesarefeaturedinexhibitionsonscientificphotography.

Page 176: SPECTRA - Australian Network for Art and Technology · SPECTRA: images and data in art/science Proceedings from the symposium SPECTRA 2012 The book and the conference that begat it,

A performer and choreographer Liz Lea trained at London Contemporary Dance School and Akademi in London and Darpana Academy in India. Based between London and Sydney for many years she is nowbasedinCanberraasArtisticDirectorofLizLea&CoandCanberraDanceTheatreandAssociateDirector at QL2 Dance. In 2013 she was Choreographer in Residence at CSIRO Discovery and Directed DANscienCE,adanceandsciencesymposiumheldinCanberraforNationalScienceWeek,August2013.ShealsopresentedInFlightattheNationalLibraryofAustraliaandSeekingBiloelaatTheStreetTheatre–twonewsoloworks;MagnificusMagnificusinspiredbytheredtailedblackcockatooforIndigenousdanceartistTammiGissellandKapture,inspiredbyAhmedKathrada,imprisonedalongsideNelsonMandelafor26years.AsadancerLizhasworkedfortheRoyalOperaHouse,RanjabatiSircar,Imlata,Sankalpam,EnglishNationalOperaandEnglishBachFestivalasaBaroquespecialist.Liz’sresearchintothe early modern dance movement and non Asian dance pioneers inspired by India such as Anna Pavlova andRuthStDenishaveledtotheforthcomingdocumentary‘DanceDetective’,filmedinIndia.Sheoneofveryfewartistswhohasreinterpretedtheearly1906solosofRuthStDenis,inspiredbyIndia.

James McArdleisAssociateProfessorintheImageatDeakinUniversityandpreviouslyHeadofVisualArtsandDesignatLaTrobeUniversity.Hisresearchisdevotedtoart,visualthinking,creativity,andarteducationandhassustainedthirty-threeyearsofcommunityservice,teachingandcurriculumdevelopmentinsecondary,adult,Universityandprofessionalart,designandmediatechnologieseducation,andongoingartisticpracticeinphotography,exhibitingnationallyandinternationallysince1974.Teachingandpracticeisconstantlyrefreshedbyregularlypublishingandexhibitingresearchintovisualattention,affordance,phenomenologyandvisualcommunicationwhichhecriticallyreappraisesthroughphotomediafundamentals,adaptingselectivefocusandbinocularvision.Acknowledgements from James: Figure 1 Cameron Robbins ‘Smoke Room: 26 Surf Street 2007’, reproduced with his kind permission, was part of his ‘Appartion’ installation (see http://cameronrobbins-merricksbeach.blogspot.com for more information and illustrations). Figure 4 is from James McArdle’s solo show ‘Vortex’ at Bendigo Art Gallery, 29 September to 28th October 2001; Figure 5 is from James McArdle, ‘Azimuth’, Phyllis Palmer Gallery, Bendigo, 6 July – 6 Aug 2007; and Figure 6, from ‘Second Nature’, a joint solo exhibition by James McArdle and Lorena Carrington at Stephen McLaughlan Gallery Melbourne, Level 8 Nicholas Building 37 Swanston St, Melbourne, 14-31 March 2012.

Lizzie Mullerisacuratorandwriterspecialisingininteraction,audienceexperienceandinterdisciplinarycollaboration.SheisSeniorLecturerintheCollegeofFineArts,UNSWAustralia.Lizzie’sprimaryresearchinterestistheaudienceexperienceofart,particularlymediaart,interdisciplinarycollaborationsandparticipatoryandinteractiveartworks.Herresearchdrawstogethercuratorialpracticebasedresearchwiththeoriesandmethodsdrawnfromparticipatorydesignandinteractiondesign.Herworkwithaudienceexperienceextendstothefieldsofpreservationandarchiving,particularlyexperientialdocumentationandoralhistoriesofmediaart.Hercurrentresearchexplorestherelationshipbetweencuratorialpracticeandshiftsincontemporarydisciplinarystructures.Acknowledgements from Lizzie: With thanks to Bec Dean, co-curator of Awfully Wonderful and all the staff at Performance Space, and to all the artists involved in the exhibition.

Andrew ParkerisResearchLeader,NaturalHistoryMuseum(London)andGreenTempletonCollege,UniversityofOxford.TheauthorofSevenDeadlyColours,AndrewParkeristheheadofGreenTempletonCollege’sPhotonicstructuresandeyes:evolution,developmentandbiomimeticsresearchteam.ParkerhasbeendescribedbyTimeMagazineas“oneofthethreemostimportantyoungscientistsintheworldforhisworkininvestigatingandansweringthegreatriddleoftheCambrianexplosion.”Acknowledgements from Andrew: This work was funded by The Royal Society (UK) and The Australian Research Council.

Page 177: SPECTRA - Australian Network for Art and Technology · SPECTRA: images and data in art/science Proceedings from the symposium SPECTRA 2012 The book and the conference that begat it,

Perdita PhillipsisanAustralianartistwithawide-rangingandexperimentalconceptualpractice.Sheworksinwalking,mixedmediainstallation,environmentalprojects,sound,sculpture,photographyanddrawing.Whilstmateriallydiverse,underlyingthemesofecologicalprocessesandacommitmenttoaresensitisationtothephysicalenvironment,areapparent.Sheoftenworkswithscientificknowledgesystemsandherbinauralsoundwalksextendthesenses,combiningrealandimaginedterrainsandgeneratingsonic/spatialdissonances.Recentworksinclude.–./.-/.-(thepenguinanticipatoryarchive)(2013) and the Shy (dissolution+exchange)conceptualmailartproject(2012-2014).www.perditaphillips.com.

Vaughan PrainisProfessorofEducationatLaTrobeUniversityandistheauthorofWriting, Thinking and Learning in Science.His2014exhibitionGet-TogetherexhibitedatthePhyllisPalmerGalleryinBendigo.

Mary Rosengren’sinstallationsandmediaworksexploreoverlaysbetweenvisualart,scienceandtechnology.Herresearchofimages,naturalphenomenaanddynamicsystemshastakenhertotheextremeenvironmentsofLakeMungoNSW,CairngormMountainsScotlandandtheAntarcticPeninsularandintosignificantscientificcollectionsandcontemporaryresearchfacilitiesinAustraliaandtheUK.ArecipientoftheANATSynapse6residencyin2011,MarylecturesinvisualartsatLaTrobeUniversity.Acknowledgements from Mary: I would like to thank and to acknowledge the significant role and aspirations of Cris Kennedy, Director- CSIRO Discovery Centre for his continuing efforts and support for SPECTRA 2012, begun with the ANAT 2011 Synapse 6 Residency award. Cris Kennedy initiated and organized the SPECTRA2012 symposium and with staff at Discovery Centre managed the event itself. It is due to Cris Kennedy’s energy, commitment and curiosity about art/science culture that the publication of the SPECTRA2012 papers has been realized. Thanks to the artists and scientists who presented at SPECTRA and those who contributed their papers here. Thanks to Vicki Sowry at ANAT, CSIRO for hosting the project, Anne and John at the Discovery Centre and the curators and technicians of CSIRO Biological Collections for supporting my research during the Residency in 2011. This paper is dedicated to Hugh McNicholl 1945-2012

Erica Seccombe’sprojectGROW:visualisingnatureatnanoscalewassupportedbyanartACTprojectgrantanda2010SynapseResidencyintheANUDepartmentofAppliedMathematicsbeforebeingacceptedintotheANUPhDprogramin2011.Ericaalsoexhibitedamajorbodyofwork‘Monster’incollaborationwithTimSendenandAjayLimayecuratedbyDavidBroker,forScienceFictionatCanberraContemporaryArtSpacein2013.ThisworkexploresthevolumetricdataofanIsopodathroughastereoscopicdigitalprojectionanda3Dprintinginstallation.FormoreinformationonErica’sactivitiesvisitherwebsitewww.ericaseccombe.com.auandwatchexerptsofheranimationsonVimeo.Acknowledgements from Erica: This paper is based on Erica’s PhD Exegisis research GROW: Visualising Nature at Nanoscale, ANU School of Art, and is also a condensed version of a peer reviewed essay ‘Relocating the real: experiencing nature in the fifth dimension,’ to be published as part of the 2013 AAANZ conference proceedings in 2014.

Barbara Maria Stafford’sresearchfocussesontheintersectionofthevisualartswiththephysicalandbiologicalsciencesaswellastheevolutionofopticaltechnologies.Authoroftenbooks,herrecentwork[EchoObjects:TheCognitiveWorkofImages[2007]andAFieldGuidetoaNewMetafield:BridgingtheHumanities-NeurosciencesDivide[2011]investigateemergingcross-disciplinaryentanglements.Recently,sheservedascritic-at-largeintheCollegeofArchitectureattheGeorgiaInstituteofTechnologywheresheinitiatedanArt/ScienceSalonbycuratingtwoexhibitions[theSalonforVision[2011]andtheNeuro-Salon[2012]andorganizedtheiraccompanyingconferences.[Seebarbaramariastafford.com]

Page 178: SPECTRA - Australian Network for Art and Technology · SPECTRA: images and data in art/science Proceedings from the symposium SPECTRA 2012 The book and the conference that begat it,

Lynden StoneisafulltimevisualartistandPhDcandidateattheQueenslandCollegeofArt,GriffithUniversity,Brisbane.Hercurrentstudiopracticeinvestigateshowvisualartistscanexploreandrepresenttheenigmasthatquantumphysicspresentstoconventionalreality.Herprimarypracticeisinpaintingbutshealsomakesvideosandinstallationwork.ShehasexhibitedinsoloandgroupexhibitionsinAustralia,PhiladelphiaandLondon.Acknowledgements from Lynden: I acknowledge the support and advice of my PhD supervisors Professor Mostyn Bramley-Moore and Dr. George Petelin. I wish also to thank Nick Herbert for his support and advice on the Metaphase Typewriter revival project as well as my collaborator and programmer on that project, M. U. Shrooms. In addition, I thank Evie Franzidis for her comments and suggestions whilst editing sections of this paper that formed part of my PhD exegesis.

Eleanor Gates-StuartisisaResearcherwiththeAustralianNationalCentreforthePublicAwarenessofScience(CPAS)atANUandassociatedwiththeCommonwealthScientificandIndustrialResearchOrganisation(CSIRO).Eleanor’sresearchinScienceandArtisdiverseandcollaborative.Specialisinginvisualmediacommunicatingherartisticpracticeinnewandinnovativeways,questioningandengagingaudienceinart,scienceandtechnology,workingwithmajorresearchorganisations,museums,businessandlocalgovernment.Herrecentproject,StellrScope,wasawardedtoEleanorbytheCentenaryofCanberraasamajorScienceArtCommission,thatwassupportedbytheAustralianCapitalTerritory(ACT)GovernmentandtheAustralianGovernment.CSIROwasthehostforthisresearch,engagingEleanorastheScienceArtFellowwiththeFoodFuturesFlagshipandtheComputationalInformatics(CIS)ResearchDivision.Eleanor’sinterestsfirmlycrossoverarts,science,design,technologyandcommunication.Havingreceivednumerousawards,grants,andcommissionsinhercareer,Eleanor’sinternationalartisticprofileandresearchincludesrolessuchasassociateprofessor,curator,exhibitorand director of media and science arts events. She is a regular contributor to numerous professional associations,enjoysworkingoncollaborations,publishingandpresentingpapersatconferencesintheUK,USA,TaiwanandAustralia.Acknowledgements from Eleanor: The Centenary Science Art Commission StellrScope is a Centenary of Canberra project, supported by the ACT Government and the Australian Government. Gates-Stuart’s residency at CSIRO has been supported through the CSIRO Transformational Biology initiative and in association with CSIRO’s Future Grains Theme. Huge acknowledgment of all those who have contributed to, or collaborated on the works described in this paper, including Matt Adcock, Chuong Nguyen, David Feng and Dulitha Ranatunga who played key roles in implementing software and display systems for StellrScope, including the input of CSIRO’s Lab 22 and the Australian National Insect Collection. An additional thank you to Professor Sue Stocklmayer, Australian National Centre for the Public Awareness of Science, ANU, for her generous support with this project.

Russell TytlerisProfessorofScienceEducationatDeakinUniversity.Hehasbeeninvolvedovermanyyearswithsystemwidecurriculumdevelopmentandprofessionaldevelopmentinitiatives.Hehasresearchedandwrittenextensivelyonstudentlearningandreasoninginscience,andscienceinves-tigations.Hisrecentresearchinterestsincludetheroleofrepresentationinreasoningandlearninginscience,teacherandschoolchange,andinternationalperspectivesonscienceandenvironmentaleduca-tion.Hehasundertakenanumberofinfluentialstudiesconcerningstudentengagementwithscienceandmathematics,andSTEMpolicy.RussellhasheldvisitingprofessorpositionsinEuropeandAsia.HeisdeputydirectoroftheveryactiveCREFIstrategicresearchcentreatDeakin.

Page 179: SPECTRA - Australian Network for Art and Technology · SPECTRA: images and data in art/science Proceedings from the symposium SPECTRA 2012 The book and the conference that begat it,

Dustin WelbourneisaPhDcandidatewiththeUniversityofNewSouthWaleswhoseresearchisonthedevelopmentofnon-invasiveresearchmethodsforterrestrialvertebrates.In2012,Mr.Welbournedevisedandpublishedamethodtousecamera-trapstosurveyingterrestrialreptiles,thefirstofitstypeintheworld,whichhasprovedtobemoreeffectivethansometraditionalmethods.Wildliferesearchhowever,isonlypartofhisinterestasMrWelbournehasrecentlycompletedaMastersinScienceCom-municationwiththeAustralianNationalUniversitywherehestudiedtheuseofYouTubeasaplatformforsciencecommunication.Mr.Welbournehaswrittennumerousarticlesforthepopularpress,givenavarietyofpublictalksincludingatTEDxCanberra2013,andwasoneofthenationalwinnersof“I’maScientist,getmeoutofhere”.Mr.WelbournecurrentlylivesinCanberra,butheisonthelookoutforupcomingpostdocopportunitiestosatisfyhisbreadthofscientificinterest.Acknowledgements from Dustin: Thank you to UNSW Canberra for providing me with the time and resources to attend SPECTRA 2012, and to the organising committee of SPECTRA 2012 for putting on such an interesting and inspiring event. Lorraine White-HancockisaPhDcandidateintheFacultyofEducationatMonashUniversity,Mel-bourne,Australia.Herbackgroundisasanartistandobjectdesigner.UntilrecentlyshewasateacherandCourseCoordinatoroftheAdv.Dip.EngineeringTechnology–JewelleryandMetalsmithingatBoxHillInstituteofTAFE,Victoria,Australia.In2013White-HancockworkedasaresearchassistantatMonashUniversity.Acknowledgements from Lorraine: Thanks to the Synapse grant recipients - Dr Mary Rosengren and Cris Kennedy, Catherine Truman and Professor Ian Gibbins, Chris Henschke and Dr Mark Boland - who agreed to be interviewed and so generously gave their valuable time to this process. Thanks also to Vicky Sowry at ANAT who kindly helped me contact project partners and discussed the Synapse program with me.

Suzette Worden’s currentresearchinterestsincludemining,aluminiumandwoolunderthethemeofmaterialityanddesign.Thisresearchlinkscraftanddesignwithheritage,materialcultureandsciencetechnologystudies.Shehasextendedthistoincluderesearchintoart-sciencecollaborations.From2002-2011shewasProfessorofDesignatCurtinUniversity,Perth,WesternAustralia.Besidesteachingandresearchingthehistoryofdesignshehasco-curatedexhibitionsandbeeninvolvedintheorganisationofconferences on digital media.Acknowledgements from Suzette: The Sixth Shore project has been assisted by the Australian Government through the Australia Council, its arts funding and advisory body. Perdita Phillips also acknowledges assistance from SymbioticA at the University of Western Australia and the Sidney Myer Fund. Figure 6 courtesy of Katherine Grey, Geological Survey of Western Australia.

Page 180: SPECTRA - Australian Network for Art and Technology · SPECTRA: images and data in art/science Proceedings from the symposium SPECTRA 2012 The book and the conference that begat it,

S P EC T R AS P EC T R A