EVA London 2016

EVA London 2016

EVA London Electronic Visualisation and the Arts www.eva-london.org

Proceedings of EVA London 2016 BCS London 12–14 July 2016

Editors: Jonathan P. Bowen Graham Diprose Nick Lambert

www.bcs.org/ewic/eva2016

© 2016 BCS Learning & Development Ltd. All rights reserved. Apart from any fair dealing for the purposes of research or private study, or criticism or review, as permitted by the Copyright Designs and Patents Act 1988, no part of this publication may be reproduced, stored or transmitted in any form or by any means, except with the prior permission in writing of the publisher, or in the case of reprographic reproduction, in accordance with the terms of the licences issued by the Copyright Licensing Agency. Enquiries for permission to reproduce material outside those terms should be directed to the publisher. All trademarks, registered names etc. acknowledged in this publication are the property of their respective owners. BCS and the BCS logo are the registered trademarks of The British Computer Society, charity number 292786 (“BCS”). Published by BCS Learning & Development Ltd., a wholly owned subsidiary of BCS, The Chartered Institute for IT, First Floor, Block D, North Star House, North Star Avenue, Swindon, SN2 1FA, UK. www.bcs.org ISBN 978-1-78017-344-3 ISSN 1477-9358

British Cataloguing in Publication Data. A CIP catalogue record for this book is available at the British Library.

Disclaimer: The views expressed in this book are of the author(s) and do not necessarily reflect the views of the Institute or BCS Learning & Development Ltd except where explicitly stated as such. Although every care has been taken by the authors and BCS Learning & Development Ltd in the preparation of the publication, no warranty is given by the authors or BCS Learning & Development Ltd as publisher as to the accuracy or completeness of the information contained within it and neither the authors nor BCS Learning & Development Ltd shall be responsible or liable for any loss or damage whatsoever arising by virtue of such information or any instructions or advice contained within this publication or by any of the aforementioned.

Acknowledgements EVA London 2016 gratefully acknowledges:  BCS, The Chartered Institute for IT for hosting EVA2016 at its London headquarters, and BCS Computer Arts Society (CAS) Specialist Group for providing bursaries. Special thanks go to Kerry Wear at the BCS, for help with budgeting, registration, and venue and speaker arrangements, as well as Becky Youe and Florence Leroy at the BCS, for support with the conference proceedings.  The Anthill Social and Tom Keene for website hosting and support.  The Pratt Institute, New York, for sponsoring the EVA London Pre-Conference Symposium.  The Victoria and Albert Museum, London, for support of Digital Futures. Thank you to Duncan Mackie and staff at BCS London office for help with IT and other support. Thanks to all the speakers and participants for making the EVA London conference a continuing success.

iii

Preface The Electronic Visualisation and the Arts London 2016 Conference (EVA London 2016) is co-sponsored by the Computer Arts Society (CAS) and BCS, the Chartered Institute for IT, of which the CAS is a Specialist Group.

Research Workshop running in parallel on the first day of the conference, to encourage postgraduate student participation. Presenters at the Research Workshop are offered bursaries for free attendance on that day. A number of other bursaries are also available to encourage attendance by those with no other source of funding (especially independent artists contributing to the conference).

Over recent decades, the EVA London Conference on Electronic Visualisation and the Arts has established itself as one of the United Kingdom’s most innovative and interdisciplinary conferences. It brings together a wide range of research domains to celebrate a diverse set of interests, with a specialised focus on visualisation.

EVA London 2016 presents papers and abstracts from international researchers inside and outside academia, from graduate artists, PhD students, seasoned industry professionals, established scholars, and senior researchers, who value EVA London for its interdisciplinary community. This year, the conference features three keynote talks with four speakers: Lincoln Wallen, the CTO of Dreamworks; Andreas Bienert and Eva Emenlauer-Blömers from EVA Berlin; and Susan Hazan of the Israel Museum in Jerusalem.

The papers and extended abstracts in this volume touch on the arts, dance, education, electronic art, mathematics, multimedia, museums, music, and photography, as well as other related areas, all involving the use of IT for the enhancement and support of the arts and humanities in some way. The EVA London 2016 conference presents a wide spectrum of papers, presentations, demonstrations, a Research Workshop and two special preconference events: the EVA PreConference Symposium (entitled “From Analogue to Digital in Literature and Art”), with four invited speakers, sponsored by the Pratt Institute in New York, and “Digital Futures”, supported by the Victoria and Albert Museum in London. The former is in association with a London Summer School on “The Arts and Digital Culture” being held 26 June to 8 July 2016 at King’s College London and co-organized by the Pratt Institute, just before the EVA London 2016 Conference. The latter is an exhibition forum where the sciences, arts, humanities, and performance, are equally at home. As in previous years, there is a

This publication has resulted from a selective peer review process, fitting as many excellent submissions as possible into the limited timetable of the conference. EVA London is part of a larger network of EVA international conferences. In the past twenty years, EVA events have been held in Athens, Beijing, Berlin, Brussels, California, Cambridge (both UK and USA), Canberra, Dallas, Delhi, Edinburgh, Florence, Gifu (Japan), Glasgow, Harvard, Jerusalem, Kiev, Laval, London, Madrid, Montreal, Moscow, New York, Paris, Prague, St Petersburg, Thessaloniki, and Warsaw. Further venues for EVA conferences are very much encouraged by the EVA community.

iv

Committee  EVA 2016 Conference Chair:  EVA 2016 Exhibition Chair:  EVA 2016 Programme Co-Chairs:

 EVA 2016 Pre-Conference Symposium Co-Chairs:  EVA 2016 Digital Futures Chair:  EVA 2016 Research Workshop Chair:  EVA 2016 Publicity Chair:  EVA 2016 Technical Support:

 EVA 2016 Website:  EVA 2016 Bursaries and Prizes:  EVA Conference Honorary Chair:

Jonathan P. Bowen Nick Lambert Jonathan P. Bowen Graham Diprose Nick Lambert Jonathan P. Bowen Tula Giannini Irini Papadimitriou Graham Diprose Eleanor Lisney Duncan Mackie Joanne Armitage Prasanth Visweswaran BCS, The Chartered Institute for IT Tom Ensom Joanne Armitage Francesca Guerrera James Hemsley

 EVA 2016 Organising Committee: Joanne Armitage Jonathan P. Bowen Graham Diprose Tom Ensom Francesca Guerrera James Hemsley Nick Lambert Eleanor Lisney George Mallen Kia Ng Irini Papadimitriou Carl Smith

v

University of Leeds London South Bank University Speos Photographic Institute King’s College London Ravensbourne Birkbeck College Ravensbourne Connect Culture CIC System Simulation University of Leeds Victoria and Albert Museum Ravensbourne

List of Reviewers  EVA 2016 Programme Committee: Joanne Armitage Julian Ashbourn Mario Athanasiou Camille Baker Isabel Bernal Christin Bolewski Ann Borda Jonathan P. Bowen Stephen Boyd Davis Beatrice Bretherton Nick Bryan-Kinns Daniel Buzzo Alfredo Calosci Vito Cappellini Cécile Chevalier Richard Collmann Ed Cookson Antonio D'Amato C. de Paiva Santana J. C. Diaz Graham Diprose Eunice Duarte Tom Ensom Laura Ferrarello Esteban Garcia Leigh Garrett

Dylan Gauld Tula Giannini Marco Gillies Oliver Gingrich Paul Golz Francesca Guerrera Oana Gui Sam Hinton Christina Kamposiori Suzanne Keene Damián Keller Eoin Kilfeather Jinhee Kim Nick Lambert Michael Lesk Eleanor Lisney Maria Luce Lupetti John Maccallum Lindsay MacDonald Marianne Markowski Sarah McDaid Murray Mckeich Lorna Moore Tessa Morrison Teoma Naccarato Rebecca Norris

vi

Irida Ntalla Joe Osmond Irini Papadimitriou Jeremy Pilcher Gareth Polmeer Anne Prugnon Elke Reinhuber Vasilis Routsis Sara Salevati Anna Shvets Rita Silva Carl Smith Allison Smith Meehae Song Terry Trickett Augoustinos Tsiros Jonathan Weinel Brian Wichmann Katrin Wolf Chris A. Wright Dalia Yassine Jing Zhou Tobias Ziegler 洁吴

Contents MONDAY 11TH JULY 2016 Pre-Conference Symposium From Analogue to Digital in Literature and Art.......................................................................................................1 Tula Giannini & Jonathan P. Bowen

TUESDAY 12TH JULY 2016 Music I Revealing the Colours of the Apocalypse..............................................................................................................5 Terry Trickett Novel Designer Plastic Trumpet Bells for Brass Instruments..............................................................................10 David Gibson Approaches to Visualising the Spatial Position of Sound Objects.......................................................................15 Jamie Bullock & Balandino Di Donato

Keynote The Technology of Animation..............................................................................................................................23 Lincoln Wallen (CTO, Dreamworks, USA)

Music and Multimedia One Stone for Hermione Levi......................................…….……………………………………………………........24 Joe Osmond Performing the Super Instrument: Reaching Beyond Technical and Expressive Capabilities.............................28 Maria Kallionpää Live Coding, Live Notation, Live Performance.....................................................................................................34 Richard Hoadley The Imaginary Friend. Crossing Over Computer Game Scoring Techniques and Musical Expression..............42 Maria Kallionpää & Hans-Peter Gasselseder

Music II The Musicians of Memory – Compositional Silence and the Audio Visuality of Sound.......................................49 Joe Osmond A Perceptually Motivated Visualisation Paradigm for Musical Timbre.................................................................53 Sean Soraghan, Alain Renaud & Ben Supper What You Hear is Where You Are is What I Hear...............................................................................................61 Hans-Peter Gasselseder

The Arts Data Network Simulator with Visualisation with Classical Ballet..........................................................................70 Genevieve Smith-Nunes, Peter Cook, Camilla Neale & Paul Golz

vii

EVA London 2016, 12th−14 th July 2016 Contents

'Dissect the Insects': Transformative experiences...............................................................................................76 Dalia Yassine

Research Workshop Periphery Vision: Data as image.........................................................................................................................79 John Hillman Presence: An exploration of the real and veiled in museums and galleries.........................................................81 Eva Iova Musealia – an artistic and documentary research project....................................................................................83 Michael Wechner, Ulrich Suter & Titus Eichenberger The Hand and the Bond.......................................................................................................................................85 Gabriel Botasso & Simone Vizioli DDArtS: Towards designing digitally enhanced street art tools...........................................................................87 Paris Xyntarianos-Tsiropinas Methods of Ontological Remix.............................................................................................................................89 Kira DeCoudres Musealisation in Mobile Apps: A communitarian museum for Ilê Aiyê...................…….………...........................91 Rita Silva Atomic Memory and the Future Human.................................................................……………............................93 Kristina Pulejkova

WEDNESDAY 13TH JULY 2016 Arts I Species Explorer: An interface for artistic exploration of multi-dimensional parameter spaces.........................95 Andy Lomas Using New Media for Practice-based Fine Arts Research in the Classroom………..........................................103 Topher Maraffi

Keynote Melting Pots: Berlin Digital meets Berlin Culture...............................................................................................111 Andreas Bienert & Eva Emenlauer-Blömers (National Museums in Berlin & EVA Berlin, Germany)

Arts II Digital Islamic Art: The use of digital technologies in contemporary Islamic art by artists in the UK.................116 Sara Choudhrey Movement Awareness through Emotion Based Aesthetic Visualization............................................................124 Steve Dipaola, Sara Salevati, Kristin Carlson & Thecla Schiphorst An Intelligent Pen-Based Online Education Platform for Design Sketching Instruction.....................................133 Wayne Li

Arts and Photography VENOMENON – A multilayered visual experience............................................................................................142 Elke E. Reinhuber Virtual and Augmented Reality in the Art of Lucio Fontana...............................................................................144 Agata Marta Soccini

viii


Alternative Visualisations of Cities: Drone shooting as a new dimension in urban photography.......................150 Murat Germen Using Artificial Intelligence Techniques to Emulate the Creativity of a Portrait Painter.....................................158

Steve Dipaola & Graeme McCaig Education and Museums Across Education and Interaction: How TEL and WELL can serve museums and their visitors.......................166 Francesca Guerrera Information Design for an Interactive Academic Space.....................................................................................170 Cristina Portugal & Natalia Brunnet JourneyMap: Visualising the time-bound student journey.................................................................................178 Daniel Buzzo & Philip Phelps Virtual Reality Tour of the “Focus of Favorites” Exhibition at the Gilcrease Museum........................................186 Will Smith, Andy Couch, Robert Pickering & J. C. Diaz

Workshop Context Engineering Experience Framework....................................................................................................191 Carl Smith

Demonstrations The System of Graphs in Music Harmony: A user interface for mobile learning game development................193 Anna Shvets Whist: Dance theatre and Virtual Reality...........................................................................................................195 Esteban Fourmi, JiaXuan Hon & Aoi Nakamura

THURSDAY 14TH JULY 2016 Mathematics and the Arts Alan Turing: Virtuosity and visualisation............................................................................................................197 Jonathan P. Bowen Visualisation of Predictive Mathematical Models using 3D Computer Graphics and Animation........................205 Dylan Gauld Poetry Beyond the Turing Test..........................................................................................................................213 Wayne Clements

Keynote The Museum Speaks – Your Narrative or Mine? The Museum in a Web 2.0 World.........................................220 Susan Hazan (The Israel Museum & EVA/Minerva Jerusalem, Israel)

Museums Using Data Visualisation to Tell Stories about Collections................................................................................221 Olivia Vane, Stephen Boyd Davis & Florian Kräutli Between the Virtual and a Hard Place: The dilemma of digital art museums....................................................229 Helena Barranha Curating Digital Life and Culture: Art and information........................................................................................237 Tula Giannini & Jonathan P. Bowen Learning Computing Heritage through Gaming – whilst teaching digital development through history.............245 Jim Wood, Haiming Liu & Thomas Briggs ix


Theory and Practice Posthumanism: The human body transition.......................................................................................................253 Anna Nazo Sublating Time: Hegel’s speculative philosophy and digital aesthetics.............................................................257 Gareth Polmeer Ask the Audience...............................................................................................................................................265 Sophy Smith

Demonstrations Recoding Cities..................................................................................................................................................271 Luca M. Damiani Observing Collective Thought............................................................................................................................273 Ian Willcock An Interactive Music Playlist Generator that Responds to User Emotion and Context......................................275 Darryl Griffiths, Stuart Cunningham & Jonathan Weinel

Workshop The Remarkably Difficult Psychology of Creative Visualisation.........................................................................277 Derek J. Smith

Music and Dance The Trumpet Shall Sound: De-anonymizing jazz recordings.............................................................................279 Janet Lazar & Michael Lesk A Practical Approach to Using Motion Capture in Performance Dance.............................................................284 Paul Golz, Chris P. Bowers & Marc Price

MONDAY 11TH JULY – THURSDAY 14TH JULY 2016 Exhibition and Digital Futures The Lumen Prize at EVA London 2016.............................................................................................................286 Nicholas Lambert (Chair, Computer Arts Society) Connected Digital Artworks................................................................................................................................287 Sean Clark 3D LIDAR Rapid Prototype Relief Model of the Jurassic Coast........................................................................289 Jeremy Gardiner Real-time Messaging Platforms for Storytelling and Gamification in Museums: A case history in Milan...........291 Stefania Boiano, Pietro Cuomo & Giuliano Gaia

Author Index...................................................................................................................................................294

x

Author Index Barranha, Helena ...............................................229

Gaia, Giuliano ....................................................291

Bienert, Andreas ................................................111

Gardiner, Jeremy ...............................................289

Boiano, Stefania ................................................291

Gasselseder, Hans-Peter ..............................42, 61

Botasso, Gabriel ..................................................85

Gauld, Dylan ......................................................205

Bowen, Jonathan P. ...............................1, 197, 237

Germen, Murat ...................................................150

Bowers, Chris P. ................................................284

Giannini, Tula .................................................1, 237

Boyd Davis, Stephen .........................................221

Gibson, David ......................................................10

Briggs, Thomas ..................................................245

Golz, Paul ....................................................70, 284

Brunnet, Natalia .................................................170

Griffiths, Darryl ...................................................275

Bullock, Jamie ......................................................15

Guerrera, Francesca ..........................................166

Buzzo, Daniel .....................................................178

Hazan, Susan ....................................................220

Carlson, Kristin ..................................................124

Hillman, John .......................................................79

Clark, Sean ........................................................287

Hoadley, Richard .................................................34

Clements, Wayne ..............................................213

Hon, JiaXuan .....................................................195

Choudhrey, Sara ................................................116

Iova, Eva ..............................................................81

Cook, Peter ..........................................................70

Kallionpää, Maria ...........................................28, 42

Couch, Andy ......................................................186

Kräutli, Florian ....................................................221

Cunningham, Stuart ...........................................275

Lazar, Janet .......................................................279

Cuomo, Pietro ....................................................291

Lambert, Nicholas ..............................................286

Damiani, Luca M. ...............................................271

Lesk, Michael .....................................................279

de Coudres, Kira ..................................................89

Li, Wayne ...........................................................133

Di Donato, Balandino ...........................................15

Liu, Haiming .......................................................245

Diaz, J. C. ..........................................................186

Lomas, Andy .......................................................95

Dipaola, Steve ...........................................124, 158

Maraffi, Topher ..................................................103

Eichenberger, Titus ..............................................83

McCaig, Graeme ................................................158

Emenlauer-Blömers, Eva ...................................111

Nakamura, Aoi ...................................................195

Fourmi, Esteban ................................................195

Nazo, Anna ........................................................253

294

EVA London 2016, 12th – 14th July 2016

Neale, Camilla .....................................................70

Wood, Jim ..........................................................245

Osmond, Joe .................................................24, 49

Xyntarianos-Tsiropinas, Paris ..............................87

Phelps, Philip .....................................................178

Yassine, Dalia ......................................................76

Pickering, Robert ...............................................186 Polmeer, Gareth ................................................257 Portugal, Cristina ...............................................170 Price, Marc .........................................................284 Pulejkova, Kristina ...............................................93 Reinhuber, Elke E. .............................................142 Renaud, Alain ......................................................53 Salevati, Sara ....................................................124 Schiphorst, Thecla .............................................124 Shvets, Anna .....................................................193 Silva, Rita .............................................................91 Smith, Carl .........................................................191 Smith, Derek J. ..................................................277 Smith, Sophy .....................................................265 Smith, Will ..........................................................186 Smith-Nunes, Genevieve .....................................70 Soccini, Agata Marta ..........................................144 Soraghan, Sean ...................................................53 Supper, Ben .........................................................53 Suter, Ulrich .........................................................83 Trickett, Terry .........................................................5 Vane, Olivia .......................................................221 Vizioli, Simone .....................................................85 Wallen, Lincoln ....................................................23 Wechner, Michael ................................................83 Weinel, Jonathan ...............................................275 Willcock, Ian .......................................................273

295

EVA London 2016, 12th – 14th July 2016

296