SITE : STAGE : STRUCTURE is an archival documentary project. It is a Transmedia Installation that integrates books, objects, photographs, short films, audio narratives, and heritage walks as a way of revitalizing memories and telling a history that is absent from the formal narratives.
Mazgaon is a port and dock area of Mumbai with a rich heritage and complex history. An integral and once central part of the city seems to be almost abandoned, its history neglected, its heritage slowly corroded by the passages of Time and the amnesia of people.
The series of photographs is a cross section of a layered and multi-tiered space, which comprises historic architecture and iconic landmarks amidst more eclectic mix of temporary setups, chawls, shanties, tenements and its inhabitants. The highlight of the exhibition are the paintings, each presenting an important aspect of the city’s history and heritage; as well as photobooks of Mazgaon that document the changing demographic and visual identity of the space. The project maps Mathar Pacady – a catholic village, the remnants of Chinatown, a Bohri (a sect within the Shia Islam) family’s apartment and Darukhana where ships are brought to be torn apart on the dry dock. The project works in multiple directions by documenting the life and living conditions of these diverse communities within the area and the relationships and dynamics of people and places spanning 300 years into the past. Here I fight nostalgia by documenting it, recreating it through videos, conversations and staging ethnographic reconstructions of people’s homes.
Mazgaon has been important to me – my grandparents have lived in Mazgaon for 42 years, for more than my entire life. During school summer vacations, I visited their home and was taken to the famous Mazgaon Gardens. The Garden located on a hilltop offers stunning views of the docks, the ships and the urban landscape of Mazgaon and beyond. This vivid memory has remained with me and I was keen to revisit the space now as an artist.
Historically, Mazgaon has been important to Bombay. Slowly over a period of time, this importance has shifted and declined. Mazgaon has moved from the center of the city to its sidelines. Sites are explored through the lens of history and heritage by looking at the importance of each of these spaces to Mazgaon and to Bombay, and how collectively they formed Mazgaon.
Mazgaon is a vast and changing space. Between the heritage and historical spaces, there are newer spaces. Some of these are devoid of significant history, while others are waiting to be assimilated into the historical and cultural narratives of the future.
Sites revisited on a daily basis over a period of two years have resulted in these spaces becoming ‘stages set for the performances of the everyday’. This transformation is something that I want to make transparent as an experience.
Slowly documenting the Site gives way to the viewing of specific elements – doors, windows, elevations and props. As individual elements they provide the setting and the drama of life – Trivia and personal histories form the script; the seemingly ordinary architecture as well as the normal unassuming people of Mazgaon transform into the set, location and protagonists of the narrative.
Structure is involved with the architectural aspects of the space – the individual houses, individual structures, and personal spaces – the interiors. This leads to another level of enquiry that is concerned with the intimacy and privacy of space as memory.
The Project is a focused attempt to document the history and the present conditions of the people of Mazgaon. They contribute to the city’s self-knowledge as a place with a conflicted and tangled cosmopolitan past. Such projects enrich Mumbai’s art scene by offering something other than aesthetic wall hangings and floor pieces, or theory-laden group shows. In an era in which rightwing groups continue to insist on Mumbai narrowly as a Hindu Marathi city, counter-historical practices like SITE : STAGE : STRUCTURE serve much more than ethnographic curiosity.
Each aspect of the current exhibition can be extrapolated into a substantial body of work. At the same time this existing body of work needs to be disseminated beyond Bombay because it’s not the story of Bombay in itself, or the way Mazgaon has changed. Mazgaon is exemplary of the way several spaces/places in the country and the world are changing – silently, and without our knowing about it. It is like a falling teacup that we don’t see till it shatters. Fortunately Mazgaon and other places like that haven’t shattered yet. But they’re falling. It is up to us how soon we can look at them and how soon we can arrest that fall.
Memories matter in any day and age - I believe in the saying, “Those who forget history, are bound to repeat it”. In the context of the city and its people, the easiest thing would be to forget people who live beyond the perimeter of our immediate vision, but in doing so we condemn ourselves to be forgotten by others – A fairy tale, the origin of a deity, stories of old men recounting childhood and parents, origins of their home, recounting of a 75 year old friendship that lasted relocation to Calcutta and back, the memories of ‘Paradise Lost’ – accounts that do not enter a formal narrative – information that in the grander scheme of things seem not as important, but which we cannot afford to forget.
In this meandering process, I had the good fortune of being introduced to Rafique Baghdadi, a journalist and amateur historian living in Mazgaon for the last 60 years. His unparalleled knowledge, insight and his long lasting relationships with the various integral communities have allowed this project to take the shape it now has.
This project is a documentation of my intimate connection with various people, strangers whose lives are an open book to me. I realized how something as intangible as a community could be reflected very concretely in architecture, colours and spaces, and most importantly in the people, those who hold on and treasure its past as well as those who look towards its future.
This is Mazgaon from 2012 to 2014.
Ali Akbar Mehta
Violations of international human rights conventions
To some it was good news when the universal right to freedom of expression, including creative and artistic expression, was reaffirmed in a joint statement by 57 states at the Human Rights Council Session 30 on 18 September 2015. In reality it was really bad news that less than a third of all UN member states were supportive. All UN Member State should respect international human rights conventions and the rule of law. Speaking on behalf of the original 53 States joining the statement (some of which actually do violate those rights), the Ambassador of Latvia, Jānis Kārkliņš, told the Council:
“In addition to being an integral part of the protected human right to freedom of expression, artistic and creative expression is critical to the human spirit, the development of vibrant cultures, and the functioning of democratic societies. Artistic expression connects us all, transcending borders and barriers. Artistic expression can challenge us and change the way we view the world.”
The major challenge is to convince all States to respect international conventions.
Repression by non-state actors
Even if all Member States of the UN did respect the right to artistic freedom, unfortunately huge regions of the world are controlled and suppressed by non-state actors such as Daesh/IS, Al-Qaeda and Boko Haram.
Their attitude toward artistic expressions is that of total control, total condemnation and total repression to any expression that they dislike. This poses a major threat to artistic freedom and the right for citizens to access artistic expressions.
Nationalism and religious orthodoxy
Nationalism and religious orthodoxy is spreading in many parts of the world – in the North as well as in the South, East and West. Controlling the minds and expressions of people is based on fear, and the tool of control is spreading more fear, leading to self-censorship, and to stereotyping of ‘the other’ whether these ‘others’ are cultural, religious, sexual or social minorities.
Behind messages such as ‘protecting our culture and nation’ and ‘protecting our moral values’, lies the fear of diversity of expressions, opinions and creativity. Has the world not learned anything from Hitler’s ‘Entartete (degenerate) art’ campaigns?
Lack of solidarity
Journalists all over the world support their colleagues through national, regional and international networks. Freedom of expression is built into the “DNA” of most journalists. That DNA does not come naturally to artists and artists’ organizations. Very few national artist’s organizations, international umbrella organizations and members of the well-endowed culture industry address artistic freedom violations. Even fewer support their colleagues – PEN International who support authors being the large exception as many members of PEN are creative writers. The documentation of violations and advocacy for artistic freedom is predominately made by human rights and freedom of expression organizations such as Freemuse.
Artistic freedom violations are underreported in many countries due to fear, self-censorship and repression. Attracting funding to support documentation is almost impossible, with some exceptions such as from the Government of Sweden. Donors tend to support media and internet freedom, and the small number of people dedicated to documenting violations of artistic freedom and advocating for it can easily be counted. This is a huge challenge
Ali Akbar Mehta talks to Kevin Lobo about his project ‘256 Million Colours of Violence’, Manifestations of Violence, Big Data Ethics and the urgency of asking questions. They discuss tools of inquiry used and attempt to dissect the various narratives presented through the survey. Inquiries into colour, violence and their perceptions can lead to multiple directions – the conversation looks at how the narrative experience of colour may be embodied, embedded and extended in the contexts of these meanings.
The conversation was conducted in Piramal Museum of Art, as part of Limitations of Liability.
Limitations of Liability was an eight day program between March 17 to 28, 2017, structured around ‘256 Million Colours of Violence’ – an interactive survey-based-research project by contemporary transmedia artist, Ali Akbar Mehta. The project began in 2016, and now includes more than 200 entries of people from all walks of life. 256 Million Colours of Violence is available to the public for free. The exposition of the past survey results were installed along with a participation booth at The Mumbai Assembly and Harkat studios inviting everyone to participate in the ongoing survey.
256 Million Colours of Violence Complete Artist Note: http://www.256millioncoloursofviolence.com/about
Limitations of Liability was held across three venues in Mumbai:
- The Mumbai Assembly (Bandra),
- The Piramal Art Foundation (Lower Parel) and
- Harkat Studios (Versova)
The program also included spoken word performances, talks and discussions, and a series of films screenings concerned with the subject of violence and trauma.
He is a Contemporary Artist working in diverse media ranging from oil painting and drawing to digital painting, photography, video, documentation and archival work.
His art practice has been concerned with creating new archetypal images involving Contemporary and Hybrid Mythologies, investigating the themes of the Hero and his/her position in contemporary society, the nature of violence, and identity. The concept of the mythic Hero and the link with a radical, transformational violence has fascinated him ever since his childhood involvement with graphic novels, cartoons and comics. A great deal of his visual vocabulary has been influenced by science fiction, manga, animation, cinema, music, mythology, philosophy and cultural anthropology.
He collaborates with robotic engineers, computer programmers, musicians, writers, theater and filmmakers and aims to found processes that would leave deep impacts on contemporary culture, technology and knowledge. He is also a poet.
In the last 10 years, he has established a multidisciplinary practice involving traditional drawing and painting, Digital painting, Photography and bookmaking. His background in 3D Animation, VFX and postproduction has facilitated an ability to support his Art practice forming a parallel body of work.
His desire to integrate these two streams of work have led to explorations in new directions of Transmedia performance installations, sound and video creation.
He is currently pursuing a Master’s Programme in Visual Contemporary Culture in Art at Aalto University’s Art, Design and Architecture Department, Helsinki, Finland; where he aims to explore digital technology in all its manifestations of audiovisual content creation, archival and documentation possibilities, and most importantly the hybridization of reality and sensory world building.
Born August 1983.
BFA (Painting) Sir J.J. School of Art, Mumbai, 2005
MFA (ViCCA) Aalto University of Art, Design and Architecture, currently studying
Visit the project: http://www.256millioncoloursofviolence.com
256 Million Colours of Violence is a survey based interactive archival research project that asks the participants to choose a colour that to them represents violence. The project started as a response to the specific events unfolding after the Malegaon Blasts 1 (2006, India). Now, a decade after the event, this response has grown to encompass several other events in a world that is radically changing.
An inquiry into colour can lead to multiple directions. Colour is troubled light – a violently oscillating frequency entering our optical system that is translated by the visual cortex of our brain. When Newton split light into the visible colour spectrum it was science.Colours have become symbolic of emotions and thoughts, taking on animate qualities and connotations that surpass their scientific properties. Colour is a central feature of social life yet its value in sociological theory is ambiguous. Colour in its perception is familiar and intuitive and subjective in its meaning where we seldom understand it beyond the parameters of our own consentual social reality.
The relationship between colour and perception is fundamental, and this project is an attempt to dismantle our selves through our understanding of colour. Perception is informed by Context. The human eye is capable of distinguishing millions of colours, but total objective colour acuity is a skill more rarified than perfect pitch (the ability to identify a single musical note without accompaniment). Most of us need context in order to make accurate colour recognition but when coupled with the proper context, we notice very subtle differences in hue, lightness, and intensity.
Colour and its perception are an unstable and contestable phenomenon shaped by personal memory and social and material factors. Similarly, Violence and its perception are an unstable and contestable phenomenon shaped by social and material factors. When colour is coupled with a subject as topical as violence, we probably have a deeply personal and unique emotional response to it. Most of us, having a sufficiently distinct understanding of things could probably assign a colour value in terms of a quick interface of the emotional quotient associated with it. This often cannot be verbalised but may be linked to a sensory memory or association – this kind of attribution is done not as an intuitive understanding but rather as a Pavlovian learning 2 or an acquired understanding. Despite having no inherited political value, colour can be made political through a sequence of contextual references. Colour can become a complex dataset presenting a person’s nuanced understanding of the world. The format of the survey is intended to gather this understanding.
Most Data mining exercises and empirical scientific surveys require a culled group in order to eradicate diversity, a standardisation of the test group to remove ‘noise’. ‘256 Million Colours of Violence’ is a celebration of that noise which represents the diversity of Human experience and collective memetic history. It is also part of an ongoing discourse to reduce effects of stereo-typification through personal scrutiny of the word and meanings of ‘Violence’ by asking how is the narrative experience of colour embodied, embedded and extended in the contexts of these meanings.
The aim of the Project is also to make the participant aware, or conscious of his/her decision regarding their choice by embedding it within series of contexts. Choice here is an active participation as well as a subliminal interfacing of several seemingly disconnected values.
Political parties and media are comfortable with the political position of attributing ‘no colour’ on religious, community or ideology based acts of violence so as to avoid issues of colour associations and its apparent, actual or perceived impacts on society. The inherent logic of the project takes their view and reverses it by stating that “Violence has a colour – it is a value of an acquired understanding unique to each individual.” The project is an artist experiment based on no previous survey or standardisation. The choice of the participants are purely their own, which is to say formed by unique combination of various elements such as parenting, religion, gender, social circles, peer group and education to name a few.
The project is addressing the notion of freely given information, conditional agreements and consent – to corporations and governments, as opposed to an artist project; that an artist may be require to profile its participants in itself seems like a joke. The survey hints at issues pertaining to equality of gender, skin colour, race and ethnicity; questions privilege, social class and problems of minimum income as well as confronts through inquiry the political-religious-socio-economic quadrangle as a constant existence in our lives today. It also acts as an introductory archive of several streams of information, and as such occupies a paradoxical position making the viewer/participant both the giver and receiver of information, if they so wish.
To this end, the viewer/participant is confronted with a question:
What according to you is a colour of violence?
If I ask you this question, chances are that you already have a colour in mind. It’s probably a very strong colour, resonating with intensity of how important this question may be to you. You probably have a specific colour in mind, you just need to pinpoint it specifically to lock it down – to triangulate its position on the map of the colour chart, as it were.
This might be easy to do in a palette of 8, or 16, or even 64 shades. As a choice, it may even fit into a colour that may be generic template for the question – but what happens if you are confronted with a digital palette of 256 million colours 3? Is your particular tint/shade/hue the exact same tint/shade/hue as the one you had in your mind – is your black / saffron / green / white / red the same as another’s?
Ali Akbar Mehta
- The Indian Connection – The Malegaon Bomb Blasts, 2006 and ‘Saffron Terror’:
Saffron terror is a neologism used to describe acts of violence motivated by Hindu nationalism. The acts are allegedly perpetrated by members, or alleged members of Hindu nationalist Rashtriya Swayamsevak Sangh (RSS) and Abhinav Bharat. However, in some cases the motivation for the acts has not been clearly determined, and in others it has been determined to be unrelated to Hindu nationalism. The term comes from the symbolic use made of the saffron color by the Hindu nationalist organisations.
The first known use of the term ‘Saffron Terror’ is from a 2002 article in Frontline. However it was in the aftermath of the 29 September 2008 bomb blast in the predominantly Muslim town of Malegaon in Maharashtra that it came to be used widely. In late 2008, Indian police arrested members of a Hindu terrorist cell allegedly involved in Malegaon blast. The blame for several of these attacks had been placed on radical Islamist groups.
Former Home Minister of India P. Chidambaram urged Indians to beware of “Saffron terror” in August 2010 at a meeting of state police chiefs in New Delhi.
Since that remark was made, a Hindu Swami in the Patan district has filed a defamation lawsuit against Chidambaram, saying that the saffron color is symbol of Hindu religion and that saints across the country wear attire of the same color. The Swami also said that saffron was a symbol of peace, sacrifice and God, and that Chidambaram has hurt the sentiments of Hindus by linking the symbol with terrorism. On 6 September 2010, a Gujarat court ordered a probe into the use of the term by Chidambaram. Chidambaram was also criticised by members of his own party (the Indian National Congress) for the use of the term.
“Saffron or bhagwa or kesariya (Hindi equivalents of saffron) is not the issue here. The issue is terrorism. Terrorism does not have any colour other than black,” said Janardan Dwivedi, Congress general secretary and head of the party’s media department.
Making plain the party’s disapproval of Chidambaram’s controversial formulation, Dwivedi said terrorism could not be associated with any color, “be it saffron, green, white or red”. He further said, “Terrorism is terrorism and should be opposed in whatever form it comes.” Significantly, he also stressed that “saffron colour has been part of our ancient tradition and is associated with our freedom struggle”.
Home minister P Chidambaram did not exactly use the phrase ‘saffron terrorism’ but made it clear it was not his patent and in the past UPA and Congress leaders have found it quite expedient to refer to ‘saffronisation of education’ to target the previous NDA government.
While vowing that he would follow the ‘party line’ as supreme, the minister said there were right-wing extremist groups and the message that they could be capable of violence should not be lost in phrases. He said, “Perhaps the use of that phrase has brought home the message. So, the purpose, in a way, has been served.”
- A method to cause a reflex response or behaviour by training with repetitive action. The Russian physiologist Ivan Petrovich Pavlov conditioned dogs to respond in what proved to be a predictable manner.
- Photoshop has a digital palette of 256 Million Colours.
- The Indian Connection – The Malegaon Bomb Blasts, 2006 and ‘Saffron Terror’:
Cinema Militans Lecture
by Peter Greenaway
Cinema died on the 31st September 1983 when the zapper, or the remote control, was introduced into the living-rooms of the world.
Cinema is a passive medium. It might well have fulfilled many of the expectations of an audience of our fathers and forefathers prepared to sit back, watch illusions and suspend disbelief, but I believe we can no longer claim this to be sufficient. New technologies have prepared and empowered the human imagination in new ways. There is, as we all well know, brand new audiences out there who make up not just a television generation, but a post-television generation where the characteristics of the laptop are persuasive and generate new demands and create new benchmark standards. The ideas of excessive choice, personal investigation, personal communication and huge interactivity have come a long way since September 1983, and the act of cinema has had to exist alongside and be a partner to a whole new world of multiple-media activities, which have all intrinsically metamorphosed cinema itself. Interactivity and multimedia may well be words that are too familiar anymore to be truly attended to, but they are certainly the major contemporary cultural stimulants. How will cinema cope with them, because it surely must. If the cinema intends to survive, I believe, it has to make a pact and a relationship with concepts of interactivity, and it has to see itself as only part of a multimedia cultural adventure.
Once upon a time, cinema — after avoiding the issue, refusing to encompass it, pretending that the patient was not sick and the object not broken, so why try to cure one, and mend the other? — faced and tackled and adapted itself to a new technology of sound. The long existing, world-dominant entertainment technology of the so-called silent cinema changed almost overnight, and in essence it died. And it is virtually entirely buried. Who now watches silent cinema? Buster Keaton and Charlie Chaplin on television, and a small minority of film enthusiasts.
Whether we are going to like it or not, the same may well soon happen to so-called sound cinema.
This is a Militans Cinema lecture. I can afford to be militant. I have been given some license to be provocative, disrespectful, irritated and angry. And militant. The terms of this platform expect it of me. And I have been given this license for a second time. Last time I tried to make a little entertainment. With pictures and projected alphabets. And a few thorns. This time I want to make a heavier polemic. With thorns. Because my complaint is that now, after 108 years of activity, we have a cinema that is dull, familiar, predictable, hopelessly weighed down by old conventions and outworn verities, an archaic and heavily restricted system of distribution, and an out-of-date and cumbersome technology.
We need to re-invent cinema.
Every medium needs to constantly re-invent itself. We need now not to put new wine in old bottles, and certainly not to put old wine in new bottles, we need to put new wine into new bottles. You are allowed to recognize the wine, which is human ingenuity and imagination, and you are permitted to recognize the bottles, which is cinema, though I am convinced we shall be needing to change that name.
Current state of the cinema’s demise.
First, a brief run through of some of the current factors we all know about cinema’s demise.
Cinema in cinemas is undoubtedly not the popular art it used to be. In the 1930s, 1940s, 1950s, it is said that European families saw two films at the cinema every week. We can easily agree that you would be hard pressed to find a European family that would see cinema now in cinemas twice a year.
Statistics from the heart of the major Western film industry in Hollywood state that 75% of people see their cinema on television, 20% buy their cinema as video or DVDs, and only 5% view their cinema in places called cinemas.
In this country, I am told, the average Dutch citizen watches only two feature films in a cinema every three years.
The head of Kodak has stated that his company will not be manufacturing celluloid in 10 year’s time.
The poverty of official cinema distribution means that I cannot, and you cannot, see any film of your choice in any cinema of your choosing this afternoon, or even next week, and probably not next month, and possibly never. It is easier for me to see a minor painting by Caravaggio in a small Umbrian town than it is for me to see Kubrick’s “2001” in any cinema that would represent that film in the way it was manufactured to be presented.
Four thousand feature-potential films have been made in the U.S. every year for the last four years: 350 get some cinema distribution, 50 hit sensible distribution figures in 80 U.S. cities, lasting for about (on average) 10 days in a cinema. That is one reasonably distributed film for every week of the year. Twenty feature films a year hit the big time, 10 hit the very big time and four make it super big time. Four out of 4,000. Where do all the undistributed films end up? The usual places are “straight to video” or television, a third of them are dumped, though most filmmakers would not be so blunt as to admit it.
European newspapers were noisy in their complaints this year that the Cannes Film Festival was of poor quality, and followed it up soon after by saying that the Venice Film Festival was not much better. These two festivals are traditionally supposed to be a litmus paper to the life and health of the inventive cinema world. The reaction is no surprise. There is precious little invention in the cinema world, because traditional cut-and-paste, narrative, illusionistic cinema has had its day. We must move on. We must re-invent cinema.
It is a fact that there are more and more film festivals instituted every year, programming greater and greater numbers of festival films which are never seen again, films which have no hope of any cinema distribution; there is less and less informed film criticism in our newspapers, fewer and fewer serious programs about cinema on television, a fall in readership of film magazines, and greater and greater creation of media courses in the universities of the Western world. Confusing and apparently contradictory statistics? Well not necessarily. It would seem that something very similar happened at the decline of opera and classical dance as major cultural forces — although happening over a longer space of time — an excess of attention as the quality and proliferation declined, a propping up of the institutions by the dismayed, that the energy had evaporated, and a deterioration of quality and insight as the means of production apparently seemed easier.
Mallarme suggested that all the world is created to be put into a book. He might now say that all the world is created to be put into a film. Everyone wants to make movies. It is a sign of overkill and a state of exhaustion, resulting in banality and repetition. And we have arrived at a monoculture, single model of cinema all over the world. Hollywood product is made in Sydney, Tokyo, Shanghai, Rotterdam and London, and especially in London.
Perhaps we can say that the cut-and-paste, narrative, chronologically plotted, illustrated-text, illusionistic cinema has played itself out. If you believe it is still alive. Consider that they say a slow-moving, herbivorous and not very bright dinosaur, shot in the head on a Monday, is brain dead for a week, and can manage to wag its tail until the Friday, before the last breath leaves its body. Friday will soon be upon us.
However, however, however, all of which is no great cause for alarm or despondency, tears, sadness or nostalgia, but probably for jubilation, because it is a situation fitting to a recognizable pattern, and the exhaustion invariably coincides with rejuvenation. We should rejoice that the dinosaur is soon to be a fossil. We await those small creatures in the forest floor who will soon take over the world.
We have every right to be optimistic about the future as long as we are prepared to acknowledge “cinema is dead, long live cinema.” We can believe in the phoenix.
A medium is governed and shaped and perceived by the characteristics of its technology. The aesthetic-technology of cinema has lasted 108 years — but if cinema essentially expired on the apocryphal 31st September 1983 — then, from 1895 to 1983, is 88 years, the length of three generations. It would seem that the life of many aesthetic-technologies might fit into an exaggerated three generation lifespan, covering the activities of invention, consolidation and then a throwing away in anticipation of a new cycle. The prime time of fresco-painting technology in the Renaissance spans Giotto, the inventor of the primary technologies, through Michelangelo, the consolidator, to the restless Carracci brothers who experimented with oil-based techniques in association with the wet plaster, and essentially corrupted its primacy to make way for a significant change. The basic fresco characteristics existed before this cycle, and persisted after it, but the major significant work in the medium is created within this span of time.
Similar arguments can be put forward for the subsequent painting technologies of egg tempera painters on wood panels — van Eyck to Durer — and the first and second waves of post-baroque canvas painters — Bernini, Velasquez, El Greco — and then the painters of artificial light — Caravaggio and de la Tour, David, Goya and Delacroix. Cinema has responded to the theory very well. If you are a European, Eisenstein invents the language, Fellini consolidates the language and Godard throws it away. If you are American, then the cycle might read Griffith, Orson Welles and Cassavetes.
In all cases, the medium might continue wagging its tail, but in homage to, or in admiration of, a tradition, or to further mine fields already strongly prospected, or simply to enjoy the well-oiled machineries of production structures and studio facilities, there will be revisionist filmmakers, as in the 1973 to 1986 period — Coppola, Kubrick, Scorsese working the Fellini-Welles vein — and Woody Allen, the Coen brothers and Wenders working the Godard vein, and then the post-revisionists of the late ’80s, further trading, pastiching and homaging like Tarantino, Stone and Scott.
Running parallel to the last throws of the old medium, the technology changes — out of a desire for change itself, or because the bending of the medium creates various breaking points, or out of a wish to repudiate the past, or because the stretching of the previous technology generates huge improvements along the avenues of cheapness, swiftness, greater accessibility and greater ease of handling, and sometimes even because of the introduction of a brand-new base-energy source, which in the case of the moving picture industry, as in music, has been first magnetic tape, and then, as in so many other fields, the full explosion of the digital revolution.
If this theory of the three generations of invention, consolidation and rejection will not suit your perception of the progress of 108 years of cinema, cinema as an entire medium has always been slow and sluggish and resistant to vigorous change. Even a well-respected cinema director like Scorsese basically makes the same films, structurally and narratively, as Griffith, the founder of narrative in cinema. There are better emulsions, smarter equipment and superior publicity, but the same structures with beginnings, middles and ends, moving from a position of negative behavior to positive behavior on a largely Christian morality program, have not changed; revenge ordained and completed, wrongs righted, retribution obtained, success rewarded, innocents exonerated, finishing with happy closures — these are structures that are repeated over and over and over again — and they are structures that have previously been invented, employed and elaborated by the 19th century literary giants, Dickens, Balzac, Zola, Tolstoy.
When we are brought to realize that most cinema is illustrated text, we then have a further demoralization, to discover that of all these texts illustrated by cinema, few, if any, have advanced to even the early years of literary excitements of the 20th century. None, for example appear to have approached James Joyce.
The distances of language change and development traveled in cinema are slight compared to what has happened in the other media in the same 1895 to 1995 period. Consider the changes that have occurred from 1895 to 1995 in music — Strauss to Stockhausen via Schoenberg, or Debussy to Reich via John Cage; in literature — from Hardy and Mann to Borges and Perec. And getting closer and closer to cinema, consider that, in the theater, Chekov is alive in 1895, and by 1995, we have experienced Osborne and Pinter, Brecht and Beckett. And closer still to the ideals of a pictorial cinema, in painting, van Gogh, Gaugin, Cezanne, Malevich and Klee are all alive and well and kicking in 1895, and we have now have traveled to Warhol and Keifer via Matisse and Duchamp, Picasso, Rothko and Jasper Johns. It is difficult to imagine such changes in characteristics, language, attitude, perspective and immense plurality, in the march of cinema from 1895 to 1995.
Is this such an unfair comparison?
Consider the huge energies, the vast sums of money, the one-time large public audiences, the huge crowds of manufacturers and the sheer number of movies made throughout this century of years — with these factors doesn’t it seem we could have expected greater developmental thrust and pull and range of practice?
However, it is now too late. The game is over. We have lost our opportunity. We must roll over and start again. And we can.
I believe the last time we saw radical cinema-language change and novel cinematic invention was with the German cinema in the mid and late seventies — Herzog, Straub, Fassbinder and the early Wenders. After that, there has been little radical experiment and radical invention. Maybe there could not have been anymore, because by 1980, television had finally won the battle for the moving image experience.
After 1980 there is little evidence of investigative finances being put into the cinema media. The money, and the energy that always follows money, was being placed elsewhere, and the really interesting inventive minds of the moving image went to places where life was more stimulating — video experiments, Web-mastering, multimedia investigations, video clips, animation — the feature film was no longer the vehicle for major synthesis and change, the all-embracing symphonic form that encapsulated the total vocabulary. We can easily believe that Bill Viola is worth 10 Scorseses.
However important the factors are of social, political, economic and cultural pressure — the absolute strength of the medium is in its aesthetic, its relationship of language to content, its relevance to now, the ability to stimulate and entrance, provide stimulus to dream, legitimize imagination, set fire to possibilities, indicate what happens next, encourage wholehearted participation — and I would say — encourage wholehearted participation to the point of the panic of overexcitement. I believe cinema as we know it now, simply fails to do this. And I believe this, in some good measure, is due to four tyrannies.
The four tyrannies
In association with the cinema celebrations of 1995, with some considerable anxiety and some deep disenchantment about contemporary cinema, I planned an investigation into film language to see what about it was investigative, useful, autonomous and worthy of preservation, and, primarily, unique. What could cinema do, after a century, that no other media could do?
I constantly saw cinema as being easily deconstructed back into other media forms where what it had to say, could be said as easily and probably more forcefully and more efficiently in other ways.
We considered ten characteristics that seemed especial to cinema — light, the text, the frame, projection, props, music, scale, time, actors and the camera, and embarked on a series of citywide exhibitions, under the generic title the Stairs. We succeeded in placing a large exhibition in the streets and squares, parks and buildings of Geneva focused on the frame — erecting 100 wooden staircases across the city where a viewer was invited to climb a short flight of stairs to an eyepiece to examine a framing of the city, a wide-shot or a medium-shot or a close-up. The staircases remained in the city for 100 days, and the framings were available to all for 24 hours a day in sunshine and rain, moonlight and fog.
The scenarios of this living cinema-film of 100 viewpoints for 100 days were anything that might happen. You could watch a man take a dog for a walk. You could, if you were lucky, watch a dog bite a man. If you were exceptionally fortunate, you could watch a man bite a dog — the ordinary, the unusual and the extraordinary.
The first motive was to consider why cinema, along with all the other plastic arts, views the world within the confines of a rectangle, a parallelogram, within the boundaries of four right-angles? And when we do so indeed, what might that mean? And do we need to continue to do this, and how was the act of framing relevant to the act of filmmaking itself? And which single frame is the most relevant and is it possible to get the timing of the framing right? Was the single frame necessary, could we break it, explode it, could we re-invent it? What were the advantages and what were the disadvantages? And the most important question — was action, event and activity within the single frame separable from the single frame itself?
In 1995 we were privileged to place a second exhibition in the series in the city of Munich, and the subject was the act of projection. On the cathedral, the town hall, the opera-house, shops and shopping malls, offices, the police station, gasometers, churches and theaters, we made screen projections to simulate the essence of the cinema experience — 100 illuminated screens — pursuing a chronology of cinema history from simple black and white 1895 Lumiere projection through to color and the experimental ratios of the 1950s and ’60s, to the advent of the television ratios — 100 cinema screens alive with projected light all the hours of darkness.
This time the motive was to demonstrate the central cinema experience, the projection of light across a distance onto a framed space to be viewable simultaneously to a mass audience.
The exhibition in the series of the Stairs dedicated to props, the significance of the inanimate object in cinema — can you imagine a gangster movie without a gun, a telephone and a car, a Shakespearian feature without a skull, a dagger and a crown, Othello without Desdemona’s handkerchief — was eventually turned into an exhibition in Vienna called One Hundred Objects to Represent the World, and then into an opera of the same name that traveled the world.
No single characteristic of cinema is entirely separable from all the others, and I was beginning to see the characteristics as tyrannies, which were confining, straight-jacketing, even abusing the cinema, tyrannies that were perhaps destroying any further emancipation of the idea of the moving image in cinema. I finally saw those major tyrannies as the tyrannies of the frame, the text, the actor and the camera.
The tyranny of the text
Every film director, with precious few exceptions, has to have a text before he or she can have an image. From Spielberg to Godard, Lynch to Tarantino, Kubrick to Fassbinder. With the cinema that we have developed — though of course, it need not have happened that way — it is impossible to approach a studio or a producer with three paintings, four prints and a sketch-book of drawings, and expect to be rewarded with support to make a movie. The cinema is supposed to be an art and an industry of the image, yet we have a text-based cinema. Every film you have watched you can see the director following the text, and if you are lucky, making pictures as an after-thought. No surprise of course. We are all very sophisticated, even across all the language barriers, at making and using and receiving texts, written and spoken. Our educational systems are based on forcefully feeding the letters of the alphabet to reluctant children, and then to press home a necessity to amassing an understanding of words. As adolescents the reading procedures become more sophisticated, and as adults, continually persuaded practice, hones and refines and focuses our abilities — a systematic universal act of education in the word. You have a tongue. It will not speak comprehensively on its own, it needs training. Few, in proportion to the mass attendance at the textual altar, attend art school, design school, receive architectural training. You have an eye — can it truly see without being trained? Just because you have eyes, does that mean you can see? And if you can see, can you project and communicate your meaning indeed to those who also have had no extensive training of the eye?
Would you, could you, presume to write a sensible comprehensible letter, leave alone a novel, without undergoing intensive training in text?
It could be said that most of us suffer from considerable visual illiteracy, persuaded upon us by a text-obsessive educational insistence. Hence the reliance on the word, not the image. Derrida famously and wittily suggested that “the image always has the last word” — it is of course a false statement, the word always has the last word, and anyway isn’t a word an image?
In England and America, there is great and vigourous support for a writer’s cinema. We do not need or want or desire a writer’s cinema. We need a cinema-maker’s cinema. The cinema should not be an adjunct to the bookshop, servicing, illustrating literature.
The last three dominant significant cinema events have been “The Lord of the Rings,” a book — three books — “Harry Potter,” a book, probably eventually, four books, and “Spider-Man,” at least that is supposed to spring from a semi-visual source, a comic, but essentially an illustrated book.
In pessimistic moments, I would argue that you have never seen any cinema, all you have witnessed is 108 years of illustrated text.
The tyranny of the frame
We view all the plastic arts through a rigid frame. Since painting separated itself from architecture at the end of the Medieval period, it regulated its parameters, with very little exception, to fit four right-angles. And theater, with a proscenium arch, copied painting; opera and ballet arranged its scenarios and choreography to be seen in association with theatre’s proscenium arch stage-space, and cinema copied the theatre, and television copied the cinema, and then there are photographs squared up for painting-picture-frames and to fit the right angles of a book. This wholesale practice has become so traditional and orthodox, it is not questioned.
Retrospectively, it is the view through a window, though we are thinking now from a contemporary window point-of-view, since the major horizontal aspect window ratio of a cinema screen could not have been matched architecturally by a window much before the middle of the nineteenth century. But the analogy is important because traditional cinema insists on creating an illusionistic space to give audiences a window experience — a surveillance through a window frame out into a parallel universe connected to that which the audience physically experiences as it sits in the cinema.
There is no such thing as a frame in the natural world — it is a man-made, man-created device, a diagrammatically sharpened and regulated reaction to his own irregular horizontal view of the world bordered by the brow and the cheek-bones when the face is held rigid and the eyes kept steady. It is an ironic curiosity that the Japanese have tried to reverse the game by forcing man-devised frames into landscape design using the sea horizon as the absolute horizontal, and planting tall straight-trunked trees to make the vertical frame-lines — ironic and curious, since Oriental picture-making has steadfastly, until it came in contact with Western practices of seeing, eschewed the frame, not finding it at all necessary to use a frame to contain and shape the world.
And the frame in the cinema has ever restrictingly tightened. There used to be several aspect ratios open to a cinematographer, especially in the years of pre-standardization, and again when cinema tried to fight the effects of television with a rash of experimental ratios in the ’60s and ’70s, but now we have been steadily reduced to that most convenient of aspect ratio frames, the television frame of the ratio 1 to 1.33. And all professional film practitioners know the contortions and humiliations that cinema has had to experience to get its non-television ratio demands onto the television screen with letter-boxing, cropping, reducing, panning and scanning. Such has been this so dominant industrial practice that few television viewers are even remotely aware that they are not watching the real thing, but some particular television-convenienced version.
If the frame is a man-made device, then just as it has been created, so it can be un-created. The parallelogram can go.
The tyranny of the actor
To acknowledge and overcome the third tyranny, the tyranny of the actor, is perhaps not going to be so popular. It could be said that we delight in being tyrannised by actors. And I am going to have some difficulty in following through the premise that the cinema is not, and should not be a playground for Sharon Stone or a Sylvester Stallone or even a Nicole Kidman or a Robert de Niro, though in 108 years we have allowed and permitted it to be so. So many films are set up to create a space for an actor to perform, that it would seem sometimes that the cinema is a vehicle for their appearance alone.
There are many genres of painting in which the actor is absent, or reduced to the concept of a figure in a landscape. I am not advocating a cinema where there are no actors, where the human figure is not by inference the centre of our interest, but I will argue that the actor has to seriously share the cinematic space with other evidences of the world, has to be, in essence a figure in a landscape which is likely to give attention to space, ideas, inanimacy, architecture, light and colour and texture itself.
The legitimate supremacy of the actor in the viewing space is a characteristic of theatre, where the demands on his dominant visibility are essential to give credence to the suspension of disbelief in a patently symbolic world, but like it or not, the cinema should not be a species of recorded theatre, and the actor has to relinquish any supremacy he rightly might believe is his for the taking in the theatre.
It is of course not so familiar a condition to the actor who is led to believe by his profession that the camera should persistently centre his contribution, especially since we have created off-screens systems to excessively promote the actor and surround him with agents and managers, a sympathetic production system and a Press and publicity organisation who appear to need his public relations power. I have had actors complain that they are too much subject to the insistence of the frame, that their movements are too bounded by the demands of the composition, that they have to arrange their contribution to be subservient to a tree, a still life, a lighting space, shadows, darkness, various devices of invisibility, that I am more interested in their legs, feet, body, their given physical anatomy, the way they wear and shape their clothes, the physical space they occupy, the gestures they make, the pose they take, their weight on the floor, their relationship to a wall or a ceiling, rather than their face or their interpretation of a psychological role, or their skill at interpreting a narrative imperative. It is true I take many of my cues and precedences from painting where there are other considerations than human performance, but I believe the actor should take his contribution in association with a sense of ensemble with the world and certainly ensemble with the cinematic language. We have developed a cinema where the identification of an actor’s emotional and psychological performance is considered to be the key to an audience’s response. This is limiting, reductive and undersells the visual potential of cinematic language.
The tyranny of the camera
If the tyranny of the actor is difficult to accept, then the fourth and last tyranny is perhaps even more of a blasphemy — for it is the tyranny of the camera. We have to get rid of the camera.
The camera is a recording device. It gives us an image of the world that is mimetic, it reproduces what we put in front of it. The camera is not a painter. It has entered the cinema equation too high up the Richter scale — say at Richter six, where it would have been better to have entered at Richter zero — which of course is contradictory because there would have been nothing there, which of course is what my proposition is all about.
Two quotations. One from Picasso: “I do not paint what I see, but what I think.” The second from Eisenstein, certainly the greatest maker of cinema, a figure you can compare with Beethoven or Michelangelo, and not be embarrassed by the comparison, and there are few cinema-makers you can elevate to such heights. On his way to Mexico, Eisenstein, traveling through California, met Walt Disney, and suggested that Walt Disney was the only filmmaker because he started at ground zero, a blank screen.
The connection between the two quotations is suggestive. There is a necessity in a curious way to bypass the lazy, mimetic, passive recording eye — human or mechanical — and jump straight to the brain, the imagination, the seat of creation. And it is suggested that we have now the tools, and we can easily imagine the tools we shall have tomorrow, to make this happen. We should not want a cinema of appropriation, of mimesis, or reproduction of the known world, not even a cinema of virtual reality, but a cinema of virtual unreality.
The Renaissance contribution to the modern world in visual terms is usually couched in terms of forever and forever successfully reproducing reality. From Giotto to Masaccio, from Masaccio to Uccello, from Uccello to Raphael, from Raphael to Giorgione — you can choose your own chain of ever-rising realism.
It has been an upward success story in getting painted images to look more and more like the natural world — the gradual controlling of the technologies of chiaroscuro and scale, sculptural modelling, linear perspective, aerial perspective, anatomy, in order in the end, to reproduce what we already have around us. Is that such a success story? Should not the energies have been spent in more worthwhile, investigative pursuits, to pursue the possibilities of the inventive human imagination, probably the most complex and self-regarding phenomenon in the universe?
The real world is always going to be more real, more exciting, more terrifying, more dangerous, more appealing than the world that can be reproduced by the camera.
Should therefore cinema eschew ambitions of illusionistic recreation of the known world — its major pursuit — and attempt to manufacture the imaginative world alone?
My militant response then to the current circumstances of a dying aesthetic technology called cinema, jolted into the necessity of accepting the novelties of inter-activity and the revitalised possibilities of multimedia, is to shake out these tyrannies of the frame, text, the actor and the camera, and try to place product in the firing line of these polemics.
It is an arrogant assumption to think we can make cultural benchmarks, significant artefacts with which to measure the state of a total practice. Benchmarks, I suspect, are made only after the event. Did Dante know that he was making profound significance with “The Divine Comedy,” a work that self-confessedly suggests an attempt to unite the angels in their heavens with the stones on the road? Did the van Eyck brothers in Ghent with their triptych of the “Adoration of the Lamb,” or Michelangelo, with his view of known beliefs on the Sistine ceiling, know that they were both manufacturing works that would attempt to put everything in one place, ordered, systematic and comprehensible? Would Shakespeare and Cervantes have known that their cultural contributions would occupy the same sort of significance. And did Joyce in writing “Ulysses,” the most influential but least read of the 20th century’s novels, know that, by gathering together every known trope of narrative and storytelling and exposition of experience in words, and thereby having to invent a new sort of word exposition to realise it — did he have consciousness of the bench-mark he was making?
It maybe that the first total cinema masterpiece benchmark was Eisenstein’s “Strike,” made in 1924. From the start of cinema on the 20th December 1895 to Eisenstein’s “Strike” in 1924 is very nearly 28 years — the length of a generation. If the new post-cinema-cinema began on 31st September 1983 — until now — that is 20 years somewhere between next Tuesday and next Wednesday — we have 8 years to go to make the first masterpiece bench-mark of the new visual technologies.
The Tulse Luper Suitcases project hopes to address and answer and find, in a deeply investigative way, some answers to some of these concerns and anxieties. It certainly revolves around, and desires to exploit, interactivity and multi-media. The project is manufactured for exploitation in the cinema, on television, on one or more websites, as a serious collection of DVDs and in association with a library of books, with links to the making of theatre and opera, exhibitions and installations in museums and galleries.
To date, after 13 months of manufacture, there are three hours of highly wrought cinema material shot, edited, and hopefully to be projected on HD television, though as you will see tonight, two hours exist — because the industry is slow to take advantage of the revolution around us — on 35mm film. There are two published books, a play performed in German at the Frankfort National Theatre, and soon to be rehearsed and performed in 12 cities in Holland, and two exhibitions, one in Milan and one currently in Ghent. In the next thirteen months, there will be three new exhibitions – in England, Leipzig and Berlin, two theatre productions in Lille and Bremen, and three more hours of HD material, bringing us up to seven episodes in the 16-episode Tulse Luper saga.
The ambition is to make an integrated product viable and comprehensible in different forms for the first decade of the 21st century, that centres, as its cement and superstructure, around the life and times of its central character Tulse Luper, whose activities are multifarious, though perhaps like us all, he is a professional prisoner. Matching the atomic number of uranium, his life-history covers 92 years. He is 92 tomorrow, the 29th September.
The whole project is an attempt to make a gathering together of today’s languages, to place them alongside one another and get them to converse, and as far as cinematic language is concerned, to find ways out of the above stated tyrannies.
Considering the tyranny of the text
In the first place, though it still begs my anxious questioning of the creation of a visual medium through text, the substance of “The Tulse Luper Suitcases” was written out indeed in words, albeit with a text of some complexity that makes it looks more perhaps like a vertical and horizontal musical score than a conventional film-script.
It is not an adaptation of a book, or a play, or any phenomenon that saw light first as literature of any description. On the argument of “If it itches, scratch it” — the text therefore is much in evidence. I give you frequent doses of the text on screen.
There is a very necessary content reason for this, since it soon becomes evident that the film is happening, so to speak, as it is written, and is, in essence, the deliberate product of a writer, though quite how that shapes up, I do not want to reveal just yet, for that would give away the whole containing conceit of the thing.
Text usually shapes the cinema narrative and certainly provides the cinema dialogue. Conventional cinema seeks to conceal that written textual origin. In the Tulse Luper Suitcases there is no hiding of these origins, and the film is so full of narratives that narrative is often negated by excess, and certainly narrative is constantly interrupted and fragmented by side-bars and listings and sub-narratives, as to make conventional narrative continuity problematic.
Since it would seem text and image are a pair, often of unequal status, and there is much evidence to suggest they have co-existed in painting for much of its history – do not try to break up the unequal, uneasy marriage but seek to exploit it. Acknowledge that most of the images seen in cinema began as textual descriptions, deliberately use text as image, employ calligraphy and typography to define text as that very thing. Contemporary advertising has made of the combination of text and image, an art of its own, and cinema might do well to imitate and develop its exploits.
Considering the tyranny of the frame
Abel Gance with his film “Napoleon” in 1927 developed a three-screen projection, and intimated possible ways to use it. Wide shot, medium shot, close-up; back, front and side; landscape, portrait, still-life. To synchronise three 35mm projections in 1927 was not so easy and the technological experiment essentially stopped with Gance.
There was a wait of some forty years before the technology and thus the possibilities of the language could be resurrected. There was a spate of films in the 1980s where it became not uncommon, more than once associated with movies featuring Steve McQueen, but noticeably the device was a decoration to the narrative not substantial to it, and rarely added more than retinal excitement. Special feature events like the Tokyo Olympic Games with large sums of money to exhibitionistically flaunt, engendered essentially non-narrative multi-screen experiments, by offering only more sheer retinal stimulus and pattern-making, and such language is now the stable diet in pop concerts and video-walls, though rarely structured in other than illustrative and decorative ways.
The conventional cinema cinema still cannot perform multi-screen projection, and until such time it can and will, the single screen can suffice to be spliced, split and fragmented. Multiple screens imply a sense of choice. It is not easy to look at all screens with equal attention simultaneously, choice for major attention has to made, though those choices can be conducted and orchestrated by the director. New digital technology minimises Gance’s difficulties, though as suggested with a single screen agenda.
“The Tulse Luper Suitcases” endeavours to utilise and develop a multi-screen language in the various ways Abel Gance anticipated and certainly to take it beyond. Superb steadiness, immaculate framed edges are digitally edited on High Definition tape at increasing near real-time editing speeds. Before, during, after; past present future; fast, slow, slowest, repetitions, reprises, across screen devices of innumerable continuities, developing a language that equates more with human experience in its interactions between reality, memory and imagination.
One of the greatest potential excitements is the ability and freedom now to fashion the frame to suit the content. Very crudely, a snake travelling across the grass suggests a long horizontal frame, a giraffe, a tall vertical one. And morphing such a snake into such a giraffe can be accomplished with hands-on ease. The frame can be cut and cropped with various layers of density, overlap and metamorphosis.
Pre-Renaissance painting, having no imperatives to depict the real, played with subjective scale, and with condensed and simultaneous time, both considerations being relevant to the dictates of theological ideals.
Christ, at the Last Supper, being the most important figure at the table, was depicted physically larger than his disciples. Adam and Eve were tempted, ate the apple, plucked the fig leaves and were expelled from the Garden of Eden all in the same interconnected single space. These are expressionistic devices long explored by painting, and to a certain extent by flourishing comic-book arts, and certainly with renewed interest in the last 150 years after the long years spent pursuing the chimera of reproducing the apparent reality of the eye, real time and true scale.
The digital revolution technologies can re-explore these issues to make — to use a convenience concept-word — an animated cubism. Making for a God-like ubiquity, you can see both sides of the wall, insides and outsides, downstairs and upstairs, macrocosm and microcosm, all at the same time. The historical key markers to a philosophy of the moving image can be profitably revisited and revitalised – Muybridge sequential photography, Duchamp’s Nude Descending a Staircase, and Marey’s multiple-image fencers, dancers and athletes can resume significance.
The frame has come alive.
It is no longer a passive jail of four right angles.
Considering the tyranny of the actor
The tyranny or conventional dominant contribution of the actor has been considered for some time in the feature films I have made over then past twelve years within bounds of what could be described as a cinema of passionate detachment. It can be characterised by being sparing of close-ups, a desire not to cut the body unless absolutely necessary, and to be aware of the human figure as a strong compositional element within a self-conscious frame, any gestures or actions that are not sympathetic to the visual composition within a frame, will probably be rejected or simply not seen, or if considered a valuable contribution, re-shot, or reformatted to give them visual compositional significance. The camera views I normally employ would rarely be person orientated. For example I would never use an over-shoulder shot in a two-way conversation and viewpoints are constructed from the ideal position of the camera not the eye-line or viewpoint of the character.
In “The Tulse Luper Suitcases,” the use of the actor has been taken further in such directions, which I believe, and certainly many of the actors believe, gives greater scope to their contribution, whilst still holding them firmly within a space that denies orthodox actor dominance.
One of the major metaphors of the project is the saying that there is no such thing as history, there are only historians, that history, in effect, is a highly subjective business recorded with vested interests. Napoleon could have behaved like this, or like this, or like this. That this conversation could have been delivered like this or this or this. That this interpretation of the event could have been melodramatic or sentimental, melancholic or yet again pathetic. Consequently we have tried to give a cinema audience alternatives, certainly in keeping with the interactivity choices laid down in our ambitions, but also to demonstrate that there is no singular verity. We have often given these interpretations simultaneously or overlaid them with one another in a cubist-like phenomenon, editing and layering techniques which could probably only be achieved with the help of the new technologies.
Conventional cinema editing in true cut-and-paste chronology style, gives you one event at a time sequentially. The cinema has never been good, unlike the theatre for example, at simultaneity. The narratives as a consequence often behave like musical scores, deliberately full of repeats and reprises, variations on a theme, returns to explore thematic areas further and in greater detail, often using different actors to play the same role, to interpret the same material. So much is this a characteristic that, within the dramas themselves, the actors are often viewed as actors, though staying inside the film and not outside of it. We see their auditions. We often show different takes of the same action, a characteristic of cinema rarely seen by viewers but extremely commonplace to actors themselves and certainly to all those involved in the making of a film. So although the conventional virtuosity of the actor on screen is denied or at least abrogated to eradicate the tyranny of his contribution, a respect and an acknowledgement for the actor’s essential presence is certainly championed, even extravagantly championed.
Considering the tyranny of the camera
The spectrum of visual possibilities in the manufacture of the moving image is large, and traditionally the feature film only uses a small section of that spectrum, sufficient to realise an illusionist drama. Mixed visual genres in the cinema are not common. I suppose the combination of live action and the cartoon, noticeably celebrated in a film like Who Framed Roger Rabbit is an example, though it was an experiment not over-enthusiastically copied, and it was a drama that afterall pursued illusionist conceptions, another window-on the world construction, and any Tex Avery self-conscious anarchies, any breaking of the frame techniques, stayed within those conventions.
The days of strict adherence to the Platonic verities, observing singular time, singular place, singular treatment and singular subject, are long gone, and eclecticism is legitimate and honourable. It would be difficult to see how it could be otherwise in an information age with encouraged encyclopaedic thinking.
The supermarket of visual and dramatic possibilities is huge. I believe cinema should seize the opportunity to shop vigourously in the supermarket.
Watching virtually any four minutes of CNN News demonstrates what television has been doing for a long time, using a whole range of communication languages simultaneously. The introduction of more and yet more multiple pictures, lines of moving text, titles, sub-titles, inter-titles, animated diagrams, animated maps, insert talking heads, split screen conversations, has not noticeably created apoplexy in viewers, and though curiously I suspect consciously unaware of the gesture, it is becoming common now for the screen itself to be self referenced with fixed company logos — which really do demonstrate to the viewer that he is watching a screen, and not merely what is conveyed through it.
We have developed habits of visual selection. Largely we take what we want. We can ignore English-language moving text of stock market reports in Tokyo, whilst we focus our attention to watch animated diagrams of hurricanes in Florida, though peripherally we are aware that communications of the world are coming at us fast and furiously. Whilst feature films, Hollywood-style and art-house style, have been pursing the straight and narrow, television has been revelling in communication skills for a long time. Godard suggested that “We look up at cinema, but down at television”, a pointed reference at anatomical reality, but also at snobbish sloth. It is curious that cinema so long regarded as a vulgar medium by the traditional arts has adopted its own snobbisms in the face of competition.
It is a commonplace now that post-production is extremely sophisticated and permeates practically everything we see on screens — not just the ubiquitous dinosaur that is so believable, children are convinced they exist somewhere outside Jurassic Park and demand to see them at the zoo, but clandestinely, polishing up politicians, sexing-up entertainers, erasing mistakes, changing colours, brightening gloomy days, and of course the opposite, adding blood and smoke, transposing grief and pain from one location to another to suit public relations and political expediency. Many years ago, although admiring the technique, we were shocked at the way unwanted politicians disappeared from official Soviet Politburo photographs, such technical manipulations now are commonplace. The ethics are decidedly problematical. But the language, almost what we could call an anti-camera language, is extraordinary.
My fascination and inclination, being interested in process and wishing to demonstrate that process, as well as to give you end-results, solutions and closures, is to use it. If I am making a project whose central metaphor is “there is no such thing as history, there are only historians”, I need to use it. And indeed every possibility of communication by visual image is used. Drama elaborated, Chekovian, kitchen-sink, vaudeville, pantomime, cinema-verite, surveillance, operatic, melodrama, soap-opera, stripped down to a black box, worked up to a David Lean exuberance, pastiche amateur theatricals, talking heads, stand-up comic. And such uses of the actor’s trade are interspliced and elaborated with animated maps and diagrams, cartoon simplicities and cartoon complexities, static and animated texts, multiple typographies and multiple calligraphies. This is an anti-Dogme film. It exuberates and celebrates new cinema language.
Cinema died on the 31st September 1983 when the zapper or the remote control was introduced into the living-rooms of the world. Cinema as our fathers and forefathers knew it was a passive elitist medium, made expensively for the patronised many by the condescending few, with a distribution system that has made its own product virtually unviewable. Now we can break the monopolies, really start with an art of the moving image with viewer participation that can truly empower the imagination, diversify interminably, cater for all, and not patronise audiences. What was cinema? Rows and rows of people sitting still (and who in any other human occupation sits still for 120 minutes?), all looking in one direction (the world is all around you – not just in front of us), in the dark (man is not a nocturnal animal). With a cinema with characteristics like this, perhaps the sooner dead, the better.
Let us rid cinema of the four tyrannies of text, the frame, actors and the camera. But what are we talking about anyway? You haven’t seen any cinema yet, all we have seen is 108 years of illustrated text, and, if you have been lucky, perhaps a little recorded theatre.
Now a cinema of what you think and not what you lazily see is truly possible. Let us seize that nettle and begin the art of the moving image all over again. Every medium needs constant re-invention.
Let us now re-invent that cinema. We can. We now have the most amazing new tools to do so. Now we need the desire and the courage. And this new medium of the moving image will almost certainly not be experienced in those strange high-street pieces of architecture called cinemas.
So-called cinema was invented in 1895. It took 29 years, with Eisenstein’s “Strike” in 1924, to make the first benchmark masterpiece of this new aesthetic-technology of film. If a New Moving Image aesthetic-technology was baptised on 31st September 1983, then we still have a few year’s grace to invent its first benchmark masterpiece.
Well-aware of the dangers of the discrepancies of what I say matching with what I make, I offer you the first toe in the water of an ocean of possibilities in the multi-media, interactive project of “The Tulse Luper Suitcases” — cinema, television, Web site, DVD, library — as a candidate for that benchmark position.
This reading from the book took place at The Memorial of the Red Guards, who died during the Finnish Civil War in Pispala, Tampere. The inscription in the stone says, ‘On this Pispala ridge, the Red Guard in Tampere last stood with weopans in hand defending their cause in 1918’.
The project is ongoing and a copy of the book in its current state is donated to the Pispala Library on the occasion of the exhibition, ‘Where does poetry nest?’, on 6th September, 2016 in memory of the over 5000 year old Civil War that the world, it seems, has not seen enough of.
Ali Akbar Mehta
Missä runous pesii? | Where does poetry nest?
Poetry—an everlasting inquiry of art, drives language outside its borders. Poetry sets into play every possible moment of signification by placing the exercise of imagination at the center of all contradictions. Poetry as an aesthetic praxis outlines our possibilities to challenge the everyday, locating potential transformation at the centre of our political enunciations. Poetry contradicts and slips between the cracks of meaning, propagating evidence that something else is there. In its intimacy, it draws complex figures from our emotions, just to blur them into new and old unreachable impossibles, to keep us moving, desiring.
If we listen to poetry carefully, we realise that it is something social. Its sociality is voiced as a constant transgression to the de politicised forms of enunciation; these poetic echoes keep on challenging every space of retreat. Poetry captures tautology and pushes it to the edges. Since there is no purity in poetry, it confronts general assumptions with a subtle whistle that triggers a dance of our subjectivities, nude and broken out in sweat. There is nothing too radical for poetry; even if something has already been said before, it can always be said differently.
Poetry is looking back at us from the other end laughing, flirting, fugitive.
Poetry grounds utopia not as something reachable, but as a practice for keeping the unreachable present. Inhabiting between sentences, it bears testimony that other histories have always been present, through gluing their words together. Within it, art becomes our interlocutor for these other histories, always rebelling, always demanding justice and dignity, driven by the air which feeds change. Another history which finds in every wall not a border, but a place for public denouncement and mobilisation.
Where does poetry nest? It is not a question asking for an answer, but a question mark waiting to be followed. D.M.
[*] The Mexican artist David Alfaro Siqueiros recalled this question during his time in Lecumberri prison: “Where does poetry nest? I can’t say how long ago this question emerged within me. But it reemerged when I listened to Macario Huízar. And the first time I followed it through to interrogation was in prison among a group of dopers.”
In the relation between art and image, photography has played a symptomatic and often paradoxical role. Baudelaire made of it the sinister instrument of the triumph of technical reproduction over artistic imagination. And yet we also know of the long struggle of photographers (pictorialistes) to affirm that photography was not merely mechanical reproduction, but rather an interpretation of the world. But scarcely had they won their battle to endow the technical medium of photography with the status of artistic medium, when Benjamin turned the game on its head. He made mechanical reproduction the principle of a new paradigm of art: the productions of the mechanical arts were for him the means towards a new sensible education, the instruments of the formation of a new class of experts in art, namely in the art of interpreting signs and documents. Cinema was a series of tests of our world. Atget’s photos were indices to interpret; Sander’s collections were notebooks for teaching combatants in the social struggle to readily identify allies and adversaries. The photographic medium participated in the construction of a sensible world where men of the age of the masses could affirm their existence as both possible subjects of art and experts in its use.
It seems, nevertheless, that the destiny of the art of photography has no more confirmed Benjamin’s diagnostic than that of Baudelaire. To support this claim, we can point to two phenomena more or less contemporary to one another that concern both photography and its interpretation. On the one hand, the 1980s saw photography invade art museums and exhibitions, taking on the dimensions of monumental paintings. These large-format photographs, amidst the proliferation of installations and video installations, assure, in a certain sense, the continuity of the pictorial surface. But, at the same time, what they present to us on this surface seems to turn its back on the forms of the pictorial revolutions of the twentieth century. Without even speaking of extreme examples like Jeff Wall’s revival of the historical tableau, we can think of the multiplication of portraits and the new status of the portrait, illustrated by, for example, photographer Rineke Dijkstra’s monumental portraits of otherwise indifferent individuals, represented without any particular aura: slightly awkward-looking adolescents on working-class beaches, young mothers still burdened by their babies, or apprentice toreadors, whose red- faced figures clash with the bull fighter’s traditional suit of lights. On the one hand, these full-length portraits present themselves as documents on social types or age groups undergoing transformation. On the other, the absence of expression, combined with the formal- ism of the pose and the size of the image, gives these indifferent gures something mysterious: something that for us also inhabits the portraits of Florentine and Venetian nobility which populate the museums. The teenager in the green swimsuit photographed on a Polish beach, with her slender body, her swaying hips, and her unfurled hair (below) is like an awkward replica of Botticelli’s Venus. Photography is thus not content to occupy the place of painting. It presents itself as the rediscovered union between two statuses of the image that the modernist tradition had separated: the image as representation of an individual and as operation of art.
How should we think this new coincidence and tension between the grand pictorial form and simply the images of indifferent individuals? The interpretation seems, at first sight, split between two extremes: at the one end, an exacerbation of the sensible presence of the photographed subject, in its provocative power with respect to modernist logic; at the other, an integration of this photographic realism – or hyperrealism – into the modernist scheme. In the first instance, we think of course of Barthes and Camera Lucida, the absolute reference for thought on photography in the 1980s. Barthes’s manoeuvre was to break the representation of the indifferent in two. The indifferent is, on the one hand, that which is identifiable by the intersection of a certain number of general traits. On the other, it is the absolute singularity of that which imposes its brute presence, and affects by this brute presence. We recognize here the principle of the opposition between the studium, conceived as the informative content of the photograph, and the punctum, conceived as its affective force, irreducible to transmission of knowledge. This affective force is the transfer of an absolute singularity, that of the represented subject, to another absolute singularity, that of the viewing subject. It is easy to underline the double paradox of this theorisation in light of the ulterior evolution of photography. It privileges a vision of photographic reproduction where it is the having-been of the body that comes to imprint itself on the sensitive plate, and from there touches us without mediation. This raising of the stakes concerning the indexical conception of photography was immediately countered by the digital invasion. At the moment when large-format photography is about to overrun the museum walls and affirm itself as a visual art, it transforms the photographic gaze into the gaze of an individual who pages through albums. But this historical contretemps refers us back to a more fundamental torsion concerning the relation between photography, art and modernism. In a certain manner, Barthes contorts the formalist modernist, who opposed the form (artistic/pictorial) to the anecdote (empiricist/photographic). Barthes diverts the opposition by transferring the anecdote to the studium, in order to pit it against not the artistic form, but an experience of the unique that refutes the pretension to art as well as the platitude of information. However, this opposition between art and photography is perhaps more profoundly the leave given to another modernity, to which Benjamin’s essay bore witness, and that inscribed photography among the instruments of a new social sensibility and a new social consciousness (three elements and not two). It is from this point of view that it seems useful to me to examine more closely the examples through which Barthes operates the opposition between studium and punctum. Let us take, for example, Lewis Hine’s photograph of the two mentally disabled children (below).
Barthes tells us not to look at the monstrous heads or the pitiful profiles that signify the disability. Instead, he opposes to these the force of fascination that is exerted on him by the details without signification: the boy’s Danton collar, the bandage on the little girl’s finger.1 But the punctum thus marked, in fact, obeys the same formal logic as the repudiated studium. It concerns, in both cases, features of disproportion. The privilege of the punctum here is simply to privatize this formal effect. We can read this analysis as the exact reversal of the critical logic previously put to work by the Barthes of Mythologies. What was at stake for him there, in a Brechtian logic, was to make visible the social hidden in the intimate, the history dissimulated as the appearance of nature. From this point of view, the very choice of the photograph is significant. The photo of the two disabled children appears as a hapax (ἅπαξ λεγόμενον ‘[something] said only once’) in the career of a photographer who devoted numerous series to the representation of work and the campaign against child labor. The ‘stupidity’ of the detail drawn from the irreducible hardship and misfortune of the two disabled children can be read like a screen placed before other photos of children: that of the Polish child, ‘Willie’, working in a mill in Rhode Island, or Francis Lance, the 5-year- old newspaper ‘salesman’. Yet, these ‘documentary’ photographs are the bearers of a tension between visuality and signification that is perhaps more interesting than the image of the two disabled children. They are in effect made for the purpose of denouncing the scandal of child labor. Yet, Willie’s attitude, as he sits nonchalantly (taking his midday rest) in a doffer-box, or Francis Lance’s, proudly standing his ground on a train platform with his newspapers tucked under his arm, do not testify to any suffering. What strikes us is precisely the opposite: it is the selfsame ease with which they show themselves capable of both adapting to their work and posing for the camera, thus obliging Lewis Hine to insist, in his commentary, on the dangers of their work, which they themselves seem so unconcerned about.
The activity of the commentator seems to respond, in advance, to the ‘Benjaminian’ demand. It is, in particular, the relation between the child workers, the camera, the photo and the text that follows this logic, linking the appreciation of the photographic performance to new forms of ‘expertise’ and to the experimentation of a new sensible world. The Danton collar suffices to silently settle the accounts with this logic. The only sensible world that the photo witnesses is the relation of the absolute singularity of the spectacle to the absolute singularity of the gaze. Much the same can be said about Avedon’s photograph of the old slave.2 Here the procedure is reversed: no detail distracts from a sociopolitical reading. On the contrary, the mask of the photographed subject speaks of nothing else than the condition of slavery. But the effect is the same: it is slavery in person, as a historical singularity, that offers itself entirely in the singularity of a single face. To declare slavery to be present in person, in front of our eyes, between our hands, is, in fact, to diminish the singularity of the other photographs that speak to us about what took place between the abolition of slavery and our present. For example, John Vachon’s photo, which shows us only the sign reading Colored, nailed high up on the trunk of a pine tree, next to which is the likely object of its discrimination: a simple drinking fountain. The multiplicity of racial discrimination’s forms of sensible existence, and the multiple singularity of these photographs that vary, and thereby tell us of, the visual forms of the metaphor and of the metonymy, come to be crushed against this black mask that presents slavery in person. But this being of slavery identifies itself with its having-been. Avedon’s photo represents the slavery that is no longer on the face of a man who, himself, is no longer, at the time when Barthes wrote his commentary. When all is said and done, the singularity of slavery written on a singular face is nothing other than the universality of the having-been; in other words, death.
It is to this singularity that the image of the two disabled children, which conceals those of the playing children of the factories, ultimately comes down. But this singularity of the image is itself determined by the power of words alone. Taking up again the two traits of the punctum of this photo, it is rst of all the bandage on the finger of the little girl. The French word with which Barthes refers to the bandage is poupée. Yet the French reader who does not know this usage of the word immediately has another image. The ordinary sense of the word in French is ‘doll’. And the identification of this poignant detail with the poupée inevitability evokes a whole series of images: from Hoffmann’s automaton, commented on by Freud, to the dismembered dolls that are a part of the surrealist imaginary, and that contributed more than a little to the transformation of Winnicott’s transitional object into Lacan’s object petit a. In short, the effect attributed to the phraseless singularity of the detail is the power of a word. And this power of the word is further accentuated by the proper name that quali es another poignant detail: the Danton collar. The French reader has no idea what a Danton collar might be. However, the name is immediately associated with that of a revolutionary who had his head sliced off by the guillotine. The punctum is nothing other than death foretold.
The analysis of the photo of the two mentally disabled children is therefore linked with that which Barthes devotes to the photo of the handcuffed young man. The photo is beautiful, Barthes tells us, and so is the young man, but that is the studium. The punctum is that ‘he is going to die’.3 Yet this death foretold is not visible in any of the features of the photograph. Its presumed effect rests on the combination of the brown colouring of the old photographs and the acquaintance with the individual represented, (in this case) Lewis Payne, condemned to death in 1885 for an attempted assassination of the then American secretary of state. But this affirmation of present death once again employs words to deny what constitutes the visual singularity of the photograph – that is, precisely that its present refuses any readings of the young man’s history, of the past that led him there, and of the future that awaits him. The half-nonchalant, half-curious attitude of the young man says nothing about this history, much the same as Willie’s relaxed pose said nothing about the hardships of factory work, and the gaze of the Polish teenager on the beach nothing about what reasons she might have had for exposing herself, nor her thoughts as she stands in front of the camera. What they speak to us of is only this capacity to expose one’s body at the request of the camera, without, for all that, surrendering to it the thought and the feeling that inhabit it. This tension between exposition and retreat vanishes in the pure relation of the viewer with the death that comes to view him.
This disappearance is not only due to the fact that Camera Lucida is first of all a eulogy addressed to Barthes’s dead mother. Behind the expression of personal grief, there is the expression of another grief, that of the gaze that endeavoured to tie the appreciation of the beauty of an image to that of the social reality that it expressed. Yet, his second grief also manifests itself in a type of reading which, contrary to Barthes, sees in the new modes photographic exposition the reaffirmation of a certain idea of the objectivity of the photograph. It is this thesis that was defended in 1988 by a period defining exhibition entitled ‘Another Objectivity’ (Une autre objectivité). The accompanying text, by Jean-François Chevrier and James Lingwood, redefined, in its own way, the relation between two fundamental aspects of the modernist norm: on the one hand, the fidelity to the law of the medium; on the other, the fidelity to a certain type of exhibition surface, the forme-tableau in its formal separation from the multiple social uses of the image. The fact is that the law of the photographic medium does not offer itself up to a simple interpretation. We can liken it to the instrumental conception that makes the camera a means to furnish some objective information about what is in front of it. But, from this, we still have not defined the specificity of the art of photography. We can liken it to the reproducible character of the photographic image. But it is hardly possible to discern the specific quality of an image from the fact that it is reproducible. This is why the theoreticians of photographic objectivity displaced the idea of multiplication in favour of the idea of a multiple unity. Reproducibility thus becomes seriality.
Benjamin based his argumentation on the typologies of August Sander, while Chevrier and Lingwood favoured the works of Bernd and Hilla Becher. But the analogy is problematic. Benjamin expected that Sander’s series would help the combatants in the
social struggle to recognize allies and enemies. There is manifestly nothing of the sort to be expected from the Bechers’ series of water towers or disused industrial sites. They would even fall easily within the scope of Brecht’s critique, which was taken up by Benjamin: photos of factories say nothing about the social relations that manifest themselves there. The interest of the series can therefore no longer be looked for in what it enables us to say about social relations. It boils down to an ethical virtue accorded to the multiple as such, in that it rules out the prestige of the one and of the aura, of the unique moment and of the ecstatic contemplation. But this principle is purely negative. Its artistic ‘positivity’ must thus come from a second manner of thinking the ‘objectivity’ of the medium. This is summed up, for Chevrier and Lingwood, in the notion of the forme-tableau, exemplified by Jeff Wall’s backlit photographs. But what relation should we think between these large scenes in the form of historical tableaux and the identical rectangles that make the Bechers’ views of water towers and smoke- stacks resemble pedagogical charts? None, perhaps, if not the Greenbergian idea of the surface that encloses the artist’s performance and prohibits him from leaving himself, from showing empathy for his subject or from considering himself as a form of social experimentation. In this sense, the Bechers’ industrial sites are a manner of concluding the dream of the artist engineers and factory builders of Peter Behrens’s era, in much the same way as Barthes’s fascination with the Danton collar served to repress photographer Lewis Hine’s engagement on the side of the oppressed and forgot- ten of the factories and hospices. The reference to the essence of the medium is again here a manner of settling accounts with the epoch where the medium was thought of as the organ of a new collective world. Simply put, this settling of accounts is more complex in the case of the Bechers and the theoreticians of ‘objective photography’, for whom the repression of the constructivist dream also wants to be the affirmation of a fidelity to the values linked to the industrial universe and the workers’ struggle: the sobriety of the documentary gaze that refuses the humanist pathos, the formal principles of the frontal perspective, the uniform framing, and the presentation in series that links scientific objectivity and the disappearance of the subjectivity of the artist.
It remains the case: that which is given to see by the objectivist mindset is fundamentally an absence – disused edifices in the place of social classes and types. Yet, photographing absence can be interpreted in two ways: it can be a manner of showing the programmed departure of the industrial world and worker; but it is just as much a manner of playing on the aesthetic affect of the disused (desaffecté) that sends us back to the side of Barthes’s ‘having-been’. This tension in the objectivist idea of the medium is more perceptible still in the series of containers taken by a follower of the Bechers, Frank Breuer, presented during the 2005 Rencontres photographiques in Arles, in the transept of an ancient church, along with two other series, devoted to warehouses and to logos. From afar the spectator perceived them as abstract scenes or as reproductions of minimalist sculptures. Upon approaching, however, one discovered that the colored rectangles on a white background were containers stacked in a large deserted space. The impact of the series was down to the tension between this minimalism and the signification that it concealed. These containers were to be, or were to have been, filled with merchandise unloaded at Antwerp or Rotterdam, and probably were produced in a distant country, perhaps by faceless workers in Southeast Asia. They were, in short, filled with their own absence, which was also that of every worker engaged to unload them, and, even more remotely, that of the European workers replaced by these distant laborers.
The ‘objectivity’ of the medium thus masks a deter- mined aesthetic relation between opacity and transparency, between the containers as brute presence of pure colored forms and the containers as representatives of the ‘mystery’ of the merchandise – that is to say, of the manner in which it absorbs human work and hides its mutations. It consists in the relation between presence and absence, in the double relation of a visible form to a signi cation and an absence of sense. Jean- François Chevrier bases his argument on the idea of an ‘impoverished ontology’ of photography. On one level, this is to say that photography does not have the strong ontological consistency that would enable its artistic forms to be deduced from its materiality. But we can give this poverty a more positive signification. If photography is not under the law of a proper ontological consistency, linked to the specificity of its technical mechanism, it lends itself to accomplishing the ideas about art formed by the other arts. This capacity of the mechanical art to realize what other arts had tried to accomplish by their own means was developed at length by Eisenstein, in relation to cinematic editing, which, via the temporal sequencing of shots, realized what painting had tried to accomplish in fragments. Serov, for example, tried to bring out on canvas the energy of the actress Yermolova through cutting, with the help of the lines of the mirrors and of the mouldings of a room, several different framings for the different parts of the body. The editing of the different shots of the stone lions in The Battleship Potemkin realized this dream of the painter. Photography allows an accomplishment of the same order by capturing a motionlessness that literature tried to attain through the movement of the phrase or the power of the mystery sought in the contortion of the uses of language. The poverty of photography permits it to realize this inclusion of non-art that literature or painting can only imitate by artistic means.
This is what can be demonstrated by a photograph situated in the interval between Barthes’s ‘having- been’ and the objectivity of the Becher School. Walker Evans’s photograph (left) represents to us a detail of the kitchen in a farm in Alabama. It responds, first of all, to a documentary function at the heart of a major investigation commissioned by the Farm Security Administration. Nevertheless, something happens in the photo that exceeds the task of providing information concerning a miserable situation: a kitchen with neither sideboard nor cupboard, tinplate silverware held in a makeshift rack, a lopsided wooden board nailed to a wall of disjointed and worm-ridden planks. What strikes us is a certain aesthetic disposition marked by disorder: the parallels are not parallel, the silverware is ordered in disorder, the objects on the high beam (functioning as a shelf) are placed in a dissymmetrical manner. This lopsided assemblage composes, in total, a harmonious dissymmetry, the cause of which remains uncertain: is it the effect of chance, the fact that the objects found themselves in front of the objective? Is it the gaze of the photographer, who chose a closeup of a detail, thus transforming a completely random or simply functional layout into an artistic quality? Or is it the aesthetic taste of an inhabitant of the premises, making art with the means available by hammering in a nail or putting a can here rather than there? It is possible that the photographer wanted to show the destitution of the farmers. It is also possible that he simply photographed what was in front of him without any particular intention, and that the photo thus benefits from the beauty of the random. And, it is possible that he took pleasure in seeing a quasi-abstract minimalist scene or, conversely, that he wanted to underline a certain beauty of the functional: the sobriety of the plank and of the rack could, in effect, satisfy a certain aesthetic of design, attracted by the simple and brute material, and the art of living and doing transmitted by generations of simple people. All in all, the aesthetic quality of the photograph stems from a perfect equilibrium, a perfect indecision between the two forms of beauty that Kant distinguished: beauty adherent to the form adapted to its function, and the free beauty of the finality without end.
We don’t know what was going through Walker Evans’s mind in framing his photo as he did. But we do know that he had an idea about art that he inherited, not from a photographer or painter, but from a writer, Flaubert. The idea is that the artist must remain invisible in his work, like God in his creation. But it would be going a bit too far to say that the camera realizes on the cheap – that is, by its mechanism alone – that which, for the writer, involves a never-ending work of subtraction. For impersonality is not the same thing as the objectivity of the camera, and the issue is perhaps not so much to subtract but rather to make the ‘impersonalisation’ of the style coincide with the grasping of the opposite movement: that by which indifferent lives appropriate the aesthetic capacities that subtract them from a simple social identification. The photographer’s gaze upon the singular arrangement of the silverware in a poor Alabama kitchen might remind us of the gaze that Flaubert lent to Charles Bovary as he looked at the head of Minerva, drawn by young Emma for her father on the peeling walls of Father Rouault’s farm. This is not merely to say that the camera directly expresses a poetry of the banal that the writer could only make felt through laborious work on each sentence. It is also the power to transform the banal into the impersonal, forged by a literature that hollows out from the inside the apparent evidence, the apparent immediacy of the photo, just as pictorial silence overran the ‘Flaubertian’ phrase. But this effect of painting on literature and of literature on photography is not the same as a simple shared capacity to trans gure the banality of life into the artistic splendor of indifference. This ‘indifference’ is also the meeting point, the point of tension, between the subtraction of the artistic effect that characterizes the work of the artist and the supplement of aesthetic sensibility that is adjoined to the lives of indifferent beings.
The consideration of both the punctum and the objectivism of the forme-tableau also lacks this relation between social banality and aesthetic power that inhabits the photographic portrait of the indifferent being. To understand what the ‘indifference’ of the photograph of the kitchen in Alabama or of the Polish teenager has in common with that of ‘Flaubertian’ literature, and to what type of ‘modernity’ this indifference bears witness, one must no doubt integrate these images into a completely different evolution of representation ( figuration). To sketch out this history, I would like to dwell for a moment on a singular analysis that Hegel devotes, in his Lessons on Aesthetics, to Murillo’s paintings of the child beggars of Seville, which he saw in the Royal Gallery in Munich. He evokes these paintings in a development whereby he attempts to reverse the classic evaluation of the value of pictorial genres according to the dignity of their subjects. But Hegel does not content himself with telling us that all subjects are equally proper to painting. He establishes a close relation between the virtue of this painting and the activity specific to these young beggars, an activity that consists precisely in doing nothing and not worrying about anything. There is in them, he tells us, a total disregard towards the exterior, an inner freedom in the exterior that is exactly what the concept of the artistic ideal calls for. They are like the young man in one of the portraits at the time attributed to Raphael, whose idle head gazes freely into the distance. Better still, they testify to a beatitude that is almost similar to that of the Olympian gods.
There is one notion in particular in this passage that grabs our attention, that of being carefree. It seems to reply in advance to an analysis of the aesthetic revolution that holds sway today, that by which Michael Fried characterizes the theorizing and the practice of painting implemented by the contemporaries of Diderot. Presenting the characters in the scene as completely absorbed by their task is, for him, the means by which the painters of that period, following the example of Greuze, posed and resolved the big question of artistic modernity: how can a work be made coherent by excluding the spectator from its space? This ‘anti-theatricality’ is for him the essence of pictorial modernity, defined not in a ‘Greenbergian’ manner as simple concentration of the artist on his medium, but rather as definition of the place that it gives to the person who looks upon it. The forme-tableau of Jeff Wall’s lightboxes or of the large-format cibachromes and chromogenic prints by Rineke Dijkstra, Thomas Struth, Andreas Gursky or Thomas Demand seems to Fried to renew, in exemplary fashion, the tradition of this modernity. But it comes at a price, and the active ‘absorption’ of the pictorial character, originally illustrated with such impassioned attention by Greuze’s characters, increasingly becomes an inability to see and to feel seen. Thus, for example, the tourists in Thomas Struth’s photographs of museums are represented in the absence of what they look upon in the Accademia (Michelangelo’s David) or blurred in the darkness in Tokyo in front of a Liberté guidant le peuple, itself separated by a glass pane. Likewise, Rineke Dijkstra’s teenagers are valued first of all for the awkwardness proper to their age, for their lack of control over their bodies which makes them unconscious of what they offer to be seen.7 The window cleaner who, in Jeff Wall’s famous photo, washes the windows of Mies van der Rohe’s pavilion, is not only separated from us by the back that he turns to us and by his relegation outside of the area directly illuminated by the sun; he is also ‘deliberately forgetful’ of the great event signifying the new day, ‘the in ux of the warm morning light’.8 As for the traders at the Hong Kong stock exchange or the workers at the basket factory in Nha Trang, their ‘absorption’ excludes the spectator all the more effectively as it renders them almost invisible by depriving them of all interiority and making of their attention an entirely mechanical process. It would be off-key, Fried emphasizes, to see here any form of representation of capitalist dehumanization. This ‘flattening of absorption’ bears witness, on the contrary, to ‘the consistency with which this artist resists or indeed repudiates all identification by the viewer with the human subjects of his images – the project of severing calls for nothing less’.
‘Objective’ photography therefore demonstrates here the exacerbation of a modernist project of separation. The visual attention that is paid by the modest people, in Greuze’s paintings, to each other and their surroundings is replaced by their ant-sized representation in Gursky’s photographs. But this transformation, in turn, reveals the presuppositions of the analysis: the active absorption of characters by their task is, ultimately, only their passive absorption into the space of the painting. What they are or do matters little, but what is important is that they are put in their place. It is with regard to this positing named absorption that Hegel’s insistence on the carefree inactivity of the young beggars becomes meaningful. Inactivity is not laziness. It is the suspension of the opposition between activity and passivity that aligned an idea of art with a hierarchical vision of the world. Murillo’s child beggars belonged to the type of picturesque paintings that eighteenth-century aristocrats collected as documents on the exotic life of the working classes. Hegel’s analysis removes them from there by giving them a quality which they share with the Olympian gods. This ‘carefree’ attitude is more striking than the new indifference of subjects and their common capacity to be ‘absorbed’. It posits as the exemplary subject of art this ‘doing nothing’, this common aesthetic neutralization of the social hierarchy and of the artistic hierarchy.
The aesthetic capacity shared by the Olympian god, the young noble dreamer and the carefree street child neutralizes the opposition between the subjects of art and the anonymous forms of experience. ‘We have the feeling that for a young person of this type any future is possible’, says Hegel.10 It is a peculiar comment, which makes the gures represented in a seventeenth- century painting contemporary beings whose future we consider. The young beggars testify, in fact, for another modernism far removed from that of Michael Fried’s absorbed characters, without, for all that, becoming identified with the young velocipede racing experts extolled by Benjamin. The future that they bear is the blurring of the opposition between the world of work and the world of leisure, between the naked forms of life and the experiences of the aestheticised world. It is to this modernity that the assertion of Walker Evans’s master, Flaubert, on the indifference of the subject, belongs. This does not mean the possibility for the artist to apply the ‘project of severing’, symbolic of Greenberg’s or Fried’s modernism, to any subject. It is realized only in that space where the artist rids himself of all the habitual attributes of the artist style and comes to encounter the attempts of obscure beings to introduce art into their sensible life, or any other of those forms of experience which their social condition is supposed to forbid. Flaubert may ridicule Emma’s artistic pretension, but her art is forever linked to this artistic aspiration of a farmer’s girl.
It is, similarly, a form of this encounter that James Agee and Walker Evans try to capture, one by bran- dishing Whitmanian enumerations and Proustian reminiscences to describe the houses of poor peasants, the other by rendering minimalist art and social document indiscernible when framing a dozen or so pieces of cutlery in front of four planks of brute wood. Before our gaze, there is thus neither simple objective information about a situation nor a wound inflicted by the ‘it has been’. The photo does not say whether it is art or not, whether it represents poverty or a game of uprights and diagonals, weights and counterweights, order and disorder. It tells us neither what the person who laid the planks and cutlery in this manner had in mind nor what the photographer wanted to do. This game of multiple gaps perfectly illustrates what Kant designated under the name of aesthetic idea: ‘a presentation of the imagination which prompts much thought, but to which no determinate thought whatsoever, i.e., no [determinate] concept can be adequate.’11 The aesthetic idea is the indeterminate idea that connects the two processes that the destruction of the mimetic order left separated: the intentional production of art which seeks an end, and the sensible experience of beauty as finality without end. Photography is exemplarily an art of aesthetic ideas because it is exemplarily an art capable of enabling non-art to accomplish art by dispossessing it. But it is also such through its participation in the construction of a sensible environment which extends beyond its own specificity. What we are shown by the young beggars seen by Hegel, the head of Minerva on the walls of the Normandy farm, the lopsided cans on the beams of the Alabama kitchen, the nonchalant demeanour of the child-worker in his doffer-box, or the swaying hips of the Polish teenager, is that this dispossession which makes art cannot be thought independently of the de-specification which removes all of these characters from their social identity. But this de-specification itself is not the making of an artistic coup de force. It is the correlate of the ability acquired by the characters themselves to play with the image of their being and of their condition, to post it to walls or to set it up before the lens. Judgements about photography are also appreciations of this ability and of what it means for art. This link between artistic purity and aesthetic impurity both fascinated and worried the authors of Spleen de Paris and Madame Bovary. Walter Benjamin wanted to integrate it in a global vision of the new man in the new technical world. Barthes brought it down to the intimacy of the private gaze. Michael Fried now proposes to bring it down to the interminable task of separation attributed to artistic modernity. But this theoretical coup de force would not be possible if the art of photography today was not already the bearer of this tendency to break the historical complicity between the art of the photographer and the aesthetic capacity of his subjects.
Translated by Darian Meacham
- Ibid., p. 34.
- Ibid., p. 96.
- Jean-François Chevrier and James Lingwood, Une autre
1. Roland Barthes, Camera Lucida, Hill & Wang, New York, 1981, p. 51.
objectivité, Prato, Paris, 1989.
5. S.M. Eisenstein, ‘Yermolova’, in Selected Works, vol. 2:
Towards a Theory of Montage, ed. Misha Glenny and Richard Taylor, British Film Institute, London, 1994, pp. 82–105.
6. G.W.F.vonHegel,VorlesungenüberÄsthetikI,Suhrkamp Verlag, Frankfurt, 1986, p. 224.
7. Michael Fried, Why Photography Matters as Art as Never Before, Yale University Press, New Haven CT, 2008, pp. 211–12.
8. Ibid., p. 75
- Ibid., p. 173.
- Vorlesungen über Ästhetik I, p. 224.
- Immanuel Kant, Critique of Judgement, trans. W.S. Plu-har, Hackett, Indianapolis, 1987, p. 182.
From biofeedback to biophysical performance
by Miguel Ortiz
This article describes the evolution of the field of biosignal-driven art. It gives an account of the various historical periods of activity related to this practice and outlines current practices. It poses the question of whether this is an artistic field or if it is only a collection of disassociated practices with mere technical aspects in common. The aim is to draw commonalities and artistic differences between the works of different practitioners and encourage academic and artistic discussion about the key issues of the field.
Biosignal monitoring in interactive arts, although present for over fifty years, remains a relatively little known field of research within the artistic community as compared to other sensing technologies. Since the early 1960s, an ever-increasing number of artists have collaborated with neuroscientists, physicians and electrical engineers, in order to devise means that allow for the acquisition of the minuscule electrical potentials generated by the human body. This has enabled direct manifestations of human physiology to be incorporated into interactive artworks. However, the evolution of this field has not been a continuous process. It would seem as if there has been little communication amongst practitioners, and historically there have been various sudden periods of activity that seem to have very little relation to past works and also a very limited influence in later works beyond some technical methodologies and general operating metaphors.
This paper presents an introduction to this field of artistic practice that uses human physiology as its main element.
The Human Nervous System
It is possible to think of the human nervous system as a complex network of specialised cells that communicate information about the organism and its surroundings (Maton et al., 1994). In gross anatomy, the nervous system is divided into two sub-systems: the Central Nervous System (CNS) and the Peripheral Nervous System (PNS). The CNS is the largest part of the nervous system. For humans, it includes the brain and the spinal cord. It is responsible for coordinating the activity of all parts of the body. It processes information, is responsible for controlling the activity of the peripheral nervous system, and plays a fundamental role in the control of behaviour.
Figure 1. Flowchart of the Nervous System, Taxonomy and Organisation. Nervous System Divisions (http://en.wikipedia.org/wiki/File:NSdiagram.png) by unknown author, CC BY-SA 3.0 (http://creativecommons.org/licenses/by-sa/3.0). [Click image to enlarge]
The PNS extends the CNS by providing a connection to the body’s limbs and organs. The PNS provides a means for sensing the outside world and for manifesting volitional actions upon it. The PNS is further divided into: Autonomic Nervous System (ANS) and Somatic Nervous System (SNS). The SNS is a component of the peripheral system that is concerned with sensing external stimuli from the environment and is responsible for the volitional control of the skeletal muscles that allow us to interact with the outside world (Knapp, Kim and André 2010). The ANS controls the internal sensing of the various elements that form the nervous system. It regulates involuntary responses to internal and external events and is further sub-divided into Sympathetic Nervous Systems (SNS), which are responsible for physiological changes during times of stress, and Parasympathetic Nervous Systems (PNS), which control salivation, lacrimation, urination, digestion and defecation during the resting state. Figure 1 illustrates the taxonomy and organisation of the Central Nervous System.
There are various techniques and methodologies available to monitor the operation of the nervous system. Changes in human physiology manifest themselves in various ways, ranging from changes in physical properties (i.e. dilatation of the pupils) to changes in electrical properties of organs or specialised tissues (i.e. changes in electrical conductivity of the skin).
Biosignal is a generic term that encompasses a wide range of continuous phenomena related to biological organisms. In common practice, the term is used to refer to signals that are bio-electrical in nature, and that manifest as the change in electrical potential across a specialised tissue or organ in a living organism. They are an indicator of the subject’s physiological state. Biosignals are not exclusive to humans, and can be measured in animals and plants. Excitable tissues can be roughly divided into tissues that generate electrical activity, such as nerves, skeletal muscles, cardiac muscle and soft muscles. Passive tissues that also manifest a small difference of potential include the skin and the eyes. Valentinuzzi defines the latter as “non-traditional sources of bioelectricity” (Valentinuzzi 2004, 219).
Biosignal monitoring has had a large tradition in healthcare ever since Italian physician Luigi Galvani discovered “animal electricity” in 1791 (Galvani 1791; Galvani 1841; Piccolino 1998) which was confirmed three years later by Humboldt and Aldini (Aldini 1794; Swartz and Goldensohn 1998). 1[1. For a more detailed definition of biosignals and their use in the fields of medicine, psychology and bioengineering instrumentation, please see Cacioppo, Tassinary, Berntson (2007) and Webster (1997).]
Galvanic Skin Response (GSR)
Galvanic Skin Response (GSR) is the change of the skin’s electrical conductance properties caused by stress and/or changes in emotional states (McCleary 1950). It reflects the activity of sweat glands and the changes in the sympathetic nervous system (Fuller 1977), and is an indicator of overall arousal state. The signal is measured at the palm of the hands or the soles of the feet using two electrodes between which a small, fixed voltage is applied and measured. Changes in the skin’s resistance are caused by activity of the sweat glands; for example, when a subject is presented with a stress-inducing stimulus; his/her skin conductivity will increase as the perspiratory glands secrete more sweat
The GSR signal is easy to measure and reliable. It is one of the main components of the original polygraph or “lie detector” (Marston 1938) and is one of the most common signals used in both psycho-physiological research and the field of affective computing (Picard 1997).
Figure 2. An ideal ECG signal. [Click image to enlarge]
The ECG is a measurement of the electrical activity of the heart as it progresses through the stages of contraction. Figure 2 shows the components of an ideal ECG signal.
In Human Computer Interaction (HCI) systems for non-clinical applications, the Heart Rate (HR) and Heart Rate Variability (HRV) are the most common features measured. For example, low and high HRs can be indicative of physical effort. In affective computing research, if physical activity is constant, a low HRV is commonly correlated to a state of relaxation, whereas an increased HRV is common to states of stress or anxiety (Haag et al., 2004).
EOG is the measurement of the Corneal-Retinal Potentials (CRP) across the eye using electrodes. In most cases, electrodes are placed in pairs to the sides or above/below the eyes. The EOG is traditionally used in HCI to assess eye-gaze and is normally used for interaction and communication by people that suffer from physical impairments that hinder their motor skills (Patmore and Knapp 1998).
Electromyography is a method for measuring the electrical signal that activates the contraction of muscle tissue. It measures the isometric muscle activity generated by the firing of motor neurons (De Luca and Van Dyk 1975). Motor Unit Action Potentials (MUAPs) are the individual components of the EMG signal that regulate our ability to control the skeletal muscles. Figure 3 illustrates a typical EMG signal and its amplitude envelope.
Figure 3. Example of an EMG signal. [Click image to enlarge]
EMG-based interfaces can recognise motionless gestures (Greenman 2003) across users with different muscle volumes without calibration, measuring only overall muscular tension, regardless of movement or specific coordinated gestures. They are commonly used in the fields of prosthesis control and functional neuromuscular stimulation. For musical applications, EMG-driven interfaces have traditionally been used as continuous controllers, mapping amplitude envelopes to control various musical parameters (Tanaka 1993).
MMG is an alternative technology to measure muscle activity. Unlike EMG, MMG is not an electrical signal, but a mechanical one. The contraction of skeletal muscles creates a mechanical change in the shape of the muscle and subsequent oscillations of the muscle fibres at the resonant frequency of the muscles. These vibrations can be audible and are effectively measured by contact microphones and/or accelerometers (Miranda and Wanderley 2006). Due to the characteristics of the signal, the MMG is also known as the acoustic myogram (AMG), phonomyogram (PMG) and viromyogram (VMG).
EMG and MMG signals share many of their characteristics and could be regarded as different techniques to measure the same phenomena. However, there is an important difference that can be explored in artistic contexts. EMG measures muscle fibre action potentials, that is it measures the activation and firing of motor neurons to trigger contraction of the muscle. MMG measures the actual mechanical contraction of the muscle fibres. This means that there is an important decoupling between both signals as repeated actions and muscle fatigue develop during any given activity (Barry, Geiringer and Ball 1985).
The Electroencephalogram (EEG) monitors the electrical activity caused by the firing of cortical neurons across the brain’s surface. In 1924, German neurologist Hans Berger measured these electrical signals in the human brain for the first time and provided the first systematic description of what he called the Electroencephalogram (EEG). In his research, Berger noticed spontaneous oscillations in the EEG signals (Rosenboom 1999) and identified rhythmic changes that varied as the subject shifted his or her state of consciousness. These variations, which would later be given the name of alpha waves, were originally known as Berger rhythms (Berger 1929, 355; Gloor 1969; Adrian and Matthews 1934).
Brainwaves are an extremely complex signal. In surface EEG monitoring, any given electrode picks up waves pertaining to a large number of firing neurons, each with different characteristics indicating different processes in the brain. The resulting large amount of data that represents brain activity creates a difficult job for physicians and researchers attempting to extract meaningful information.
Brainwaves have been categorised into four basic groups or bands of activity related to frequency content in the signals: Alpha, Beta, Theta and Delta (Lusted and Knapp 1996). Figure 4 shows each of the frequency bands as displayed by an EEG monitoring system.
Figure 4. EEG frequency bands. [Click image to enlarge]
This categorisation however, is the source of certain controversy as some researchers recognise up to six different frequency bands (Miranda et al., 2003). Furthermore, the exact frequency at which each band is divided from the rest is not cast in stone and one might find discrepancies of up to 1 Hz in various texts dealing with the subject. The following categorisation is based on the guidelines provided by the International Federation of Electrophysiology and Clinical Neurophysiology (Steriade et al., 1990):
Delta waves are slow periodic oscillations in the brain that lie within the range of 0.5–4 Hz and appear when the subject is in deep sleep or under the influence of anæsthesia.
Theta waves lie within the range of 4–7 Hz and appear as consciousness slips toward drowsiness. It has been associated with access to unconscious material, creative inspiration and deep meditation.
Alpha rhythm has a frequency range that lies between 8 and 13 Hz. Alpha waves have been thought to indicate both a relaxed awareness and the lack of a specific focus of attention. In holistic terms, it has been often described as a “Zen-like state of relaxation and awareness”.
Beta refers to all brainwave activity above 14 Hz and is further subdivided into 3 categories:
- Slow beta waves (15–20 Hz) are the usual waking rhythms of the brain associated with active thinking, active attention, focus on the outside world or solving concrete problems.
- Medium beta waves (20–30 Hz): this state occurs when the subject is undertaking complex cognitive tasks, such as making logical conclusions, calculations, observations or insights (Rosenboom 1999).
- Fast beta waves (Over 30 Hz): this frequency band is often called Gamma and is defined as a state of hyper-alertness, stress and anxiety (Miranda et al., 2003). It is found when performing a reaction-time motor task (Sheer 1989).
Biosignal-driven Interactive Arts
In 1919, German poet Rainer Maria Rilke wrote an essay entitled Primal Sound, in which he stresses the visual similarity between the surface of the human skull and that of early phonograph wax cylinders. He then speculated about the possibility of transducing the skull’s grooves into this primal sound using a similar technology as it was used for the playback of wax cylinders. In the author’s own words:
The coronal suture of the skull has — let us assume — a certain similarity to the closely wavy line which the needle of a phonograph engraves on the receiving, rotating cylinder of the apparatus. What if one changed the needle and directed it on its return journey along translation of a sound, but existed of itself naturally — well, to put it plainly, along the coronal suture, for example. What would happen? A sound would necessarily result, a series of sounds, music.… Feelings — which? Incredulity, timidity, fear, awe — which of all the feelings here possible prevents me from suggesting a name for the primal sound which would then make its appearance in the world… (Rilke 1978)
Although Rilke never implemented the necessary interface to generate the primal sound, his idea is extremely seductive in its conception and the artistic-æsthetic implications it proposes. Rilke’s text captures the fascination that many artists hold for the possibility of using physiological phenomena to create art. The implication being that something inherently “human-body-like” might result from the direct sonification of bodily features and physiological functions.
Early Pieces and the Biofeedback Paradigm
In the 1960s, a whole generation of artists indeed reappropriated medical tools and developed systems to harness the subtle physiological changes of the human body. These pioneers slowly created a decentralised movement that sought inspiration in medical science to create works that relate to the human being at a physiological level.
In 1964, American composer Alvin Lucier had begun working with physicist Edmond Dewan and became the first composer to make use of biosignals in an artistic context. His piece Music for Solo Performer, scored for “enormously amplified brainwaves”, was premiered at Brandeis University in 1965 (Holmes 2002).
Lucier’s piece explores the rhythmic modulations of the alpha band of brainwaves by means of direct audification and with the addition of percussion instruments — namely cymbals, drums and gongs — which were coupled to large speakers (Teitelbaum 1976). High bursts of alpha activity would cause the speakers to excite the acoustic instruments, which in turn activated a disembodied percussion ensemble.
Music for Solo Performer challenged the very notions of performance and composition. The work is not prescriptive and the composer does not have full control over the end sound result. Similarly, there is no active performance activity, at least not in the way it was understood at the time. The process itself is the music, a feature that is characteristic of Lucier’s musical æsthetic. Regarding the piece Lucier stated:
To release alpha, one has to attain a quasi-meditative state while at the same time monitoring its flow. One has to give up control to get it. In making Music for Solo Performer (1965), I had to learn to give up performing to make the performance happen. By allowing alpha to flow naturally from mind to space without intermediate processing, it was possible to create a music without compositional manipulation or purposeful performance. (Siegmeister et al., 1979)
Lucier’s pioneering use of EEG signals for music composition was quickly adopted by other composers, most notably Richard Teitelbaum and David Rosenboom. Teitelbaum had been working in Rome since the early 1960s as part of the group Musica Elettronica Viva (MEV). In 1967, he presented his work Spacecraft, in which EEG and ECG signals of five performers were used to control various sound and timbre parameters of a Moog synthesiser (Arslan et al., 2005). A year later, Finnish multimedia artist Erkki Kurenniemi attended a music conference organised by the Teatro Comunale in Florence, Italy. During the conference, he was exposed to Mandord Eaton’s ideas of biofeedback as a source for musical practice (Ojanen et al., 2007). Kurenniemi then designed the Dimi-S and Dimi-T. Two electronic musical instruments that measure changes in the electroresistance of the human skin and the production of brainwaves respectively.
During the following years, Teitelbaum explored biosignals further. His 1968 compositions Organ Music and In Tune incorporated the use of the voice and breathing sounds in order to create a close relationship between the resulting music and the human body that generated it (Teitelbaum 1976).
David Rosenboom carried on Teitelbaum’s explorations and, in 1970, presented Ecology of the Skin, a work that measures EEG and ECG signals of performers and audience members (Rosenboom 1999). He was the first artist to undertake systematic research into the potential of brainwaves for artistic applications, creating a large body of works and developing a series of systems that increasingly improved the means of detecting cognitive aspects of musical thinking for real-time music making.
The following year, musique concrète pioneer Pierre Henry began collaborating with scientist Roger Lafosse who was undertaking research into brainwave systems. This collaboration spawned a highly complex and sophisticated live performance system entitled Corticalart (Henry 1971). During the same year, Manford Eaton, who was working at Orcus Research in Kansas City, published Bio-Music (Eaton 1971), a manifesto in which he describes in great detail the apparatus and methods to implement a full biofeedback system for artistic endeavours and calls for a completely new biofeedback-based art in which the intentions of the composer are “fed directly” to the listener by means of careful monitoring and manipulation of the listener’s physiological signals.
Eaton’s system consisted of both audio and visual stimuli for the listener, designed to elicit pre-defined psycho-physiological states which are controlled by the composer. Therefore, his Bio-Music ethos abandons the division between performer and audience. Bio-Music compositions are neither to be “listened to” nor “witnessed” by a large audience, but to be experienced by individual listeners. The composer / performer, adapts his or her algorithms and the presented stimuli to the subject’s individual physiological responses and delivering a consistent “message” or experience for each individual that experiences the work. In Eaton’s Bio-Music, the specific sounds or images presented to the listener are irrelevant as long as they succeed in modulating the subject’s physiological state to that desired by the composer.
Post Biofeedback Practice
Towards the end of the 1980s, the advent of digital signal processing systems and the wide availability of powerful personal computer systems made it possible for researchers to further develop the existing techniques for biosignal analysis in real-time applications. In 1988, California-based scientists Benjamin Knapp and Hugh Lusted introduced the BioMuse system (Knapp and Lusted 1988), which consisted of a signal-capturing unit that sampled eight channels of biosignals, which were then amplified, conditioned and translated to midi messages. The sensors were implemented as simple limb-worn velcro bands that were able to capture EMG, EEG, EOG, ECG and GSR signals. The BioMuse system, facilitated not only the analysis of the signals, but also the ability to use the results of the analysis to control other electronics in a precise and reproducible manner that had not been previously possible (Knapp and Lusted 1990). This allowed them to introduce the concept of biocontrol, an important conceptual shift from the original biofeedback paradigm that had reigned unchallenged during the 1970s. Whilst biofeedback allowed for physiological states to be monitored and, relatively passively, translated to other media by means of sonification, biocontrol proposed the idea and means to create reproducible volitional interaction using physiological data as input (Tanaka 2009).
In order to fully demonstrate the possibilities afforded by their system, Knapp and Lusted commissioned composer Atau Tanaka to write the first piece for their new interface. The BioMuse’s maiden concert took place in Stanford California in 1989. In that concert, Tanaka premiered Kagami, a piece that used EMG signals measuring muscular tension on his forearms (Keislar et al., 1993). This introduced a novel biosignal performance practice that consisted of a highly personal visual and sonic style of biosignal-driven music and stage presence, moving from the archetypal image of the motionless centre-stage-seated bio-performer pioneered by Lucier, to a dynamic musician that explored arm gestures in a highly engaging way.
In 1998, Teresa Marrin-Nakra and Rosalind Picard, who were carrying out research in the field of affective Computing at the Massachusetts Institute of Technology (MIT), created The Conductor’s Jacket, a wearable computing device that facilitated the measuring and recording of physiological and kinematic signals from orchestra conductors (Marrin and Picard 1998). Even though The Conductor’s Jacket was originally conceived as a recording and monitoring device for scientific enquiry, its ability to stream data in real time allowed Nakra to use it in performance contexts, where it functioned not as a passive monitoring device but as a disembodied musical instrument.
Biosignals in the 21st Century
The Early 2000s
The turn of the 21st Century brought with it a renewed worldwide interest in biosignals for artistic applications, as many favourable factors converged. On the one hand, personal computers became powerful enough to deal with these types of signals. Likewise, the evolution of the BioMuse and other biosignal measuring devices created by the affective computing team at MIT meant that it was now possible to ecologically measure physiological signals from performers in stage situations in a transparent and effective way. 2[2. The term “ecological” is often used in the field in similar contexts to refer to measurement techniques that do not impede the natural execution of actions by performers.] Moreover, commercially available medical equipment such as the g.MOBIlab, Emotiv’s EPOC, MindMedia’s Nexus units and Thought Technology’s Infiniti systems have become more affordable and easy to use. This contrasts with the complicated and extremely costly systems that were available for artists in the 1970s. The popularisation of the internet, as well as the establishing of international conferences and symposia that dealt with musical interactive systems, meant that information could be shared by artists and researchers at faster rates than ever before, allowing for a steady incremental development of biosignal interfaces and art works created for these novel devices.
This makes the issue of meaning and content even more relevant than ever. The various technologies that facilitate the measurement of biosignals as well as their correlates to human emotion have undergone a great development, yet the associated approaches and metaphors that artists use to create works using these technologies remain relatively unchanged.
In 2002, Australian artist Tina Gonsalves began to explore the ways in which her artworks could monitor the audience’s emotional states, through “the use of bio-metric sensors as triggers for emotional video narratives, leading to both more immersive installations, as well as intimate ubiquitous works.” (Gonsalves 2009).
Her work explores issues of intimacy, empathy and emotional behaviour in humans through immersive audio-visual installations. According to Gonsalves:
Nothing seems as private as the bodily experience of raw emotion. Emotions are a common thread that every human being can read, understand, and share. Emotions influence all aspect of behaviour and subjective experience; grabbing attention, enhancing or blocking memories and swaying logical thought. Emotions spread in social collectives almost by contagion. In cohesive social interactions, we are highly attuned to subtle and covert emotional signals, Our behaviours often mirror each other in minute detail. At times, we may voluntarily suppress our emotional reactions, temporarily disguising our intentions or vulnerability, though “true” emotions are nevertheless evident in a pattern of internal bodily responses that set an underlying tone for behaviour. (Gonsalves 2009).
In 2004, during the International Conference on Auditory Displays (ICAD), Stephen Barrass organised a practice-led research project entitled Listening to the Mind Listening. The project consisted of an open call for composers to write a piece based on the brain activity of a person listening to a piece of music. The data-set was recorded from the brain activity generated by the chief executive officer of the Brain Resource company, Evian Gordon, as he listened to David Page’s composition Dry Mud (1997). The essential criteria for the pieces submitted were as follows (Barrass 2004):
- Data-driven. Sonification is a mapping of data into sounds for some purpose. The sonification should be the result of an explicit mapping from the data into sounds. The listener should be able to understand relations and structures in the data from the sonification.
- Time is the binding. The timeline of the data must map directly to the timeline of the sonification. All other mapping decisions are completely open but we need to be able to compare pieces across time, and also compare them with the original data set and source piece of music. This means that the final sonification pieces will all be exactly the same duration as the data set, and original piece of music.
- Reproducibility. The mapping of the data into sound must be described in a manner than can be reproduced by others. Mappings should be described explicitly. Different mappings will enable different perceptions of information in the data. The experiment should lay a foundation for scientific and æsthetic observations and ongoing development by the research community.
The concert was followed by a set of reviews carried out by the composers themselves, sonification scientists, brain scientists and members of the attending audience. According to Barrass, the experiment resulted not only in a successful concert which presented pieces that were æsthetically well received by the audience, but in providing a clear auditory display that could be used for scientific purposes, thanks to the systematic sonification approach to composition (Barrass et al., 2006).
During the same year, London-based artist Christian Nold began the Bio Mapping project, a community-led initiative to emotionally map urban environments. According to Nold, throughout the duration of the project, over 1500 people took part in it. The project consisted of equipping participants with a GSR measuring device and a Global Positioning System (GPS) unit. As the participants walk and interact with the urban surroundings, their arousal level is measured by the GSR sensor and linked to the specific location where important variations on the signal occur, thus creating detailed communal emotion maps which display areas within the city that people feel strongly about.
A year later, Ben Knapp and Perry Cook extended the original concept of biocontrol and introduced a conceptual framework which they called the Integral Music Controller (IMC) [Knapp and Cook 2005]. They define four categories of possible musical interfaces based on the type of interaction between performer and the resulting sound as follows:
- Traditional Physical Interface. All acoustic instruments fall into this category. There is a direct physical-acoustic coupling between the performer’s actions and the production of sound.
- Augmented Interface. When one embeds additional sensing modalities to an existing traditional instrument. HyperInstruments fall under this category, the idea being that the interface is augmented to sense events which would not normally produce changes in the instrument’s sound producing or modulating capabilities. For example, a trumpet with pressure sensors on the pistons that can change the sound as more pressure is applied to them, a gesture that does not make any discernable sound difference in a non-augmented trumpet.
- Remote Interface. When there is no direct physical connection between the performance action and the sound being produced. The iconic example for this type of interface is the computer itself, specifically laptop computers which have become pervasive in concert environments.
- Emotion Interface. An interface that allows for motionless emotion-driven interaction between the performer and the resulting sounds. Any of the biofeedback interfaces reviewed so far in this chapter could fit in this category, but only once proper analysis has been carried out to identify and assess emotion.
Based on this categorisation, the IMC can be seen as a framework within which specific musical interfaces (or instruments) that afford all possible interactions can be developed in a transparent way. According to Knapp and Cook (2005), the IMC is defined as a controller that:
- Creates a direct interface between emotion and sound production unencumbered by the physical interface.
- Enables the musician to move between this direct emotional control of sound synthesis and the physical interaction with a traditional acoustic instrument and through all of the possible levels of interaction in between.
Figure 5. The Integral Music Controller Pyramid (Knapp and Cook 2005). [Click image to enlarge]
Figure 5 shows the IMC pyramid, which illustrates the growing complexity of available interfacing options from simple physico-mechanical interaction to the emotion-driven interaction model. According to Knapp and Cook, the image also illustrates the number of available interfaces for each category which narrows down as we climb up the pyramid. I would add to this, that our understanding as creators of each interactive model follows a similar shape, from the well understood traditional instruments to the complex interaction with biosignal-driven interfaces.
In 2006, the artist duo Terminalbeach collaborated with the Trondheim Sinfonietta to create the Heart Chamber Orchestra (HCO). The HCO project consisted of an audio-visual composition where real-time ECG signals were measured from a group of twelve classically trained musicians. The data generated by the performer’s heart beats was used to control a computer composition and visualisation environment which generated a score in real time for the musicians to play, as well as the generation of electronic sound and visual content. During the performance, the score was constantly changed by the state of the musicians’ heart beats and vice versa, creating a closed feedback loop system. 3[3. See Peter Votava and Erich Berger’s article “The Heart Chamber Orchestra: An audio-visual real-time performance for chamber orchestra based on heartbeats” in this issue of eContact! for a discussion and videos of the project.]
Brazilian composer Eduardo Reck Miranda, a researcher at the Interdisciplinary Centre for Computer Music Research at the University of Plymouth, has carried out important research in the field of EEG monitoring by proposing Brain-Computer Musical Interfaces (BCMI) [Miranda and Brouse 2005a, 2005b; Miranda 2006]. His research focuses on the identification and classification of music-related cognitive processes for the direct control of generative musical algorithms. Miranda has published a series of articles describing the technical and musical implications of BCMIs. Canadian composer Andrew Brouse has collaborated with Miranda, using BCMIs to create meditative musical compositions. Miranda’s research has also fed back into the medical sciences field.
Current State of the Field
The second half of the 2000s has seen an explosion in the use of biosensing technologies in interactive art practice. This has started a process of diversification of practitioners and their original disciplines. Whilst the early works were pioneered by composers linked to the western contemporary or electroacoustic traditions, the turn of the century has seen a large number of artists from very diverse mediums that span from fine arts, media arts, cinema and philosophy.
In 2005, Belgian researcher Benoît Macq directed a project at the eNTERFACE Summer Workshop on Multimodal Interfaces dedicated to the creation of a musical instrument driven by biosignals (Arslan et al., 2005). The project had great success, and for the next four years the core team assembled by Macq continued participating in the eNTERFACE workshops improving their design implementation for biosignal-driven musical instrument. This allowed not only for the team members to work directly in this field but various artists who participated for a single year had the opportunity of approaching the use of these technologies in collaboration with highly skilled technicians as they were developing the instruments. Amongst some of the artists who had these opportunity we have Hanna Drayson and Cumhur Erkut.
A year later, BioMuse creator Benjamin Knapp joined the Sonic Arts Research Centre (SARC) at Queen’s University Belfast. There, he founded the Music, Sensors and Emotion (MuSE) research group. MuSE is a multidisciplinary team focused on both qualitatively and quantitatively measuring the relationship between music and emotion and using this information to inform musical composition and performance. The main areas of interest for the team are:
- Integral music control: Using both gestural and emotional interactions to control digital musical instruments.
- The use of physiological and kinematic ambulatory monitoring to measure gesture and emotion during performance.
- Physiological monitoring of audiences during performance.
- Contagion of emotion and physiological signals between performer and audience.
Within these areas, the MuSE team has produced various biosignal-driven interactive installations (Coghlan et al., 2009; Jaimovich 2010) and high quality scientific research (Jaimovich et al., 2011).
During 2006, my own work with biosignal interfaces started at Queen’s University as one of the founding members of the MuSE team. Following on the tradition of contemporary classical music practice, my work has largely focused in the integration of physiological sensing technologies with traditional acoustic instruments. In a way that compliments the ongoing research within MuSE, my artistic practice does not focus on the assessment of emotional states but on the intrinsic audible characteristics of biosignals themselves as a source for composing materials and as medium of performance. In a way that could be compared to hyperinstruments (Machover and Chung 1989), I have focused on extending not the instruments, but the performer. I.e., taking the physical actions required to perform on a traditional instrument and the physiological states that these actions produce on the performer as the driving element of sound output. A good example of this is my 2010 work S&V for saxophone, violin and heart rate monitor.
Video 1 (12:38). Gascia Ouzounian and Franziska Schroeder performing Miguel Ortiz’ S&V (2010) at the Sonic Arts Research Centre, Belfast (UK) 2010.
During his time as director of MuSE, Knapp went from instrument designer to performer as he founded the Biomuse Trio in 2008 to perform computer chamber music integrating traditional classical performance, laptop processing of sound and the transduction of bio-signals for the control of musical gesture. The work of the ensemble encompasses hardware design, audio signal processing, bio-signal processing, composition, improvisation and gesture choreography. The Biomuse Trio consists of Gascia Ouzounian (violin), Ben Knapp (BioMuse) and Eric Lyon (computer). 4[4. MuSE research and projects and compositions using the BioMuse system are discussed in “The Biomuse Trio in Conversation: An Interview with R. Benjamin Knapp and Eric Lyon” by Gascia Ouzounian, in this issue of eContact!]
In December 2010, new media artist and sonic artist Marco Donnarumma presented Music for Flesh I at the University of Edinburgh, a first public performance using his Xth Sense system. Xth Sense is an MMG-driven interactive system for the biophysical generation and control of music (Donnarumma 2011). Drawing from the growing fields of open source software and hardware, Xth Sense is not only a bespoke system for the sole use of its creator, but a set of tools that can be easily implemented by the community at large and at a very low cost. This marks an important milestone as it opens the doors for a grassroots physiological-driven arts practice outside university walls.
In April 2012, the Sonorities Festival at Queen’s University had a special theme titled The Body’s Music. The festival focused on innovative relationships between music and the body. In particular, explorations of the combination of body and technology, while delving into the sonic world of the body itself. During the parallel Two Thousand + TWELVE symposium, a plenary session was held with the participation of experts Ben Knapp and Atau Tanaka and some of the more active new practitioners Marco Donnarumma, Miguel Ortiz and Gascia Ouzounian. During this open discussion some of the most relevant questions that had previously only been made in conference hallways and late night pub sessions were tackled, namely:
- Is this a field or just a collection of decentralised individual artistic practices?
- Are there any connections or direct progress from the initial intentions of the early pioneers of the 1960s and current practices?
- Are there any intrinsic musical properties in these signals or are they just a bridge between higher cognitive and emotional states and musical outputs?
- Are there any opportunities for collaboration and focused development of biosignal-driven musical practice or are the individual interests of practitioners too focused for any commonalities?
Despite long discussions during the plenary session and throughout the festival, this (and other) questions remain open…
The use of biosignal monitoring technologies in interactive art contexts has been present for over sixty years. From Alvin Lucier’s pioneering work Music for Solo Performer to the current practice of biosignal-driven performance and sound installation, the field has advanced both in its technical implementations and the artistic affordances that the medium provides. Developments in medicine and psychophysiology allow us to understand better the meaning and implication of human-generated electrical signals and their correlation to emotion. The work carried out by the Affective Computing Group at MIT and the Music, Sensors and Emotion team at SARC has facilitated the technical aspects of biosignal monitoring for interactive artistic practice. Furthermore, the technical and social advancements in the wider electronic music field that appeared in the early 2000s has evolved and matured into the establishment of specific interest groups that allow for thorough research and artistic practice in the field.
It is now easier than ever to incorporate physiological measurements onto the stage; thus, biosignal-driven art can now be carried out in a practical way, without the need for the large and expensive equipment used in the early 60s and 70s. This opens the door for deeper artistic and æsthetic explorations, which in our opinion should become the central focus of creative work.
The opportunities seem open ended and it is up to the artistic community interested in harvesting the physiologic mechanisms of the human body to fully realise their potential beyond the mere novelty of the interface.
Adrian, Edgar D. and Bryan H.C. Matthews. “The Berger Rhythm: Potential changes from the occipital lobes in man.” Brain 57/4 (1934), pp. 355–383.
Aldini Giovanni. De animali electricitate dissertationes duae. Typographia Instituti Scientiarum: Bonomiae, 1794.
Arslan, Burak, Andrew Brouse, Julien Castet, Jean-Julien Filatriau, Rémy Lehembre, Quentin Noirhomme and Cédric Simon. “Biologically-driven Musical Instrument.” eNTERFACE 05: Summer Workshop on Multimodal Interfaces (Mons, Belgium, 17 July – 11 August 2005). ISCA, 2005.
Arslan, Burak, Andrew Brouse, Julien Castet, Jean-Julien Filatriau, Rémy Lehembre, Quentin Noirhomme and Cédric Simon. “From Biological Signals to Music.” Enactive05. Proceedings of the 2nd International Conference on Enactive Interfaces (Genoa, Italy, 17–18 November 2005). Available online at http://tcts.fpms.ac.be/publications/papers/2005/enactive05_abbacjfjjlrnqsc.pdf [Last accessed 26 April 2010]
Barrass, Stephen. “Listening to the Mind Listening.” Call for submissions for a Concert of Sonifications at the Sydney Opera House during ICAD 2004. http://www.icad.org/websiteV2.0/Conferences/ICAD2004/concert_call.htm
Barrass, Stephen, Michael Whitelaw and Freya Bailes. “Listening to the Mind Listening: An Analysis of sonification reviews, designs and correspondences.” Leonardo Music Journal 16 (December 2006) “Noises Off: Sound Beyond Music,” pp. 13–19.
Barry, Daniel T., Steven R. Geiringer and Richard D. Ball. “Acoustic Myography: A Noninvasive Monitor of Motor Unit Fatigue.” Muscle Nerve 8/3 (March-April 1985), pp. 189–94.
Berger, Hans. “Über das Elektroenkephalogramm des Menschen. I. Mitteilung.” Archiv für Psychiatrie und Nervenkrankheiten 87 (1929), pp. 527–570.
Cacioppo, John T., Louis G. Tassinary and Gary G. Berntson (eds.). Handbook of Psychophysiology. Cambridge, UK: Cambridge University Press, 2007.
De Luca, Carlo J. and Egbert J. Van Dyk. “Derivation of Some Parameters of Myoelectric Signals Recorded During Sustained Constant Force Isometric Contractions.” Biophysical Journal 15/12 (1975), pp. 1167–1180.
Coghlan, Nial, Javier Jaimovich, R. Benjamin Knapp, Donald O’Brien and Miguel Ortiz. “AffecTech: an Affect-Aware Interactive AV Artwork.” ISEA 2009. Proceedings of the 15th International Symposium of Electronic Arts (Belfast: University of Ulster, 23 August – 1 September 2009).
Donnarumma Marco. “Xth Sense: A Study of muscle sounds for an experimental paradigm of musical performance.” ICMC 2011: “innovation : interaction : imagination”. Proceedings of the International Computer Music Conference (Huddersfield, UK: Centre for Research in New Music (CeReNeM) at the University of Huddersfield, 31 July – 5 August 2011).
Eaton, Manford. Bio-Music: Biological feedback, experiential music system.Kansas City, USA: Orcus, 1971.
Fuller, George D. Biofeedback: Methods and procedures in clinical practice. San Francisco: Biofeedback Press, 1977.
Galvani, Luigi. “De viribus electricitatis in motu musculari commentarius.” Comment Bonon Scient et art Inst Bologna 7 (1791), pp. 363–418.
_____. Opere edite ed inedite del Professore Luigi Galvani raccolte e pubblicate dall’Accademia delle Science dell’Istituto di Bologna. Edited by Silvestro Gherardi. Accademia delle Science dell’Istituto di Bologna: Dall’Olmo, Bologna. 1841.
Gloor, Pierre. Hans Berger on the Electroencephalogram of Man. The Fourteen Original Reports on the Human Electroencephalogram. New York: Elsevier, 1969.
Gonsalves, Tina. “Tina Gonsalves’ Digital Folio.” 2009. http://www.tinagonsalves.com/INTERFrame.html [Last accessed 26 April 2010].
Greenman, Phillip E. Principles of Manual Medicine. Philadelphia, USA: Lippincott Williams & Wilkins, 2003.
Haag, Andreas, Silke Goronzy, Peter Schaich and Jason Williams. “Emotion Recognition Using Bio-Sensors: First Steps Towards an Automatic System.” In Affective Dialogue Systems. Berlin/Heidelberg: Springer Verlag, 2004, pp. 36–48.
Henry, Pierre. Mise en musique du corticalart de Roger Lafosse (1971). Prospective 21e Siècle [6521 022]. 1971.
Holmes, Thomas B. Electronic and Experimental Music: Pioneers in Technology and Composition. New York: Routledge, 2002.
Jaimovich, Javier. “Ground Me!: An Interactive Sound Art Installation.” NIME 2010. Proceedings of the 10th International Conference on New Instruments for Musical Expression (Sydney, Australia: University of Technology Sydney, 15–18 June 2010). pp. 391–394.
Jaimovich, Javier, Nicholas Gillian, Paolo Coletta, Esteban Maestre and Marco Marchini. “Workshop on Multi-Modal Data Acquisition for Musical Research.” NIME 2010. Proceedings of the 10th International Conference on New Instruments for Musical Expression (Sydney, Australia: University of Technology Sydney, 15–18 June 2010). p. 551.
Juslin, Patrik N. and John A. Sloboda. Music and Emotion: Theory and Research. Series in Affective Science Oxford, UK: Oxford University Press, 2001.
Knapp, R. Benjamin, Jonghwa Kim and Elisabeth André. “Physiological Signals and their Use in Augmenting Emotion Recognition for Human-Machine Interaction.” In Emotion-Oriented Systems, Cognitive Technologies. Edited by Roddy Cowie, Catherine Pelachaud and Paolo Petta. Berlin/Heidelberg: Springer Verlag, 2011, pp. 133–159.
Knapp, R. Benjamin and Perry R. Cook. “The Integral Music Controller: Introducing a direct emotional interface to gestural control of sound synthesis.” ICMC 2005: Free Sound. Proceedings of the International Computer Music Conference (Barcelona, Spain: L’Escola Superior de Música de Catalunya, 5–9 September 2005), pp. 4–9.
Knapp, R. Benjamin and Hugh S. Lusted. “A real-time digital signal processing system for bioelectric control of music.” Acoustics, Speech, and Signal Processing, 1988. ICASSP-88. 1988 5, pp. 2556–2557.
Knapp, R. Benjamin and Hugh S. Lusted. “A Bioelectric Controller for Computer Music Applications.” Computer Music Journal 14/1 (Spring 1990) “New Performance Interfaces (1),” pp. 42–47.
Keislar, Doug, Robert Pritchard, Todd Winkler, Heinrich Taube, Mara Helmuth, Jonathan Berger, Jonathan Hallstrom and Brad Garton. “1992 International Computer Music Conference, San Jose, California USA, 14–18 October 1992.” Computer Music Journal 17/2 (Summer 1993) “Synthesis and Transformations,” pp. 85–98.
Kreibig, Sylvia D., Frank H. Wilhelm, Walton T. Roth and James J. Gross. “Cardiovascular, Electrodermal and Respiratory Response Patterns to Fear- and Sadness-Inducing Films.” Psychophysiology 44/5 (September 2007), pp. 787–806.
Lusted, Hugh S., and R. Benjamin Knapp. “Controlling Computers with Neural Signals.” Scientific American275/4 (October 1996), pp. 82–87.
Machover, Tod and Joe Chung. “Hyperinstruments: Musically Intelligent and Interactive Performance and Creativity Systems.” ICMC 1989. Proceedings of the International Computer Music Conference (USA: Ohio State University, 1989). Key: citeulike:794359
Marrin, Teresa and Rosalind W. Picard. “The Conductor’s Jacket: A Device for recording expressive musical gestures.” ICMC 1998. Proceedings of the International Computer Music Conference (Ann Arbor MI, USA: University of Michigan 1998), pp. 215–219.
Marston, William M. Lie Detector Test. New York: R.R. Smith, 1938.
Maton, Anthea, Jean Hopkins, Susan Johnson, David LaHart, Maryanna Q. Warner and Jill D. Wright. Human Biology And Health. Englewood Cliffs NJ: Prentice Hall, 1994.
McCleary, Robert A. “The Nature of the Galvanic Skin Response.” Psychological Bulletin 47 (1950), pp. 97–117.
Miranda, Eduardo Reck. “Brain-Computer Interface for Generative Music.” ICDVRAT 2006. Proceedings of the 6th International Conference on Disability, Virtual Reality and Associated Technologies (Esbjerg, Denmark, 18–20 September 2006), pp. 295–302.
Miranda, Eduardo Reck and Andrew Brouse. “Toward Direct Brain-Computer Musical Interfaces.” NIME 2005. Proceedings of the 5th International Conference on New Instruments for Musical Expression (Vancouver: University of British Columbia, 26–28 May 2005), pp. 216–219.
_____. “Interfacing the Brain Directly with Musical Systems: On Developing systems for making music with brain signals.” Leonardo 38/4 (August 2005), pp. 331– 336, 2005b. doi: 10.1162/0024094054762133. URL http://dx.doi.org/10.1162/ 0024094054762133.
Miranda, Eduardo Reck, Ken Sharman, Kerry Kilborn and Alexander Dunca. “On Harnessing the Electroencephalogram for the Musical Braincap.” Computer Music Journal 27/2 (Summer 2003) “Live Electronics in Recent Music of Luciano Berio,” pp. 80–102.
Miranda, Eduardo Reck and Marcelo Wanderley. New Digital Musical Instruments: Control And Interaction Beyond the Keyboard. Computer Music and Digital Audio Series. Madison WI, USA: A-R Editions, Inc. 2006. http://portal.acm.org/citation.cfm?id=1201683
Nold, Christian (ed.). Emotional Cartography — Technologies of the Self. Softbook published under a Creative Commons Attribution, 2009. http://emotionalcartography.net [Last accessed 26 April 2010].
Ojanen, Mikko, Jari Suominen, Titti Kallio and Kai Lassfolk. “Design Principles and User Interfaces of Erkki Kurenniemi’s Electronic Musical Instruments of the 1960s and 1970s.” NIME 2007. Proceedings of the 7th International Conference on New Instruments for Musical Expression (New York: New York University, 6–10 June 2007), pp. 88–93. DOI=10.1145/1279740.1279756 http://doi.acm.org/10.1145/1279740.1279756
Ortiz, Miguel. “Towards an Idiomatic Compositional Language for Biosignal Interfaces.” Unpublished PhD Thesis. Belfast, Northern Ireland: Queen’s University, 2010.
Patmore, David W. and R. Benjamin Knapp. “Towards an EOG-based Eye Tracker for Computer Control.” Proceedings of the 3rd International ACM Conference on Assistive Technologies (New York, USA, 1998), pp. 197–203.
Picard, Rosalind W. Affective Computing. Cambridge MA, USA: MIT Press. 1997.
Piccolino, Marco. “Animal Electricity and the Birth of Electrophysiology: The Legacy of Luigi Galvani.” Brain Research Bulletin 46/5 (1998), pp. 381–407.
Rilke, Rainer Maria. Where Silence Reigns: Selected Prose. New York: New Directions Publishing Corporation, 1978.
Rosenboom, David. “Extended Musical Interface with the Human Nervous System: Assessment and prospectus.” Leonardo 32/4 (August 1999), p. 257.
Siegmeister, Elie, Alvin Lucier and Mindy Lee. “Three Points of View.” The Musical Quarterly 65/2 (April 1979), pp. 281–295. ISSN 00274631. URL http://www.jstor.org.ezproxy. qub.ac.uk/stable/741709. ArticleType: primary article / Full publication date: Apr., 1979 / Copyright © 1979 Oxford University Press.
Sheer, Daniel E. “Sensory and Cognitive 40–Hz Event-Related Potentials: Behavioral correlates, brain functions and clinical application.” Brain Dynamics. Edited by E. Basar and T.H. Bullock. Springer series in Brain Dynamics vol. 2. Berlin/Heidelberg: Springer Verlag, 1989, pp. 339–374
Steriade, Mircea, Pierre Gloor, Rodolfo R. Llinas, Fernando H. Lopes da Silva and M. Marsel Mesulam. “Basic Mechanisms of Cerebral Rhythmic Activities.” Electroencephalography and Clinical Neurophysiology 76/6 (December 1990), pp. 481–508.
Swartz, Barbara E. and Eli S. Goldensohn. “Timeline of the History of EEG and associated fields.” Electroencephalography and Clinical Neurophysiology 106/2 (February 1998), pp. 173–176.
Tanaka, Atau. “Musical Technical Issues in Using Interactive Instrument Technology with Application to the BioMuse.” ICMC 1993. Proceedings of the International Computer Music Conference (Japan: Waseda University, 1993), pp. 124–126.
_____. “Sensor based Musical Instruments and Interactive Music.” In The Oxford Handbook of Computer Music. Edited by Roger T. Dean. Oxford, UK: Oxford University Press, 2009, pp. 233–257.
Tanaka, Atau and R. Benjamin Knapp. “Multimodal Interaction in Music using the Electromyogram and Relative Position Sensing.” NIME 2002. Proceedings of the 2nd International Conference on New Instruments for Musical Expression (Dublin: Media Lab Europe, 24–26 May 2002), pp. 1–6.
Teitelbaum, Richard. “In tune: Some early experiments in biofeedback music (1966–1974).” In Biofeedback and the Arts: Results of early experiments. Edited by David Rosenboom. Vancouver: Aesthetic Research Centre of Canada, 1974.
Valentinuzzi, Max E. Understanding the Human Machine: A Primer for bioengineering. Singapore: World Scientific Publishing Company, 2004.
Webster, John G. Medical Instrumentation-Application and Design. 3rd Editions. New York: John Wiley and Sons, 1997.
Wishart, Trevor. “Transforming Sounds: Confirming and Confounding Expectations.” Paper presented at the International Conference on Music and Emotion (Durham, UK: Durham University, 31 August – 3 September 2009.