Category Archives: Exhibition

TEI’25

I’ve recently returned from the Nineteenth International Conference on Tangible, Embedded, and Embodied Interaction (TEI’25) hosted by Université Bordeaux. This was my first experience of TEI and it was really insightful and encouraging to meet and hear from international researchers and creative practitioners at the forefront of tangible interaction in its many forms. This annual conference is essentially an international community of talented makers keen to constructively critique one another’s research and practice.

I was very happy to show an installation ‘Suitcase Stories’ which was included as part of the conference Arts and Perfomance track, exhibiting at Capc Contemporary Art Museum Bordeaux. I proposed Suitcase Stories in response to the Art and Performance call which asked artists to propose an art work fitting into a suitcase, somewhat inspired by La Boîte-en-Valise [Box in a Suitcase] by Marcel Duchamp, also responding to the conference theme of sustainability.

A number of themes I had previously been considering fed into the ideation process. Firstly, the 17 United Nations Sustainable Development Goals, many of which are concerned with improving social and personal factors, not just developing infrastructure, although these aspects are evidently interrelated. Secondly, lived experience and personal testimony of climate change – I personally find first hand accounts of subjects such as flooding and drought very moving. Thirdly, bodily interaction with typography as a way to develop a near-physical relationship with narrative.

This led me to develop the following proposal:

The Suitcase Stories installation facilitates embodied interaction with typographic representations of firsthand accounts of climate change. The work aspires to create a powerful and visceral connection between the participant and individuals affected directly by environmental changes, thus developing greater awareness and propensity towards positive action. Participants interact with powerful and often emotive narratives through upper body movement and gesture, discovering and playing with words and phrases. The entire artwork is integrated within a vintage suitcase, adding aesthetic and thematic dimensions to the user experience. Through this installation, the author sets out to test whether interactive typography, controlled through body tracking, can offer a unique platform for disadvantaged voices to be heard in a powerful and immersive way.  

I developed the following lo-fi mock-ups to support the proposal.

Although I had already created bodily-interactive typography some years ago (e.g. Journey Words), this was created using now defunct Quartz Composer patches and recently I have been keen to push the limits of TouchDesigner. So, with just a weekend to create a prototype from scratch in time for the application deadline, I managed to develop the following demo in TouchDesigner.

My proposal was thankfully accepted and I started work in earnest on the installation following the Christmas break. My first task was to find suitable first-hand accounts of climate change that I could legitimately use. After some discourse with organisations such as the Climate and Migration Coalition, it became apparent that several first-hand accounts published by organisations such as Oxfam are already widely shared, with due reference, across media platforms. In the end I re-used and referenced the following accounts:

Extract from the account of Marcos Choque, 67-year-old inhabitant of Khapi, in the Bolivian Andes. Oxfam International. 2009. Bolivia: Climate change, poverty and adaptation. Oxfam International, La Paz, Bolivia. 
Extract from the account of Sefya Funge, 38-year-old farmer in Adamii Tulluu-Jido Kombolcha, Ethiopia. Oxfam International. 2010. The Rain Doesn’t Come on Time Anymore – Poverty, Vulnerability, and Climate Variability in Ethiopia. Oxfam International, Oxford, UK. 
Extract from the account of Tulsi Khara, 70-year-old inhabitant of the Sundarbans, in the Ganges delta, India. Quoted in: WWF. 2005. Climate Witness: Tulsi Khara, India.  WWF. 2005. Climate Witness: Tulsi Khara, India. Retrieved from: https://wwf.panda.org/es/?22345/Climate-Witness-Tulsi-Khara-India 
Extract from the account of Rosalie Ticala, 33-year-old typhoon survivor of Baganga, Mindanao Island, Philippines. Thomson Reuters Foundation. 2013. Typhoon survivor Rosalie tells her story in Philippines. Retrieved from: https://news.trust.org/item/20130214164700-xrwmo 
Extract from the account of Fatay and Zulaikar, husband and wife of a pastoralist family in Badin district, Sindh, Pakistan. Quoted in: Climate & Development Knowledge Network. 2012. Disaster-proofing your village before the floods – the case of Sindh, Pakistan. Retrieved from: https://cdkn.org/story/disaster-proofing-your-village-before-the-floods-%25e2%2580%2593-the-case-of-sindh-pakistan 
Extract from the account of Assoumane Mahamadou Issifou, NGO employee in Agadez, Nigeria. Gavi,  Quoted in: The Vaccine Alliance. 2023. Ten eyewitness reports from the frontline of climate change and health. Retrieved from: https://www.gavi.org/vaccineswork/ten-eyewitness-reports-frontline-climate-change-and-health 
Extract from the account of Parbati Ghat, 58-year-old community health volunteer in Melauli, Baitadi, Nepal.  Quoted in: BBC Media Action, Living Climate Change. 2024. Mosquitoes in the mountains, Nepal. Retrieved from: https://www.bbc.co.uk/mediaaction/our-work/climate-change-resilience/living-climate-change/nepal-malaria 
Extract from the account of Lomilio Ewoi, pastoralist in Kenya. Quoted in: BBC Media Action, Living Climate Change. 2024. The flood that took everything, Kenya. Retrieved from: https://www.bbc.co.uk/mediaaction/our-work/climate-change-resilience/living-climate-change/kenya-mental-health 

The TouchDesigner development process was quite time-consuming although I managed to achieve an outcome by resolving challenges in key stages. My original demo essentially mixed a Kinetic Typography tutorial by bileam tschepe (elekktronaut) with a 3D Grid with Depth Camera tutorial by Motus Art. This resulted in a grid of letters extruded using depth information provided by a RealSense D345 camera. However, I wanted to only show letters extruded by the body and not those on the background grid, but keeping the left to right flow of text, as shown in the diagram below.

I managed to do this by using a threshold filter to isolate image pixels above a certain greyscale level and therefore considered to be part of the body, and then used this information to reorganise the text indices relating to each grid cell so that text only appeared on cells extruded by the body.

With artistic works featuring typography, there is often a tension between aesthetics and legibility. I wanted participants to enjoy playing with the text, forming ‘word sculptures’ with their bodies, but ultimately they needed to be able to read the text. To this end, I developed a phrase cycling function that sequentially picked out individual phrases when the participant stopped moving and after a short delay, showed them as pure text overlayed along the bottom of the screen. Although it perhaps seemed slightly obvious to do so, I wanted to ensure 100% legibility of these important stories.

The fabrication side of the project came together quite serendipitously, I found a medium-sized, yet robust, vintage suitcase in an antique bazaar which just happened to be a perfect fit for an old monitor. I used photography mounting components to hold the lid of the suitcase open and support the weight of the monitor, then created a mount for the RealSense camera in the suitcase lid. After several failed attempts trying to get the RealSense camera working with my MacBook (official RealSense support for Mac is discontinued by Intel), I managed to borrow a gaming PC laptop and house that in the body of the suitcase. The last additions were a fan to cool the laptop down and some suitable material to stretch across the interior of the suitcase (which by now had several holes cut into it). You can see the results in the images below.

I had some really useful and insightful feedback from the conference attendees and also a number of productive conversations about using technology to explore human narratives – essentially Digital Humanities. I’m taking a break from this project for a short while to reflect upon where it might go next. In the meantime, if you’re interested in reading the accompanying ACM short paper, you can find it here: https://dl.acm.org/doi/pdf/10.1145/3689050.3707677

And here is a screen recording demonstrating the phrase selection functionality as it was presented at TEI’25.

Play Table: Iteration 3

Now that the dust of the summer holidays has settled, I’ve had chance to edit some video of the Play Table R&D project as it appeared at FACT, Liverpool, in August.

Play Table : Iteration 2

Installed at The Minories Galleries, Colchester.

Data Flow at FACT

Data Flow is now up and running at the Foundation for Art and Creative Technology (FACT), Liverpool, as part of the Type Motion exhibiton which opens tomorrow evening (13/11/14) and doesn’t stop until 08/02/15. Just as I threw the switch to demonstrate the installed work to FACT people, after some time spent tweaking, 50+ students turned up directly in front of the screens and immediately started jumping around and taking pictures. That was a good start! Here’s a short screen capture of the piece being put through its paces by a combination of FACT staff and passers-by.

6 Days in Liverpool

I was up in Liverpool again recently for a 6 day residency as part of the art tech, boundary pushing Syndrome project curated and produced by Nathan Jones.
‘Choros’ was a collaboration between myself and sound artist Stefan Kazassoglou of Kinicho. Artist and poet, Steven Fowler gave a martial-arts derived performance for the opening event. The venue was 24 Kitchen St which is a fascinating project in its own right – a constantly evolving arts-centric space at the very beating heart of Liverpool’s Baltic Quarter, full of positiveness and an admirable can-do attitude.
kitchen-st

Inspired by a visit to the venue and at all times spurred on by Nathan Jones, Stefan Kazassoglou and myself set ourselves the brief of creating a ‘roomstrument’ – an interactive space capable of responding visually and sonically to physical presence and movement, similar to the way in which a musical instrument responds to the physicality of being played. The roomstrument should be ‘playable’ by an individual or by a group. It would be an experimental piece designed to make performers of participants by stimulating and rewarding performative play. The name Choros came about as an anglicisation of the Greek word ‘Koros’ which happens to mean both dance and room – the synonymity appealed to us.

With the benefit of continued encouragement and support from Syndrome, we specified 3 projectors, 3 screens, 3 Kinect cameras and an 8 speaker ambisonic sound system to create a kind of open sided cube that would form the basis of an interactive space. In the end this relatively complex rig was constructed with a minimum of fuss by the Syndrome team and suppliers and we found ourselves facing a technically exacting set-up with plenty of calibrated communication required between video and audio processing. After the inevitable teething issues, we kickstarted our creative workflow and got a basic interactive audiovisual framework up and running on day 4 of the residency which only gave us 1 day to tweak before the incredible opening performance featuring Steven Fowler. The following day we opened up the work to the wider public…

spec

At the centre of the installation was a lit ‘hotspot’ which we invited visitors to use a starting point to explore the interactive space. By reaching out towards or approaching any of the 3 screens from this hotspot, a series of ‘control cubes’ was revealed, each of which triggered a sound in respective ambisonic audio space. Thus a control cube in the bottom left part of a screen triggered an audio element spatially placed at the corresponding location. For the opening performance we used a series of Japanese martial arts-inspired vocal samples recorded by Steven Fowler himself.

Subsequent sound sets featured cello samples specially recorded by Stefan Kazassoglou and vocal samples from 20th Century philosopher and mathematician Alfred Korzybski discussing how abstraction creates an illusion of reality.

Moving around quickly inside the space triggered a rapid sucession of audio elements, resulting in a dramatic if slightly overwhelming mix of near-simultaneous sounds issuing from various locations in 3D space. Conversely, moving more carefully and identifying the points at which audio elements triggered gave visitors the chance to learn how to ‘play’ the work more as an actual ‘roomstrument’.

This experimental piece was a great success judging by the feedback and comments from visitors. As an artistic collaboration, I am sure it has inspired each one of us involved both at an individual and collaborative level. Certainly Stefan Kazassoglou and myself are keen to develop the ideas and techniques at the heart of Choros…

Massive thanks to all who helped and supported in spirit or in person.

Bye-bye Liverpool until next time…liverpool

The after-glow of Luminescence

Luminescence was installed at firstsite for 3 days in April. Due to the crescendo of effort required to pull the project together followed soon after by Easter holidays and the beginning of a new term, it has take me a little while to get round to writing up my thoughts and observations.

Not long after I wrote the last post discussing my previous show Electricus, I finally got hold of a Kinect sensor. Having worked exclusively with webcam video input for the last year or more, it was a good time to cross the line into the world of the depth image and positional information. I’m particularly happy that I really ‘maxed out’ the webcam and learned so much from operating within the constraints of rgb video over an extended period before coming in from the cold. The way I see it there are two main directions to go with the (version 1) Kinect – skeleton tracking which provides fine control for a restricted number of participants or exploitation of the depth image which just gives z information in a grainy black and white low-res feed. The first approach sounds way more groovy right? But the second approach is to my mind essentially more open in the sense that it can be used to set up multi-participant interactivity with the minimum of calibration or initialisation. I really like the idea of an ‘uninvigilated’ interactive space as opposed to the invigilated version in which perhaps only 2 are allowed to approach the sensor at a time. But of course, it’s all a matter of fitness for purpose and I’m sure I’ll be maxing out the skeleton tracking functionality before long!

So what of the depth image? For a start, using a threshold-type filter it is simple to set up an active zone in front of the sensor thereby knocking out the background or any other unwanted objects. For Luminescence, I developed functionality that locates objects/people and draws lines around them in an approximation of their silhouette. Because the lines are drawn using a cluster of points located on the edge of a person/object’s shape, it is straight forward enough to calculate the average position of a cluster which roughly equates to the centre of a drawn shape. Once more than one shape occurs, the piece joins them together dramatically. So an individual might dwell at the edge of the active zone and experiment by putting only parts of the body (eg hands, face) into the active zone and seeing how these all connect up. A group of participants might just jump around in front of the screen and watch how the connections between their respective body shapes light the screen up.
Visitor response was very positive. I was in the installation space or close by for the duration of the event at firstsite which gave me ample opportunity to observe, chat with and generally appreciate participant interaction with the piece.

mumandson-simple-800-600
mumandson-800-600
spec-side

From Electricus to Luminescence

Electricus is dead, long live Electricus! Well not dead, just put to bed for now while I start to work on my next show ‘Luminescence’ to be exhibited at firstsite in April.

Putting on a show at Ipswich Town Hall was certainly a memorable experience. Although Gallery 3 feels slightly off the beaten track, it’s such a hugely impressive room with enormous sash windows, ornate plasterwork not to mention several large 19th Century maritime-themed oil paintings hanging high, that one cannot help but feel slightly in awe. Luckily the 4 metre wide, 3 metre high back projection screen I had installed across one corner of the room was big enough to hold its own within the space.

The exhibition opened to a queue of people thanks to Sarah Jacques of University Campus Suffolk who brought her Fine Art undergraduates along to have  a look and ‘show some energy’.  I gave an impromptu presentation which was fun 😉  Saturday was the busiest day thanks to a great feature by Wayne Savage which appeared in the East Anglian Daily Times and Ipswich Star newspapers on the previous day.

This was the first time I had worked with back rather than overhead projection and it really does make things much easier in terms of positioning, providing that the necessary space behind the screen is available. In general, the show was a definite success with lots of minor production lessons learned and quite a few in-depth conversations with visitors, which was really informative.

I’ve been working with outlines and sparks now for some time and will probably now take a slightly different route foward. I hope to post samples of some of the ideas I’m working on for Luminescence over the coming weeks.

solo

Electricus, Jamie Gledhill 2014

Spark Shower at Slack Space

As part of the ‘Lights in the Dark’ exhibition at Slack Space Colchester I exhibited ‘Spark Shower’, a development of an individual element of my 2013 masters project ‘Mirrornoise’. It was a positive experience not least being the first time I have exhibited an interactive work in Colchester where I am based. Slack Space is a very supportive organisation despite the meagre resources they have to hand and I commend them for giving artists such as myself an opportunity to show new work.

I tried something a little different from previous shows with the sound design cycling through a series of rhythmic sequences interspersed with periods of rest, all superimposed upon responsive sound elements such as spark noises. Each time a new rhythmic sequence began, a visual change occurred such as change of spark colour. Although pretty simple at heart, the transformative apect of this approach seemed to work.

Here is a excerpt of video shot of the screen during the private view.