Deep Dream Generator is one of many emerging image manipulation platforms that use AI to great effect. According to AIArtists.org, itself a fascinating resource, the service is an enhanced version of Google Deepdream which has been around since 2015. In simplistic terms, the service uses ‘neural network’ processing to manipulate images, often resulting in quite stunning effects.
Deep Dream Generator essentially enables 2 images to be mixed together with the power of AI.
On October the 20th, 2021, I presented my preliminary research findings from The Multitude project at Beyond 21, ‘a conference where thinkers, makers, investors and researchers across the creative industries come together to explore the relationship between creative research and business innovation’. The event was physically held in Belfast with many elements presented online.
Here is the research poster that I submitted (select to enlarge):
I’m currently involved in a collaborative art-tech research project between NUA and Collusion in support of emerging artists in the Norwich and Norfolk area. One of the topics I have been looking into is the way that UX practices and concepts may be used in the context of developing and delivering arts projects. This will come as no surprise, as I am a sometime artist myself as well as being a User Experience Design lecturer at Norwich University of the Arts.
Let’s establish a working definition of UX design as:
A multidisciplinary practice that sets out to create positive experience in the consumption of digital products and services by matching users’ needs, capabilities and motivations with corresponding functionality, content and reward.
When considering the major areas of contributary practice that feed into UX design as it is commonly thought of, i.e. commercially oriented, it can be seen from the simplified diagram below that at least one or more of these disciplines is likely to be relevant to arts practice. The key questions here are whose art practice, what is the nature of that individual practice and therefore where are the natural synergies between that practice and the hybridised discipline that is UX Design?
The more digital the arts practice and the more it relies upon users, interfaces and content, the closer it comes to the natural territory of commercial UX Design.
Artists operating in the art-tech space would do well to consider where their practice can draw from UX Design and where it needs to be differentiated.
At the risk of stating the obvious:
The further away an arts practice is in nature from commercial UX Design, the more easily an artist can learn, borrow and steal from commercial UX Design.
The closer an arts practice is in nature to commercial UX Design, the harder an artist has to work to differentiate art works from commercial UX design-derived products and services.
Where well-designed user experience is intended to create delight in a commercial context, it can provoke a much wider range of emotional and intellectual responses in an artistic context.
Let’s consider user experience design as a wholistic term that can be applied to the design of both commercial and artistic experiences that involve some form of interface.
Compare the potential driving forces behind UX for commercial purpose vs. those for artistic endeavour.
If anything, artistic user experience design has more chance of creating delight; it can address whimsical, comedic, bizarre or otherwise engaging non-commercial themes as it is not driven by business objectives. However, delight is not always the response that an artist seeks to provoke. Artistic user experience may reasonably provoke a whole range of responses from shock to shame, anxiety to antipathy etc.
Understand and embrace the research continuum.
In the world of commercial UX, design is underpinned by substantive if not exhaustive research used to develop, evaluate and validate design strategy and implementation. UX research thinking identifies the shifting nature of research activity as a trajectory from formative to summative.
Research cannot be all things at all times, it has a role to play at a given point in a project cycle. Artists would do well to consider how and when they can use research in their projects. For example, thematic exploration at the formative stage of a project to user testing towards a final exhibition / installation.
The designer is not the user, the artist is not the audience.
‘The designer is not the user’ is a common maxim in UX design used to reiterate the importance of objective review and testing. Another well known supposition is that it’s only necessary to test with 5 users in order to identity design problems. This idea comes from an original article published by the grand-daddies of UX Design, the Nielsen-Norman Group.
The 5 user tests approach is based on research identifying that exponentially less new faults are disovered by a greater numbers of testers and therefore 5 testers alone will identify the most pertinent and immediate issues. In a sense, it is a form of cost benefit analysis; why pay for more testers when they will identify far fewer new faults than the first 5? There are many assumptions wrapped up in this assertion, not least that the scale of the project to be tested does not exceed the testing capabilities of 5 individuals. Although the original research is sometimes challenged, in my own opinion, it’s a sensible and achieveable approach to have at least 5 people test the core functionality of a project, be it commercial or artistic. The implication is to expect problems to be found and plan to resolve those problems before re-testing.
Artists woud do well to consider how, when and with how many people they can test their work
Respect the double diamond.
The double diamond is a construct popularised by the Design Council in the mid 2000’s. It has now evolved somewhat and has been adapted to suit a growing number of contexts. It is often used to underpin UX design workflow.
At its heart, quite literally, the double diamond situates a defined design brief. To the left of the design question, the first diamond represents a divergent process that begins with the investigation of an orginal question, problem or proposition.
In the UX design workflow, an initial process of divergent investigation is used to thoroughly explore user needs, behaviours, motivations etc as well as to examine a whole raft of other important contexts such as stakeholder requirements, technological, legal and financial considerations. Through the process of user, stakeholder and domain knowledge discovery, the UX designer can begin to formulate and validate hypotheses and propositions through a convergent process of definition leading towards a validated design brief. The first diamond is often summarised as ‘design the right thing’ and exists to mitigate the risk of creating unnessary and/or unwanted products.
The second diamond is often summarised as ‘designing things right’. It too begins with a divergent phase, but this time the primary activity is to develop a range of designs in reponse to the validated brief. At some stage, the most suitable design is selected and the final approach to an actual solution is characterised as a convergent process of design validation including, of course, user testing.
The double diamond approach is exceptionanly versatile and can easily be adapted to the process of making tech-art, as shown below.
In this case, speculative investigation replaces the user / domain knowledge discovery phase, although of course, the artist will discover their own domains of knowledge through the art research process. Convergent ideation replaces design definition with the end result looking very similar – a defined proposition at the heart of the double diamond. The second diamond is perhaps closer to the UX version shown previously; divergent and then convergent processes are used to transform the defined concept into a resolved outcome.
There are a number of other UX design concepts and practices that can easily be appropriated by artists. Check out the following resources to form your own.
Arrango, J., Morville, P. and Rosenfield, L. (2015) Information Architecture, 4th Edition. Sebastopol, CA: O’Reilly Media
Cooper, A., Reimann, R., Cronin, D. & Noessel, C. (2014) About Face The Essentials of Interaction Design, 4th Edition. Indianapolis, Indiana: Wiley
Speaking at the recent Plugin Symposium hosted by Signals Media of Colchester, has given me a reason to reflect upon my own creative practice and in particular my urge to investigate the collaborative potential of digital art.
Professional self-reflection is a great activity, particularly when enhanced by the perspective of time: not just a little so that events are still fresh and perhaps too recent to view holistically, but neither too much so that memory is impinged upon by the distance of age! Of course, regular self-reflection is often portrayed as the saviour of creative professionals but ocassional, yet timely, self-reflection is certainly better than none!
Recently, in reflecting upon my own practice, I began by reclaiming the personal manifesto of seeking to create artistic works that are public, participatory and playful – the 3 p’s I set out to explore and draw connections between but a few years ago. I realised that my developing interest in collaborative art can essentially be articulated by a series of questions and corresponding creative responses.
Question: “How do I construct interactive experiences that are a pleasure to interact with and encourage co-interaction?”
For the sake of a more meaningful presentation at Plugin – I tried to pull together some of the elements that have shown themselves to be of special importance in the process of creating collaborative digital art. So here they are in slightly jumbled form, I hope they may be of some use to you, dear reader…
T is for Technology.
There is a seemingly insatiable appetite for new tech. It’s like a magnet that draws people in… so lets use it to do just that. Like the pathological urge to open Pandora’s Box. As an artist, one must position one’s box of tricks strategically with the metaphorical lid slighty ajar…
P is for the Phenomenon of Play.
Play is a magic circle entirely of our own making. Rules can be made, rules can be broken. Transgressions can be made in perfect safety. The willingness to participate is all it takes…therefore the invitation to play is of particular importance.
F is for Facilitation.
An Artist often plays the role of Facilitator. Collaborative digital art in itself is a facilitation. Some people very much like to be shown what to do – helping them understand how to get involved is an important aspect of facilitation. In certain situations, participants exiting an art experience themselves can become ambassadors to the next group of participants. Facilitation can go viral!
D is for Design.
If Art is about asking questions and opening up possibilities… design in the service of art solves problems and brings the art to life. From tech to user experience, there are many dimensions of design. It is an iterative process and can always be improved – so improve it!
A is for Audience.
Who is the collaborative experience aimed at? If its ‘aimed at everyone’ – that’s a tough call to get right, reword: that’s impossible! By figuring out who collaborative experiences are for, we can make them better, just the same as for any other service or product design – know thy user!
C is for Collaboration.
A truly multi-faceted word. Generally a force for good within the arts. But let’s consider what we mean by it when we use the word. For me it implies creating something new or finding new ways of working together where agency and creativity are bounced around the court of collective imagination. It can be question and response, it can synchronised, multilateral creativity. Whatever form it takes, collaboration can produce amazing results is to be recommended.
R is for Risk
Perhaps a certain amount of risk is inherent in collaboration and maybe that’s why it might feel unsafe and uncertain at times. It won’t work everytime either! One thing is for sure: the best creativity does not occur within a nice padded comfort zone!
Pleased to be sharing experiences and insights at the forthcoming Plug In Symposium, hosted by Signals Media, Colchester. Also very pleased to be sharing a platform with some great names 😉
Here’s how my talk is billed:
Collaborative Interaction: How Playful Technology Can Be Used To Mediate The Space In Between Us
Jamie Gledhill Digital Artist and Computer Sciences lecturer, Norwich University of the Arts
East Anglia-based artist and educator, Jamie Gledhill, will present and discuss elements of his digital arts practice including interactive installations and public art commissions. A recurring theme is the design of experiences that create connections between friends and strangers alike through the medium of technology-enabled play. Jamie will share the knowledge he has developed in this area and how this might be applied in wider contexts.