Beauty in code – 5 ways digital poetry combines human and computer languages



Joshua Sortino/Unsplash, CC BY

David Thomas Henry Wright, Nagoya University

Since lockdown, everyone has had to rely heavily on digital technologies: be it Zoom work meetings and lengthy email chains, gaming and streaming services for entertainment, or social media platforms to organise everything from groceries to protests. Human existence is now permeated by non-human computer language.

This includes poetry. Digital technologies can disseminate and publish contemporary poetry, and also create it.

Digital artists combine human and computer languages to create digital poetry, which can be grouped into at least five genres.

1. Generative poetry

Generative poems use a program or algorithm to generate poetic text from a database of words and phrases written or gathered by the digital poet.

The poem may run for a fixed period, a fixed number of times, or indefinitely. Dial by Lai-Tze Fan and Nick Montfort, for example, is a generative poem that represents networked, distant communication. It depicts two isolated voices engaged in a dialogue over time. Time can be adjusted by clicking the clocks at the bottom of this emoji-embedded work.

A still from generative poem Dial (2020) by Lai-Tze Fan and Nick Montfort.
nickm.com

The recent web-based work Say Their Names! by digital artist John Barber generates a list from more than 5,000 names of Black, Hispanic, and Native Americans who have been killed by police officers in the United States from 2015 to the present day. No judgement regarding the victims’ guilt or innocence is made. Each name is simply spoken – in a sometimes incongruously cheerful tone – by a computerised voice.




Read more:
Listen to me: machines learn to understand how we speak


2. Remixed poetry

Nick Montfort’s generative poem Taroko Gorge was inspired by a visit to Taroko Gorge in Taiwan.

Montfort writes: “If others could go to a place of natural beauty and write a poem about that place, why couldn’t I write a poetry generator, instead?” Scott Rettberg then took the code from Montfort’s poem and replaced the vocabulary to produce Tokyo Garage, turning Montfort’s minimalist nature poem into a maximalist urban poem.

J.R. Carpenter undertook a similar transformation – replacing the nature vocabulary with words associated with eating.

There are now dozens of Taroko Gorge remixes. By inspecting the source of Montfort’s poem, one can carve into the code to remix one’s own version.

Scott Rettberg’s Taroko Gorge remix.

3. Visual verse

For centuries, poets have combined poetry and images. In the late 1700s, William Blake combined poetry with engraved artwork in his conceptual collection Songs of Innocence. Contemporary poets use digital technologies to similarly adorn poetry with imagery.

The title of Qianxun Chen’s work Shan Shui means mountain and water in Chinese, and landscape when combined as shanshui. It also refers to traditional Chinese landscape painting and a style of poetry that conveys the beauty of nature. With each click, a new Shan Shui poem is generated with a corresponding Shan Shui landscape painting.

Shan Shui (2014) by Qianxun Chen makes a new illuminated poem with each click.
elmcip.net

Visuals also find their way into poetry performance. The Buoy by Meredith Morran is a poetic work of auto-fiction that uses a series of diagrams to create a new form of language to address political issues involving marginalised identities.

Morran combines abstract images, performance and PowerPoint presentation software to indirectly address a personal history of growing up queer in Texas.

A Brief History of How Life Works (2017) by Meredith Morran.



Read more:
Friday essay: a real life experiment illuminates the future of books and reading


4. Video game poem plays

The 1960s and 70s saw the emergence of text-based computer games, such as Zork, the source code of which is archived at the MIT libraries.

Queensland digital poet Jason Nelson has created a number of works that fuse these two modes. One is called game, game, game, and again game, which Nelson describes as “a digital poem, retro-game, an anti-design statement, and a personal exploration of the artist’s changing worldview lens”. The work disrupts commercial video game design with the player not striving for a high score – but instead moving, jumping, and falling through an excessive, disjointed, poetic atmosphere.

A still from game, game, game, and again game (2007) by Jason Nelson.
elmcip.net

The emergence of virtual reality games, such as Half-Life: Alyx, has also met with poetry.

Australian digital artist Mez Breeze’s V[R]ignettes is a virtual reality microstory series. The audience can experience this work by donning a virtual reality headset or viewing it in 3D space in browser. Each V[R]ignette combines poetic text, 3D models, and atmospheric sound design. The reader (or user) can navigate by clicking on the “Select an annotation” bar at the bottom of the screen, or simply look around in 3D space and freely explore the work.

A still from V[R]ignettes (2019) by Mez Breeze.
elmcip.net

5. Coded messages

Code poetry is a genre that combines classical poetry with computer language.

Code poems, such as those compiled by Ishac Bertran in the print collection code {poems}, do not require a computer to exist. However, they do use computer languages, so to comprehend the poem one must be able to read computer code.

Like so many untranslatable Russian and Chinese poems, these works require a knowledge of the original language to be appreciated.The Conversation


Ignotus the Mage/flickr, CC BY-SA

David Thomas Henry Wright, Associate Professor, Nagoya University

This article is republished from The Conversation under a Creative Commons license. Read the original article.

We, robot: the computer co-authoring a story with a human writer



File 20171002 12115 f0kpql
shutterstock.
Shutterstock

Leah Henrickson, Loughborough University

In Isaac Asimov’s I, Robot, a collection of nine short stories about robotics, Asimov explores the possibilities of human-computer interaction. How can humans and computers co-exist? How can they work together to make a better world?

A research group from the Meertens Instituut in Amsterdam and the Antwerp Centre for Digital Humanities and Literary Criticism recently introduced a new digital creative writing system. Using a graphical interface, an author drafts a text sentence by sentence. Then, the system proposes its own sentences to continue the story. The human and the computer work together to create what the system’s developers call “synthetic literature”.

The paper detailing this project describes the text generation system as an attempt to:

Create a stimulating environment that fosters co-creation: ideally, the machine should output valuable suggestions, to which the author retains a significant stake within the creative process.

How to train your robot

To learn language and sentence structure, the system has been trained using the texts of 10,000 Dutch-language e-books. Additionally, the system was trained to mimic the literary styles of such renowned authors as Asimov and Dutch science fiction author Ronald Giphart by generating sentences that use similar words, phrases, and sentence structures as these authors.

As part of this year’s annual Nederland Leest (The Netherlands Reads) festival, Giphart has been trialling the co-creative writing system to write a tenth I, Robot story. Once Giphart’s story is completed it will be published at the end of a new Dutch edition of Asimov’s classic text. Throughout November, participating libraries throughout the Netherlands will be offering free copies of this edition to visitors to get people thinking about this year’s festival theme: Nederland Leest de Toekomst (The Netherlands Reads the Future).

As Giphart types new sentences into the system’s graphical interface, the system responds by generating a selection of sentences that could be used to continue the story. Giphart can select any of these sentences, or ignore the system’s recommendations altogether.

The point of the system, its developers explain, is to “provoke the human writer in the process of writing”. Giphart says he still considers himself “the boss, but [the system] does the work”. One article even described the system as being ideal “for those who have literary aspirations, but who lack talent”.

Can a computer be creative?

The “synthetic literature” referred to by this system’s developers implies a combined production effort of both human and computer. Of course, the human still guides production. As co-developer Folgert Karsdorp explained: “You have numerous buttons to make your own mix. If you want to mix Giphart and Asimov, you can do that too.” The system follows its user’s direction, responding by using its own capacity for creativity.

But can a computer ever be truly creative? This is a question that the field of computational creativity has been studying since computers were invented. The field generally accepts that a computer can be called creative if its output would be considered creative had it been produced by a human.

Computational creativity debates are all rooted in one underlying question: is the computer merely a tool for human creativity, or could it be considered a creative agent itself? In a discussion about computer-generated art, creativity scholar Margaret Boden noted that:

It is the computer artist [the developer] who decides what input a system will respond to, how the system will respond, how unpredictable the system’s output will be, and how transparent the system’s functionality will be to users.

Even the most unpredictable output, according to Boden, results from choices the computer artist has made. While a developer may not be able to predict a system’s exact output, the output nevertheless reflects the choices the developer has made while programming.

Computer systems can be trained to mimic the language and sentence structure of particular writers.
Shutterstock

The co-creative writing system Giphart is using isn’t able to produce an entire book by itself, but it can produce paragraphs that continue Giphart’s story for him. Giphart, though, ultimately has the power to choose what computer output he uses.

But does this mean that Giphart alone will be credited as the author of his Ik, robot story, or will his computer be given credit as a co-author? It’s still unclear. Although it could be hotly debated whether the creative writing system is just a tool for Giphart’s vision or could be considered an agent itself, we won’t be seeing the demise of human authors any time soon.

One Nederland Leest blog post compares this new method of writing to the evolution of the electric guitar. It may have existed for nearly a century, but it wasn’t until Jimi Hendrix showed us how to really play the instrument that its potential was realised. Similarly, we still need to discover how to “play” this writing system to get the best results, whatever they might be.

So is synthetic literature the future? Maybe. Keep reading to find out.

The ConversationA video explaining the project is available here, in Dutch.

Leah Henrickson, PhD Candidate, Loughborough University

This article was originally published on The Conversation. Read the original article.

Despite slowing growth, tablet sales expected to overtake PCs next year


Gigaom

If you consider the start of the current tablet market to be 2010 when the iPad(s aapl) launched, it will have only taken five years for tablets to outsell traditional PCs. That’s the expectation from research firm Gartner, which published its latest computer sales forecast figures on Monday.

Dell Venue Pro tablets

We’ve already witnessed an overall decline in PC sales for the past 18 months but the growth rate for tablet sales is slowing as well. Put another way: Tablet sales are still on the rise, just not as quickly as they were in previous years. Gartner estimates 256 million tablets will be sold this year, which is 23.9 percent more than in 2013. By comparison, the firm says 120 million tablets were sold in 2012 and 206 million last year, which is a jump of nearly 72 percent.

Next year, Gartner figures, will see 320.9 million tablet sales compared to 316.6 million…

View original post 142 more words

Book Review: Phantoms on the Bookshelves, by Jacques Bonnet


‘Phantoms on the Bookshelves,’ by Jacques Bonnet was translated from the French original by Sian Reynolds and has an introduction by James Salter. The copy I have is a Kindle edition. It was first published in Great Britain in 2010 by MacLehose Press. It is a relatively short book at 123 pages in length, so it won’t take too much to get through it.

Phantoms on the Bookshelves, by Jacques BonnetThe introduction to the book by James Salter is a good, brief read concerning the author of the book and his book collecting ways. It could easily describe me, though I have nowhere near as many books as Bonnet, even though I have thousands myself in traditional form and/or digital format. I see similarities between the description given of Bonnet by Salter and myself, with my far fewer volumes. I too struggle now to find room for them all, with my virtual bookshelves requiring expansion in the near future to accomodate my book collecting ways into the current century and digital age. Traditional books have long run out of room in this house, as I suspect they have in Bonnet’s apartment.

Bonnet is a man who loves books and his thoughts on what is normal in a home, the presence of many books, is something I can relate to. I also find myself in wonder when I see homes with no books, particularly in some of the circles in which I move or have moved. How can they get by without books? Mind you it is probably not as easy a situation to read (no pun intended – truly not) these days, with books now being able to be stored by the thousands on a home computer and/or on an external hard drive or two. Still, I have wondered this for many years and I think Bonnet would probably agree with me. Relating to others is made easier when discussing books for Bonnet and I find this an agreeable thing also. It is the way of Bibliophiles, whether we use that term or not (perhaps for some Bibliomaniac is a better term).

I did not find Bonnet’s chapter on cataloguing and organisation helpful at all, though I expect it would help some. This is probably because I have developed my own system which closely resembles that of the Dewey to almost certainly be called a Dewey system. The Bonnet decsription horrified me and I thought it would become far too confusing and disorienting for me. He is certainly right about the Internet making a major impact on libraries and the need to have as many books as he has in his collection. It is not only the storing of works on the World Wide Web, in the cloud and on other digital storage systems like computers, external drives, etc, where libraries are changing and/or have changed, but also in the cataloguing and organisation of books. I have a large number of books stored on digital devices and by digital means, but I also have access to far more over the Internet from vast libraries that I can access online. But I also have both offline and online digital methods for assisting me in cataloguing and organising my books, which I use as best I can and with great relief for being able to do so. Yet it boils down to individual choice and comfortableness, being able to manage these resources in a way that allows the individual to harness them to the greatest effect, which is indeed something of an indiviual matter and process.

The Bonnet method of reading will not be everyones cup of tea, but that’s OK too, because that is also a very individualistic thing. Bonnet likes lying down to read, I prefer sitting at a desk. Bonnet likes to underline and write in his books as he reads, I prefer to highlight and collate quotes via other media. There is no one rule for all, but many different rules for many different people. The thing is to retain what one reads in some way, that I think is the key to reading. It is certainly not a requirement to read each and every book from cover to cover, but to take a dip in each one to some extent and to achieve some purpose when doing so is required if you wish to say that you read your books and they aren’t just display items.

The manner in which Bonnet has collected his books is almost baffling to someone who has not done so in the same manner. He seems almost obsessed with completing lists and collections of books, of following every author/book line that comes up in what he reads or experiences. It seems any book mentioned must be obtained for his library. This is the way of a Bibliomaniac, that is for sure. His obsession with collecting ‘picture’ books is another seemingly crazed hobby which almost seems to be a driving force for him. I too collect books, but this insight into how another book lover and lover of reading goes about collecting his books is one that is beyond my experience. It is a fascinating world of book hunting and gathering if ever there was one. Something about one book leads to another which leads to another, or some conversation leads to a book which leads to another, etc.

Bonnet’s reflections upon his books shows someone who truly absorbs what he reads and imbibes the being of those written about. He seems to feel them, to know them, far better than any creator of them. Authors of books, whether fictional pieces or biographical/autobiographical works fade with the passing of time, if indeed a true reflection of them is left in the pages of the books they write or in the annals of history. However, those created and placed within the realms of literature remain the same and can be known almost completely. There are places to visit, whether real or ethereal, people to meet and to greet. Books bring a whole world to one’s home and experience, and even beyond that one travels into the realm of fictional lands and peoples. A plethora of experience that is only exaggerated when the library is swollen by multimedia resources. What an amazing world the library can become – is.

Buy this book at Amazon:
http://www.amazon.com/Phantoms-Bookshelves-Jacques-Bonnet/dp/1590207599/

The Book Stand


The Book Stand is my Tumblr Blog, which is all about free Kindle and PDF format ebooks. The Blog is regularly updated and now has something like 50 ebooks listed. These ebooks are not always free for long, so please check that they still are if you wish to get the ebook for free only. There are some great books available for free.

Visit The Book Stand at:
The Book Stand.

The Book Stand content is now available in the right hand column of this Blog also via a RSS feed and widget.

Remember, you can always download the free Kindle app for your computer, Mac or other device from Amazon, so you don’t need to actually own a Kindle ebook reader.

Visit Amazon for these options:
Amazon Kindle Apps

Kindle: I Finally Have One


After a number of years of reading ebooks on my lap top and before that on my old computer, I have now got myself a Kindle – the Kindle 4. A little bit of trial and error – a bit of playing about with it and I think I now have it worked out (more or less). I’m thrilled with it I have to say. I’ll finally be able to read ebooks without having to set up the lap top – so much easier with the Kindle. So I have loaded a couple of books onto it with the USB connection to the lap top, so I’m set to go. Now I can take my reading with me wherever I go and not be worried about a bulky set up of any description.

I have also bought the Kindle cover for it, that way the screen will be protected and my investment won’t meet an unhappy and early death.

For more information on the Kindle visit:
http://www.amazon.com/dp/B0051QVF7A/
http://en.wikipedia.org/wiki/Amazon_Kindle