What to watch out for in 2021: scarcity models, return to live, and sustainability

MUSIC x focuses on long-term thinking about music & surrounding industries, so instead of looking back at the year we’re taking a look at trends we expect to be influential in the coming months with regards to tech, the pandemic, and sustainability. Here’s what to watch out for in 2021.

This article is jointly written by Bas Grasmayer and Maarten Walraven-Freeling.

Tech: Scarcity

Music was once a scarce good; the only way to experience it was live. Throughout the twentieth century technological developments have driven music from scarce to ubiquitous:

  • The inventions related to recorded sound go back to the late-nineteenth century and the patent for the first gramophone disc stems from 1887. It wasn’t until the 1920s that recording techniques changed to make it easier to record music and this helped the spread of music beyond the live experience. It also spurred on the music industry as we know it today.
  • Moreover, the 1920s saw the advent of radio which brought recorded music into most homes. Not only did this broaden the scope of the audience for music, the medium also influenced the format of music itself and the popularity of it and its performers. Fan culture was born.
  • Of course, radio was thought to kill the phonograph industry. But it didn’t. The equipment used for radio broadcast helped to improve recording standards for music and with it the sale of records which doubled from around 100 million in 1921 to 200 million in 1929. 
  • We jump to the 1950s and the rise of television and film. New opportunities first and foremost for composers and musicians to find new revenue streams. But, of course, this new medium was thought to kill the old radio industry. Again, it didn’t. Fan culture got a massive boost.
  • The trend continued into the broader acceptance of video and the rise of MTV in the 1980sVideo killed the radio star may be a popular song, but it didn’t happen. The age of the CD broke and recorded music industry revenues grew astronomically. More people got access to more and more music. 
  • 1999, Napster. The internet did actually nearly kill the recorded music industry. Suddenly, all music was available for free at everyone’s keyboard-fingertips. The response? All bets on ubiquity: From the failed early experiments of the major labels through YouTube to Spotify. Music is everywhere and we, the listener and fan, expect to have it all, always. 
  • For more than 100 years the music industry has been on a wave towards ubiquity with technological innovations as a catalyst forever thought to do more harm than good. Moving into the third decade of the twenty-first century, in order to maintain growth, we’ll need to jump on the scarcity wave.

Where to find scarcity?

How many people, publications, musicians, labels, etc. do you directly support? How many in 2018? How many right now? It’s likely you support a few and that this number has grown in the past three years. To keep you supporting you’re usually given access to exclusive content. In other words, exclusive content = stickiness. 

This year, the virtual Music Tectonics conference provided a couple of days of being online together with some of the frontrunners in music and tech and you would have been forgiven if you came away thinking direct-to-fan is what everybody does. This isn’t true yet, but it has grown significantly in 2020. Three things to keep an eye on:

Equity investment

From major players such as BTS’ label Big Hit Entertainment going public and the ARMY taking a stake in their own fandom to something like Bumper Collective which allows fans to buy a stake in the future royalties of their favourite artists’ music. This investment idea – and subsequently the idea behind all the major catalogue acquisitions of 2020 – comes from the belief that the music streaming economy will grow. More and more people will become a part of the music industry of ubiquity, but that also provides opportunities around the scarcity of ownership. 

Non-fungible tokens

In our recent update on blockchain in 2020 we dove into so-called ‘NFTs’. One week later, a digital artwork by Beeple sold for $777,777 on Nifty Gateway, a platform that makes it possible to own digital goods, making them scarce again. Days later, rapper Lil Yachty sold a digital collectible for $16,050 through the same platform. While earlier auctioned collectibles relied on being physical, such as the infamous single-copy Wu-Tang Clan album purchased by Martin Shkreli (the story of which is being turned into a movie on Netflix), the phenomenon has now gone digital.

Gated content

When Cardi B signed up to OnlyFans earlier this year, she announced it would be a place for only her and her fans. While doing stuff out in the open may get you fans and makes it easy for people to spread the word, gating content allows fans to feel like they’re accessing or are part of something special and helps the artist feel like they’re talking to their ‘true fans’. Cardi B and OnlyFans are far from the only examples. Membership models are rising in popularity through PatreonSubstack, and good old YouTube, among many others. If 2020 didn’t do so already, 2021 will see membership access models for artists go mainstream.

Corona: live/stream

Andrea and Virginia Bocelli during Believe in Christmas
Andrea Bocelli’s Believe in Christmas livestream

The pandemic and the enforced lockdowns have accelerated many changes that were already bubbling right underneath the surface of the music industry for years. None of these accelerations went faster than with livestreaming. While the live music industry was decimated, livestreaming took centre stage. At first most everything was free and poorly produced but that thankfully changed and we’re now faced with ticketed events of high production value from major artists like Dua LipaBillie Eilish and BTS. Similarly, there are artists who started going live often with good productions and on a subscription basis (exhibit A being Melissa Etheridge) leaning hard into their superfans. Meanwhile, the return to live seems to creep further into 2021 as we flow from lockdown to lockdown. With the vaccines, there will surely be live concerts as we head into the second half of 2021 but how will they be organised? Thus, the double-headed beast of live, streaming events and in-person events, is the trend coming through pandemic 2021

The livestream will develop into an ever more interactive medium, both for fans and artists. There will be more productions that will include elements like BTS’ geotagged lightstick, the ARMY BOMB, during their Bang Bang Con virtual concert. Similarly, the way Billie Eilish provided engagement even the day before the show and pulled up 500 fans during one song as they were watching from behind their screen will be further developed to enhance interactions between artist and audience. Once live music returns these livestream events will remain a staple of the touring artist. Take, as an example, the Genesis Reunion tour, postponed twice due to the pandemic and now scheduled to start in April 2021. Let’s imagine for a moment this tour will go ahead, but the band has no interest in touring beyond the UK and Ireland. One full month of touring and most of the world is left without an option to attend. They can decide to bring a full camera and production crew to one of their gigs and film the whole thing as is. The other option is to take one extra date, create something more interactive and bring that as a live event around the world. Instead of 18 months of touring the globe, the band can perform once and ‘tour’ from one geofenced url to the next. This will be attractive to artists not eager to tour full time and to fans who are traditionally in geographical locations where most touring musicians don’t visit.

Pandemic, or even epidemic, in-person concerts will see new hygiene regimes enter the everyday vocabulary for concert- and festival-goers. We’ve reported before about the scientific trials taking place in Germany, the Netherlands, and Spain, among others. What these show is that a combination of rapid testing, staggered entry, mask-wearing, ventilation, and protocols pertaining to movement will become normal. You won’t have to decide whether you want to watch the support act, instead you’ll arrive at a very specific time to be able to enter a venue. Tickets will become just that little bit more expensive as the cost of the rapid test will be included in the price. It will be a long slog and hard work to put these types of events on and to attend them, perhaps also to perform them.

And, of course, tours could get cancelled. How the risk of cancellation will be attributed will be a spearpoint for 2021: artist, promotor, venue? What role will governments play? One of the reasons everything has been postponed is that this has deferred the losses that would have come from cancelling. At what point, however, will it become impossible to postpone a tour – again? As these risks become real as the year advances more governments will step in to make sure venues, promotors and artists alike will feel safe to plan events (Germany leading the way again). This type of risk deferral will look different for major artists and companies like Live Nation and AEG than for smaller artists and independent venues and promotors. The former rely on more long-term planning and have access to different types of funding (see AEG’s staff cuts and its owner’s loan). They will certainly be able to hold out one way or another until live and in-person events return. Smaller artists and independent venues will depend more heavily on support structures, both from governments and fundraising activities.

Sustainability: think local

European Commission Executive Vice-President for the European Green Deal, Frans Timmermans.

Will sustainability be on anyone’s priority list in 2021 as many feel they’re making up for lost time, and revenue? Hard to answer, but it absolutely should be as our environmental crises are of an order of magnitude disproportionate to one pandemic. No music on a dead planet, as they say. Before the pandemic broke out, climate and the environment in general had a lot of momentum as topics in popular culture. This was, in part, due to movements like Extinction Rebellion and Fridays For Future, the latter of which spawned movements of school kids protesting weekly in countless cities all over the world. The latter has largely moved their protests online, while also trying to figure out pandemic-friendly protests offline that can easily be amplified through social media. While this cultural force has become momentarily less visible, it’s ready to mobilize as soon as it’s possible again.

While you can find an overview of initiatives and resources regarding this topic on MUSIC x GREEN, what we think you should be watching out for next year is the following:

Regional collaboration between the music sector, government, and other industries.

In many countries, but more specifically cities, we’ve been seeing various levels of cooperation and coordination between the music sector and (local) governments & institutions. This can be over restrictions and limitations, corona-proofing venues, scientific experiments, layoffs & furloughing, or bureaucratic aspects like insurances and cancellation. This relation should be preserved coming out of the pandemic in order to drive positive change around music & sustainability.

A prime example of this is Massive Attack’s work on decarbonising live music and coming to the conclusion that the primary partner for this are cities, rather than promoters or venues, because it’s about transport infrastructure, power, and waste. For this type of innovation & problem-solving, live events can be useful trials (as we’ve highlighted before). This echoes some of the thoughts put forth by Shain Shapiro, founder of Sound Diplomacy. In a multi-part series, Shapiro points out new trends in localism such as the 15-minute city and the fact that the music sector is as organised as it’s even been. Those are two very important ingredients to actionable change. While change is also anticipated in other areas, such as more artists employing more circular models for their merchandise, 2021 will be a year of disruption with a local focus being an easy way to counter risks, and an important opportunity for bringing about sustainable change.

How the rise of Authorless Music will bring Authorful Music

Forty thousand. That’s the number of songs being added to Spotify every day. Per year, that’s nearly 15 million. With AI, we are approaching a world where we could easily create 15 million songs per day. Per hour even. What might that look like?

Can music experiences performed by robots be Authorful? (photo: Compressorhead)

The music trend we can most linearly extrapolate into the AI age is that of utilitarian music: instead of putting on an album, we put on workout music playlists, jazz for cooking, coffee time Sunday, music for long drives.

Artists have become good at creating music specifically for contexts like this. It often forms a big consideration in marketing music, but for also the creation process itself. But an artist can’t be everywhere at once. AI can and will be. Meaning that for utilitarian music, artificial intelligence will have an unfair advantage: it can work directly with the listener to shape much more gratifying, functional music experiences.

This will lead to the rise of Authorless Music. Music without a specific author, besides perhaps a company or algorithm name. It may be trained by the music of thousands of artists, but for the listener it will be hard to pinpoint the origins back to all or any of those artists.

Do we want Authorless Music? Well, not necessarily. However if you track music consumption, it becomes obvious that the author of music is not important at all for certain types of music listening. Yet we crave humanity, personality, stories, context.

Those familiar with trend watching and analysis, know to keep their eyes open for counter trends. When more of our time started being spent on social platforms and music became more anonymous due to its abundance, what happened? We started going to festivals in numbers never seen before. So what counters Authorless Music?

The counter trend to Authorless Music is Authorful Music. Although there will be a middle space, for the sake of brevity I’ll contrast the two.

Authorless MusicAuthorful Music
OriginAI-created or obscureHuman-created (ish)
FocusSpecialised in functionSpecialised in meaning
RelationLittle emotional involvementStrong emotional involvement
TraitPersonalizedSocialized

Authorless Music: primarily driven by AI or the listener is unable to tell whether the listed artist is a real person or an algorithm. The music is specifically targeted towards augmenting certain activities, moods, and environments. Due to its obscure origin, the listener has little emotional involvement with the creator (although I’m looking forward to the days where we can see AI-algorithms fan bases argue with each other about who’s the real King / Queen of AI pop). In many cases it will be personalised to the listener’s music taste, environment, weather, mood, etc.

Authorful Music: primarily created and / or performed by tangible people or personalities. It will be focused in shaping meaning, as it is driven by human intent which embeds meaning by default. This type of music will maintain a strong emotional link between artists and their fans, as well as among fans themselves. This music exists in a social way – even music without lyrics, such as rave music, exists in a social context and can communicate that meaning, context, and intention.

With the increasing abundance of music (15 million tracks per year!), the gateway to Authorless Music has been opened. What about Authorful? What experiences will we craft in a mature streaming landscape?

Two important directions to pay attention to:

Socialising music experiences

It’s so easy to make and manipulate music on our smartphones now. Whether it’s music as a standalone or accompanying something on Instagram or TikTok. One reason for this massive amount of music being added to streaming services is because it’s easier than ever to make music. With apps that make it easy for people to jam around with each other, we’ll see a space emerge which produces fun tools and basically treats music as communication. This happens on smartphones but is strongly complemented by the virtual reality and gaming space.

See: JAM, Jambl, Endlesss, Figure, Smule, Pacemaker.

Contextualising music experiences

There is a lot of information around music. What experiences can be created by exposing it? What happens when the listeners start to enter the space between creator and listener and find their own creative place in the music through interaction? (I previously explored this in a piece called The future of music, inspired by a cheap Vietnamese restaurant in Berlin)

Examples of this trend: lyrics annotation community Genius, classical music streaming service IDAGIO, and projects like Song Sommelier.

Special thanks to Data Natives, The Venue Berlin, and Rory Kenny of JAM for an inspiring discussion on AI music recently. You’ve helped inspire some of these thoughts.

New to MUSIC x? Subscribe to the free newsletter for regular updates about innovation in music. Thousands of music professionals around the world have gone before you.

Four of the biggest opportunities for the future of music consumption

A reflection on key trends in music, tech, and user interfaces.

Soundcloud is saved, for now. On top of whatever strategic decisions they make to be able to attract follow-up investments, they face the difficult task of preserving their user community’s trust and winning back part of the trust they already lost. Tumultuous times are ahead, which will be frustrating, but also very exciting as it creates opportunity for new innovation and startups to claim their piece of the pie.

Underserved early adopter: the Myspace moment

Back in April I wrote about the fact that music is about to experience another Myspace moment. What I mean by that is that when Myspace hit decline, as it lost its community’s trust, new platforms got a chance as early adopters bailed and moved on. Musicians started building up audiences on Facebook and Twitter, and sharing their music on Soundcloud.

Now we see another Myspace moment: Spotify is focusing on mass audiences, and the prime early adopter platform has a distressed community due to the continuous struggles that Soundcloud has faced over the last years.

This creates opportunities for concepts such as:

  • Connecting groups of music listeners based on music taste or curiosity:
    • Soundcloud‘s struggling with this due to its failure to keep its search & tagging feature useful as the amount of content grew over the years, and they killed their groups feature;
    • Spotify has deprioritized user-created playlists and removed messaging functionality.
    • TheWaveVR could be one of the startups to fill this gap.
  • Collaboration and feedback:
    • If people are leaving Soundcloud, they need to take that somewhere else.
    • Audiu, which was one of the hottest startups at Sonar+D this year, could play a big role here.
  • Promo services for people who need an easy way to share music to journalists, labels, etc.

You could come up with a lot more ideas and find startups striving to make a meaningful impact there.

A third device in our midst: the Voice User Interface (VUI)

I’ve recently been playing around with an Amazon Alexa I ordered. At first I was skeptical and thought it would always feel awkward, but you get used to it fast and the convenience of a voice-controlled device in the living room (and other rooms) is bigger than I expected. I thought all those times you have to grab your mobile phone, or look something up on the computer, were minor and infrequent inconveniences. Now, the VUI has embedded itself into my life and all kinds of small habits, patterns and every day rituals.

VUIs are going to be the third device: first came PCs (plus laptops), then came smartphones (plus tablets), and now we’re going to get a third addition through voice-controlled devices like Amazon Alexa, Google Home, Apple‘s Siri-based devices, devices in the car, etc. Perhaps this is why Tesla is in talks to do a music streaming service: music is the way into these spaces.

So what happens to the way we browse and explore music when we take the visual user interface away? What place does the smartphone get? What place does the laptop get? And what behaviour extends to our smart speakers?

What happens in AI is very important for VUI apps, but also for chatbots.

Conversational interfaces: the rise of messaging apps

Messaging has frequently been called the next major platform. It enables chatbots, which are apps that live on conversational platforms (this is a trend that’s also strengthened by VUIs). Some of the biggest social platforms to rise up over the last decade were primarily messaging apps, such as  Snapchat, Whatsapp, Telegram, and Kik.

The next step of the social web is messaging, but smarter than the AIM, ICQ, and chatroom phase of social. Facebook is positioning Messenger in such a way that it can live as a platform on its own.

Read Music Ally‘s write-up of the chatbot panel I moderated at Midem.

Short-form video

I urge people to try out Instagram Stories and figure out what it takes to make good content for it. Short-form video content is so important in an age of short attention spans. Some of the hottest platforms to emerge among teens in the last years have been Snapchat and Musically, both limiting the time-length of videos being shared on the platforms. It’s fun, fast, and requires low commitment: making users share and explore more content.

I firmly believe this is going to change the way we write songs and structure them. We’ve already seen how the streaming playlist economy made tracks shorter, with people moving the vocals to the start of the track in order to make skips less likely. In the next years, the video story format is going to strongly impact music.

Instagram is another platform that may fare very well from the decline of user trust in Soundcloud‘s community.

 

I’ll be discussing more of these trends in my newsletter, which goes out every week on Monday. Sign up to stay in the loop.

Online music is about to experience another MySpace moment

An emerging void signals new opportunity for innovation in digital music.

The benefit of writing thoughts down is that you get to revisit them. Six years ago, I penned a piece for Hypebot called The Next MySpace. At that time, people in the music business were desperate to for another MySpace to emerge: the site had been a ray of hope, but as it collapsed, online music was scattered across an immature ecosystem of rapidly growing startups like Soundcloud, Bandcamp, Facebook, Spotify, and many others that were eventually acquired or perished and forgotten. I argued:

The closest we will ever get to a “next MySpace” will be either a music network or a social network that manages to gather, organise and integrate the fragments in spectacular fashion.

Defining the MySpace moment

What I call a MySpace moment is not when everything was going well for MySpace: it’s when decline set in. People started replacing MySpace’s music players, which sucked, with Soundcloud’s beautiful waveform players. People started moving much of their social lives to Facebook (for friends) and Twitter (to connect to strangers). Up until then, the dominant social network had been music-driven — people, especially teenagers, expressed their identities by making long lists of bands they liked.

From the ashes of MySpace, which never managed to recover, rose a new ecosystem of music startups. They’ve managed to make it easy for artists to connect to fans, get paid for online playback, let fans know about new shows, and be able to very specifically target people with ads.

That moment, that void, was a massive opportunity and many companies benefited from it.

That moment is here once again.

The new MySpace moment

There are two main factors contributing to a new emerging void for entrepreneurs to leap in. One has to do with product adoption life cycles, which I’ll explain below. The other has to do with the important position Soundcloud claimed in the online music ecosystem.

Soundcloud came closer to being the ‘next MySpace’ than any startup has. And let’s be blunt: the company is not doing well. After years of legal pressure to tackle the problem of works being uploaded to the service without rights holders’ permission, they were forced to adopt a service model that does not make sense for Soundcloud. The typical $10 a month subscription doesn’t make sense. People are on Soundcloud for the fresh content, the mixtapes, remixes, unreleased stuff: the things that will not be on Spotify for weeks or months (or ever!). Why inject the catalogue with music of long deceased people?

There have been reports that Soundcloud would consider any bids higher than the total amount of money invested into the company to date. That’s not a good sign. The road they’ve been forced into is a dead-end street, and the only end game is a quick acquisition.

I don’t think Soundcloud will die, but it is hard for the company to focus on what they’ve always been good at. Now that they’ve been forced into the Spotify model, those are the types of metrics that are going to matter. Subscriber numbers, conversion, retention. So it may struggle to do as good a job serving the audience they’ve traditionally serviced so well. (small note: I love Soundcloud, and the people there: prove me wrong!)

This leaves a vacuum.

Adding to that vacuum, is the fact that Spotify (and other streaming services) are looking beyond early adopters. To understand the phenomenon, have a look at the below graph:

Product Life Cycle & Innovation Adoption Curve

The top part of the graph details the product life cycle. The bottom part explains the type of audience you address during the steps of that life cycle. As we’ve all noticed from the jubilant press reports on streaming’s expansion, we’re in the growth part of the cycle. This means services like Spotify and Apple Music have to get really good at targeting Early Majority and Late Majority type consumers.

If you’re reading this, you’re in the Innovator or Early Adopter segment. Startups typically start off by targeting those segments. So when Spotify moves on from Early Adopters (their de-emphasizing of user generated playlists is a big hint!), it leaves room for new startups to target and better serve those types of users.

Filling the new void

What happens then? Well, we’re going to get to the next phase of the digital music ecosystem – which is mobile-driven, and flirting with augmented reality, VR, and artificial intelligence. Early adopters are likely to keep paying for their Spotify subscriptions – it’s too big a convenience to give up… So entrepreneurs will have to figure out ways to monetize new behaviours.

Now is a great time to look at very specific problems in music. Don’t try to build the next Spotify or the next Soundcloud. For a while, everyone was trying to build the next MySpace — all those startups are dead now. Instead, take a specific problem, research it, build a solution for someone, test it, try it again for a broader group, and if it works: double down and scale up.

Personally, I’m very curious to see where startup accelerator Techstars Music’s current batch will be five years from now.

Quick guide to the relaunched Anchor: reinventing the radio format

You may remember Anchor: it started as a sound-based social network where users could start discussions that others could chime in on. A kind of long-form Twitter, but with voice instead of text. I remember getting involved with some discussions started by Bruce Houghton, from Hypebot, but people’s interest soon waned and many of us moved on.

So the startup went back to the drawing board and re-envisioned its service, relaunching with a complete overhaul last week. It now allows users to include music in their audio stories and aims to “completely reinvent the radio format by making it easy for anyone to easily broadcast high quality audio from your phone, to wherever audio is heard.”

Screenshots of the relaunched Anchor 2.0

My first impressions

I paused writing in order to do my first show on Anchor (listen now) in order to get more familiar with the service. You can check it out for my first impressions on the call-ins feature, which allows station hosts to let other people get some airtime, the ephemerality, as well as some thoughts about Anchor as a place for music curation.


Expires in 24 hours, so you may be hearing something else by now.

After playing around with the app a bit more, checking out some of the content, including Cherie Hu’s, I’ve come to revisit my first impressions.

Anchor is like Instagram for audio

Instagram lets people share moments from their lives. It’s used by professionals and amateurs. Some content is more social and some is not. And with the introduction of Instagram Stories, a lot of the content has become ephemeral. That’s exactly what Anchor is, or could be, but for audio content.

While I was initially skeptical of Anchor’s ephemerality, it may be an upside: it reduces the hurdle for sharing content and stimulates creators to deliver content in a bite-size format. People can use it to record their day and share their experiences, like music tech blogger Cherie Hu is doing at SXSW, while others use it as an extension of their professional podcasts or YouTube channels.

When someone calls in, it can be added to the station, after which it lives for another 24 hours. The host needs to take into account that whatever the caller might be responding to is not available anymore by the time their audience checks it, but that can be easily mitigated by adding a short “So yesterday I asked how people feel about fainting goats, and here’s what some of you had to say!”

As people add new audio, it’s added to their stories similar to what Snapchat (or Instagram) do in their apps.

The Instagram analogy extends:

  • station can be seen as a profile
  • Pressing favorite is akin to following
  • Calling-in is like tweeting & featuring a call-in is like retweeting

It seems Anchor may be able to deliver upon Soundcloud-founder Alexander Ljung’s vision of the web becoming a more audible medium, with sound possibly becoming bigger than video:

“Sound is one of the only mediums that can be consumed completely while multitasking, so it has the potential to do so much more on the web than it’s already doing.”

So forget the radio lingo: Anchor is still a sound-based social network and it’s pretty awesome.

Experiment with it. Develop a format. Then ping me on Twitter, so I can check it out.

Google Glass

When augmented reality converges with AI and the Internet of Things

The confluence of augmented reality, artificial intelligence, and the Internet of Things is rapidly giving rise to a new digital reality.

Remember when people said mobile was going to take over?

Well, we’re there. Some of the biggest brands in our world are totally mobile: Instagram, Snapchat, Uber. 84% (!) of Facebook’s ad revenue now comes from mobile.

And mobile will, sooner or later, be replaced by augmented reality devices, and it will look nothing like Google Glass.

Google Glass
Not the future of augmented reality.

Why some predictions fail

When viewing trends in technology in isolation, it’s inevitable you end up misunderstanding them. What happens is that we freeze time, take a trend and project the trend’s future into a society that looks almost exactly like today’s society.

Past predictions about the future
Almost.

This drains topics of substance and replaces it with hype. It causes smart people to ignore it, while easily excited entrepreneurs jump on the perceived opportunity with little to no understanding of it. Three of these domains right now are blockchain, messaging bots, and virtual reality, although I count myself lucky to know a lot of brilliant people in these areas, too.

What I’m trying to say is: just because it’s hyped, doesn’t mean it doesn’t deserve your attention. Don’t believe the hype, and dig deeper.

The great convergence

In order to understand the significance of a lot of today’s hype-surrounded topics, you have to link them. Artificial intelligence, smart homes & the ‘Internet of Things’, and augmented reality will all click together seamlessly a decade from now.

And that shift is already well underway.

Artificial intelligence

The first time I heard about AI was as a kid in the 90s. The context: video games. I heard that non-playable characters (NPCs) or ‘bots’ would have scripts that learned from my behaviour, so that they’d get better at defeating me. That seemed amazing, but their behaviour remained predictable.

In recent years, there have been big advances in artificial intelligence. This has a lot to do with the availability of large data sets that can be used to train AI. A connected world is a quantified world and data sets are continuously updated. This is useful for training algorithms that are capable of learning.

This is also what has given rise to the whole chatbot explosion right now. Our user interfaces are changing: instead of doing things ourselves, explicitly, AI can be trained to interpret our requests or even predict and anticipate them.

Conversational interfaces sucked 15 years ago. They came with a booklet. You had to memorize all the voice commands. You had to train the interface to get used to your voice… Why not just use a remote control? Or a mouse & keyboard? But in the future, getting things done by tapping on our screens may look as archaic as it would be to do everything from a command-line interface (think MS-DOS).

XKCD Sudo make me a sandwich
There are certain benefits to command-line interfaces… (xkcd)

So, right now we see all the tech giants diving into conversational interfaces (Google Home, Amazon Alexa, Apple Siri, Facebook Messenger, and Microsoft, err… Tay?) and in many cases opening up APIs to let external developers build apps for them. That’s right: chatbots are APPS that live inside or on top of conversational platforms.

So we get new design disciplines: conversational interfaces, and ‘zero UI’ which refers to voice-based interfaces. Besides developing logical conversation structures, integrating AI, and anticipating users’ actions, a lot of design effort also goes into the personality of these interfaces.

But conversational interfaces are awkward, right? It’s one of the things that made people uncomfortable with Google Glass: issuing voice commands in public. Optimists argued it would become normalized, just like talking to a bluetooth headset. Yet currently only 6% of of people who use voice assistants ever do so in public… But where we’re going, we won’t need voice commands. At least not as many.

The Internet of Things

There are still a lot of security concerns around littering our lives with smart devices: from vending machines in our offices, to refrigerators in our homes, to self-driving cars… But it seems to be an unstoppable march, with Amazon (Alexa) and Google (Home) intensifying the battle for the living room last year:

Let’s converge with the trend of artificial intelligence and the advances made in that domain. Instead of having the 2016 version of voice-controlled devices in our homes and work environments, these devices’ software will develop to the point where they get a great feeling of context. Through understanding acoustics, they can gain spacial awareness. If that doesn’t do it, they could use WiFi signals like radar to understand what’s going on. Let’s not forget cameras, too.

Your smart device knows what’s in the fridge before you do, what the weather is before you even wake up, it may even see warning signs about your health before you perceive them yourself (smart toilets are real). And it can use really large data sets to help us with decision-making.

And that’s the big thing: our connected devices are always plugged into the digital layer of our reality, even when we’re not interacting with them. While we may think we’re ‘offline’ when not near our laptops, we have started to look at the world through the lens of our digital realities. We’re acutely aware of the fact that we can photograph things and share them to Instagram or Facebook, even if we haven’t used the apps in the last 24 hours. Similarly, we go places without familiarizing ourselves with the layout of the area, because we know we can just open Google Maps any time. We are online, even when we’re offline.

Your connected home will be excellent at anticipating your desires andbehaviour. It’s in that context that augmented reality will reach maturity.

Google Home

Augmented reality

You’ve probably already been using AR. For a thorough take on the trend, go read my piece on how augmented reality is overtaking mobile. Two current examples of popular augmented reality apps: Snapchat and Pokémon Go. The latter is a great example of how you can design a virtual interaction layer for the physical world.

So the context in which you have to imagine augmented reality reaching maturity is a world in which our environments are smart and understand our intentions… in some cases predicting them before we even become aware of them.

Our smart environments will interact with our AR device to pull up HUDs when we most need them. So we won’t have to do awkward voice commands, because a lot of the time, it will already be taken care of.

Examples of HUDs in video games
Head-up displays (HUDs) have long been a staple of video games.

This means we don’t actually have to wear computers on our heads. Meaning that the future of augmented reality can come through contact lenses, rather than headsets.

But who actually wants to bother with that, right? What’s the point if you can already do everything you need right now? Perhaps you’re too young to remember, but that’s exactly what people said about mobile phones years ago. Even without contact lenses, all of these trends are underway now.

Augmented reality is an audiovisual medium, so if you want to prepare, spend some time learning about video game design, conversational interfaces, and get used to sticking your head in front of a camera.

There will be so many opportunities emerging on the way there, from experts on privacy and security (even political movements), to designing the experiences, to new personalities… because AR will have its own PewDiePie.

It’s why I just bought a mic and am figuring out a way to add audiovisual content to the mix of what I produce for MUSIC x TECH x FUTURE. Not to be the next PewDiePie, but to be able to embrace mediums that will extend into trends that will shape our digital landscapes for the next 20 years. More on that soon.

And if you’re reading this and you’re in music, then you’re in luck:
People already use music to augment their reality.

More on augmented reality by me on the Synchtank blog:
Projecting Trends: Augmented Reality is Overcoming its Hurdles to Overtake Mobile.