Your own personal AI music star

Could virtual music stars reach millions of people without doing so through communal experiences? It’s something we’re bound to find out in the next decade.

Virtual stars are not a new thing. Vocaloid avatar Hatsune Miku has been around for over a decade and opened for Lady Gaga in 2014. Another type of avatars are virtual YouTubers who have been around for about half a decade. Arguably the most well-known avatar of that group, Kazuna AI, recently performed at Porter Robinson’s online Secret Sky Festival. Chinese streaming giant iQiyi’s research into virtual idols has shown that 64% of people aged 14 to 24 in the country follow one or more avatar stars.

Thus far, the music stars in this area of entertainment have followed a similar strategy to real-life pop stars: getting on a (virtual) stage and singing to many fans. An AI-powered chatbot named Xiaoice shows the potential for another approach.

Visitors view the Xiaoice booth at the World Artificial Intelligence Conference 2019 in Shanghai, Aug. 31, 2019. Chen Yuyu/People Visual

Xiaoice is a virtual assistant designed to keep users engaged by forming deep emotional connections to them. The result? Over 600 million people have tried the bot out over the past years with many of them becoming hyper-engaged. The company, spun off from Microsoft, estimates that “half the interactions with AI software that have taken place worldwide have been with Xiaoice.” The AI’s fans are 75% male and reading about some of the ways they describe interacting with her may remind one of the movie Her.

Xiaoice is a type of mass media to which each user feels a personal connection, because instead of one-to-many communication (like pop stars), the virtual friend is able to have one-to-one communication at scale, much like Siri and Alexa. The communication model it uses is hard to apply for a human being who can only do one thing in one place at one time, but with improvements in AI and the increasing virtualization of music the one-to-one model is easier to utilize by the music business.

I’m not aware of a one-to-one virtual music idol at scale (do leave a comment if you know of something), but I have no doubt that something like this will emerge over the next years, no doubt using channels like TikTok as part of a user acquisition funnel and becoming part of mainstream consciousness that way.

Interestingly, I think this discussion mimics one of the cultural discussions we are having around music right now as exhaustion sets in trying to attain higher streaming numbers for unsatisfactory incomes. So as musicians explore models beyond extracting small amounts of money from giant numbers of listeners — such as membership models like Patreon â€” we may see virtual idols mimic the cultural shift in music, but apply the dynamics at a scale that non-AI creators can’t employ.

As long as that doesn’t lead to a situation where AI idols start cannibalising the membership revenues of non-AI performers, that scale may not be an issue beyond the fact that the bargaining power may distort other markets that musicians rely on for income. While the next year’s theme will be a return to normal, the next decade will stretch and upend the meaning of normal.

Music & blockchain as 2020 concludes

It’s not that things have gone quiet around blockchain. It’s just that things were really loud when it was being touted as a silver bullet to all of the music industry’s productivity.

Meanwhile the technology is reaching its plateau of productivity, so let’s take a quick look at what’s bubbling up among the initiatives leveraging blockchain technology in the music space right now.

(If you need a primer on blockchain, read my 2016 piece “The Music Industry Isn’t Ready For Blockchain” in which I shared my skepticism about the silver bullet way of thinking at the time)

The following is not intended to be a complete overview — if you’re doing something in this space, feel free to put yourself on my radar by pinging me on Twitter.

Music rights

Ownership of songs can famously be complex. One of the startups trying to solve the problems around this is Verifi Media (formerly Dot Blockchain). This year the company partnered with music distributor FUGA to let its users register their (meta)data on a blockchain that tracks changes to proprietary data. Then, Verifi partnered with rights management platform Unison Rights bringing together rights metadata on the work and recording level.

The promise of the use of blockchain in this space is that changes to data can be made real-time and transparently, which also creates benefits for faster and more accurate reporting and payments.

Cryptocurrency

Facebook’s long-awaited ‘stablecoin’ Diem (formerly known as Libra) could launch as early as January. One of the Diem association’s members is Spotify, which has long shown interest in the space. They’re furthering their commitment now and are looking to hire someone to their payments strategy & innovation team that is specifically focused on digital assets such as the blockchain-based Diem.

Rapper Lil Yachty is the most recent star to launch their own cryptocurrency, called “YachtyCoin”. The token will allow fans to earn perks similar to things you might see in Patreon tiers or Kickstarter rewards. How exactly is still unclear. The token is powered by Fyooz, a platform that encourages creators to ‘become a token’.

Decentralization

In the case of Audius, a blockchain-based streaming platform I’ve written about (a lot) recently, blockchain is used to distribute value more directly between participants of the platform (e.g. artists and listeners). Their tokens also allow users to participate in the governance of the platform — creating a more decentralized approach to platform-development than the status quo of streaming — akin to common practices in open source software.

Marketplaces & Non-fungible tokens

Through tokenizing the trade of goods, market places such as Foundation and Zora (the latter of which recently raised $2M) allow creators to participate in the secondary market of limited-edition goods. The latter launched a token with musician RAC, which is built on Ethereum (a popular blockchain for cryptocurrencies) and is rewarded to his “most loyal fans”. Holders of the token, which can only be earned and not bought, will have exclusive early access to new merch released through Zora by RAC (who’s also an investor in Zora).

Whether physical or digital, so-called non-fungible tokens (NFTs) are used to prove the authenticity of goods and are already leading to sales of digital art for $100k. It could create an interesting avenue for digital scarcity and what 2020 was for livestreaming in music, 2021 could be for NFTs for high profile artists. New startups keep popping up, like Catalog where artists can sell single-edition music recordings and make money off of the secondary trades.

Up until now, these types of experiences would mostly appeal to collectors and superfans due to the associated price tags, but it’s interesting to think about what applications could be for more accessible types of digital scarcity (e.g. creating a song that can only be heard once and then must be sold on through a bidding mechanism).

As music professionals had to figure out models of digital scarcity and unique virtual experiences as a response to the pandemic, those insights can now be used to explore completely new avenues, some of which may be blockchain-based.

Special nod to Music Ally and Cherie Hu whose writing provide an accessible overview of the space.

Music streaming as a protocol: why I was wrong about Audius

Last week I wrote about blockchain-based streaming platform Audius in this newsletter. I criticized the strategy of ‘becoming the anti-SoundCloud’ and its plans for dealing with takedowns while recognizing the exciting potential of a more complex music economy. The next day Holly Herndon and Mat Dryhurst released a new Interdependence podcast episode where they go in conversation with the Audius founders. It made me completely change my mind about the platform.

Don’t be too quick to dismiss Audius: separating the content & functionality layer is one of the keys to unlocking a new music economy.

Protocol or platform, not service

Audius should be thought of as a decentralized platform rather than as a startup or streaming service. While there is a team behind the project, it seems they mostly work to bring into existence the components outlined in their whitepaper (PDF). These aspects are open-sourced and governed by the user community of the protocol.

While a service’s success is dependent on whatever interface is slapped on to the technical infrastructure, a protocol is less dependent on any one interface. For example, a company poorly redesigning an email client isn’t going to kill email, but it may kill the app or the company behind it. The most exciting aspect of Audius is not the current interface; it’s that they’re trying to create a protocol for digital music that could have any number of interfaces plug into it.

Clipped from the Audius whitepaper linked above.

One of the most important elements of that protocol is a concept I was previously very skeptical about.

Artist-determined stream pricing

Audius wants to let artists set a per-stream rate for their tracks, so if someone wants $1 / stream, they could do so. If they want something close to whatever are the current average Spotify or Apple rates, that’s possible too.

Why I was skeptical about per-stream rates is that it creates a form of metered streaming: load up your wallet and watch the currency tick away as you listen to music. If you’re creating a SoundCloud lookalike (or: ‘like Soundcloud, but better’) to fit into the current landscape of streaming services, then metered streaming is a constraint that will inevitably scare users off. It won’t just scare people off in the sense that they won’t want to load up their wallet if they don’t know what they’re going to listen to yet, but more importantly it will have people make economical decisions about established micro-behaviours around music listening. I think in the end, that would be stressful and exhausting and users would stop coming back. However I’ve come to realize I’m wrong about this.

Differently priced music does not have to live in the same streaming interface. Lower-priced music might be what fuels background-listening type radio apps. Higher-priced music may be at the center of interfaces that connect you to new releases by your favourite artists. There are some pieces of classical music that I listen to maybe once a year, that I value more than some music that I listen to weekly. Per-stream pricing could help make up for the fact that that classical piece gets only 1 yearly stream from me versus 52 streams for a random track — whose creator I don’t even know — in a playlist I use to focus on writing.

What Mat and Holly communicate very well in their podcast with Audius is that ‘music’ is not one thing, yet the online landscape doesn’t reflect that fact well. To some degree, the compensation model embedded in the licenses dictates a lot of the user experience. In the past I’ve led teams at two music streaming services wanting to do things differently and while you can go quite a long way, in the end you have to exist in a landscape dictated by just one economic game: maximization of streams.

A change to that landscape would be refreshing and a welcome way to generate more revenue streams.

Content / interface-layer challenges

There is still a whole range of challenges to deal with in such a system. Who sets the per-stream price for example? Is it whoever has the highest degree of ownership of the sound recording? What if they change the price while it’s live and because of that the track is no longer playable through certain interfaces? Or if it all lives in the same interface: do you interrupt playback to give people a warning before an expensive track starts playing? What if their phone is in their pocket? These are just some of the design problems developers would have to think about in a decentralized system with such principles.

It’s possible that the decentralization of the functionality layer doesn’t go as far as I imagine. In any case, Audius or the apps using the protocol will have to deal with the existing national and international copyright regimes which inevitably dictate some of the economics.

In the end, it’s not about Audius versus SoundCloud; it’s about creating a new layer for music streaming. Imagining music streaming as a protocol, rather than a competitive space of services, is refreshing though. It allows for a rethink of the principles underpinning the digital music landscape without going through the arduous mental exercise of imagining small iterative improvements to solve streaming’s flaws.

Why Audius needs to be more like Roblox to succeed in creating a music economy

Recently blockchain-based music streaming service Audius distributed tokens to 10,000 of its top users, giving them ownership of the platform and rights to vote on its future plus make changes to its structure.

While its advisory board — which includes Twitch co-founder Justin Kan and EA Games co-founder Bing Gordon â€” is impressive (though all-male), I have my reservations about the platform. I’ll explain why in a moment.

Despite my reservations, I do believe Audius is on to something. When it distributed the tokens, they didn’t all go to artists, but also fans. Music is in desperate need for a digital economy more complex than one-directionally spreading out subscription fees over stream counts.

Screenshot of Audius

The ‘anti-SoundCloud’

From the beginning, Audius set itself up as “like SoundCloudbut not SoundCloud.” There’s a real difficulty in positioning yourself that way. SoundCloud is a company with more than half a billion USD in funding to date. It has relations with most of the music business, technical integrations with all kinds of hardware & software, and has spent over a decade building up its community, team and infrastructure.

The standards for music streaming are incredibly high now compared to the landscape that the current incumbents started out in. While I definitely think SoundCloud and other music streaming services of that generation are leaving space for newcomers to claim, I think it’s important to focus on what in particular a newcomer can do better and excel in that. In terms of doing a particular thing better, I’d argue Instagram has become the anti-SoundCloud.

How do you deliver a good user experience and an audience to people? How do you get them to regularly visit your app / platform? How do you grow beyond the front of the adoption curve? All of these have answers, but how do you do that better than others? Setting yourself up as a one-size-fits-all service creates expectations you can’t fulfill.

Takedown issues

On to a more complicated matter. Audius, as a decentralized service, will pass takedown requests on to uploaders who will have to take action. If it can’t be resolved, it moves to an arbitration committee made up of Audius users:

“That group can vote on whether a track legally should be removed or its revenue reattributed, and both plaintiffs and committee members must put up a small financial stake they’ll lose if their claim is frivolous or they make erroneous decisions.”

I appreciate the idealism in letting its community resolve these issues. The financial stake part also makes sense, assuming the party issuing is on the platform, but it also reads like the type of maximalist thought usually associated with blockchain or “disruptive startup” culture. It assumes as a newcomer it can set a new status quo that everyone will have to interact with — even people who are not on the platform. In actuality, as a newcomer you’re an outlier and the type of strategy you have to employ is growth, so you can actually become the status quo.

What does not help growth is artists finding parts of their catalogue on the platform without uploading it themselves and then going through a tedious and risky process to right the wrong.

A more complex economy

Another company I had similar reservations about in terms of being able to stand out as a compelling streaming platform is Resonate, a community-owned cooperative. However what excites me about Audius and Resonate are their visions for a different music streaming economy. In particular, giving fans and artists equal participation in that economy.

Money in streaming flows in one direction and that’s away from fans. It feels like that’s the point, but it’s also a limitation. There’s a reductionist vision that music services are solely about listening to music. Yet what could be created by incentivizing platform participation? What if the $10/month subscription fee was more like an entrance ticket or season pass and there’s additional, optional value exchange happening on the platform, much like in video games?

Some users wouldn’t be able to afford a fee higher than that $10. As a matter of fact, I know music fans who only stream from free services. By participating in the platform’s economy they could still unlock perks they’re after. They could do so by creating value on the platform, e.g. by building experiences, creating fan art and other value for communities, or by participating in platform improvements like the cleaning of metadata or, I suppose, DMCA takedown arbitration.

This type of thing has been happening in games for years. A current prominent example being Roblox (est. 2004), which recently saw Lil Nas X perform in-game.

The starting point isn’t the economy though — it’s to envision what you want players to be able to do in the world created for them. From engagement flow the opportunities to shape an economy (another reason why I’m skeptical of consumer-facing startups whose value propositions focus on the economy more than the user experience). In order to create robust digital economies around music, the likely question to figure out is how to create a compelling platform for fan culture at large.

Then starting by focusing on a specific problem.

What does digital strategy in a user-centric streaming landscape look like?

The year is 2023. After intensive lobbying, the governments of the US, the EU, and Britain have decreed changes to the way music streaming services pay out artists. Instead of pooling all of users’ revenue together and distributing it pro-rata based on the number of streams, the money will now be divided based on listening-share per user. That means, if a listener’s playback is composed for 50% of one artist’s music, that artist will get 50% of the revenue that specific user generated.

With new economics, the game changes – and so does the way we measure success.

Why user-centric is a paradigm shift beyond the economics

A common argument against the user-centric model is that it doesn’t necessarily bring more money in, would be costly to transition to, and might not end up in radically different sums at the bottom of royalty statements. The problem with the studies that these arguments are based on is that the studies took data generated by the current status quo of streaming and ran it through a new system. A different system means different incentives and would have led to a different data set.

More importantly, it changes the overall game as Spotify’s then-chief economist Will Page pointed out in 2018:

“Under ‘pro rata,’ an artist is less concerned with diversity and will simply prefer the platform whose users stream their music most. Under ‘user-centric,’ artists prefer streaming platforms where their listeners exhibit less diversity in taste.”

The game in user-centric streaming is to make sure your listeners spend as much time on you as possible. As an artist, you want to make sure they’re a) paying for a subscription, and b) listening to you primarily. What you don’t care about is their exact number of listens.

A familiar metric will stay just as important: your number of monthly listeners. What will become more important, is a new metric: average listening-share per user (ALPU).

ALPU: average listening-share per user

Fast-forward to imaginary 2023 again. Music marketeers are obsessed with ALPU, which they can monitor in the dashboards of popular streaming services. Some of the tactics they use to increase ALPU are:

  • Getting fans to turn disable Autoplay features on streaming services, since it’s better if playback stops rather than moves on to another artist.
  • Prioritizing profile-focused platforms over catalogue & discovery-focused platforms. While getting discovered is still important, the money is made when you get people to stream on high-ALPU platforms.
  • Move fast on new platforms, since being first on a new service is a massive advantage for ALPU due to the fact that there’s not much else to stream yet.

It would slowly lead to a landscape that looks more like that of newsletters and Patreon communities in the sense that they’re isolated and there’s not much discovery between them. As a matter of fact, Patreon stated they’re not a discovery platform up until a recent funding round. Their now-deleted blog post was cached by the Wayback Machine and can still be read. In it, their then-SVP Product Wyatt Jenkins said:

“Because we’re not focused on discovery, we’re not constantly trying to recommend new creators to your fans. It takes time to build an audience, for a fan to become passionate enough about you as a creator to become a paying patron. We respect that relationship. We’re not here to market other creators to your patrons.”

While a user-centric payments landscape doesn’t exist yet for music steaming, it’s useful to think about what it would look like. While I think something healthy can flourish from such a landscape, it’s not a cure-all for today’s most important problems. For example, a shift to user-centric is among the demands in the Justice at Spotify campaign by the Union of Musicians and Allied Workers, because they claim that pro-rata “puts artists in competition with each other.” I suspect a user-centric economy would make that competition much more fierce.

Finally, ALPU already makes for a useful thought experiment at present. Before you get to revenue, you have to garner attention. What’s your attention share of your most dedicated fans? How do you stay top of mind and have fans checking in on you, so you can get your latest music, merch, or livestream tickets under the eyes and into their shopping carts? Shifting to user-centric would mean the streaming landscape is more closely aligned with the same metrics used to build dedicated fan bases.

Are investors looking for a fire sale in independent live music?

Live Nation‘s head Michael Rapino has called the plans of ex-WME music chief Marc Geiger to acquire 51% stakes in struggling venues a “fire sale“.

The background

Geiger recently announced a $75m fund to create a “partnership plan” called SaveLive. It will see the fund buying up stakes of at least 51% and “backstop all these clubs”. This received very mixed reactions, partly due to the altruistic-sounding name, despite there obviously being more to it than that. The New York Times sees potential:

“As SaveLive partners, Geiger said, they would gain economies of scale as well as access to favourable deals for ticketing or sponsorship — suggesting that SaveLive would, to some degree, resemble a mom-and-pop version of Live Nation or AEG.”

Why the shade from Rapino?

For most of this year, I’ve been concerned about the ability of venues to maintain their independence beyond the pandemic. Then back in August, paired with their Q2 financial results, Live Nation announced their intention to expand:

“We believe that over the next 24 months there’ll be ongoing opportunities for us to expand our global footprints in foreign and international markets that we’ve have been looking to get into and build some businesses around.”

How they’ll get into those markets is unclear, but the company has a history of expansion through acquisitions. It also bears keeping in mind that the above statement came at the end of the same quarter that saw Saudi Arabia’s Public Investment Fund acquire a $500M stake in Live Nation.

The differentiator between Geiger’s SaveLive and Live Nation seems to be the geographical focus. Rapino opines that US independent venues won’t sell cheaply, because “there’s a lot of capital out there.

What’s the take-away?

It’s a waste of time trying to figure out who’s right or wrong in these types of debates, because that’s not why the actors of the debates participate in them. What’s valuable about it is that you can spot intentions and see headlines that clearly point towards trends.

To me, the takeaway here is: independent music is at risk of becoming less independent. That’s always so, but more so now. Prominent music business veterans can raise funds of tens of millions of dollars and incumbents have all but announced their intention to spend cash to expand.

It may be worth checking in on your local music venue organisations and seeing what forms of support they can use. Each territory has their own unique challenges, economically and politically, so it’s a global plight with a local character.