我们即将推出一款名为 Sora 的新应用。它结合了名为 Sora 2 的新模型,以及一款让视频创作、分享和观看变得轻松便捷的新产品。
对我们许多人来说,这感觉就像是“ChatGPT 之于创造力”的时刻,既有趣又新颖。让创意从想法到成果变得极其简单快速,并由此催生新的社交动态,这本身就意义非凡。
创造力或许即将迎来一场寒武纪大爆发,随之而来的是艺术和娱乐品质的显著提升。即便在试用 Sora 的初期阶段,我们中许多人都惊讶于创作空间突然变得如此开阔。
特别是,通过客串功能将你自己和朋友融入视频的能力——团队在角色一致性上付出了巨大努力——是我们在测试期间非常享受的一点,对我们许多人来说,这是一种出人意料且极具吸引力的全新连接方式。
我们也感到一些不安。社交媒体给世界带来了一些积极影响,但也造成了一些负面影响。我们意识到这类服务可能变得多么令人上瘾,也能想象出它可能被用于霸凌的多种方式。
很容易想象 AI 视频生成的退化情形:最终我们都深陷于一个经过强化学习优化的垃圾信息流中。团队投入了大量心血和思考,试图找到打造一款令人愉悦、又不落入此陷阱的产品的方法,并提出了许多有前景的想法。在产品初期,我们将尝试不同的方法。
除了我们已经实施的缓解措施(包括防止他人利用深度伪造技术滥用他人肖像、针对令人不适或非法内容的防护措施、定期检查 Sora 对用户情绪和幸福感的影响等),我们确信,如果 Sora 变得非常成功,我们还会发现需要采取的新行动。为了引导我们趋利避害,以下是我们为这款产品制定的一些原则:
*以长期用户满意度为优化目标。绝大多数用户在回顾过去六个月时,应当觉得使用 Sora 让他们的生活比不使用更好。如果情况并非如此,我们将做出重大调整(若无法修复,我们会停止提供该服务)。
*鼓励用户掌控自己的信息流。您应该能够告诉 Sora 您想要什么——是想看让您更放松的视频,还是更有活力的视频?或者只想看符合特定兴趣的视频?又或者只想看特定时长的视频?随着我们技术的进步,您最终将能够用自然语言详细地告诉 Sora 您想要什么。(不过,针对青少年的家长控制功能包括选择退出个性化信息流,以及关闭私信等其他选项。)
*优先支持创作。我们希望让每个人都能轻松且富有成就感地参与创作过程;我们相信人们是天生的创作者,而创作对我们的满足感至关重要。
*帮助用户实现长期目标。我们希望了解用户的真实目标,并帮助他们实现这些目标。如果您想与朋友保持更紧密的联系,我们会尽力协助。如果您想健身,我们可以向您展示能激励您的健身内容。如果您想创业,我们愿意教您所需的技能。而如果您真的只想漫无目的地刷屏、发泄愤怒,那也没问题,我们也会满足您(尽管我们希望用户只在认为时间花得值时才使用应用,但我们不想以家长式作风替他们决定什么才算值得)。
We are launching a new app called Sora. This is a combination of a new model called Sora 2, and a new product that makes it easy to create, share, and view videos.
This feels to many of us like the “ChatGPT for creativity” moment, and it feels fun and new. There is something great about making it really easy and fast to go from idea to result, and the new social dynamics that emerge.
Creativity could be about to go through a Cambrian explosion, and along with it, the quality of art and entertainment can drastically increase. Even in the very early days of playing with Sora, it’s been striking to many of us how open the playing field suddenly feels.
In particular, the ability to put yourself and your friends into a video—the team worked very hard on character consistency—with the cameo feature is something we have really enjoyed during testing, and is to many of us a surprisingly compelling new way to connect.
We also feel some trepidation. Social media has had some good effects on the world, but it’s also had some bad ones. We are aware of how addictive a service like this could become, and we can imagine many ways it could be used for bullying.
It is easy to imagine the degenerate case of AI video generation that ends up with us all being sucked into an RL-optimized slop feed. The team has put great care and thought into trying to figure out how to make a delightful product that doesn’t fall into that trap, and has come up with a number of promising ideas. We will experiment in the early days of the product with different approaches.
In addition to the mitigations we have already put in place (which include things like mitigations to prevent someone from misusing someone’s likeness in deepfakes, safeguards for disturbing or illegal content, periodic checks on how Sora is impacting users’ mood and wellbeing, and more) we are sure we will discover new things we need to do if Sora becomes very successful. To help guide us towards more of the good and less of the bad, here are some principles we have for this product:
*Optimize for long-term user satisfaction. The majority of users, looking back on the past 6 months, should feel that their life is better for using Sora that it would have been if they hadn’t. If that’s not the case, we will make significant changes (and if we can’t fix it, we would discontinue offering the service).
*Encourage users to control their feed. You should be able to tell Sora what you want—do you want to see videos that will make you more relaxed, or more energized? Or only videos that fit a specific interest? Or only for a certain about of time? Eventually as our technology progresses, you will be should to the tell Sora what you want in detail in natural language. (However, parental controls for teens include the ability to opt out of a personalized feed, and other things like turning off DMs.)
*Prioritize creation. We want to make it easy and rewarding for everyone to participate in the creation process; we believe people are natural-born creators, and creating is important to our satisfaction.
*Help users achieve their long-term goals. We want to understand a user’s true goals, and help them achieve them. If you want to be more connected to your friends, we will try to help you with that. If you want to get fit, we can show you fitness content that will motivate you. If you want to start a business, we want to help teach you the skills you need. And if you truly just want to doom scroll and be angry, then ok, we’ll help you with that (although we want users to spend time using the app if they think it’s time well spent, we don’t want to be paternalistic about what that means to them).