In short, SORA differs from Lumiere in architecture, generation methods, output flexibility, and level of development.
Alexander: SORA is capable of generating videos of various types and contents. It can create new videos, complement existing videos, or even change their characteristics. SORA supports various resolution parameters, including resolutions with different aspect ratios, durations, and qualities. It provides the flexibility to customize these parameters according to the user’s requirements and preferences.
GreenSMM: Why did OpenAI choose to train the model on videos at their original resolution, rather than shorter ones at 512x512 resolution?
Alexander: Because using the original resolution allows the model to get a more complete understanding of the diversity and detail of the visual data. Training on videos with the original resolution allows the model to capture a wider range of objects, scenes, and dynamics. Thanks to this, the generation results are more diverse and of higher quality.
GreenSMM: What role does the GPT-4V neural network (ChatGPT function) play in the process of creating detailed descriptions for videos?
Alexander: The GPT-4V (ChatGPT) neural network can asia mobile number list create rich descriptions for videos, providing text descriptions or accompaniments to videos. It can be used to automatically create text descriptions of the content, plot, or scenes in videos based on visual data. GPT-4V is capable of generating high-quality texts that can complement videos, become subtitles, or descriptions for visually impaired users.
GreenSMM: What are the potential risks and concerns associated with using the SORA generative model, especially in the context of creating deepfakes?
Alexander: The main danger in the misuse of any such generative model is the risk of spreading disinformation.
SORA can be used to create realistic deepfakes, which are artificially created videos that can be mistaken for real.
A juicy example of such a realistic deepfake that instantly spread online is evidence of the fire at the Eiffel Tower. Videos and photos of the blazing symbol of France went viral not only on social networks, but also got into some media. Thanks to the technical perfection of the deepfake and a real precedent that happened not so long ago (in 2019, there was a devastating fire in Notre Dame Cathedral), hundreds of thousands of people believed that the Eiffel Tower was on fire.
