Adobe’s new upscaling tech uses AI to sharpen video


Many of the new features and experiences Adobe recently announced include artificial intelligence object addition and removal Premiere Pro and create a text-based image In Photoshop. Now the company has introduced VideoGigaGANan experimental AI function can upscale video up to eight times without common artifacts such as judder or distortion, The Verge informed.

According to Adobe, VideoGigaGAN outperforms other Video Super Resolution (VSR) techniques because it avoids the usual artifacts and jitter introduced by GAN (General Adversarial Networks). At the same time, it adds sharpness and detail – most other systems can’t do both at the same time.

Adobe's new enhancement technology uses artificial intelligence to sharpen videoAdobe's new enhancement technology uses artificial intelligence to sharpen video

Adobe

Of course, the system creates detail that doesn’t exist from the whole piece, so it wouldn’t be suitable for things like forensic video enhancement. à la CSI-style crime shows. But the detail he adds is skin textures, fine hairs, swan details and more.

According to Adobe researchers, the model is based on large-scale image samples called GigaGAN. Previous VSR models struggled to produce rich detail in the results, so Adobe added “temporal focus” (reducing artifacts that build up over time), feature spreading (adding detail that was nowhere to be found), anti-aliasing, and a so-called “HF shuttle” (shuttling). married the thing. high frequency features) to create the final result.

Adobe's new enhancement technology uses artificial intelligence to sharpen videoAdobe's new enhancement technology uses artificial intelligence to sharpen video

Adobe

If added to products such as Premiere Pro or After Effects, this could allow video producers to render low-quality footage better, although the use of artificial intelligence makes humans more powerful. controversial practice. There’s no word yet on whether Adobe plans to do this (currently, clips are short and only play at 12fps), but many companies, including NVIDIA, Microsoft, Blackmagic Design, and others, are working on AI-enhancing technology .



Source link

Leave a Reply

Your email address will not be published. Required fields are marked *