An AI Infused Enhancement To LCEVC Codec

  • Thread starter Thread starter bhobba
  • Start date Start date
  • Tags Tags
    Ai
AI Thread Summary
The discussion centers on the distribution of 8K video using LCEVC (Low Complexity Enhancement Video Coding), highlighting its effectiveness with older codecs but noting limited gains with newer codecs like VVC. AI advancements have led to the development of an AI variant of LCEVC that significantly outperforms the original LCEVC, utilizing an auto-encoder called CAESR. This AI-infused version shows superior performance except in multilayer configurations. The conversation also hints at upcoming enhancements through super-resolution techniques and improvements to EVC Baseline Inter coding, indicating a trend toward integrating AI in video coding for better efficiency and quality.
Messages
10,920
Reaction score
3,795
In the insights article, I did on how 8k video can be distributed at internet speeds we have usually access to these days, I mentioned LCEVC:



For more details see:
https://ieeexplore.ieee.org/document/9795094

It is a very effective technique with older codecs, but with newer codecs like VVC the gains are only small, with not using it often producing better results:
https://ieeexplore.ieee.org/iel7/76/4358651/10019298.pdf

As mentioned in previous posts, since LCEVC was standardised, AI has made significant gains. An AI varient of LCEVC will be shown to outperform LCEVC.

It uses an auto-encoder called CAESR:
https://arxiv.org/pdf/2202.00416

This is combined with an AI-infused varient of LCEVC:
https://www.tnt.uni-hannover.de/pap...ding_with_Spatial_and_Temporal_Prediction.pdf.

It outperforms LCEVC, except for a multilayer configuration.

Again, this post has introduced a number of new ideas the reader may not be familiar with. It will take a bit of time to assimilate, but already it is seen that AI outperforms single-layer LCEVC.

The next post will show how the scheme can be enhanced using the newer super-resolution techniques from a previous post and enhancements to EVC Baseline Inter coding.
 
  • Like
Likes Greg Bernhardt
Computer science news on Phys.org
I came across a video regarding the use of AI/ML to work through complex datasets to determine complicated protein structures. It is a promising and beneficial use of AI/ML. AlphaFold - The Most Useful Thing AI Has Ever Done https://www.ebi.ac.uk/training/online/courses/alphafold/an-introductory-guide-to-its-strengths-and-limitations/what-is-alphafold/ https://en.wikipedia.org/wiki/AlphaFold https://deepmind.google/about/ Edit/update: The AlphaFold article in Nature John Jumper...
Interesting article about an AI writing scandal at Sports Illustrated: https://www.cnn.com/2023/11/29/opinions/sports-illustrated-ai-controversy-leitch/index.html I hadn't heard about it in real-time, which is probably indicative about how far SI has fallen*. In short, the article discusses how SI was caught using AI and worse fake reporter photos/profiles to write game summaries. Game summaries are the short articles that summarize last night's Phillies game. They are so formulaic that...

Similar threads

Replies
8
Views
4K
Replies
2
Views
3K
Replies
6
Views
3K
Replies
1
Views
2K
Back
Top