An AI Infused Enhancement To LCEVC Codec

  • Thread starter Thread starter bhobba
  • Start date Start date
  • Tags Tags
    Ai
Click For Summary
The discussion centers on the distribution of 8K video using LCEVC (Low Complexity Enhancement Video Coding), highlighting its effectiveness with older codecs but noting limited gains with newer codecs like VVC. AI advancements have led to the development of an AI variant of LCEVC that significantly outperforms the original LCEVC, utilizing an auto-encoder called CAESR. This AI-infused version shows superior performance except in multilayer configurations. The conversation also hints at upcoming enhancements through super-resolution techniques and improvements to EVC Baseline Inter coding, indicating a trend toward integrating AI in video coding for better efficiency and quality.
Messages
10,946
Reaction score
3,818
In the insights article, I did on how 8k video can be distributed at internet speeds we have usually access to these days, I mentioned LCEVC:



For more details see:
https://ieeexplore.ieee.org/document/9795094

It is a very effective technique with older codecs, but with newer codecs like VVC the gains are only small, with not using it often producing better results:
https://ieeexplore.ieee.org/iel7/76/4358651/10019298.pdf

As mentioned in previous posts, since LCEVC was standardised, AI has made significant gains. An AI varient of LCEVC will be shown to outperform LCEVC.

It uses an auto-encoder called CAESR:
https://arxiv.org/pdf/2202.00416

This is combined with an AI-infused varient of LCEVC:
https://www.tnt.uni-hannover.de/pap...ding_with_Spatial_and_Temporal_Prediction.pdf.

It outperforms LCEVC, except for a multilayer configuration.

Again, this post has introduced a number of new ideas the reader may not be familiar with. It will take a bit of time to assimilate, but already it is seen that AI outperforms single-layer LCEVC.

The next post will show how the scheme can be enhanced using the newer super-resolution techniques from a previous post and enhancements to EVC Baseline Inter coding.
 
  • Like
Likes Greg Bernhardt
Computer science news on Phys.org
LLMs and AIs have a bad reputation at PF, and I share this opinion. I have seen too much nonsense they produced, and too many "independent researchers" who weren't so independent after all, since they used them. And then there is a simple question: If we had to check their results anyway, why would we use them in the first place? In fact, their use is forbidden by the rules. I tend to interpret the reason for this rule because nobody wants to talk to a machine via PF. Those who want to can...

Similar threads

  • · Replies 8 ·
Replies
8
Views
4K
  • · Replies 2 ·
Replies
2
Views
3K
  • · Replies 6 ·
Replies
6
Views
3K
Replies
4
Views
2K
  • · Replies 1 ·
Replies
1
Views
2K