An AI Infused Enhancement To LCEVC Codec

  • Thread starter Thread starter bhobba
  • Start date Start date
  • Tags Tags
    Ai
AI Thread Summary
The discussion centers on the distribution of 8K video using LCEVC (Low Complexity Enhancement Video Coding), highlighting its effectiveness with older codecs but noting limited gains with newer codecs like VVC. AI advancements have led to the development of an AI variant of LCEVC that significantly outperforms the original LCEVC, utilizing an auto-encoder called CAESR. This AI-infused version shows superior performance except in multilayer configurations. The conversation also hints at upcoming enhancements through super-resolution techniques and improvements to EVC Baseline Inter coding, indicating a trend toward integrating AI in video coding for better efficiency and quality.
Messages
10,902
Reaction score
3,782
In the insights article, I did on how 8k video can be distributed at internet speeds we have usually access to these days, I mentioned LCEVC:



For more details see:
https://ieeexplore.ieee.org/document/9795094

It is a very effective technique with older codecs, but with newer codecs like VVC the gains are only small, with not using it often producing better results:
https://ieeexplore.ieee.org/iel7/76/4358651/10019298.pdf

As mentioned in previous posts, since LCEVC was standardised, AI has made significant gains. An AI varient of LCEVC will be shown to outperform LCEVC.

It uses an auto-encoder called CAESR:
https://arxiv.org/pdf/2202.00416

This is combined with an AI-infused varient of LCEVC:
https://www.tnt.uni-hannover.de/pap...ding_with_Spatial_and_Temporal_Prediction.pdf.

It outperforms LCEVC, except for a multilayer configuration.

Again, this post has introduced a number of new ideas the reader may not be familiar with. It will take a bit of time to assimilate, but already it is seen that AI outperforms single-layer LCEVC.

The next post will show how the scheme can be enhanced using the newer super-resolution techniques from a previous post and enhancements to EVC Baseline Inter coding.
 
  • Like
Likes Greg Bernhardt
Computer science news on Phys.org
In my discussions elsewhere, I've noticed a lot of disagreement regarding AI. A question that comes up is, "Is AI hype?" Unfortunately, when this question is asked, the one asking, as far as I can tell, may mean one of three things which can lead to lots of confusion. I'll list them out now for clarity. 1. Can AI do everything a human can do and how close are we to that? 2. Are corporations and governments using the promise of AI to gain more power for themselves? 3. Are AI and transhumans...
Thread 'ChatGPT Examples, Good and Bad'
I've been experimenting with ChatGPT. Some results are good, some very very bad. I think examples can help expose the properties of this AI. Maybe you can post some of your favorite examples and tell us what they reveal about the properties of this AI. (I had problems with copy/paste of text and formatting, so I'm posting my examples as screen shots. That is a promising start. :smile: But then I provided values V=1, R1=1, R2=2, R3=3 and asked for the value of I. At first, it said...

Similar threads

Replies
8
Views
4K
Replies
2
Views
3K
Replies
6
Views
3K
Replies
1
Views
2K
Back
Top