An AI Infused Enhancement To LCEVC Codec

  • Thread starter Thread starter bhobba
  • Start date Start date
  • Tags Tags
    Ai
Click For Summary
SUMMARY

The discussion focuses on the advancements in the LCEVC (Low Complexity Enhancement Video Coding) codec, particularly its integration with AI technologies. The AI variant of LCEVC, utilizing the CAESR (Content-Aware Encoder for Scalable Resolution) auto-encoder, demonstrates superior performance compared to traditional LCEVC, especially in single-layer configurations. While the benefits of LCEVC diminish when paired with newer codecs like VVC (Versatile Video Coding), the AI-enhanced version shows promise for future applications in video distribution. Upcoming enhancements will incorporate super-resolution techniques and improvements to EVC (Enhanced Video Coding) Baseline Inter coding.

PREREQUISITES
  • Understanding of LCEVC (Low Complexity Enhancement Video Coding)
  • Familiarity with AI techniques in video encoding, specifically CAESR (Content-Aware Encoder for Scalable Resolution)
  • Knowledge of VVC (Versatile Video Coding) and its performance metrics
  • Awareness of super-resolution techniques in video processing
NEXT STEPS
  • Research the implementation of CAESR in video encoding workflows
  • Explore the performance comparisons between LCEVC and VVC in various scenarios
  • Investigate the latest advancements in super-resolution techniques for video enhancement
  • Study the improvements in EVC (Enhanced Video Coding) Baseline Inter coding methodologies
USEFUL FOR

Video engineers, codec developers, AI researchers, and professionals involved in video streaming optimization will benefit from this discussion.

Messages
10,968
Reaction score
3,838
In the insights article, I did on how 8k video can be distributed at internet speeds we have usually access to these days, I mentioned LCEVC:



For more details see:
https://ieeexplore.ieee.org/document/9795094

It is a very effective technique with older codecs, but with newer codecs like VVC the gains are only small, with not using it often producing better results:
https://ieeexplore.ieee.org/iel7/76/4358651/10019298.pdf

As mentioned in previous posts, since LCEVC was standardised, AI has made significant gains. An AI varient of LCEVC will be shown to outperform LCEVC.

It uses an auto-encoder called CAESR:
https://arxiv.org/pdf/2202.00416

This is combined with an AI-infused varient of LCEVC:
https://www.tnt.uni-hannover.de/pap...ding_with_Spatial_and_Temporal_Prediction.pdf.

It outperforms LCEVC, except for a multilayer configuration.

Again, this post has introduced a number of new ideas the reader may not be familiar with. It will take a bit of time to assimilate, but already it is seen that AI outperforms single-layer LCEVC.

The next post will show how the scheme can be enhanced using the newer super-resolution techniques from a previous post and enhancements to EVC Baseline Inter coding.
 
  • Like
Likes Greg Bernhardt
Computer science news on Phys.org
I am having a hell of a time finding a good all-in-one inkjet printer. I must have gone through 5 Canon, 2 HP, one Brother, one Epson and two 4 X 6 photo printers in the last 7 yrs. all have all sort of problems. I don't even know where to start anymore. my price range is $180-$400, not exactly the cheapest ones. Mainly it's for my wife which is not exactly good in tech. most of the problem is the printers kept changing the way it operate. Must be from auto update. I cannot turn off the...

Similar threads

  • · Replies 8 ·
Replies
8
Views
5K
  • · Replies 2 ·
Replies
2
Views
3K
  • · Replies 6 ·
Replies
6
Views
3K
Replies
4
Views
2K
  • · Replies 1 ·
Replies
1
Views
2K