How Modern Video Codecs Work

  • Thread starter Thread starter bhobba
  • Start date Start date
  • Tags Tags
    Video
Click For Summary
SUMMARY

The discussion focuses on modern video codecs, particularly H264, HEVC, EVC, and AV1. H264 serves as the foundational codec, while HEVC offers 30%-40% better performance but suffers from complex licensing issues, hindering its adoption. In contrast, EVC Baseline is a simpler codec that performs comparably to HEVC without the licensing complications. The author plans to develop an AI Codec based on EVC Baseline and will introduce new tools to enhance its capabilities, referencing LCEVC concepts.

PREREQUISITES
  • Understanding of video codec fundamentals, specifically H264 and HEVC
  • Familiarity with licensing issues related to video codecs
  • Knowledge of EVC Baseline and its performance metrics
  • Basic concepts of AI integration in video encoding
NEXT STEPS
  • Research AV1 codec specifications and performance benchmarks
  • Explore the implications of licensing in video codec adoption
  • Learn about LCEVC and its integration with existing codecs
  • Investigate AI techniques for enhancing video compression efficiency
USEFUL FOR

Video engineers, codec developers, and anyone involved in video streaming technology who seeks to understand modern codec performance and licensing challenges.

Messages
10,973
Reaction score
3,839
The easiest way to understand modern codecs is to look at the most common one in use today and the one most other codecs are based on, H264:



Since then, several codecs have been developed and are in use (HEVC, VVC, AV1, EVC, etc). A big problem arose with licensing. As codecs became more sophisticated, so did the licensing. It reached the point with HEVC that its uptake was slow due to the horrid licencing situation. Because of that, codecs were developed that require no licensing. The two best-known are AV1 and EVC Baseline. AV1 is a complex codec with many tools. EVC Baseline is the opposite - a simple codec with just a few tools. Surprisingly, it performs about the same as HEVC, which is 30%-40% better than H264. Because of this simplicity, I will build on it in my AI Codec.

For details of EVC Baseline:
https://www.itu.int/en/ITU-T/Workshops-and-Seminars/20191008/Documents/Ken_McCann_Presentation.pdf

I will leave it there for this post. If this is new, it will require time to understand. If not, it is a good revision.

The next post will introduce new tools that modify the EVC Baseline codec to become a combined AI and EVC Baseline Codec loosely based on the ideas of LCEVC, which will also be introduced.
 
Last edited:
  • Like
  • Informative
Likes   Reactions: Greg Bernhardt and berkeman
Computer science news on Phys.org
Will do.

No problemo.

Added later:

I tried to write the article but had problems. I am working on it - I will have it done shortly - hopefully.

Thanks
Bill
 
Last edited:
  • Like
Likes   Reactions: berkeman

Similar threads

  • · Replies 8 ·
Replies
8
Views
5K
  • · Replies 1 ·
Replies
1
Views
2K
  • · Replies 6 ·
Replies
6
Views
4K
  • · Replies 1 ·
Replies
1
Views
8K
  • · Replies 1 ·
Replies
1
Views
2K
Replies
4
Views
2K
Replies
2
Views
3K
  • · Replies 5 ·
Replies
5
Views
2K