CNN based HEVC

HEVC (High Efficiency Video Codec)
  Electronics, such as cameras in cell phones or video camcorder, are evolving these days. As new digital devices come out, video compression technology in those devices are evolving day by day.  Therefore, video compression performance is improving accordingly.

 For example, HEVC, the latest standard video codec, use the various size of blocks for coding efficiency and in-loop filters for removing compression artifacts. It has been improved 40% of performance compare to the before standard video, H.264.


 

CNN based HEVC
  As CNN shows great performance in Super-Resolution problem, people started to apply it at removing compression artifacts like artifacts caused by JPEG or HEVC.

There are many ways to insert CNN in HEVC with in-loop filtering or CU division and so on. Among those methods, we are trying to replace CNN to in-loop filter to improve coding efficiency. There are many researches that modified in-loop filter already and it shows the possibility to improve coding efficiency with CNN.

[이소윤, 홍진형, 오병태, “CNN 기반 HEVC 루프 필터의 성능 비교,” 한국방송미디어공학회 추계학술대회, 2017.]

MPLAB