The following is a list of compression formats and related codecs.

Audio compression formats

edit

Non-compression

edit

Lossless compression

edit

Lossy compression

edit

General/Speech hybrid

edit

Neural audio codecs

edit

General

edit
AES3
edit
  • SMPTE 302M
    • FFmpeg (decoder only)
  • Dolby E
    • FFmpeg (decoder only)
Bluetooth
edit
Digital radio
edit

Voice

edit

(low bit rate, optimized for speech)

Microsoft DirectPlay
edit

Those codecs are used by many PC games which use voice chats via Microsoft DirectPlay API.

  • Voxware MetaVoice
    • Windows Media Player (voxmvdec.ax)
  • Truespeech
    • Windows Media Player (tssoft32.acm)
    • FFmpeg (decoder only)
  • MS GSM
    • Windows Media Player (msgsm32.acm)
    • libgsm
    • FFmpeg (decoder only)
  • MS-ADPCM
    • Windows Media Player (msadp32.acm)
    • FFmpeg
Digital Voice Recorder
edit
  • International Voice Association (IVA) standards:
    • Digital Speech Standard / Standard Play (DSS-SP)
      • FFmpeg (decoding only)
    • Digital Speech Standard / Quality Play (DSS-QP)
  • Sony LPEC
  • Truespeech Triple Rate CODER (TRC)[23] – used in some pocket recorders
  • Micronas [de] Intermetall MI-SC4 - used by voice recorders such as RadioShack Digital Recorder[24] and I-O DATA [ja] HyperHyde[25]
    • FFmpeg (decoder only)
Mobile phone
edit
Generation 2
edit
Generation 3/4
edit
  • 3rd Generation Partnership Project (3GPP)
    • Adaptive Multi-Rate (AMR)
      • AMR-NB
        • 3GPP TS 26.073 – AMR speech Codec (C-source code) – reference implementation[26]
        • opencore-amr (one may compile ffmpeg with—enable-libopencore-amrnb to incorporate the OpenCORE lib)
        • FFmpeg (by default decoder only, but see above the compiling options to incorporate the OpenCORE lib)
      • AMR-WB
        • 3GPP TS 26.173 – AMR-WB speech Codec (C-source code) – reference implementation[11]
        • opencore-amr (decoder), from OpenCORE (one may compile ffmpeg with—enable-libopencore-amrwb to incorporate the OpenCORE lib)
        • vo-amrwbenc (encoder), from VisualOn, included in Android (one may compile ffmpeg with—enable-libvo-amrwbenc to incorporate the VisualOn lib)
        • FFmpeg (by default decoder only, but see above the compiling options).
      • AMR-WB+
        • 3GPP TS 26.273 – AMR-WB+ speech Codec (C-source code) – reference implementation[27]
      • Enhanced Voice Services (EVS)
        • 3GPP TS.26.443 – Codec for Enhanced Voice Services (EVS) – ANSI C code (floating-point)[28]
  • 3rd Generation Partnership Project 2 (3GPP2)
Professional mobile radio
edit
  • APCO
    • Project 25 Phase 2 Enhanced Full-Rate (AMBE+2 4400bit/s with 2800bit/s FEC)
    • Project 25 Phase 2 Half-Rate (AMBE+2 2450bit/s with 1150bit/s FEC) – also used in NXDN and DMR
      • mbelib (decoder only)
    • Project 25 Phase 1 Full Rate (IMBE 7200bit/s)
      • mbelib (decoder only)
  • European Telecommunications Standards Institute (ETSI)
    • ETS 300 395-2 (TETRA ACELP 4.6kbit/s)
  • TETRAPOL
    • RPCELP 6 kbit/s
  • D-STAR Digital Voice (AMBE 2400bit/s with 1200bit/s FEC)
    • mbelib (decoder only)
  • Professional Digital Trunking System Industry Association (PDT Alliance) standards:
    • NVOC – used in China
  • Spirit DSP RALCWI
  • DSPINI
    • SPR Robust
    • TWELP Robust
  • Codec2
    • libcodec2
  • RL-CELP (used in Japanese railways[29][30])
Military
edit

Video games

edit
  • Bink Audio, Smacker Audio
    • FFmpeg (decoder only)
  • Actimagine (Nintendo European Research & Development) FastAudio[32]
    • MobiclipDecoder (decoder only)
    • FFmpeg (decoder only)
  • Nintendo GCADPCM[33] (a.k.a. DSP ADPCM or THP ADPCM) - used in GameCube, Wii and Nintendo 3DS.
    • vgmstream (decoder only)
    • VGAudio
    • FFmpeg (decoder only)
  • Sony VAG[33] (a.k.a. Sony PSX ADPCM)
    • vgmstream (decoder only)
    • FFmpeg (decoder only)
  • Sony HEVAG[33] - used in PS Vita.[34]
    • vgmstream (decoder only)
  • Sony ATRAC9[33] - used in PS4 and PS Vita.
    • VGAudio (decoder only)
    • FFmpeg (decoder only)
  • Microsoft XMA[33] - WMA variants for Xbox 360 hardware decoding.[35]
    • FFmpeg (decoder only)
  • Xbox ADPCM
    • vgmstream (decoder only)
  • CRI ADX ADPCM
    • vgmstream (decoder only)
    • VGAudio
    • FFmpeg
  • CRI HCA/HCA-MX - used in CRI ADX2 middleware.[36]
    • vgmstream (decoder only)
    • VGAudio
    • FFmpeg (decoder only)
    • libcgss
    • HCADecoder (decoder only)
  • FMOD FADPCM[37]
    • vgmstream (decoder only)

Text compression formats

edit

Video compression formats

edit
  • RGB 4:4:4 (only linear, transfer-converted and bit-reduced also sort of compression up to about 3:1 for HDR)
  • YUV 4:4:4/4:2:2/4:1:1/4:2:0 (all lower 4:4:4 is spatially compressed up to 2:1 for 4:2:0 with specific colour distortions).
    • Intel IYUV
  • 10-bit uncompressed video
  • Composite digital signal - used by SMPTE D-2 and D-3 broadcast digital videocassettes
  • Avid DNxUncompressed (SMPTE RDD 50)
  • V210 - defined by Apple and used by Serial digital interface Input/output video cards[38]

Analog signals

edit

Lossless video compression

edit
  • ITU-T/ISO/IEC standards:
  • IETF standards:
    • FFV1 (RFC 9043)[43]  – FFV1's compression factor is comparable to Motion JPEG 2000, but based on quicker algorithms (allows real-time capture). Written by Michael Niedermayer and published as part of FFmpeg under GNU LGPL.
      • FFmpeg
  • SMPTE standards:
    • VC-2 HQ lossless (a.k.a. Dirac Pro lossless)
      • libdirac
      • libschroedinger
  • Alparysoft Lossless Video Codec (Alpary)
  • Apple Animation (QuickTime RLE)
    • QuickTime
    • FFmpeg
  • ArithYuv
  • AV1
  • AVIzlib
    • LCL (VfW codec) MSZH and ZLIB[44]
    • FFmpeg
  • Autodesk Animator Codec (AASC)
    • FFmpeg (decoder only)
  • CAI Format
  • CamStudio GZIP/LZO
    • FFmpeg (decoder only)
  • Chennai Codec (EVX-1)
    • Cairo Experimental Video Codec (open source)
  • Dxtory
    • FFmpeg (decoder only)
  • FastCodec
  • Flash Screen Video v1/v2[45]
    • FFmpeg
  • FM Screen Capture Codec
    • FFmpeg (decoder only)
  • Fraps codec (FPS1)[46]
    • FFmpeg (decoder only)
  • Grass Valley Lossless
    • Grass Valley Codec Option
    • FFmpeg (decoder only)
  • Huffyuv Huffyuv (or HuffYUV) was written by Ben Rudiak-Gould and published under the terms of the GNU GPL as free software, meant to replace uncompressed YCbCr as a video capture format. It uses very little CPU but takes a lot of disk space. See also ffvhuff which is an "FFmpeg only" version of it.
    • FFmpeg
  • IgCodec
  • Intel RLE
  • innoHeim/Rsupport Screen Capture Codec
    • FFmpeg (decoder only)
  • Lagarith A more up-to-date fork of Huffyuv is available as Lagarith[47]
    • Lagarith Codec (VfW codec)
    • FFmpeg (decoder only)
  • LOCO[48] - based on JPEG-LS
    • FFmpeg (decoder only)
  • MagicYUV[49]
    • MagicYUV SDK
    • FFmpeg
  • Microsoft RLE (MSRLE)
    • FFmpeg
  • MSU Lossless Video Codec
  • MSU Screen Capture Lossless
  • CorePNG [de] - based on PNG
    • FFmpeg
  • ScreenPresso (SPV1)
    • FFmpeg (decoder only)
  • ScreenPressor[50] - a successor of MSU Screen Capture Lossless
    • FFmpeg (decoder only)
  • SheerVideo
    • FFmpeg (decoder only)
  • Snow lossless
    • FFmpeg
  • TechSmith Screen Capture Codec (TSCC)[51]
    • EnSharpen Video Codec for QuickTime
    • FFmpeg (decoder only)
  • Toponoky
  • Ut Video Codec Suite[52][53]
    • libutvideo
    • FFmpeg
  • VBLE[54]
    • FFmpeg (decoder only)
  • VMnc VMware screen codec[55] - used by VMware Workstation
    • FFmpeg (decoder only)
  • VP9 by Google[56]
    • libvpx
    • FFmpeg (decoder only)
  • YULS
  • ZeroCodec
    • FFmpeg (decoder only)
  • ZMBV (Zip Motion Block Video) Codec - used by DOSBox
    • FFmpeg

Lossless game codecs

edit
  • DXA
    • ScummVM Tools (encoder only)
    • FFmpeg (decoder only)

Lossy compression

edit

General

edit

AI-based / AI-enhanced video codecs

edit
  • AIVC[64]
  • Deep Render codec[65][66]
  • MPAI
    • AI-Enhanced Video Coding (MPAI-EVC; under development)
    • AI-based End-to-End Video Coding (MPAI-EEV; under development)

Scalable / Layered

edit

VP8,[67] VP9,[67] AV1,[67] and H.266/VVC support scalable modes by default.

  • ITU-T/ISO/IEC standards:
    • Scalable Video Coding (H.264/SVC; H.264/MPEG-4 AVC Annex G; an extension of H.264/MPEG-4 AVC)
    • Scalable High Efficiency Video Coding (SHVC; an extension of H.265/HEVC)
    • Low Complexity Enhancement Video Coding (LCEVC; MPEG-5 Part 2)
      • LCEVC Decoder SDK (open source; decoder only)
      • V-Nova LCEVC SDK
  • SMPTE standards
    • VC-4 Layered Video Extension (SMPTE ST 2058-1:2011)

Intra-frame-only

edit
  • Motion JPEG
    • FFmpeg
    • Morgan Multimedia M-JPEG[68]
    • Pegasus PICVideo M-JPEG
    • MainConcept M-JPEG
  • ISO/IEC standard
    • Motion JPEG 2000 (ISO/IEC 15444-3, ITU-T T.802)
      • libopenjpeg
      • FFmpeg
      • Morgan Multimedia M-JPEG2000[69]
      • Morgan Multimedia dcpPlayer (decoder only)[70]
    • JPEG XS (ISO/IEC 21122) Lightweight Low latency video codec
      • intoPIX fastTICO-XS[71]
    • DV (IEC 61834)
      • FFmpeg
    • MPEG-4 SStP (ISO/IEC 14496-2)
    • Motion JPEG XR (ISO/IEC 29199-3, ITU-T T.833)
    • Animated JPEG XL (ISO/IEC 18181)
  • Apple ProRes 422/4444
    • FFmpeg
  • Apple Intermediate Codec
    • FFmpeg (decoder only)
  • Apple Pixlet
    • FFmpeg (decoder only)
  • AVC-Intra
    • x264 (encoder only)
    • FFmpeg (decoder only)
  • AVC-Ultra – a subset of MPEG-4 AVC Hi444PP profile
  • XAVC-I
  • CineForm HD
    • CineForm-SDK  – developed by GoPro (open source)
    • FFmpeg
  • SMPTE standard
    • VC-2 SMPTE standard (a.k.a. Dirac Pro. SMPTE ST 2042)
      • Schrödinger
      • dirac-research
      • VC-2 Reference Encoder and Decoder  – developed by BBC (open source)
      • FFmpeg (the encoder only supports VC-2 HQ profile)
    • VC-3 SMPTE standard (SMPTE ST 2019)
    • VC-5 SMPTE standard (SMPTE ST 2073; a superset of CineForm HD)
    • VC-6 SMPTE standard (SMPTE ST 2117-1)
      • V-Nova VC-6 SDK
  • Grass Valley HQ/HQA/HQX
    • Grass Valley Codec Option
    • FFmpeg (decoder only)
  • NewTek NT25
  • NewTek SpeedHQ - used in Network Device Interface (NDI) protocol
    • NewTek Codec[74]
    • FFmpeg

Stereoscopic 3D / Multiview

edit
  • Multiview Video Coding
  • Multiview High Efficiency Video Coding (MV-HEVC; an extension of H.265/HEVC)
    • FFmpeg (decoder only)

Security and surveillance cameras

edit
  • Guobiao standards (GB/T)
    • AVS-S-P2 (suspended[75])
    • SVAC (GB/T 25724-2010)
  • Infinity CCTV Codec (IMM4/IMM5/IMM6)
    • FFmpeg[76][77] (IMM4 and IMM5 decoder only)
edit
  • CDXL codec
    • FFmpeg (decoder only)
  • Cinepak[78] (a.k.a. Apple Compact Video)
    • FFmpeg
  • Photo CD codec
    • FFmpeg (decoder only)
  • MotionPixels - used in MovieCD
    • FFmpeg (decoder only)
  • CD+G (CD+Graphics) codec
    • FFmpeg (decoder only)
    • VLC (decoder only)
  • CD+EG (CD+Extended Graphics) codec

Network video codecs

edit

Bayer video codecs

edit
  • CinemaDNG (created by Adobe; used in Blackmagic cameras)
  • Redcode RAW (used in RED cameras) – a modified version of JPEG 2000[81]
    • libredcode
  • ArriRaw (used in Arri cameras)
  • Cineform RAW (used in Silicon Imaging cameras)
    • CineForm-SDK
  • Blackmagic RAW (used in Blackmagic cameras)
    • Blackmagic RAW SDK
  • Cintel RAW (used in Cintel Scanner[82])
    • FFmpeg (decoder only)
  • Apple ProRes RAW
  • intoPIX TICO RAW[83]
    • intoPIX fastTICO-RAW SDK & TICO-RAW FPGA/ASIC libraries[84]
  • Canon CRX - used in Canon Cinema Raw Light movie
    • Canon RAW Plugin for Avid Media Access
    • LibRaw (decoder only; open source)

Video games

edit

Real-time

edit
  • RivaTuner video codec (RTV1/RTV2)
    • FFmpeg (RTV1 decoder only)
  • Hap/Hap Alpha/Hap Q
    • VIDVOX hap codec
    • FFmpeg
  • DXV Codec
    • Resolume DXV Codec
    • FFmpeg
  • NotchLC
    • FFmpeg (decoder only)
  • VESA Display Stream Compression (DSC)
  • VESA Display Compression-M (VDC-M)

See also

edit

References

edit
  1. ^ FLAC (Free Lossless Audio Codec), Version 1.1.2 Library of Congress
  2. ^ "About lossless audio in Apple Music". 25 October 2021.
  3. ^ "BFDLAC: A Fast lossless Audio Compression Algorithm For Drum Sounds" (PDF).
  4. ^ Matsui, Emiko (2023-09-19). "Huawei L2HC 3.0 delivers 1.5Mbps lossless sound quality, 4X faster than Apple's AAC". Huawei Central. Retrieved 2024-04-29.
  5. ^ "Lossless Audio Homepage". www.lossless-audio.com.
  6. ^ Shorten Lossless Audio Compression Format (SHN), Version 3.5.1 Library of Congress
  7. ^ "RK Audio - Hydrogenaudio Knowledgebase". wiki.hydrogenaud.io.
  8. ^ FFmpeg 7.1 Released With VVC Decoder Promoted To Stable, Vulkan H.264/H.265 Encode. Phoronix. 30 September 2024.
  9. ^ IPMR Speech Codec - draft-spiritdsp-ipmr-01.txt IETF
  10. ^ TeamSpirit Voice&Video Engine PC. Spirit DSP
  11. ^ a b c 3GPP (2008-12-11) 3GPP TS 26.173 - AMR-WB speech Codec; version 8.0.0 Release 8, retrieved 2009-09-09
  12. ^ Release of sbc-1.1, BlueZ Project, April 30, 2013
  13. ^ PulseAudio 15 Released With Bluetooth Improvements, Better Hardware Support. Phoronix. July 28, 2021
  14. ^ PipeWire: Bluetooth support status update. Collabora. April 29, 2022
  15. ^ a b Integration of the aptX and aptX-HD codecs for A2DP source, Android Open Source Project, January 4, 2017
  16. ^ The contribution of LDAC encoder, Android Open Source Project, January 10, 2017
  17. ^ "What is LHDC". hwa-audio. Retrieved 2019-04-30.
  18. ^ "What is LLAC™?". LHDC org.[dead link]
  19. ^ Speex Audio Codec, Version 1.2 Library of Congress
  20. ^ a b c d e f Finding voice codecs for free software. Linux.com. October 14, 2005
  21. ^ SILK Speech Codec - draft-vos-silk-02 IETF
  22. ^ Constrained-Energy Lapped Transform (CELT) Codec - draft-valin-celt-codec-02 IETF
  23. ^ "DSP Group Unveils Total Telephony Solutions(TM) For Digital Cordless Telephony Applications". Archived from the original on August 23, 2016. Retrieved June 24, 2015.
  24. ^ RadioShack Digital Recorder OWNER'S MANUAL p.38. RadioShack. 2002.
  25. ^ HyperHyde Operation Manual. p.40. I-O DATA. 2000.
  26. ^ 3GPP (2008-12-11) 3GPP TS 26.073 - AMR speech Codec; version 8.0.0 Release 8, retrieved 2009-09-08.
  27. ^ 3GPP (2008-12-18) 3GPP TS 26.273 - AMR-WB+ speech Codec; version 8.0.0 Release 8, retrieved 2009-09-09
  28. ^ 3GPP TS 26.443. Codec for Enhanced Voice Services (EVS); ANSI C code (floating-point).
  29. ^ INFORMATION COLLECTION SURVEY FOR THE MEGA MANILA SUBWAY PROJECT IN THE REPUBLIC OF THE PHILIPPINES Japan International Cooperation Agency September, 2015
  30. ^ 東北上越新幹線デジタル列車 無線システムの開発 (in Japanese) East Japan Railway Company 2003
  31. ^ Obranovich, Charles R.; Golusky, John M.; Preuss, Robert D.; Fabbri, Darren R.; Cruthirds, Daniel R.; Aylward, Erin M.; Freebersyser, James A.; Kolek, Stephen R. (2010). "300 BPS noise robust vocoder". 2010 - Milcom 2010 Military Communications Conference. pp. 298–303. doi:10.1109/MILCOM.2010.5680311. ISBN 978-1-4244-8178-1. S2CID 8991597.
  32. ^ Actimagine allège le multimédia sur les terminaux portables (in French), IT Industrie & Technologies, June 25, 2004
  33. ^ a b c d e AudioCompressionFormat, Unity Technologies
  34. ^ Audio Clip, Unity Technologies
  35. ^ Differences Between Windows and Xbox 360, Microsoft
  36. ^ 【ひらブラ vol.37】音数を諦めず/音質を妥協せず/負荷を極小にする方法(iOS&Android) (in Japanese), Kadokawa Dwango, September 26, 2014
  37. ^ FMOD Studio 1.06 and FMOD at GDC expo program announced, Gamasutra, February 17, 2015
  38. ^ Faster professional 10-bit video conversions. Open Broadcast Systems
  39. ^ "Lossless". x265.readthedocs.io.
  40. ^ "HEVC Decoding". x265.
  41. ^ "FFmpeg Now Supports HEVC/H.265 Decoding". phoronix.
  42. ^ "Encode/H.265". FFmpeg.
  43. ^ Niedermayer, Michael; Rice, Dave; Martinez, Jérôme (August 2021). "rfc9043 - FFV1 Video Coding Format Version 0, 1, and 3". datatracker.ietf.org.
  44. ^ "Lossless Codec Libraries". multimedia.cx.
  45. ^ "FFmpeg: libavcodec/flashsv.c File Reference". ffmpeg.org.
  46. ^ "FRAPS show fps, record video game movies, screen capture software". www.fraps.com.
  47. ^ "Lagarith Lossless Video Codec". lags.leetcode.net.
  48. ^ "LOCO - MultimediaWiki". wiki.multimedia.cx.
  49. ^ "MagicYUV – Lossless video codec".
  50. ^ "ScreenPressor by Infognition - lossless video codec for screen capture". infognition.com.
  51. ^ "Downloads". TechSmith.
  52. ^ "#534 (Ut Video Support) – FFmpeg". ffmpeg.org.
  53. ^ "Ut Video Codec Suite - a new lossless video codec for Windows! [Archive] - Doom9's Forum". doom9.org.
  54. ^ "VBLE - MultimediaWiki". wiki.multimedia.cx.
  55. ^ "VMware Video". multimedia.cx.
  56. ^ "The WebM Project - VP8 Encode Parameter Guide". webmproject.org.
  57. ^ Medoff, Norman; Fink, Edward J. (September 10, 2012). Portable Video: ENG & EFP. CRC Press. p. 221. ISBN 9781136047701.
  58. ^ Samuelsson, J. and P. Hermansson (July 2, 2018). "The xvc video codec". datatracker.ietf.org.
  59. ^ Fuldseth, Arild; Bjontegaard, Gisle; Midtskogen, Steinar; Davies, Thomas; Zanaty, Mo (October 31, 2016). "Thor Video Codec". tools.ietf.org.
  60. ^ "Live demonstration". Forbidden.
  61. ^ Indeo Video Codec, Version 3 Library of Congress
  62. ^ Indeo Video Codec, Version 5 Library of Congress
  63. ^ Sorenson Video Codec, Version 3 Library of Congress
  64. ^ What Is AI Video Compression?. MASV. January 5, 2023
  65. ^ Streamers look to AI to crack the codec code. International Broadcasting Convention. 25 June 2024
  66. ^ Intel Ignite Selects Startups for Spring ’23 Cohorts. Intel
  67. ^ a b c Scalable Video Coding (SVC) Extension for WebRTC - 4. Operational model, World Wide Web Consortium, September 26, 2020
  68. ^ "M-JPEG Codec". Montpellier, France: Morgan Multimedia. Retrieved April 28, 2018.
  69. ^ "M-JPEG2000 Codec". Montpellier, France: Morgan Multimedia. Retrieved April 28, 2018.
  70. ^ "dcpPlayer". Montpellier, France: Morgan Multimedia. Retrieved April 28, 2018.
  71. ^ "FastTICO-XS Codec". Mont-Saint-Guibert, Belgium: intoPIX.
  72. ^ FFmpeg-cvslog - mpeg4video: Add support for MPEG-4 Simple Studio Profile., FFmpeg Project, April 2, 2018
  73. ^ FFmpeg Adds Support For Animated JPEG-XL, Phoronix, June 8, 2023
  74. ^ NewTek Codec Notes NewTek
  75. ^ Achievement, Audio Video Coding Standard Workgroup of China
  76. ^ FFmpeg-cvslog - avcodec: add IMM4 decoder, FFmpeg Project, August 21, 2018
  77. ^ FFmpeg-cvslog - avcodec: add IMM5 decoder, FFmpeg Project, August 29, 2019
  78. ^ Cinepak Library of Congress
  79. ^ SunVideo Plus for PCI User's Guide - Audio Video Conferencing. Oracle
  80. ^ vic: Change History. Lawrence Berkeley National Laboratory
  81. ^ libredcode
  82. ^ Cintel Scanner p.35. Blackmagic Design. May, 2020.
  83. ^ intoPIX Tico Raw is a format with a huge potential
  84. ^ intoPIX Tico Raw
  85. ^ 独自コーデックを搭載したニンテンドーDS版Sofdec (in Japanese) CRI Middleware, May 11, 2006
  86. ^ CRI・ミドルウェア、ゲーム開発者向けブログ「CRIチャンネル」を開設 (in Japanese) Impress Watch Corporation, April 19, 2007