Re: [PATCH v8 0/3] HEVC/H.265 stateless support for V4L2 and Cedrus

From: Jernej Åkrabec
Date: Tue Oct 08 2019 - 17:48:43 EST


Dne petek, 27. september 2019 ob 16:34:08 CEST je Paul Kocialkowski
napisal(a):
> HEVC/H.265 stateless support for V4L2 and Cedrus
>
> This is early support for HEVC/H.265 stateless decoding in V4L2,
> including both definitions and driver support for the Cedrus VPU
> driver, which concerns Allwinner devices.
>
> A specific pixel format is introduced for the HEVC slice format and
> controls are provided to pass the bitstream metadata to the decoder.
> Some bitstream extensions are intentionally not supported at this point.
>
> Since this is the first proposal for stateless HEVC/H.265 support in
> V4L2, reviews and comments about the controls definitions are
> particularly welcome.
>
> On the Cedrus side, the H.265 implementation covers frame pictures
> with both uni-directional and bi-direction prediction modes (P/B
> slices). Field pictures (interleaved), scaling lists and 10-bit output
> are not supported at this point.

Whole series is:
Reviewed-by: Jernej Skrabec <jernej.skrabec@xxxxxxxx>

Hopefully this can be merged soon.

Best regards,
Jernej

>
> Changes since v7:
> * Rebased on latest media tree;
> * Fixed holes in structures for cacheline alignment;
> * Added decode mode and start code controls
> (only per-slice and no start code is supported at this point).
>
> Changes since v6:
> * Rebased on latest media tree from Hans;
> * Reordered some fields to avoid holes and multi-padding;
> * Updated the documentation.
>
> Changes since v5:
> * Rebased atop latest next media tree;
> * Moved to flags instead of u8 fields;
> * Added padding to ensure 64-bit alignment
> (tested with GDB on 32 and 64-bit architectures);
> * Reworked cedrus H.265 driver support a bit for flags;
> * Split off codec-specific control validation and init;
> * Added HEVC controls fields cleanup at std_validate to allow reliable
> control comparison with memcmp;
> * Fixed various misc reported mistakes.
>
> Changes since v4:
> * Rebased atop latest H.254 series.
>
> Changes since v3:
> * Updated commit messages;
> * Updated CID base to avoid conflicts;
> * Used cpu_to_le32 for packed le32 data;
> * Fixed misc minor issues in the drive code;
> * Made it clear in the docs that the API will evolve;
> * Made the pixfmt private and split commits about it.
>
> Changes since v2:
> * Moved headers to non-public API;
> * Added H265 capability for A64 and H5;
> * Moved docs to ext-ctrls-codec.rst;
> * Mentionned sections of the spec in the docs;
> * Added padding to control structures for 32-bit alignment;
> * Made write function use void/size in bytes;
> * Reduced the number of arguments to helpers when possible;
> * Removed PHYS_OFFSET since we already set PFN_OFFSET;
> * Added comments where suggested;
> * Moved to timestamp for references instead of index;
> * Fixed some style issues reported by checkpatch.
>
> Changes since v1:
> * Added a H.265 capability to whitelist relevant platforms;
> * Switched over to tags instead of buffer indices in the DPB
> * Declared variable in their reduced scope as suggested;
> * Added the H.265/HEVC spec to the biblio;
> * Used in-doc references to the spec and the required APIs;
> * Removed debugging leftovers.
>
> Cheers!
>
> Paul Kocialkowski (3):
> media: v4l: Add definitions for HEVC stateless decoding
> media: pixfmt: Document the HEVC slice pixel format
> media: cedrus: Add HEVC/H.265 decoding support
>
> Documentation/media/uapi/v4l/biblio.rst | 9 +
> .../media/uapi/v4l/ext-ctrls-codec.rst | 553 +++++++++++++++-
> .../media/uapi/v4l/pixfmt-compressed.rst | 23 +
> .../media/uapi/v4l/vidioc-queryctrl.rst | 18 +
> .../media/videodev2.h.rst.exceptions | 3 +
> drivers/media/v4l2-core/v4l2-ctrls.c | 108 ++-
> drivers/media/v4l2-core/v4l2-ioctl.c | 1 +
> drivers/staging/media/sunxi/cedrus/Makefile | 2 +-
> drivers/staging/media/sunxi/cedrus/cedrus.c | 52 +-
> drivers/staging/media/sunxi/cedrus/cedrus.h | 18 +
> .../staging/media/sunxi/cedrus/cedrus_dec.c | 9 +
> .../staging/media/sunxi/cedrus/cedrus_h265.c | 616 ++++++++++++++++++
> .../staging/media/sunxi/cedrus/cedrus_hw.c | 4 +
> .../staging/media/sunxi/cedrus/cedrus_regs.h | 271 ++++++++
> .../staging/media/sunxi/cedrus/cedrus_video.c | 10 +
> include/media/hevc-ctrls.h | 212 ++++++
> include/media/v4l2-ctrls.h | 7 +
> 17 files changed, 1907 insertions(+), 9 deletions(-)
> create mode 100644 drivers/staging/media/sunxi/cedrus/cedrus_h265.c
> create mode 100644 include/media/hevc-ctrls.h