[feature]: Add a new IO engine for AMD GPUs via the hipFile API

[sbates130272]

Description of the new feature

AMD GPUs support the allocation of buffers from Video RAM (VRAM) and this has been enabled for storage IO via the hipFile library. This is equivalent to the functionality provided by NVIDIA's cuFile library.

fio already has a libcufile IO engine and we would like to add support for a libhipfile IO engine too. We will work up a PR for this that does a bit of refactoring to leverage common code as much as possible and then wire in the new engine. We will add documentation and examples too.

[ankit-sam]

Hi @sbates130272,

It’s a great idea and I am also exploring this, and excited to see some work in this direction.

To make the implementation extensive, it would be very helpful if the following could be considered:

1. A single ioengine that can refactor common functionality (memory allocation / free, buffer registration / deregistration, any synchronization / stream management operations, error handling, P2P transfer helpers etc), and then the subsequent backends handle the interactions with hipFile and cuFile library. I sense you meant something like this based on your refactoring comment.

2. If possible, the new ioengine can be used to integrate with your GPU initiated work https://github.com/ROCm/fio/tree/dev/stebates/rocm-xio

Really looking forward to the PR, and I am open for collaboration!

[sbates130272]

@ankit-sam thanks. I do want to break this out into a hipfile engine first. And then a xio engine later.

I have a WIP libhipfile ioengine patch series on my fio fork. Feel free to take a look and I plan to convert that to a PR soon.

Any input appreciated!!

[sbates130272]

@ankit-sam here is what we have so far. If you get a chance you can provide early feedback. If not I will aim to get this ready for a PR next week and you and others can review it then. Still needs a bit more of a final polish but its close.

master...sbates130272:fio:feat/hipfile-upstream-rebase

[sbates130272]

@ankit-sam I opened a PR for this. Feedback is most welcome!