Event Manager

Simple liburing based library which uses coroutines for dealing with I/O.

Usage

Example to print the output of a file test.txt:

#include "event_manager.hpp"
#include <fcntl.h>

EvTask coro(EventManager *ev) {
  // open a file and make a buffer to read into
  int fd = open("test.txt", O_RDWR);
  constexpr int size = 2048;
  char buff[size]{};

  // read some data and print it
  co_await ev->read(fd, reinterpret_cast<uint8_t*>(buff), size);
  std::cout << "Read:\n" << buff << "\n";

  // close the file, and kill the event manager
  co_await ev->close(fd);
  co_await ev->kill();
  co_return 0;
}

int main() {
  const int queue_depth = 10; // i.e how many items may be in the internal queue before it needs to be flushed, max is 4096
  EventManager ev{queue_depth};

  // register it with the system, which will run it once it has started
  ev.register_coro(coro, &ev);
  // start it
  ev.start();
}

event_loop/event_manager.hpp is relatively self documenting, and have a look at the tests and examples for more.

Note, it's fine to reinterpret cast in this case, as the char array will be completely unchanged by just changing the pointer type.

Codebase

EventManager class

When registering a coroutine, you can do one of 3 things: 1) construct the coroutine and std::move it to the event manager via register_coro, 2) use the other definition for register_coro, and just pass in the function and its arguments i.e ev->register_coro(coroFn, arg1, arg2, arg3) or 3) just construct it like this ev->register_coro(coroFn(arg1, arg2, arg3))

The coroutine is completely managed by the event manager (it's also started by it, but it should be fine to move in an already started one as well), and once it finishes it is cleaned up in the future if necessary.

Queue Submission

You can make a queue with EventManager::make_request_queue and use those methods to effectively queue up a bunch of operations, and then you can submit them all at once, and set a callback for processing them using EventManager::submit_and_wait.

EvTask class

• You can use it for coroutines, and await on awaitable objects in a function with this return type
• You can await on it, and it will return an integer
• If you await on it, then the current coroutine will be suspended if the inner coroutine is suspended
  • This leads to a semblance of sequential execution for a stack of coroutine calls

Errors

Errors are propagated back to the user using a std::variant - this can be accessed fairly easily, and there are some helper functions to aid use in errors.hpp. Further there are examples of how to use it in the examples/ folder, with the most thorough one being in http_example.cpp.

Development

TODO

• Add a poll context object, to allow for polling without having to submit all the items you want at once

Adding More Operations

To add more operations, there are a few files you need to update:

In communication/

1. Add a new enum request type representing the request in communiation_types.hpp
2. Add a new data type which would store the response data you want in response_packs.hpp
3. Add a new type trait specialisation for the enum value (i.e a new mapping from the enum to the data type) in communication_types.hpp
4. Add RespDataTypeMap<RequestType::your_new_request_enum> to the variant at the bottom (before the monostate) of communication_types.hpp

In event_loop/parameter_packs.hpp

1. Make a struct containing the parameters needed for your request, i.e for readv:

struct ReadvParameterPack {
  int fd;
  struct iovec *iovs;
  size_t num;
};

2. Add that new parameter pack to the OperationParameterPackVariant
3. Add a new type trait specialisation for the enum value you added in communication_types.hpp, like this:

template <> struct RequestToParamPack<RequestType::READV> {
  using type = ReadvParameterPack;
};

4. And then define a new operation on the RequestQueue for your operation, like this:

void queue_readv(int fd, struct iovec *iovs, size_t num) {
  req_vec.push_back(ReadvParameterPack{fd, iovs, num});
}

In event_loop/request_data.hpp

Add another entry to the specific_data union, like:

  ...
  ReadvParameterPack readv_data;
  ...

In coroutine/io_awaitables.hpp

You need to add a new awaitable for your request of the form below in this file:

struct [/* operation name */]Awaitable : IOAwaitable<RequestType::[/* operation name */], [/* operation name */]Awaitable> {
  void prepare_sqring_op(EvTask::Handle handle, io_uring_sqe *sqe) {
    auto &[/* operation name */]_data = req_data.specific_data.[/* operation name */]_data;
    io_uring_prep_[/* operation name */](sqe, ...);
  }

  [/* operation name */]Awaitable(... , EventManager *ev)
      : IOAwaitable(ev) {
    auto &[/* operation name */]_data = req_data.specific_data.[/* operation name */]_data;
    [/* operation name */]_data = { ... };
  }

  // default initialiser
  [/* operation name */]Awaitable() : IOAwaitable(nullptr) {}
};

This will allow us to later do stuff like co_await ev->[/* operation name */](...)

In event_loop/event_manager.hpp

1. Add a forward declaration for the awaitable you made above, we can't include it here since that file includes this file too
2. Add an appropriate declaration to make use of the awaitable in the event manager, like this:

ReadvAwaitable readv(int fd, struct iovec *iovs, size_t num);

In event_loop/io_ops.cpp

1. Define the operation you declared above like this:

ReadvAwaitable EventManager::readv(int fd, struct iovec *iovs, size_t num) {
  if (should_restrict_usage())
    return {};
  return ReadvAwaitable{fd, iovs, num, this};
}

2. Add another case to the switch case in the submit_and_wait(...) function corresponding to this operation, i.e:

case RequestType::READV: {
  auto *pack = std::get_if<ReadvParameterPack>(&req);
  if (pack) {
    specific_data.readv_data = {pack->fd, pack->iovs, pack->num};
    io_uring_prep_readv(sqe, pack->fd, pack->iovs, pack->num, 0);
  } else {
    std::cerr << "There was an error in retrieving queued data\n";
    co_return -1;
  }
  break;
}

In event_loop/core.cpp

Add in a case for your operation in the event_handler(...) switch case, like this:

case RequestType::READV: {
  ReadvResponsePack data{};
  if (res < 0) {
    data.error_num = -res; // -res since errno isn't used for io_uring
  } else {
    data = {.bytes_read = res, .buff = specific_data.read_data.buffer};
  }
  data.req_fd = specific_data.readv_data.fd;
  promise.publish_resp_data<RequestType::READV>(std::move(data));
  req_data->handle.resume();
  break;
}

---

And then after all of these, make sure to update any visitor switch cases you may have to handle the new response types.