Audio Graph (Version 0.2) and Internal Rework (Version 0.3)

[Ohjurot]

Audio

Sorry for the recent inactivity of this project but my EE university studies are currently quit demanding I didn't have much time. However, I have created a "Audio graph" to illustrate the audio flow currently planned.
You can take a look at it here https://github.com/Ohjurot/DualSense-Windows/blob/audio/Doc/Audio/audio_graph.pdf

Feedback is highly appreciated I have not started the implementation yet!

Rework and Additions

Since audio and some planed features require a more sophisticated allocation and background worker concept I’m planning to rework the internal flow of memory allocation and I/O calls to be more advanced and fully customisable (when things are done you will be able to integrate the API in your Engine's job system; But don’t worry there will be an easy to use DefaultInit() function)
Currently I can't tell you much about the concrete plans because I have not started working on it. But there will be a class IMemoryAllocator and struct API_FLOW_DESC to optionally configure the behaviour of the API.

[KITATUS]

Excellent, thanks for the flow graph. This is enough information to at least make a space in the UE4 port for this!

[Ohjurot]

@KITATUS another thing I should mention is that with the addition of audio a dedicated worker thread is required. As already stated out it will be possible to fully control the flow via the coming API_FLOW_DESC descriptor. I am not familiar with the job / threading system of the Unreal Engine, so If you want to fully integrate the API callings into the engine you need to provide me some information on how this kind of stuff is done in UE (then I can design this system with UE in mind). I suspect UE has a kind of UE4_JOB_DESC (or sth like that) which include a function pointer to static callback which accepts void* set in the struct. This would perfectly fit with my current design in mind... but probably it is a bit more complex ;)

[KITATUS]

As much as I hate throwing videos at people, I think this video sums up pretty well how UE deals (read: WANTS you to deal) with tasks / threads in a practical example: https://www.youtube.com/watch?v=0Yyh3oQgonI - I would show some documentation but UE falls off a cliff when it comes to documentation that is actually useful for things like threads and tasks :P Hope it helps!

[Ohjurot]

@KITATUS The video was good for the beginning and helped me to gain a first insight into the unreal engine concurrent architecture. Integrating should be no problem than. I just requested access to the UE4 source code, I plan to look at it.

[KITATUS]

If it helps take some stress from you, I am more than happy to integrate the next release with this memory management in and report back any pain points or changes I had to do to make it work (if any). That way you don't have to crawl through the source code of UE (which from too many years of experience, I warn can be very painful!)

[Ohjurot]

@KITATUS This would be nice! I poked around in some random files didn’t saw much code comments....

[petersvp]

Is there anh API to send samples to the controller? Or hints? Or anything related to reverse engineering the audio part? I don't want the library to spawn a worker thread by default but I want to find an interface to send audio data to the controller (the thread is my responsibility).

[Ohjurot]

The controller is a normal audio device. You should be able to use it with no lib at all. I have a gist for demo: https://gist.github.com/Ohjurot/b0c04dfbd25fb71bc0da50947d313d1b

[DJm00n]

@Ohjurot Neat!

One thing to add: you can select proper audio device by the same DEVPKEY_Device_ContainerId property as in requested HID device:

PS: This will work only via usual USB connection. Sending sound to a DualShock4/DualSense via Bluetooth is a way harder - there is no any Audio device present in Windows in this case...