Was wondering if its possible to get the head tracking feature on the Audeze Mobius into this software?
I believe it has this device intergrated in it or something similar https://www.waves.com/hardware/nx-head-tracker
Last edit: Rhyzak Revy 2020-09-08
If you would like to refer to this comment somewhere else in this project, copy and paste the following link:
Sounds interesting! If there is something like an SDK which can be used to retrieve the data from the device, it certainly would be possible. Did you find any aplications that use it?
If you would like to refer to this comment somewhere else in this project, copy and paste the following link:
I have been interested in this as well. I am trying to find a program to convert Mobius 3d tracking to Freetrack 2.0 to use in games such as Star Citizen. Apparently the Audeze HQ program "allows apps using Zeroconf (OSC protocol) to access the headtracking data provided by Audeze Mobius. If you have software that’s compatible with that protocol, the data should transmit to it."
I dont know what that means or how to get it to function.
I do remember investigating this matter in 2020, but at that time I did not get much further. The Zeroconf communication seems to require a Bonjour service (for Windows). I have not found that at the time.
It's a pity that the OSC protocol they mention is not explained much further. As you know, FaceTrackNoIR supports OSC, but that is send via TCP or UDP...
If you would like to refer to this comment somewhere else in this project, copy and paste the following link:
Do you have any news here ?
If Bonjour is required, it can be installed automatically when you install iTunes on windows. I have just asked to Audeze how they have implmented OSC (client, server, tcp, udp and port number)
If you would like to refer to this comment somewhere else in this project, copy and paste the following link:
I wrote again to audeze support, let's see what will happen.
In the meanwhile i did a port scan on audeze software.
When the "link mode" is enable, audeze open the following port
UDP 0.0.0.0:59437
Quite strange the address 0.0.0.0 ... it looks like audeze software cannot set the right ip
Restarting the audeze software, that port changes into 57144 UDP.
It looks like a client behaviour ?
I have seen that facetracknoir allows me only to define a port up to 9999, so i cannot go further and set 59437.
It will be possibile to unlock whole port range in some way ?
Last edit: ronzino 2022-11-21
If you would like to refer to this comment somewhere else in this project, copy and paste the following link:
once you reboot you will have bonjour service running.
now the "step" is, whenever you enable "link mode" in Audeze software, it suddenly crashs ....always
even if you stop the bonjour service, audeze software crash. The only way to avoid this was to uninstall bonjour. It seems that bonjour interacts in a bad way with link mode
Last edit: ronzino 2022-11-22
If you would like to refer to this comment somewhere else in this project, copy and paste the following link:
Today when testing method above, AudezeHQ was sending in Link Mode on UDP 1900 (the first time I've seen it use a 4 digit port, scanned with netstat command) I set FaceTrackNoIR to receive OSC on UDP 1900 and for a split second it showed "Tracking" under status when I pressed the Start button, and the 3d graphic on AudezeHQ glitched out. After pressing Stop and then Start again, once more it showed Tracking and glitched out for a split second before returning to blank status. Eventually FaceTrackNoIR crashed after a few more attempts at Stop/Start.
There is some communication between AudezeHQ Link Mode and FaceTrackNoIR without any other software (no Bonjour installed). I tried the Bonjour SDK method above but even using the SDK caused AudezeHQ to crash when turning on Link Mode.
👍
1
If you would like to refer to this comment somewhere else in this project, copy and paste the following link:
@v4friend Hey mate! I got Audeze Mobius headphones and really want to use its head tracking feature with your software but I coudn't do it. I tried everything but it's not pulling head tracking data via OSC cause it requires Zeroconfig protocol (Bonjour). As you know AudezeHQ app shows the headtracking value in itself. So is it possible to make your software read these values from Audeze HQ app?
you cant . i spoke alot with tech support years ago. it is workinprogress feature for facebook headttavking whosé development was abbandoned due to instability.
i ended up buying an ir head tracking device and attachin with magnets the ir reflector on headsed so i can detach it whenever I want.
If you would like to refer to this comment somewhere else in this project, copy and paste the following link:
It would also be worth the trouble to build a custom protocol, if the Audeze community was bigger. Unfortunately my health also does not enable me to do much...
If you would like to refer to this comment somewhere else in this project, copy and paste the following link:
The problem is that AudezeHQ is not using the standart OSC protocol. It uses a different OSC protocol (zeroconfig) and we didn't know anything about it. I contact with Audeze and they said that Link Mode is an experimental feature for using it via Facebook 360 Workstation. They stopped developing this feature and they are not explaining any details of how it works or how we can make it work. It's starting 3 connection (2 UCP and 1 TCP) with 4 digit port number when I activated "Link Mode" but how many times I tried to connect it to an OSD supported app (including Facebook 360 Workstation), it couldn't pull the headtracking data. I have not enough knowledge how OSD connection or UDP/TCL connections work. BTW there are lots of Audeze Mobius users and this headphones is the only headphones which don't have a public SDK for headtracking data but visible data in its app. So it worth for that. Maybe we should focus on this accessible datas in app rather than trying to make an OSD connection. Or can someone dig into the AudezeHQ app and find a way to pull the headtracking data like AudezeHQ? Maybe a costum app for this process works like the app is gonna read the values in AudezeHQ app and convert it to a standart OSC messages for your Facetracknoir app?
Last edit: Ahmet Ali 2024-07-23
If you would like to refer to this comment somewhere else in this project, copy and paste the following link:
I just spent a half day working on this same idea for the Maxwell headset and was able to succesfully get head tracking to work in games. I previously owned a Mobius, but it no longer functions - I'd be happy to compare notes, though, and see if there is any commonality.
The Maxwell sends OSC messages as UDP packets (by default to 127.0.0.1:8000) in four or five different flavors at roughly 60 Hz; the one I have explored is yaw-pitch-roll amd the rest are variously-flavored quaternions.
The OSC header ("message pattern") is /ypr, the type tag string is fff, and it correspondingly carries three 32-bit float values for yaw, pitch, and roll. I threw together some quick and dirty python code to capture all the /ypr messages, extract the floats, and synthesize a new OSC UDP message using the /gyrosc/gyro header that is already supported by the OSC plugin.
I also added a very basic scaling factor to the ypr values to make them play nicely based on a bit of empirical testing.
Once all the pieces were running, I set the game protocol to FreeTrack 2.1 and confirmed that I had functioning TrackIR head tracking behavior in Warthunder.
Please let me know if these insights help at all or let me know if you have any questions. I would also be happy to dive into figuring out the same process for specifically Mobius data if somebody can pcap or otherwise capture it for me (as my Mobius headset is long dead, I think).
If you would like to refer to this comment somewhere else in this project, copy and paste the following link:
Was wondering if its possible to get the head tracking feature on the Audeze Mobius into this software?
I believe it has this device intergrated in it or something similar https://www.waves.com/hardware/nx-head-tracker
Last edit: Rhyzak Revy 2020-09-08
Hello Rhyzak,
Sounds interesting! If there is something like an SDK which can be used to retrieve the data from the device, it certainly would be possible. Did you find any aplications that use it?
Not sure where to find an SDK for it but the application that uses it is this.
I added a quick webm of the program in attachments.
Maybe there is a way to pull the data from the appication for the Pitch/Yaw/Roll?
There is also a mention in here that it can route all of its head tracking information straight to this plugin.
Most It can do by default for in-game controls is just macros with the head gestures you can setup.
Last edit: Rhyzak Revy 2020-09-13
Hello Rhyzak,
OK, so I have sent an email to Audeze support, to see if this is possible. Keep your fingers crossed!
I have been interested in this as well. I am trying to find a program to convert Mobius 3d tracking to Freetrack 2.0 to use in games such as Star Citizen. Apparently the Audeze HQ program "allows apps using Zeroconf (OSC protocol) to access the headtracking data provided by Audeze Mobius. If you have software that’s compatible with that protocol, the data should transmit to it."
I dont know what that means or how to get it to function.
Source: https://research.mach1.tech/posts/imu-enabled-devices/
Please let me know if there are any future developments regarding this topic.
Hello Bailey ,
I do remember investigating this matter in 2020, but at that time I did not get much further. The Zeroconf communication seems to require a Bonjour service (for Windows). I have not found that at the time.
It's a pity that the OSC protocol they mention is not explained much further. As you know, FaceTrackNoIR supports OSC, but that is send via TCP or UDP...
Do you have any news here ?
If Bonjour is required, it can be installed automatically when you install iTunes on windows. I have just asked to Audeze how they have implmented OSC (client, server, tcp, udp and port number)
Let me know if there is an answer?
I wrote again to audeze support, let's see what will happen.
In the meanwhile i did a port scan on audeze software.
When the "link mode" is enable, audeze open the following port
UDP 0.0.0.0:59437
Quite strange the address 0.0.0.0 ... it looks like audeze software cannot set the right ip
Restarting the audeze software, that port changes into 57144 UDP.
It looks like a client behaviour ?
I have seen that facetracknoir allows me only to define a port up to 9999, so i cannot go further and set 59437.
It will be possibile to unlock whole port range in some way ?
Last edit: ronzino 2022-11-21
just a step forward and one behind
Bonjour for windows can only be installed downloading itunes not from microsoft store but for desktop.
you can follows this link
https://secure-appldnld.apple.com/itunes12/001-97787-20210421-F0E5A3C2-A2C9-11EB-A40B-A128318AD179/iTunes64Setup.exe
once you reboot you will have bonjour service running.
now the "step" is, whenever you enable "link mode" in Audeze software, it suddenly crashs ....always
even if you stop the bonjour service, audeze software crash. The only way to avoid this was to uninstall bonjour. It seems that bonjour interacts in a bad way with link mode
Last edit: ronzino 2022-11-22
Bonjour SDK can be download here for windows
https://developer.apple.com/opensource/
https://download.developer.apple.com/Developer_Tools/bonjour_sdk_for_windows_v3.0/bonjoursdksetup.exe
this will allows command line from CMD like " dns-sd " that is an help command
in this case, bonjour service is installed and audeze software survive
Wim Vriend , you have a private message
Answer sent to you via private message
Did anyone manage to get any further with this?
Hello Roman,
Actually, I have not yet investigated the info I received from ronzino. I have been busy with some other computer stuff and the holidays ;)
Hi Wim!
Hope you had a good holiday period.
Thanks for your reply, hopefully you make some progress with this. Look forward to hearing more!
@v4friend just thought this may be usedul -
Today when testing method above, AudezeHQ was sending in Link Mode on UDP 1900 (the first time I've seen it use a 4 digit port, scanned with netstat command) I set FaceTrackNoIR to receive OSC on UDP 1900 and for a split second it showed "Tracking" under status when I pressed the Start button, and the 3d graphic on AudezeHQ glitched out. After pressing Stop and then Start again, once more it showed Tracking and glitched out for a split second before returning to blank status. Eventually FaceTrackNoIR crashed after a few more attempts at Stop/Start.
There is some communication between AudezeHQ Link Mode and FaceTrackNoIR without any other software (no Bonjour installed). I tried the Bonjour SDK method above but even using the SDK caused AudezeHQ to crash when turning on Link Mode.
@v4friend Hey mate! I got Audeze Mobius headphones and really want to use its head tracking feature with your software but I coudn't do it. I tried everything but it's not pulling head tracking data via OSC cause it requires Zeroconfig protocol (Bonjour). As you know AudezeHQ app shows the headtracking value in itself. So is it possible to make your software read these values from Audeze HQ app?
Last edit: Ahmet Ali 2024-07-20
you cant . i spoke alot with tech support years ago. it is workinprogress feature for facebook headttavking whosé development was abbandoned due to instability.
i ended up buying an ir head tracking device and attachin with magnets the ir reflector on headsed so i can detach it whenever I want.
If so there is only one solution left. Reading head tracking data from the AudezeHQ itself.
Hello guys,
If the Audeze software would send OSC messages (like the OSC tracker reads: https://facetracknoir.sourceforge.net/Trackers/OSC.htm) then things would be simple.
It would also be worth the trouble to build a custom protocol, if the Audeze community was bigger. Unfortunately my health also does not enable me to do much...
The problem is that AudezeHQ is not using the standart OSC protocol. It uses a different OSC protocol (zeroconfig) and we didn't know anything about it. I contact with Audeze and they said that Link Mode is an experimental feature for using it via Facebook 360 Workstation. They stopped developing this feature and they are not explaining any details of how it works or how we can make it work. It's starting 3 connection (2 UCP and 1 TCP) with 4 digit port number when I activated "Link Mode" but how many times I tried to connect it to an OSD supported app (including Facebook 360 Workstation), it couldn't pull the headtracking data. I have not enough knowledge how OSD connection or UDP/TCL connections work. BTW there are lots of Audeze Mobius users and this headphones is the only headphones which don't have a public SDK for headtracking data but visible data in its app. So it worth for that. Maybe we should focus on this accessible datas in app rather than trying to make an OSD connection. Or can someone dig into the AudezeHQ app and find a way to pull the headtracking data like AudezeHQ? Maybe a costum app for this process works like the app is gonna read the values in AudezeHQ app and convert it to a standart OSC messages for your Facetracknoir app?
Last edit: Ahmet Ali 2024-07-23
I just spent a half day working on this same idea for the Maxwell headset and was able to succesfully get head tracking to work in games. I previously owned a Mobius, but it no longer functions - I'd be happy to compare notes, though, and see if there is any commonality.
The Maxwell sends OSC messages as UDP packets (by default to 127.0.0.1:8000) in four or five different flavors at roughly 60 Hz; the one I have explored is yaw-pitch-roll amd the rest are variously-flavored quaternions.
The OSC header ("message pattern") is
/ypr
, the type tag string isfff
, and it correspondingly carries three 32-bit float values for yaw, pitch, and roll. I threw together some quick and dirty python code to capture all the/ypr
messages, extract the floats, and synthesize a new OSC UDP message using the/gyrosc/gyro
header that is already supported by the OSC plugin.I also added a very basic scaling factor to the ypr values to make them play nicely based on a bit of empirical testing.
Once all the pieces were running, I set the game protocol to FreeTrack 2.1 and confirmed that I had functioning TrackIR head tracking behavior in Warthunder.
Very short video showing it running here: https://www.reddit.com/r/Audeze/comments/1g41c36/maxwell_3dof_head_tracking_for_games_proof_of/
Please let me know if these insights help at all or let me know if you have any questions. I would also be happy to dive into figuring out the same process for specifically Mobius data if somebody can pcap or otherwise capture it for me (as my Mobius headset is long dead, I think).