WebRTC issue - Hololens unable to send video offer
we developed a fully working webRTC UWP environment starting from this project (https://github.com/webrtc-uwp/PeerCC/tree/Mosa/20180320-peercc-unity).
We developed a Desktop app and a HoloLens app to communicate with each other. Everything was good until we moved to a custom server (Xirsys in this case).
We then modified the Signalling script to adapt it to the new server which uses the MessageWebSocket instead of the StreamSocket that we used before with the peerccconnection_server.exe included in the sample demo.
The current scenario is:
Desktop connects to the server and waits for peers.
Hololens connects to the server and is added to the available peers' list.
The desktop can now call the Hololens and start communicating.
Hololens should send both audio and video, while the Desktop only sends audio.
The actual problem now is the hololens is not able to send the video offer, so the app freezes and crashes. Audio is still working fine (just a few secs before the crash).
If we try communicating between two Desktop clients everything works like a charm.
It would be appreciated some help to solve the problem.
uwp webrtc hololens peer-connection xirsys
edited Nov 21 '18 at 15:10
Adam
65521022
asked Nov 21 '18 at 13:55
Franz
12
add a comment |
we developed a fully working webRTC UWP environment starting from this project (https://github.com/webrtc-uwp/PeerCC/tree/Mosa/20180320-peercc-unity).
We developed a Desktop app and a HoloLens app to communicate with each other. Everything was good until we moved to a custom server (Xirsys in this case).
We then modified the Signalling script to adapt it to the new server which uses the MessageWebSocket instead of the StreamSocket that we used before with the peerccconnection_server.exe included in the sample demo.
The current scenario is:
Desktop connects to the server and waits for peers.
Hololens connects to the server and is added to the available peers' list.
The desktop can now call the Hololens and start communicating.
Hololens should send both audio and video, while the Desktop only sends audio.
The actual problem now is the hololens is not able to send the video offer, so the app freezes and crashes. Audio is still working fine (just a few secs before the crash).
If we try communicating between two Desktop clients everything works like a charm.
It would be appreciated some help to solve the problem.
uwp webrtc hololens peer-connection xirsys
edited Nov 21 '18 at 15:10
Adam
65521022
asked Nov 21 '18 at 13:55
Franz
12
NEWS: if we disable the video streaming from Hololens, setting the RTCMediaStreamConstraints.videoEnabled to false, the app works great streaming only audio both ways. So the problem occurs when trying to use the Hololens camera.
– Franz
Nov 21 '18 at 15:22
new update: I put the constraints back to true for both clients, then I disabled _selfVideoTrack on the Desktop and try. The result is that now hololens streams audio and video correctly, desktop receives them and streams audio to Hololens (and it receives it), BUT, all the UI on hololens disappears and we get: An unhandled exception of type 'System.AccessViolationException' occurred in xxx.exe Attempted to read or write protected memory. This is often an indication that other memory is corrupt. in the hololens client, in this method: public void Run() { m_AppCallbacks.Run(); }
– Franz
Nov 21 '18 at 16:10
add a comment |
we developed a fully working webRTC UWP environment starting from this project (https://github.com/webrtc-uwp/PeerCC/tree/Mosa/20180320-peercc-unity).
We developed a Desktop app and a HoloLens app to communicate with each other. Everything was good until we moved to a custom server (Xirsys in this case).
We then modified the Signalling script to adapt it to the new server which uses the MessageWebSocket instead of the StreamSocket that we used before with the peerccconnection_server.exe included in the sample demo.
The current scenario is:
Desktop connects to the server and waits for peers.
Hololens connects to the server and is added to the available peers' list.
The desktop can now call the Hololens and start communicating.
Hololens should send both audio and video, while the Desktop only sends audio.
The actual problem now is the hololens is not able to send the video offer, so the app freezes and crashes. Audio is still working fine (just a few secs before the crash).
If we try communicating between two Desktop clients everything works like a charm.
It would be appreciated some help to solve the problem.
uwp webrtc hololens peer-connection xirsys
edited Nov 21 '18 at 15:10
Adam
65521022
asked Nov 21 '18 at 13:55
Franz
12
we developed a fully working webRTC UWP environment starting from this project (https://github.com/webrtc-uwp/PeerCC/tree/Mosa/20180320-peercc-unity).
We developed a Desktop app and a HoloLens app to communicate with each other. Everything was good until we moved to a custom server (Xirsys in this case).
We then modified the Signalling script to adapt it to the new server which uses the MessageWebSocket instead of the StreamSocket that we used before with the peerccconnection_server.exe included in the sample demo.
The current scenario is:
Desktop connects to the server and waits for peers.
Hololens connects to the server and is added to the available peers' list.
The desktop can now call the Hololens and start communicating.
Hololens should send both audio and video, while the Desktop only sends audio.
The actual problem now is the hololens is not able to send the video offer, so the app freezes and crashes. Audio is still working fine (just a few secs before the crash).
If we try communicating between two Desktop clients everything works like a charm.
It would be appreciated some help to solve the problem.
uwp webrtc hololens peer-connection xirsys
uwp webrtc hololens peer-connection xirsys
edited Nov 21 '18 at 15:10
Adam
65521022
asked Nov 21 '18 at 13:55
Franz
12
edited Nov 21 '18 at 15:10
Adam
65521022
asked Nov 21 '18 at 13:55
Franz
12
edited Nov 21 '18 at 15:10
Adam
65521022
edited Nov 21 '18 at 15:10
Adam
65521022
edited Nov 21 '18 at 15:10
Adam
65521022
65521022
asked Nov 21 '18 at 13:55
Franz
12
asked Nov 21 '18 at 13:55
Franz
12
asked Nov 21 '18 at 13:55
Franz
12
12
NEWS: if we disable the video streaming from Hololens, setting the RTCMediaStreamConstraints.videoEnabled to false, the app works great streaming only audio both ways. So the problem occurs when trying to use the Hololens camera.
– Franz
Nov 21 '18 at 15:22
new update: I put the constraints back to true for both clients, then I disabled _selfVideoTrack on the Desktop and try. The result is that now hololens streams audio and video correctly, desktop receives them and streams audio to Hololens (and it receives it), BUT, all the UI on hololens disappears and we get: An unhandled exception of type 'System.AccessViolationException' occurred in xxx.exe Attempted to read or write protected memory. This is often an indication that other memory is corrupt. in the hololens client, in this method: public void Run() { m_AppCallbacks.Run(); }
– Franz
Nov 21 '18 at 16:10
add a comment |
NEWS: if we disable the video streaming from Hololens, setting the RTCMediaStreamConstraints.videoEnabled to false, the app works great streaming only audio both ways. So the problem occurs when trying to use the Hololens camera.
– Franz
Nov 21 '18 at 15:22
new update: I put the constraints back to true for both clients, then I disabled _selfVideoTrack on the Desktop and try. The result is that now hololens streams audio and video correctly, desktop receives them and streams audio to Hololens (and it receives it), BUT, all the UI on hololens disappears and we get: An unhandled exception of type 'System.AccessViolationException' occurred in xxx.exe Attempted to read or write protected memory. This is often an indication that other memory is corrupt. in the hololens client, in this method: public void Run() { m_AppCallbacks.Run(); }
– Franz
Nov 21 '18 at 16:10
NEWS: if we disable the video streaming from Hololens, setting the RTCMediaStreamConstraints.videoEnabled to false, the app works great streaming only audio both ways. So the problem occurs when trying to use the Hololens camera.
– Franz
Nov 21 '18 at 15:22
NEWS: if we disable the video streaming from Hololens, setting the RTCMediaStreamConstraints.videoEnabled to false, the app works great streaming only audio both ways. So the problem occurs when trying to use the Hololens camera.
– Franz
Nov 21 '18 at 15:22
new update: I put the constraints back to true for both clients, then I disabled _selfVideoTrack on the Desktop and try. The result is that now hololens streams audio and video correctly, desktop receives them and streams audio to Hololens (and it receives it), BUT, all the UI on hololens disappears and we get: An unhandled exception of type 'System.AccessViolationException' occurred in xxx.exe Attempted to read or write protected memory. This is often an indication that other memory is corrupt. in the hololens client, in this method: public void Run() { m_AppCallbacks.Run(); }
– Franz
Nov 21 '18 at 16:10
new update: I put the constraints back to true for both clients, then I disabled _selfVideoTrack on the Desktop and try. The result is that now hololens streams audio and video correctly, desktop receives them and streams audio to Hololens (and it receives it), BUT, all the UI on hololens disappears and we get: An unhandled exception of type 'System.AccessViolationException' occurred in xxx.exe Attempted to read or write protected memory. This is often an indication that other memory is corrupt. in the hololens client, in this method: public void Run() { m_AppCallbacks.Run(); }
– Franz
Nov 21 '18 at 16:10
add a comment |
0
active
oldest
votes
Your Answer
StackExchange.ifUsing("editor", function () {
StackExchange.using("externalEditor", function () {
StackExchange.using("snippets", function () {
StackExchange.snippets.init();
});
});
}, "code-snippets");
StackExchange.ready(function() {
var channelOptions = {
tags: "".split(" "),
id: "1"
};
initTagRenderer("".split(" "), "".split(" "), channelOptions);
StackExchange.using("externalEditor", function() {
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled) {
StackExchange.using("snippets", function() {
createEditor();
});
}
else {
createEditor();
}
});
function createEditor() {
StackExchange.prepareEditor({
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: true,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: 10,
bindNavPrevention: true,
postfix: "",
imageUploader: {
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
},
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
});
}
});
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f53413648%2fwebrtc-issue-hololens-unable-to-send-video-offer%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
0
active
oldest
votes
0
active
oldest
votes
active
oldest
votes
active
oldest
votes
Thanks for contributing an answer to Stack Overflow!
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
To learn more, see our tips on writing great answers.
Some of your past answers have not been well-received, and you're in danger of being blocked from answering.
Please pay close attention to the following guidance:
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
To learn more, see our tips on writing great answers.
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f53413648%2fwebrtc-issue-hololens-unable-to-send-video-offer%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
NEWS: if we disable the video streaming from Hololens, setting the RTCMediaStreamConstraints.videoEnabled to false, the app works great streaming only audio both ways. So the problem occurs when trying to use the Hololens camera.
– Franz
Nov 21 '18 at 15:22
new update: I put the constraints back to true for both clients, then I disabled _selfVideoTrack on the Desktop and try. The result is that now hololens streams audio and video correctly, desktop receives them and streams audio to Hololens (and it receives it), BUT, all the UI on hololens disappears and we get: An unhandled exception of type 'System.AccessViolationException' occurred in xxx.exe Attempted to read or write protected memory. This is often an indication that other memory is corrupt. in the hololens client, in this method: public void Run() { m_AppCallbacks.Run(); }
– Franz
Nov 21 '18 at 16:10