#2868 Choppy Opus audio

[Anonymous]

Originally created by: hvtaifwk...@gmail.com

What steps will reproduce the problem?
1. Use Opus
2.
3.

What is the expected output? What do you see instead?
with SILK I get OK sound, but with Opus the audio is choppy.

because of "Issue attachment storage quota exceeded", here's a link:
https://drive.google.com/file/d/0B_EMXtsx7o56ZnY2djZRS05DUlk/view?usp=sharing

I wonder if my ZTE Blade III (cyanogenmod 11) is too slow. The other end has Nexus 5 (Lollipop).

If CPU is too slow, csipsimple should run performance test on startup.

[Anonymous]

Originally posted by: r3gis...@gmail.com

Sounds like problems I had with compatibility of older version of Opus spec. Are both devices using the very latest opus plugin version? Also, is there a sip server in the middle?

Status: Need-Details

[Anonymous]

Originally posted by: hvtaifwk...@gmail.com

Both devices have the latest codec pack from Play.
We both have configured ostel.co accounts, using tls and zrtp.

[Anonymous]

Originally posted by: r3gis...@gmail.com

Hi,

The version on the playstore is outdate.
Please download and install the 1.5 from http://nightlies.csipsimple.com/plugins/

I'm trying to solve some change in android 5.x changes before releasing on playstore.

[Anonymous]

Originally posted by: aeburr...@gmail.com

I'm experiencing another kind of choppy sound with Opus: with a ptime of 40ms in FreeSwitch (Opus frame composed of 2*20ms subframes), the decoded audio by CSS is missing the second part (20ms of sound followed by 20ms of silence) and so on...

SDP:
v=0
o=FreeSWITCH 1424805772 1424805773 IN IP4 192.168.1.3
s=FreeSWITCH
c=IN IP4 192.168.1.3
t=0 0
m=audio 10454 RTP/AVP 111 101
a=rtpmap:111 opus/48000/2
a=fmtp:111 maxplaybackrate=16000
a=rtpmap:101 telephone-event/8000
a=fmtp:101 0-16
a=ptime:40
a=rtcp:10455 IN IP4 192.168.1.3

Partial log:
23:25:17.778      pj_opus.c !Frame recovered 640
23:25:17.778      pj_opus.c  Frame recovered 320
23:25:17.779 pjsua_jni_addo !.....Call 0 state changed to CONFIRMED
23:25:17.779      pj_opus.c !Encoder packet size 65 for input 1280 ouput max len 800 @ 6720
23:25:17.781      pj_opus.c  Frame recovered 640
23:25:17.781      pj_opus.c  Frame recovered 320
23:25:17.781 pjsua_jni_addo !.....Get secure for media type 1
23:25:17.782      pj_opus.c !Encoder packet size 84 for input 1280 ouput max len 800 @ 7360
23:25:17.782   Master/sound  Underflow, buf_cnt=0, will generate 1 frame
23:25:17.782      pj_opus.c  Frame recovered 640
23:25:17.782      pj_opus.c  Frame recovered 320
23:25:17.782   Master/sound  Underflow, buf_cnt=0, will generate 1 frame
23:25:17.783      pj_opus.c  Encoder packet size 75 for input 1280 ouput max len 800 @ 8000
23:25:17.783      pj_opus.c  Frame recovered 640
23:25:17.783      pj_opus.c  Frame recovered 320
23:25:17.785   Master/sound  Underflow, buf_cnt=0, will generate 1 frame
23:25:17.786      pj_opus.c  Encoder packet size 76 for input 1280 ouput max len 800 @ 8640
23:25:17.786 zrtp_android.c !ZRTP info message: Hello received, preparing a Commit
23:25:17.789 zrtp_android.c  ZRTP info message: Commit: Generated a public DH key
23:25:17.791 pjsua_jni_addo !.....Get secure for media type 1
23:25:17.885      pj_opus.c !Frame recovered 640
23:25:17.885      pj_opus.c  Frame recovered 320
23:25:17.886      pj_opus.c  Encoder packet size 66 for input 1280 ouput max len 800 @ 9280
23:25:17.886      pj_opus.c  Frame recovered 640
23:25:17.886      pj_opus.c  Frame recovered 320
23:25:17.887      pj_opus.c  Encoder packet size 53 for input 1280 ouput max len 800 @ 9920
23:25:17.887   Master/sound  Underflow, buf_cnt=0, will generate 1 frame
23:25:17.905      pj_opus.c  Encoder packet size 62 for input 1280 ouput max len 800 @ 10560
23:25:18.006      pj_opus.c  Encoder packet size 70 for input 1280 ouput max len 800 @ 11200
23:25:18.006      pj_opus.c  Encoder packet size 58 for input 1280 ouput max len 800 @ 11840
23:25:18.025      pj_opus.c  Encoder packet size 66 for input 1280 ouput max len 800 @ 12480
23:25:18.125      pj_opus.c  Encoder packet size 59 for input 1280 ouput max len 800 @ 13120
23:25:18.127      pj_opus.c  Encoder packet size 71 for input 1280 ouput max len 800 @ 13760
23:25:18.145      pj_opus.c  Encoder packet size 56 for input 1280 ouput max len 800 @ 14400
23:25:18.246      pj_opus.c  Encoder packet size 62 for input 1280 ouput max len 800 @ 15040
23:25:18.248      pj_opus.c  Encoder packet size 62 for input 1280 ouput max len 800 @ 15680
23:25:18.266      pj_opus.c  Encoder packet size 51 for input 1280 ouput max len 800 @ 16320
23:25:18.366      pj_opus.c  Encoder packet size 59 for input 1280 ouput max len 800 @ 16960
23:25:18.368      pj_opus.c  Encoder packet size 54 for input 1280 ouput max len 800 @ 17600
23:25:18.386      pj_opus.c  Encoder packet size 53 for input 1280 ouput max len 800 @ 18240
23:25:18.487      pj_opus.c  Encoder packet size 51 for input 1280 ouput max len 800 @ 18880
23:25:18.490      pj_opus.c  Encoder packet size 66 for input 1280 ouput max len 800 @ 19520
23:25:18.506      pj_opus.c  Encoder packet size 61 for input 1280 ouput max len 800 @ 20160
23:25:18.590 zrtp_android.c !ZRTP info message: Initiator: DHPart1 received, preparing DHPart2
23:25:18.597 zrtp_android.c  ZRTP info message: At least one retained secrets matches - security OK
23:25:18.606      pj_opus.c !Encoder packet size 71 for input 1280 ouput max len 800 @ 20800
23:25:18.608      pj_opus.c  Encoder packet size 68 for input 1280 ouput max len 800 @ 21440
23:25:18.627      pj_opus.c  Encoder packet size 66 for input 1280 ouput max len 800 @ 22080
23:25:18.727      pj_opus.c  Encoder packet size 62 for input 1280 ouput max len 800 @ 22720
23:25:18.729      pj_opus.c  Encoder packet size 59 for input 1280 ouput max len 800 @ 23360
23:25:18.730 zrtp_android.c !ZRTP info message: Initiator: Confirm1 received, preparing Confirm2
23:25:18.747      pj_opus.c !Encoder packet size 65 for input 1280 ouput max len 800 @ 24000
23:25:18.849      pj_opus.c  Encoder packet size 61 for input 1280 ouput max len 800 @ 24640
23:25:18.853      pj_opus.c  Encoder packet size 57 for input 1280 ouput max len 800 @ 25280
23:25:18.861 zrtp_android.c !Show sas : indw in ctxt 2a287cd0
23:25:18.865 zrtp_android.c  ZRTP info message: Entered secure state
23:25:18.867 pjsua_jni_addo !Get secure for media type 1
23:25:18.867      pj_opus.c !Pkt info : bw -> 1105 , spf -> 320, offset 2, packet_size 289
23:25:18.868      pj_opus.c  parsed 289 of 2
23:25:18.868      pj_opus.c  parsed 289 of 2
23:25:18.873 pjsua_jni_addo !Get secure for media type 1
23:25:18.892      pj_opus.c !Pkt info : bw -> 1105 , spf -> 320, offset 2, packet_size 248
23:25:18.893      pj_opus.c  parsed 248 of 2
23:25:18.893      pj_opus.c  parsed 248 of 2
23:25:18.931      pj_opus.c !Pkt info : bw -> 1105 , spf -> 320, offset 2, packet_size 266
23:25:18.931      pj_opus.c  parsed 266 of 2
23:25:18.931      pj_opus.c  parsed 266 of 2
23:25:18.966      pj_opus.c !Encoder packet size 74 for input 1280 ouput max len 800 @ 25920
23:25:18.967      pj_opus.c  Decode : copy from big buffer 1280 to 640
23:25:18.967      pj_opus.c  Decoded 289 to 640 with max 1280
23:25:18.967      pj_opus.c  Decode : copy from big buffer 640 to 640
23:25:18.967      pj_opus.c  Decoded 289 to 640 with max 640
23:25:18.969      pj_opus.c  Encoder packet size 63 for input 1280 ouput max len 800 @ 26560
23:25:18.970      pj_opus.c  Decode : copy from big buffer 1280 to 640
23:25:18.970      pj_opus.c  Decoded 248 to 640 with max 1280
23:25:18.970      pj_opus.c  Decode : copy from big buffer 640 to 640
23:25:18.970      pj_opus.c  Decoded 248 to 640 with max 640
23:25:18.972      pj_opus.c  Encoder packet size 58 for input 1280 ouput max len 800 @ 27200
23:25:18.974      pj_opus.c !Pkt info : bw -> 1105 , spf -> 320, offset 2, packet_size 323
23:25:18.974      pj_opus.c  parsed 323 of 2
23:25:18.974      pj_opus.c  parsed 323 of 2
23:25:18.985      pj_opus.c !Decode : copy from big buffer 1280 to 640
23:25:18.985      pj_opus.c  Decoded 266 to 640 with max 1280
23:25:18.985      pj_opus.c  Decode : copy from big buffer 640 to 640
23:25:18.985      pj_opus.c  Decoded 266 to 640 with max 640

I've been taking a look at opus_codec_parse() (pj_opus.c) and if I set *frame_cnt = 1; before the loop, the issue improves with continuous clicks.

By the way, in opus_codec_decode(),
the mask for frm_info should'n be 0xff, as shown in opus_codec_parse()?
  frm_info = input->bit_info & 0xFF;
instead of
  frm_info = input->bit_info & 0xF;
Opus accepts up to 48 subframes for an internal ptime of 2.5ms.

[Anonymous]

Originally posted by: hvtaifwk...@gmail.com

can't reproduce with current versions, except that now I have Motorola Moto G 2014.