From: Gupta Nitin-A. <nit...@mo...> - 2009-01-28 01:04:29
|
Hi, I am using lksctp version 1.0.7 having multiple {approx 5 to 10} sctp end point [same ip/ diff ports]. We are observing sctp kernel panic when using all of these sockets using sctp client. Below are the 2 different variation which we could reproduce multiple times in our lab. While the console of machine becomes unusuable having sctp exceptions dumping continuously, accessing the machine through remote loging and checking /proc/net/sctp entries shows some stale data [end point info and association info]. Whereas /proc entries supposed to be empty. Can someone help fixing this issue with sctp ? its not been seen when multiple sctp client talks to single end point. In either sctp crash/panic, below error printed repeatedly. ================================== sctp_generate_timeout_event:Sock is busy: timer 8 sctp_generate_heartbeat_event:Sock is busy. ================================== 1/ CPU 3 Unable to handle kernel paging request at virtual address fdfdfdfdfdfdfed5, epc == ffffffff837d8224, ra == ffffffff837cbb48 Oops[#1]: Cpu 3 $ 0 : 0000000000000000 000000001000dce0 a8000002146db590 a8000002146db590 $ 4 : a80000021422cec0 0000000000000000 a800000214143920 0000000000000000 $ 8 : 00000000078fcc84 00000000078f4c84 0000000000008001 ffffffff84650000 $12 : ffffffff84640000 ffffffff84640000 fffffffffffffffd ffffffff8380cb68 $16 : fdfdfdfdfdfdfdfd a80000021422cec0 a8000002146db590 a8000002146da000 $20 : a8000002146db590 a800000214143800 0000000000000000 a8000002146db570 $24 : 0000000000000000 0000000000000030 $28 : a800000214140000 a8000002141437f0 000000003ecc057d ffffffff837cbb48 Hi : 000000000000000a Lo : 0000000000000000 epc : ffffffff837d8224 [S 1_STF]01/02/2 Tainted: P 00|01:15:30[stf_ra : ffffffff837cbb48 sctp_recv.c|156|Status: 1000dce3 <7>sctp_generate_timeout_event:Sock is busy: timer 8 stf_process_sctpsctp_do_sm prefn: ep a80000021fd7fde0, EVENT_T_TIMEOUT, TIMEOUT_SACK, asoc a800000213e60000[STATE_ESTABLISHED], sctp_sf_do_6_2_sack sctp_do_sm postfn: asoc a800000213e60000, status: DISPOSITION_CONSUME _data]:Received sackCTSNAck sent: 0x98453e51. sctp_outq_tail(a800000213e61570, a8000002140655a0[SACK]) sctp_packet_config: packet:a80000021c31d350 vtag:0x3fdecc1d sctp_packet_transmit_chunk: packet:a80000021c31d350 chunk:a8000002140655a0 Packet from LKSCsctp_packet_append_chunk: packet:a80000021c31d350 chunk:a8000002140655a0 sctp_packet_transmit: packet:a80000021c31d350 ***sctp_transmit_packet*** TP [S1_STF]01/0** Chunk a8000002140655a0[SACK] No TSN 0x0, length 16, chunk->skb->len 16, rtt_in_progress 0 ***sctp_transmit_packet*** skb len 28 sctp_v4_xmit: skb:a800000213df7a60, len:28, src:192.168.12.125, dst:192.168.9.123 2/2000|01:15:30[sctp_do_sm post sfx: error 0, asoc a800000213e60000[STATE_ESTABLISHED] +++sctp_inq_pop+++ chunk a8000002140655a0[SHUTDOWN], length 8, skb->len 4 stf_sctp_server.sctp_do_sm prefn: ep a80000021fd7fde0, EVENT_T_CHUNK, SHUTDOWN, asoc a800000213e60000[STATE_ESTABLISHED], sctp_sf_do_9_2_shutdown sctp_do_sm postfn: asoc a800000213e60000, status: DISPOSITION_CONSUME c|1826|stf_dump_sm_sideff: event_up: a800000213df7980, ulpq: a800000213e615d8. sctp_cmd_new_state: asoc a800000213e60000[STATE_SHUTDOWN_RECEIVED] packet]:Bytes[20sctp_cmd_new_state: asoc a800000213e60000[STATE_SHUTDOWN_ACK_SENT] sctp_outq_tail(a800000213e61570, a8000002140654a0[SHUTDOWN_ACK]) ] received - sctp_mark_missing: transport: a80000021c31d200, cwnd: 4380, ssthresh: 53760, flight_size: 0, pba: 0 sctp_outq_sack: sack Cumulative TSN Ack is 0x836b9bda. 80 01 00 00 00 0sctp_outq_sack: Cumulative TSN Ack of association, a800000213e60000 is 0x836b9bda. Adv peer ack point: 0x836b9bda sctp_packet_config: packet:a80000021c31d350 vtag:0x3fdecc1d 0 00 14 00 00 00sctp_packet_transmit_chunk: packet:a80000021c31d350 chunk:a8000002140654a0 sctp_packet_append_chunk: packet:a80000021c31d350 chunk:a8000002140654a0 00 00 02 00 02 sctp_packet_transmit: packet:a80000021c31d350 ***sctp_transmit_packet*** 00 00 00 01 [S1*** Chunk a8000002140654a0[SHUTDOWN_ACK] No TSN 0x0, length 4, chunk->skb->len 4, rtt_in_progress 0 ***sctp_transmit_packet*** skb len 16 sctp_v4_xmit: skb:a80000021425dd60, len:16, src:192.168.12.125, dst:192.168.9.123 _STF]01/02/2000|sctp_do_sm post sfx: error 0, asoc a800000213e60000[STATE_SHUTDOWN_ACK_SENT] +++sctp_inq_pop+++ chunk a8000002140655a0[SHUTDOWN_COMPLETE], length 4, skb->len 0 01:15:30[stf_sctsctp_do_sm prefn: ep a80000021fd7fde0, EVENT_T_CHUNK, SHUTDOWN_COMPLETE, asoc a800000213e60000[STATE_SHUTDOWN_ACK_SENT], sctp_sf_do_4_C sctp_do_sm postfn: asoc a800000213e60000, status: DISPOSITION_DELETE_TCB p_recv.c|167|stfsm_sideff: event_up: a800000213df7ac0, ulpq: a800000213e615d8. sctp_cmd_new_state: asoc a800000213e60000[STATE_CLOSED] _process_sctp_dasctp_packet_free: packet:a80000021c31d350 sctp_do_sm post sfx: error 0, asoc a800000213e60000[STATE_CLOSED] ta]:received msgsctp_do_sm prefn: ep a80000021fd7fee0, EVENT_T_TIMEOUT, TIMEOUT_SACK, asoc a800000214736000[STATE_ESTABLISHED], sctp_sf_do_6_2_sack sctp_do_sm postfn: asoc a800000214736000, status: DISPOSITION_CONSUME assoc:(0),strm(sackCTSNAck sent: 0xccffb480. sctp_outq_tail(a800000214737570, a8000002140655a0[SACK]) sctp_packet_config: packet:a80000021c31df50 vtag:0x2fabe1ec sctp_packet_transmit_chunk: packet:a80000021c31df50 chunk:a8000002140655a0 0),enbAddr( 192sctp_packet_append_chunk: packet:a80000021c31df50 chunk:a8000002140655a0 sctp_packet_transmit: packet:a80000021c31df50 ***sctp_transmit_packet*** .168.9.123:23451** Chunk a8000002140655a0[SACK] No TSN 0x0, length 16, chunk->skb->len 16, rtt_in_progress 0 ***sctp_transmit_packet*** skb len 28 sctp_v4_xmit: skb:a80000021425dd60, len:28, src:192.168.12.125, dst:192.168.9.123 2/ root@router:~/server/# +++sctp_inq_pop+++ chunk a80000021aaeade0[INIT], length 44, skb->len 40 sctp_do_sm prefn: ep a80000021c3e30c0, EVENT_T_CHUNK, INIT, asoc 0000000000000000[STATE_CLOSED], sctp_sf_do_5_1B_init Created asoc a80000021a8d6000 sctp_assoc_add_peer:association a80000021a8d6000 addr: 192.168.9.199 port: 42356 state:1 sctp_v4_get_dst: DST:192.168.9.199, SRC:0.0.0.0 - <7>rt_dst:192.168.9.199, rt_src:192.168.12.102 sctp_assoc_add_peer:association a80000021a8d6000 PMTU set to 1500 sctp_packet_init: packet:a80000021bc25150 transport:a80000021bc25000 sctp_do_sm postfn: asoc 0000000000000000, status: DISPOSITION_DELETE_TCB sctp_outq_tail(a80000021a8d7570, a80000021aaeace0[INIT_ACK]) sctp_packet_config: packet:a80000021bc25150 vtag:0x563d2e8 sctp_packet_init: packet:ffffffff838738a0 transport:a80000021bc25000 sctp_packet_config: packet:ffffffff838738a0 vtag:0x563d2e8 sctp_packet_append_chunk: packet:ffffffff838738a0 chunk:a80000021aaeace0 sctp_packet_transmit: packet:ffffffff838738a0 sctp_v4_get_dst: DST:192.168.9.199, SRC:0.0.0.0 - <7>rt_dst:192.168.9.199, rt_src:192.168.12.125 sctp_assoc_sync_pmtu: asoc:a80000021a8d6000, pmtu:1500, frag_point:1452 ***sctp_transmit_packet*** *** Chunk a80000021aaeace0[INIT_ACK] No TSN 0x0, length 252, chunk->skb->len 252, rtt_in_progress 0 ***sctp_transmit_packet*** skb len 264 sctp_v4_xmit: skb:a80000021abed220, len:264, src:192.168.12.125, dst:192.168.9.199 sctp_packet_free: packet:a80000021bc25150 sctp_do_sm post sfx: error 0, asoc 0000000000000000[STATE_CLOSED] +++sctp_inq_pop+++ chunk a80000021aaeade0[COOKIE_ECHO], length 200, skb->len 196 sctp_do_sm prefn: ep a80000021c3e30c0, EVENT_T_CHUNK, COOKIE_ECHO, asoc 0000000000000000[STATE_CLOSED], sctp_sf_do_5_1D_ce Created asoc a80000021a8d6000 sctp_assoc_add_peer:association a80000021a8d6000 addr: 192.168.9.199 port: 42356 state:1 sctp_v4_get_dst: DST:192.168.9.199, SRC:0.0.0.0 - <7>rt_dst:192.168.9.199, rt_src:192.168.12.102 sctp_assoc_add_peer:association a80000021a8d6000 PMTU set to 1500 sctp_packet_init: packet:a80000021bc25150 transport:a80000021bc25000 sctp_do_sm postfn: asoc 0000000000000000, status: DISPOSITION_CONSUME sctp_cmd_new_state: asoc a80000021a8d6000[STATE_ESTABLISHED] sctp_outq_tail(a80000021a8d7570, a80000021aaeace0[COOKIE_ACK]) sm_sideff: event_up: a80000021a56fda0, ulpq: a80000021a8d75d8. sctp_packet_config: packet:a80000021bc25150 vtag:0x563d2e8 sctp_packet_transmit_chunk: packet:a80000021bc25150 chunk:a80000021aaeace0 sctp_packet_append_chunk: packet:a80000021bc25150 chunk:a80000021aaeace0 sctp_packet_transmit: packet:a80000021bc25150 sctp_v4_get_dst: DST:192.168.9.199, SRC:0.0.0.0 - <7>rt_dst:192.168.9.199, rt_src:192.168.12.125 sctp_assoc_sync_pmtu: asoc:a80000021a8d6000, pmtu:1500, frag_point:1452 ***sctp_transmit_packet*** |