After patch from ticket #62 reached pfSense I started to see issues with my 2 home ISPs. I'll submit all details I can here and will be able to send you every information you need and make tests.
Here is my config:
startup: # configure the console set console close # configure the web server set web close set log +iface +iface2 default: pppoeclient: create bundle static wan set bundle enable ipv6cp set iface name pppoe0 set iface disable on-demand set iface idle 0 set iface enable tcpmssfix set iface up-script /usr/local/sbin/ppp-linkup set iface down-script /usr/local/sbin/ppp-linkdown set ipcp ranges 0.0.0.0/0 0.0.0.0/0 #log -bund -ccp -chat -iface -ipcp -lcp -link create link static wan_link0 pppoe set link action bundle wan set link disable multilink set link keep-alive 10 60 set link max-redial 0 set link disable chap pap set link accept chap pap eap set link disable incoming set link mtu 1492 set auth authname "renato.couto" set auth password renatocouto set pppoe service "" set pppoe iface igb1 open ``` Using mpd5 5.8_3, that works perfectly I got: ``` Aug 1 07:40:55 pfgarga ppp: [wan] IFACE: Close event Aug 1 07:40:55 pfgarga ppp: [wan] IPCP: Close event Aug 1 07:40:55 pfgarga ppp: [wan] IPCP: state change Opened --> Closing Aug 1 07:40:55 pfgarga ppp: [wan] IPCP: SendTerminateReq #4 Aug 1 07:40:55 pfgarga ppp: [wan] IPCP: LayerDown Aug 1 07:40:55 pfgarga ppp: [wan] IFACE: Down event Aug 1 07:40:55 pfgarga ppp: [wan] IFACE: Rename interface pppoe0 to pppoe0 Aug 1 07:40:55 pfgarga ppp: [wan] IPV6CP: Close event Aug 1 07:40:55 pfgarga ppp: [wan] IPV6CP: state change Stopped --> Closed Aug 1 07:40:55 pfgarga ppp: [wan] IPCP: rec'd Terminate Ack #4 (Closing) Aug 1 07:40:55 pfgarga ppp: [wan] IPCP: state change Closing --> Closed Aug 1 07:40:55 pfgarga ppp: [wan] IPCP: LayerFinish Aug 1 07:40:55 pfgarga ppp: [wan] Bundle: No NCPs left. Closing links... Aug 1 07:40:55 pfgarga ppp: [wan] Bundle: closing link "wan_link0"... Aug 1 07:40:55 pfgarga ppp: [wan_link0] Link: CLOSE event Aug 1 07:40:55 pfgarga ppp: [wan_link0] LCP: Close event Aug 1 07:40:55 pfgarga ppp: [wan_link0] LCP: state change Opened --> Closing Aug 1 07:40:55 pfgarga ppp: [wan_link0] Link: Leave bundle "wan" Aug 1 07:40:55 pfgarga ppp: [wan] Bundle: Status update: up 0 links, total bandwidth 9600 bps Aug 1 07:40:55 pfgarga ppp: [wan] IPCP: Close event Aug 1 07:40:55 pfgarga ppp: [wan] IPV6CP: Close event Aug 1 07:40:55 pfgarga ppp: [wan] IPCP: Down event Aug 1 07:40:55 pfgarga ppp: [wan] IPCP: state change Closed --> Initial Aug 1 07:40:55 pfgarga ppp: [wan] IPV6CP: Down event Aug 1 07:40:55 pfgarga ppp: [wan] IPV6CP: state change Closed --> Initial Aug 1 07:40:55 pfgarga ppp: [wan_link0] LCP: SendTerminateReq #4 Aug 1 07:40:55 pfgarga ppp: [wan_link0] LCP: LayerDown Aug 1 07:40:55 pfgarga ppp: [wan_link0] LCP: rec'd Terminate Ack #4 (Closing) Aug 1 07:40:55 pfgarga ppp: [wan_link0] LCP: state change Closing --> Closed Aug 1 07:40:55 pfgarga ppp: [wan_link0] LCP: LayerFinish Aug 1 07:40:55 pfgarga ppp: [wan_link0] Link: DOWN event Aug 1 07:40:55 pfgarga ppp: [wan_link0] LCP: Down event Aug 1 07:40:55 pfgarga ppp: [wan_link0] LCP: state change Closed --> Initial Aug 1 07:40:57 pfgarga ppp: [wan] Bundle: Shutdown Aug 1 07:40:57 pfgarga ppp: [wan_link0] Link: Shutdown Aug 1 07:40:58 pfgarga ppp: [wan] Bundle: Interface ng0 created Aug 1 07:40:58 pfgarga ppp: [wan_link0] Link: OPEN event Aug 1 07:40:58 pfgarga ppp: [wan_link0] LCP: Open event Aug 1 07:40:58 pfgarga ppp: [wan_link0] LCP: state change Initial --> Starting Aug 1 07:40:58 pfgarga ppp: [wan_link0] LCP: LayerStart Aug 1 07:40:58 pfgarga ppp: [wan_link0] PPPoE: Connecting to '' Aug 1 07:40:58 pfgarga ppp: [wan_link0] PPPoE: connection successful Aug 1 07:40:58 pfgarga ppp: [wan_link0] Link: UP event Aug 1 07:40:58 pfgarga ppp: [wan_link0] LCP: Up event Aug 1 07:40:58 pfgarga ppp: [wan_link0] LCP: state change Starting --> Req-Sent Aug 1 07:40:58 pfgarga ppp: [wan_link0] LCP: SendConfigReq #1 Aug 1 07:40:58 pfgarga ppp: [wan_link0] PROTOCOMP Aug 1 07:40:58 pfgarga ppp: [wan_link0] MRU 1492 Aug 1 07:40:58 pfgarga ppp: [wan_link0] MAGICNUM 0x7c8beca2 Aug 1 07:40:59 pfgarga ppp: [wan_link0] LCP: rec'd Configure Request #1 (Req-Sent) Aug 1 07:40:59 pfgarga ppp: [wan_link0] AUTHPROTO CHAP MD5 Aug 1 07:40:59 pfgarga ppp: [wan_link0] MRU 1480 Aug 1 07:40:59 pfgarga ppp: [wan_link0] MAGICNUM 0x31299b17 Aug 1 07:40:59 pfgarga ppp: [wan_link0] MP MRRU 1600 Aug 1 07:40:59 pfgarga ppp: [wan_link0] LCP: SendConfigRej #1 Aug 1 07:40:59 pfgarga ppp: [wan_link0] MP MRRU 1600 Aug 1 07:40:59 pfgarga ppp: [wan_link0] LCP: rec'd Configure Request #2 (Req-Sent) Aug 1 07:40:59 pfgarga ppp: [wan_link0] AUTHPROTO CHAP MD5 Aug 1 07:40:59 pfgarga ppp: [wan_link0] MRU 1480 Aug 1 07:40:59 pfgarga ppp: [wan_link0] MAGICNUM 0x31299b17 Aug 1 07:40:59 pfgarga ppp: [wan_link0] LCP: SendConfigAck #2 Aug 1 07:40:59 pfgarga ppp: [wan_link0] AUTHPROTO CHAP MD5 Aug 1 07:40:59 pfgarga ppp: [wan_link0] MRU 1480 Aug 1 07:40:59 pfgarga ppp: [wan_link0] MAGICNUM 0x31299b17 Aug 1 07:40:59 pfgarga ppp: [wan_link0] LCP: state change Req-Sent --> Ack-Sent Aug 1 07:41:00 pfgarga ppp: [wan_link0] LCP: rec'd Configure Request #3 (Ack-Sent) Aug 1 07:41:00 pfgarga ppp: [wan_link0] AUTHPROTO CHAP MD5 Aug 1 07:41:00 pfgarga ppp: [wan_link0] MRU 1480 Aug 1 07:41:00 pfgarga ppp: [wan_link0] MAGICNUM 0x31299b17 Aug 1 07:41:00 pfgarga ppp: [wan_link0] LCP: SendConfigAck #3 Aug 1 07:41:00 pfgarga ppp: [wan_link0] AUTHPROTO CHAP MD5 Aug 1 07:41:00 pfgarga ppp: [wan_link0] MRU 1480 Aug 1 07:41:00 pfgarga ppp: [wan_link0] MAGICNUM 0x31299b17 Aug 1 07:41:00 pfgarga ppp: [wan_link0] LCP: SendConfigReq #2 Aug 1 07:41:00 pfgarga ppp: [wan_link0] PROTOCOMP Aug 1 07:41:00 pfgarga ppp: [wan_link0] MRU 1492 Aug 1 07:41:00 pfgarga ppp: [wan_link0] MAGICNUM 0x7c8beca2 Aug 1 07:41:00 pfgarga ppp: [wan_link0] LCP: rec'd Configure Reject #2 (Ack-Sent) Aug 1 07:41:00 pfgarga ppp: [wan_link0] PROTOCOMP Aug 1 07:41:00 pfgarga ppp: [wan_link0] LCP: SendConfigReq #3 Aug 1 07:41:00 pfgarga ppp: [wan_link0] MRU 1492 Aug 1 07:41:00 pfgarga ppp: [wan_link0] MAGICNUM 0x7c8beca2 Aug 1 07:41:00 pfgarga ppp: [wan_link0] LCP: rec'd Configure Ack #3 (Ack-Sent) Aug 1 07:41:00 pfgarga ppp: [wan_link0] MRU 1492 Aug 1 07:41:00 pfgarga ppp: [wan_link0] MAGICNUM 0x7c8beca2 Aug 1 07:41:00 pfgarga ppp: [wan_link0] LCP: state change Ack-Sent --> Opened Aug 1 07:41:00 pfgarga ppp: [wan_link0] LCP: auth: peer wants CHAP, I want nothing Aug 1 07:41:00 pfgarga ppp: [wan_link0] LCP: LayerUp Aug 1 07:41:00 pfgarga ppp: [wan_link0] CHAP: rec'd CHALLENGE #1 len: 56 Aug 1 07:41:00 pfgarga ppp: [wan_link0] Name: "BRAS Iracemapolis - Telecom IntePe^S" Aug 1 07:41:00 pfgarga ppp: [wan_link0] CHAP: Using authname "renato.couto" Aug 1 07:41:00 pfgarga ppp: [wan_link0] CHAP: sending RESPONSE #1 len: 33 Aug 1 07:41:00 pfgarga ppp: [wan_link0] CHAP: rec'd SUCCESS #1 len: 12 Aug 1 07:41:00 pfgarga ppp: [wan_link0] MESG: Welcome. Aug 1 07:41:00 pfgarga ppp: [wan_link0] LCP: authorization successful Aug 1 07:41:00 pfgarga ppp: [wan_link0] Link: Matched action 'bundle "wan" ""' Aug 1 07:41:00 pfgarga ppp: [wan_link0] Link: Join bundle "wan" Aug 1 07:41:00 pfgarga ppp: [wan] Bundle: Status update: up 1 link, total bandwidth 64000 bps Aug 1 07:41:00 pfgarga ppp: [wan] IPCP: Open event Aug 1 07:41:00 pfgarga ppp: [wan] IPCP: state change Initial --> Starting Aug 1 07:41:00 pfgarga ppp: [wan] IPCP: LayerStart Aug 1 07:41:00 pfgarga ppp: [wan] IPV6CP: Open event Aug 1 07:41:00 pfgarga ppp: [wan] IPV6CP: state change Initial --> Starting Aug 1 07:41:00 pfgarga ppp: [wan] IPV6CP: LayerStart Aug 1 07:41:00 pfgarga ppp: [wan] IPCP: Up event Aug 1 07:41:00 pfgarga ppp: [wan] IPCP: state change Starting --> Req-Sent Aug 1 07:41:00 pfgarga ppp: [wan] IPCP: SendConfigReq #1 Aug 1 07:41:00 pfgarga ppp: [wan] IPADDR 0.0.0.0 Aug 1 07:41:00 pfgarga ppp: [wan] COMPPROTO VJCOMP, 16 comp. channels, no comp-cid Aug 1 07:41:00 pfgarga ppp: [wan] IPV6CP: Up event Aug 1 07:41:00 pfgarga ppp: [wan] IPV6CP: state change Starting --> Req-Sent Aug 1 07:41:00 pfgarga ppp: [wan] IPV6CP: SendConfigReq #1 Aug 1 07:41:00 pfgarga ppp: [wan] IPCP: rec'd Configure Request #1 (Req-Sent) Aug 1 07:41:00 pfgarga ppp: [wan] IPADDR 177.53.80.8 Aug 1 07:41:00 pfgarga ppp: [wan] 177.53.80.8 is OK Aug 1 07:41:00 pfgarga ppp: [wan] IPCP: SendConfigAck #1 Aug 1 07:41:00 pfgarga ppp: [wan] IPADDR 177.53.80.8 Aug 1 07:41:00 pfgarga ppp: [wan] IPCP: state change Req-Sent --> Ack-Sent Aug 1 07:41:00 pfgarga ppp: [wan_link0] rec'd unexpected protocol MPLS Control Protocol (RFC 3032), rejecting Aug 1 07:41:00 pfgarga ppp: [wan] IPCP: rec'd Configure Reject #1 (Ack-Sent) Aug 1 07:41:00 pfgarga ppp: [wan] COMPPROTO VJCOMP, 16 comp. channels, no comp-cid Aug 1 07:41:00 pfgarga ppp: [wan] IPCP: SendConfigReq #2 Aug 1 07:41:00 pfgarga ppp: [wan] IPADDR 0.0.0.0 Aug 1 07:41:00 pfgarga ppp: [wan_link0] LCP: rec'd Protocol Reject #4 (Opened) Aug 1 07:41:00 pfgarga ppp: [wan_link0] LCP: protocol IPV6CP was rejected Aug 1 07:41:00 pfgarga ppp: [wan] IPV6CP: protocol was rejected by peer Aug 1 07:41:00 pfgarga ppp: [wan] IPV6CP: state change Req-Sent --> Stopped Aug 1 07:41:00 pfgarga ppp: [wan] IPV6CP: LayerFinish Aug 1 07:41:00 pfgarga ppp: [wan] IPCP: rec'd Configure Nak #2 (Ack-Sent) Aug 1 07:41:00 pfgarga ppp: [wan] IPADDR 177.53.86.172 Aug 1 07:41:00 pfgarga ppp: [wan] 177.53.86.172 is OK Aug 1 07:41:00 pfgarga ppp: [wan] IPCP: SendConfigReq #3 Aug 1 07:41:00 pfgarga ppp: [wan] IPADDR 177.53.86.172 Aug 1 07:41:00 pfgarga ppp: [wan] IPCP: rec'd Configure Ack #3 (Ack-Sent) Aug 1 07:41:00 pfgarga ppp: [wan] IPADDR 177.53.86.172 Aug 1 07:41:00 pfgarga ppp: [wan] IPCP: state change Ack-Sent --> Opened Aug 1 07:41:00 pfgarga ppp: [wan] IPCP: LayerUp Aug 1 07:41:00 pfgarga ppp: [wan] 177.53.86.172 -> 177.53.80.8 Aug 1 07:41:00 pfgarga ppp: [wan] IFACE: Up event Aug 1 07:41:00 pfgarga ppp: [wan] IFACE: Rename interface ng0 to pppoe0 # ifconfig pppoe0 pppoe0: flags=88d1<UP,POINTOPOINT,RUNNING,NOARP,SIMPLEX,MULTICAST> metric 0 mtu 1480 inet 177.53.86.172 --> 177.53.80.8 netmask 0xffffffff inet6 fe80::208:a2ff:fe09:5b54%pppoe0 prefixlen 64 scopeid 0xc nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL> # netstat -nrWf inet Routing tables Internet: Destination Gateway Flags Use Mtu Netif Expire default 177.53.80.8 UGS 171 1480 pppoe0 10.250.250.0/24 link#11 U 0 1500 igb0.666 10.250.250.1 link#11 UHS 0 16384 lo0 127.0.0.1 link#8 UH 7785 16384 lo0 172.21.4.0/24 link#1 U 9969928 1500 igb0 172.21.4.1 link#1 UHS 0 16384 lo0 177.53.80.4 pppoe0 UHS 446 1480 pppoe0 177.53.80.8 link#12 UH 0 1480 pppoe0 177.53.86.172 link#12 UHS 0 16384 lo0 201.77.127.155 link#13 UHS 0 16384 lo0 216.66.22.2 177.53.80.8 UGHS 539 1480 pppoe0
And then after I upgrade mpd5 to 5.8_5:
Aug 1 07:47:07 pfgarga ppp: [wan] IFACE: Close event Aug 1 07:47:07 pfgarga ppp: [wan] IPCP: Close event Aug 1 07:47:07 pfgarga ppp: [wan] IPCP: state change Opened --> Closing Aug 1 07:47:07 pfgarga ppp: [wan] IPCP: SendTerminateReq #4 Aug 1 07:47:07 pfgarga ppp: [wan] IPCP: LayerDown Aug 1 07:47:08 pfgarga ppp: [wan] IFACE: Down event Aug 1 07:47:08 pfgarga ppp: [wan] IFACE: Rename interface pppoe0 to pppoe0 Aug 1 07:47:08 pfgarga ppp: [wan] IPV6CP: Close event Aug 1 07:47:08 pfgarga ppp: [wan] IPV6CP: state change Stopped --> Closed Aug 1 07:47:08 pfgarga ppp: [wan] IPCP: rec'd Terminate Ack #4 (Closing) Aug 1 07:47:08 pfgarga ppp: [wan] IPCP: state change Closing --> Closed Aug 1 07:47:08 pfgarga ppp: [wan] IPCP: LayerFinish Aug 1 07:47:08 pfgarga ppp: [wan] Bundle: No NCPs left. Closing links... Aug 1 07:47:08 pfgarga ppp: [wan] Bundle: closing link "wan_link0"... Aug 1 07:47:08 pfgarga ppp: [wan_link0] Link: CLOSE event Aug 1 07:47:08 pfgarga ppp: [wan_link0] LCP: Close event Aug 1 07:47:08 pfgarga ppp: [wan_link0] LCP: state change Opened --> Closing Aug 1 07:47:08 pfgarga ppp: [wan_link0] Link: Leave bundle "wan" Aug 1 07:47:08 pfgarga ppp: [wan] Bundle: Status update: up 0 links, total bandwidth 9600 bps Aug 1 07:47:08 pfgarga ppp: [wan] IPCP: Close event Aug 1 07:47:08 pfgarga ppp: [wan] IPV6CP: Close event Aug 1 07:47:08 pfgarga ppp: [wan] IPCP: Down event Aug 1 07:47:08 pfgarga ppp: [wan] IPCP: state change Closed --> Initial Aug 1 07:47:08 pfgarga ppp: [wan] IPV6CP: Down event Aug 1 07:47:08 pfgarga ppp: [wan] IPV6CP: state change Closed --> Initial Aug 1 07:47:08 pfgarga ppp: [wan_link0] LCP: SendTerminateReq #4 Aug 1 07:47:08 pfgarga ppp: [wan_link0] LCP: LayerDown Aug 1 07:47:08 pfgarga ppp: [wan_link0] LCP: rec'd Terminate Ack #4 (Closing) Aug 1 07:47:08 pfgarga ppp: [wan_link0] LCP: state change Closing --> Closed Aug 1 07:47:08 pfgarga ppp: [wan_link0] LCP: LayerFinish Aug 1 07:47:08 pfgarga ppp: [wan_link0] Link: DOWN event Aug 1 07:47:08 pfgarga ppp: [wan_link0] LCP: Down event Aug 1 07:47:08 pfgarga ppp: [wan_link0] LCP: state change Closed --> Initial Aug 1 07:47:10 pfgarga ppp: [wan] Bundle: Shutdown Aug 1 07:47:10 pfgarga ppp: [wan_link0] Link: Shutdown Aug 1 07:47:10 pfgarga ppp: [wan] Bundle: Interface ng0 created Aug 1 07:47:10 pfgarga ppp: [wan_link0] Link: OPEN event Aug 1 07:47:10 pfgarga ppp: [wan_link0] LCP: Open event Aug 1 07:47:10 pfgarga ppp: [wan_link0] LCP: state change Initial --> Starting Aug 1 07:47:10 pfgarga ppp: [wan_link0] LCP: LayerStart Aug 1 07:47:11 pfgarga ppp: [wan_link0] PPPoE: Connecting to '' Aug 1 07:47:11 pfgarga ppp: [wan_link0] PPPoE: connection successful Aug 1 07:47:11 pfgarga ppp: [wan_link0] Link: UP event Aug 1 07:47:11 pfgarga ppp: [wan_link0] LCP: Up event Aug 1 07:47:11 pfgarga ppp: [wan_link0] LCP: state change Starting --> Req-Sent Aug 1 07:47:11 pfgarga ppp: [wan_link0] LCP: SendConfigReq #1 Aug 1 07:47:11 pfgarga ppp: [wan_link0] PROTOCOMP Aug 1 07:47:11 pfgarga ppp: [wan_link0] MRU 1492 Aug 1 07:47:11 pfgarga ppp: [wan_link0] MAGICNUM 0xe5091981 Aug 1 07:47:12 pfgarga ppp: [wan_link0] LCP: rec'd Configure Request #1 (Req-Sent) Aug 1 07:47:12 pfgarga ppp: [wan_link0] AUTHPROTO CHAP MD5 Aug 1 07:47:12 pfgarga ppp: [wan_link0] MRU 1480 Aug 1 07:47:12 pfgarga ppp: [wan_link0] MAGICNUM 0x21c40f19 Aug 1 07:47:12 pfgarga ppp: [wan_link0] MP MRRU 1600 Aug 1 07:47:12 pfgarga ppp: [wan_link0] LCP: SendConfigRej #1 Aug 1 07:47:12 pfgarga ppp: [wan_link0] MP MRRU 1600 Aug 1 07:47:12 pfgarga ppp: [wan_link0] LCP: rec'd Configure Request #2 (Req-Sent) Aug 1 07:47:12 pfgarga ppp: [wan_link0] AUTHPROTO CHAP MD5 Aug 1 07:47:12 pfgarga ppp: [wan_link0] MRU 1480 Aug 1 07:47:12 pfgarga ppp: [wan_link0] MAGICNUM 0x21c40f19 Aug 1 07:47:12 pfgarga ppp: [wan_link0] LCP: SendConfigAck #2 Aug 1 07:47:12 pfgarga ppp: [wan_link0] AUTHPROTO CHAP MD5 Aug 1 07:47:12 pfgarga ppp: [wan_link0] MRU 1480 Aug 1 07:47:12 pfgarga ppp: [wan_link0] MAGICNUM 0x21c40f19 Aug 1 07:47:12 pfgarga ppp: [wan_link0] LCP: state change Req-Sent --> Ack-Sent Aug 1 07:47:12 pfgarga ppp: [wan_link0] LCP: rec'd Configure Request #3 (Ack-Sent) Aug 1 07:47:12 pfgarga ppp: [wan_link0] AUTHPROTO CHAP MD5 Aug 1 07:47:12 pfgarga ppp: [wan_link0] MRU 1480 Aug 1 07:47:12 pfgarga ppp: [wan_link0] MAGICNUM 0x21c40f19 Aug 1 07:47:12 pfgarga ppp: [wan_link0] LCP: SendConfigAck #3 Aug 1 07:47:12 pfgarga ppp: [wan_link0] AUTHPROTO CHAP MD5 Aug 1 07:47:12 pfgarga ppp: [wan_link0] MRU 1480 Aug 1 07:47:12 pfgarga ppp: [wan_link0] MAGICNUM 0x21c40f19 Aug 1 07:47:13 pfgarga ppp: [wan_link0] LCP: SendConfigReq #2 Aug 1 07:47:13 pfgarga ppp: [wan_link0] PROTOCOMP Aug 1 07:47:13 pfgarga ppp: [wan_link0] MRU 1492 Aug 1 07:47:13 pfgarga ppp: [wan_link0] MAGICNUM 0xe5091981 Aug 1 07:47:13 pfgarga ppp: [wan_link0] LCP: rec'd Configure Reject #2 (Ack-Sent) Aug 1 07:47:13 pfgarga ppp: [wan_link0] PROTOCOMP Aug 1 07:47:13 pfgarga ppp: [wan_link0] LCP: SendConfigReq #3 Aug 1 07:47:13 pfgarga ppp: [wan_link0] MRU 1492 Aug 1 07:47:13 pfgarga ppp: [wan_link0] MAGICNUM 0xe5091981 Aug 1 07:47:13 pfgarga ppp: [wan_link0] LCP: rec'd Configure Ack #3 (Ack-Sent) Aug 1 07:47:13 pfgarga ppp: [wan_link0] MRU 1492 Aug 1 07:47:13 pfgarga ppp: [wan_link0] MAGICNUM 0xe5091981 Aug 1 07:47:13 pfgarga ppp: [wan_link0] LCP: state change Ack-Sent --> Opened Aug 1 07:47:13 pfgarga ppp: [wan_link0] LCP: auth: peer wants CHAP, I want nothing Aug 1 07:47:13 pfgarga ppp: [wan_link0] LCP: LayerUp Aug 1 07:47:13 pfgarga ppp: [wan_link0] CHAP: rec'd CHALLENGE #1 len: 56 Aug 1 07:47:13 pfgarga ppp: [wan_link0] Name: "BRAS Iracemapolis - Telecom Inte�^_^X" Aug 1 07:47:13 pfgarga ppp: [wan_link0] CHAP: Using authname "renato.couto" Aug 1 07:47:13 pfgarga ppp: [wan_link0] CHAP: sending RESPONSE #1 len: 33 Aug 1 07:47:13 pfgarga ppp: [wan_link0] CHAP: rec'd SUCCESS #1 len: 12 Aug 1 07:47:13 pfgarga ppp: [wan_link0] MESG: Welcome. Aug 1 07:47:13 pfgarga ppp: [wan_link0] LCP: authorization successful Aug 1 07:47:13 pfgarga ppp: [wan_link0] Link: Matched action 'bundle "wan" ""' Aug 1 07:47:13 pfgarga ppp: [wan_link0] Link: Join bundle "wan" Aug 1 07:47:13 pfgarga ppp: [wan] Bundle: Status update: up 1 link, total bandwidth 64000 bps Aug 1 07:47:13 pfgarga ppp: [wan] IPCP: Open event Aug 1 07:47:13 pfgarga ppp: [wan] IPCP: state change Initial --> Starting Aug 1 07:47:13 pfgarga ppp: [wan] IPCP: LayerStart Aug 1 07:47:13 pfgarga ppp: [wan] IPV6CP: Open event Aug 1 07:47:13 pfgarga ppp: [wan] IPV6CP: state change Initial --> Starting Aug 1 07:47:13 pfgarga ppp: [wan] IPV6CP: LayerStart Aug 1 07:47:13 pfgarga ppp: [wan] IPCP: Up event Aug 1 07:47:13 pfgarga ppp: [wan] IPCP: state change Starting --> Req-Sent Aug 1 07:47:13 pfgarga ppp: [wan] IPCP: SendConfigReq #1 Aug 1 07:47:13 pfgarga ppp: [wan] IPADDR 0.0.0.0 Aug 1 07:47:13 pfgarga ppp: [wan] COMPPROTO VJCOMP, 16 comp. channels, no comp-cid Aug 1 07:47:13 pfgarga ppp: [wan] IPV6CP: Up event Aug 1 07:47:13 pfgarga ppp: [wan] IPV6CP: state change Starting --> Req-Sent Aug 1 07:47:13 pfgarga ppp: [wan] IPV6CP: SendConfigReq #1 Aug 1 07:47:13 pfgarga ppp: [wan_link0] rec'd unexpected protocol MPLS Control Protocol (RFC 3032), rejecting Aug 1 07:47:13 pfgarga ppp: [wan] IPCP: rec'd Configure Reject #1 (Req-Sent) Aug 1 07:47:13 pfgarga ppp: [wan] COMPPROTO VJCOMP, 16 comp. channels, no comp-cid Aug 1 07:47:13 pfgarga ppp: [wan] IPCP: SendConfigReq #2 Aug 1 07:47:13 pfgarga ppp: [wan] IPADDR 0.0.0.0 Aug 1 07:47:13 pfgarga ppp: [wan_link0] LCP: rec'd Protocol Reject #4 (Opened) Aug 1 07:47:13 pfgarga ppp: [wan_link0] LCP: protocol IPV6CP was rejected Aug 1 07:47:13 pfgarga ppp: [wan] IPV6CP: protocol was rejected by peer Aug 1 07:47:13 pfgarga ppp: [wan] IPV6CP: state change Req-Sent --> Stopped Aug 1 07:47:13 pfgarga ppp: [wan] IPV6CP: LayerFinish Aug 1 07:47:13 pfgarga ppp: [wan] IPCP: rec'd Configure Nak #2 (Req-Sent) Aug 1 07:47:13 pfgarga ppp: [wan] IPADDR 177.53.86.172 Aug 1 07:47:13 pfgarga ppp: [wan] 177.53.86.172 is OK Aug 1 07:47:13 pfgarga ppp: [wan] IPCP: SendConfigReq #3 Aug 1 07:47:13 pfgarga ppp: [wan] IPADDR 177.53.86.172 Aug 1 07:47:13 pfgarga ppp: [wan] IPCP: rec'd Configure Ack #3 (Req-Sent) Aug 1 07:47:13 pfgarga ppp: [wan] IPADDR 177.53.86.172 Aug 1 07:47:13 pfgarga ppp: [wan] IPCP: state change Req-Sent --> Ack-Rcvd Aug 1 07:47:13 pfgarga ppp: [wan] IPCP: rec'd Configure Request #2 (Ack-Rcvd) Aug 1 07:47:13 pfgarga ppp: [wan] IPADDR 177.53.80.8 Aug 1 07:47:13 pfgarga ppp: [wan] 177.53.80.8 is OK Aug 1 07:47:13 pfgarga ppp: [wan] IPCP: SendConfigAck #2 Aug 1 07:47:13 pfgarga ppp: [wan] IPADDR 177.53.80.8 Aug 1 07:47:13 pfgarga ppp: [wan] IPCP: state change Ack-Rcvd --> Opened Aug 1 07:47:13 pfgarga ppp: [wan] IPCP: LayerUp Aug 1 07:47:13 pfgarga ppp: [wan] 177.53.86.172 -> 177.53.80.8 Aug 1 07:47:13 pfgarga ppp: [wan] IFACE: Up event Aug 1 07:47:13 pfgarga ppp: [wan] IFACE: Rename interface ng0 to pppoe0 # ifconfig pppoe0 pppoe0: flags=88d1<UP,POINTOPOINT,RUNNING,NOARP,SIMPLEX,MULTICAST> metric 0 mtu 1492 inet 177.53.86.172 --> 177.53.80.8 netmask 0xffffffff inet6 fe80::208:a2ff:fe09:5b54%pppoe0 prefixlen 64 scopeid 0xc nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL> # netstat -nrWf inet Routing tables Internet: Destination Gateway Flags Use Mtu Netif Expire default 177.53.80.8 UGS 43 1492 pppoe0 10.250.250.0/24 link#11 U 0 1500 igb0.666 10.250.250.1 link#11 UHS 0 16384 lo0 127.0.0.1 link#8 UH 7868 16384 lo0 172.21.4.0/24 link#1 U 9972647 1500 igb0 172.21.4.1 link#1 UHS 0 16384 lo0 177.53.80.4 pppoe0 UHS 94 1492 pppoe0 177.53.80.8 link#12 UH 0 1492 pppoe0 177.53.86.172 link#12 UHS 0 16384 lo0 201.77.127.155 link#13 UHS 0 16384 lo0 216.66.22.2 177.53.80.8 UGHS 115 1492 pppoe0
Using 5.8_5 I have problems to access many hosts.
There are more information I should bring here.
If I force MTU and MRU to be 1480, using the following config it works:
But if I comment out both MTU and MRU lines the problem is back
The command "set log ..." is wrong, it should be "log +iface +iface2" without "set". Because of this, there is not enough details in the log. Please correct the configuration and repeat the test using new version (no need to re-test using old one).
Last edit: Eugene Grosbein 2018-08-01
Sure, follow you can see the one that fails
Last edit: Renato Botelho 2018-08-01
And here the one that works:
It is possible that your build environment for net/mpd5 port is unexpected and the binary is built without HAVE_NG_TCPMSS / USE_NG_TCPMSS support and that would be bad. Please show output of "ngctl ls" command for the system running PPPoE client connection that uses new version and has problems. Also, show messages produced by mpd5 port building process starting from the line "===> Configuring for mpd5-5.8_6" and until the line "===> Building for mpd5-5.8_6"
Sure. I can see -DUSE_NG_TCPMSS all around during build phase
At this moment it's working because I set MTU and MRU to 1480 on mpd.conf. Let me know if you need me to force the error before collect ngctl ls output
```
$ ngctl ls
There are 25 total nodes:
Name: igb1 Type: ether ID: 00000002 Num hooks: 1
Name: igb2 Type: ether ID: 00000003 Num hooks: 1
Name: <unnamed> Type: socket ID: 00000009 Num hooks: 0
Name: igb0_666 Type: ether ID: 0000000c Num hooks: 0
Name: mpd11854-lso Type: socket ID: 0000028f Num hooks: 1
Name: mpd11854-cso Type: socket ID: 00000290 Num hooks: 0
Name: mpd11854-eso Type: socket ID: 00000291 Num hooks: 0
Name: ng0 Type: iface ID: 00000292 Num hooks: 1
Name: mpd11854-wan Type: ppp ID: 00000293 Num hooks: 3
Name: mpd11854-wan_link0-lt Type: tee ID: 00000294 Num hooks: 2
Name: <unnamed> Type: socket ID: 00000295 Num hooks: 0
Name: mpd11854-stats Type: socket ID: 00000296 Num hooks: 0
Name: mpd11854-wan-mss Type: tcpmss ID: 00000297 Num hooks: 2
Name: <unnamed> Type: pppoe ID: 00000017 Num hooks: 2
Name: <unnamed> Type: pppoe ID: 00000022 Num hooks: 2
Name: ngctl80863 Type: socket ID: 000002a9 Num hooks: 0
Name: mpd57847-lso Type: socket ID: 00000270 Num hooks: 1
Name: mpd57847-cso Type: socket ID: 00000271 Num hooks: 0
Name: mpd57847-eso Type: socket ID: 00000272 Num hooks: 0
Name: ng1 Type: iface ID: 00000273 Num hooks: 1
Name: mpd57847-opt1 Type: ppp ID: 00000274 Num hooks: 3
Name: mpd57847-opt1_link0-lt Type: tee ID: 00000275 Num hooks: 2
Name: <unnamed> Type: socket ID: 00000276 Num hooks: 0
Name: mpd57847-stats Type: socket ID: 00000277 Num hooks: 0
Name: mpd57847-opt1-mss Type: tcpmss ID: 00000278 Num hooks: 2
Aug 1 08:28:55 pfgarga ppp: [wan_link0] LCP: SendConfigReq #1
Aug 1 08:28:55 pfgarga ppp: [wan_link0] PROTOCOMP
Aug 1 08:28:55 pfgarga ppp: [wan_link0] MRU 1492
Aug 1 08:28:55 pfgarga ppp: [wan_link0] MAGICNUM 0xa8790a74
Aug 1 08:28:56 pfgarga ppp: [wan_link0] LCP: rec'd Configure Request #1 (Req-Sent)
Aug 1 08:28:56 pfgarga ppp: [wan_link0] AUTHPROTO CHAP MD5
Aug 1 08:28:56 pfgarga ppp: [wan_link0] MRU 1480
Aug 1 08:28:56 pfgarga ppp: [wan_link0] MAGICNUM 0x9468ac2b
Aug 1 08:28:56 pfgarga ppp: [wan_link0] MP MRRU 1600
```
If I'm reading it right ISP is proposing me to use 1480, no? If it's correct, why it ends up configured as 1492?
Last edit: Renato Botelho 2018-08-01
It seems the binary builds just fine.
The interface ends up configured with mtu=1492 because ISP later agrees with this value by "LCP: rec'd Configure Ack #3" message to mpd's proposal.
Please put attached file to /usr/ports/net/mpd5 directory and rebuild latest version of mpd5, restart it and post the log it produces. No need to to force the error but use latest version.
That's just fine and expected: "IFACE: Configuring tcpmssfix" line shows value lesser than interface MTU by exactly 40 bytes. Now please comment out all "mtu/mru" lines from the mpd.conf and re-establish PPPoE and post the log again and output of "ifconfig pppoe0" too.
Last edit: Eugene Grosbein 2018-08-01
This is fine too and no connectivity problems should occur. Does it work if you try to run the following command?
ping -D -s 1464 177.53.80.8
ping works as expected.
The connectivity problem I face in this case is not for all hosts I try to connect but for some specific ones. For example, if I try to access https://www.ubnt.com it fails like this until timeout:
Please create an attachment with captured outgoing TCP traffic (pcap file) for such connection.
I waited a few time and then pressed ctrl+C on curl command. Let me know if you want it to go until timeout
That's enough. The very first TCP SYN segment has option MSS=1460 that is more than value in the line of the log "IFACE: Configuring tcpmssfix mpd4417-wan-mss:: 1452" and this is the reason of timeouts. It must not exceed 1452 for this configuration.
MSS=1460 corresponds to MTU=1500 and/or non-functioning tcpmssfix but the log assures us that tcpmss is configured properly. And ping assures us that mpd5 configured PPPoE connection properly too.
There should be something in your local setup making bad interference that breaks MSS fix. Do you have any kind of packet filtering or "sanitizing" like pf(4) configured? If so, could you please disable it completely for a test?
And comment out "set iface up-script /usr/local/sbin/ppp-linkup" in the mpd.conf, if possible, too. If not, post its contents.
I'll get some sleep and will back to the case several hours later.
Last edit: Eugene Grosbein 2018-08-01
Yes, I have pf running, it's a pfSense. I tried after do a
pfctl -d
to disable it and the problem persisted.Here is ppp-linkup script:
An hour in the morning is worth two in the evening. I was wrong in my pcap-file analysis: packet capture on virtual PPPoE interface shows traffic before MSS fix obtains it and does its job. Please repeat same test but this time capture traffic using underlying interface corresponding physical NIC like this:
tcpdump -nps0 -w file.pcap -i igb0
Here it is, and it also has MSS=1460
It seems you have used wrong interface as the file contains plain IPoE frames with internal IP addresses instead of PPPoE frames running over NIC corresponding to WAN interface. Please double-check and re-do using external NIC.
You are right and I need more coffee. Attached you will find a capture on igb1, the right interface. I couldn't filter it on tcpdump, the target IP is 52.34.248.163
This capture's packet #37 confirms that tcpmssfix works as expected changing original 1460 to 1452 (1492-40)
Just a note, If I add the following scrub rule to my pf.conf it makes the connection to work fine again:
scrub on pppoe0 all max-mss 1440 fragment reassemble
What happens if you use 1441 here instead if 1440?
It doesn't work anymore
It's interesting to note that MSS is also 1460 when MTU is configured to 1480 and connection works as you can see on attached capture