After patch from ticket #62 reached pfSense I started to see issues with my 2 home ISPs. I'll submit all details I can here and will be able to send you every information you need and make tests.
Here is my config:
startup:
# configure the console
set console close
# configure the web server
set web close
set log +iface +iface2
default:
pppoeclient:
create bundle static wan
set bundle enable ipv6cp
set iface name pppoe0
set iface disable on-demand
set iface idle 0
set iface enable tcpmssfix
set iface up-script /usr/local/sbin/ppp-linkup
set iface down-script /usr/local/sbin/ppp-linkdown
set ipcp ranges 0.0.0.0/0 0.0.0.0/0
#log -bund -ccp -chat -iface -ipcp -lcp -link
create link static wan_link0 pppoe
set link action bundle wan
set link disable multilink
set link keep-alive 10 60
set link max-redial 0
set link disable chap pap
set link accept chap pap eap
set link disable incoming
set link mtu 1492
set auth authname "renato.couto"
set auth password renatocouto
set pppoe service ""
set pppoe iface igb1
open
```
Using mpd5 5.8_3, that works perfectly I got:
```
Aug 1 07:40:55 pfgarga ppp: [wan] IFACE: Close event
Aug 1 07:40:55 pfgarga ppp: [wan] IPCP: Close event
Aug 1 07:40:55 pfgarga ppp: [wan] IPCP: state change Opened --> Closing
Aug 1 07:40:55 pfgarga ppp: [wan] IPCP: SendTerminateReq #4
Aug 1 07:40:55 pfgarga ppp: [wan] IPCP: LayerDown
Aug 1 07:40:55 pfgarga ppp: [wan] IFACE: Down event
Aug 1 07:40:55 pfgarga ppp: [wan] IFACE: Rename interface pppoe0 to pppoe0
Aug 1 07:40:55 pfgarga ppp: [wan] IPV6CP: Close event
Aug 1 07:40:55 pfgarga ppp: [wan] IPV6CP: state change Stopped --> Closed
Aug 1 07:40:55 pfgarga ppp: [wan] IPCP: rec'd Terminate Ack #4 (Closing)
Aug 1 07:40:55 pfgarga ppp: [wan] IPCP: state change Closing --> Closed
Aug 1 07:40:55 pfgarga ppp: [wan] IPCP: LayerFinish
Aug 1 07:40:55 pfgarga ppp: [wan] Bundle: No NCPs left. Closing links...
Aug 1 07:40:55 pfgarga ppp: [wan] Bundle: closing link "wan_link0"...
Aug 1 07:40:55 pfgarga ppp: [wan_link0] Link: CLOSE event
Aug 1 07:40:55 pfgarga ppp: [wan_link0] LCP: Close event
Aug 1 07:40:55 pfgarga ppp: [wan_link0] LCP: state change Opened --> Closing
Aug 1 07:40:55 pfgarga ppp: [wan_link0] Link: Leave bundle "wan"
Aug 1 07:40:55 pfgarga ppp: [wan] Bundle: Status update: up 0 links, total bandwidth 9600 bps
Aug 1 07:40:55 pfgarga ppp: [wan] IPCP: Close event
Aug 1 07:40:55 pfgarga ppp: [wan] IPV6CP: Close event
Aug 1 07:40:55 pfgarga ppp: [wan] IPCP: Down event
Aug 1 07:40:55 pfgarga ppp: [wan] IPCP: state change Closed --> Initial
Aug 1 07:40:55 pfgarga ppp: [wan] IPV6CP: Down event
Aug 1 07:40:55 pfgarga ppp: [wan] IPV6CP: state change Closed --> Initial
Aug 1 07:40:55 pfgarga ppp: [wan_link0] LCP: SendTerminateReq #4
Aug 1 07:40:55 pfgarga ppp: [wan_link0] LCP: LayerDown
Aug 1 07:40:55 pfgarga ppp: [wan_link0] LCP: rec'd Terminate Ack #4 (Closing)
Aug 1 07:40:55 pfgarga ppp: [wan_link0] LCP: state change Closing --> Closed
Aug 1 07:40:55 pfgarga ppp: [wan_link0] LCP: LayerFinish
Aug 1 07:40:55 pfgarga ppp: [wan_link0] Link: DOWN event
Aug 1 07:40:55 pfgarga ppp: [wan_link0] LCP: Down event
Aug 1 07:40:55 pfgarga ppp: [wan_link0] LCP: state change Closed --> Initial
Aug 1 07:40:57 pfgarga ppp: [wan] Bundle: Shutdown
Aug 1 07:40:57 pfgarga ppp: [wan_link0] Link: Shutdown
Aug 1 07:40:58 pfgarga ppp: [wan] Bundle: Interface ng0 created
Aug 1 07:40:58 pfgarga ppp: [wan_link0] Link: OPEN event
Aug 1 07:40:58 pfgarga ppp: [wan_link0] LCP: Open event
Aug 1 07:40:58 pfgarga ppp: [wan_link0] LCP: state change Initial --> Starting
Aug 1 07:40:58 pfgarga ppp: [wan_link0] LCP: LayerStart
Aug 1 07:40:58 pfgarga ppp: [wan_link0] PPPoE: Connecting to ''
Aug 1 07:40:58 pfgarga ppp: [wan_link0] PPPoE: connection successful
Aug 1 07:40:58 pfgarga ppp: [wan_link0] Link: UP event
Aug 1 07:40:58 pfgarga ppp: [wan_link0] LCP: Up event
Aug 1 07:40:58 pfgarga ppp: [wan_link0] LCP: state change Starting --> Req-Sent
Aug 1 07:40:58 pfgarga ppp: [wan_link0] LCP: SendConfigReq #1
Aug 1 07:40:58 pfgarga ppp: [wan_link0] PROTOCOMP
Aug 1 07:40:58 pfgarga ppp: [wan_link0] MRU 1492
Aug 1 07:40:58 pfgarga ppp: [wan_link0] MAGICNUM 0x7c8beca2
Aug 1 07:40:59 pfgarga ppp: [wan_link0] LCP: rec'd Configure Request #1 (Req-Sent)
Aug 1 07:40:59 pfgarga ppp: [wan_link0] AUTHPROTO CHAP MD5
Aug 1 07:40:59 pfgarga ppp: [wan_link0] MRU 1480
Aug 1 07:40:59 pfgarga ppp: [wan_link0] MAGICNUM 0x31299b17
Aug 1 07:40:59 pfgarga ppp: [wan_link0] MP MRRU 1600
Aug 1 07:40:59 pfgarga ppp: [wan_link0] LCP: SendConfigRej #1
Aug 1 07:40:59 pfgarga ppp: [wan_link0] MP MRRU 1600
Aug 1 07:40:59 pfgarga ppp: [wan_link0] LCP: rec'd Configure Request #2 (Req-Sent)
Aug 1 07:40:59 pfgarga ppp: [wan_link0] AUTHPROTO CHAP MD5
Aug 1 07:40:59 pfgarga ppp: [wan_link0] MRU 1480
Aug 1 07:40:59 pfgarga ppp: [wan_link0] MAGICNUM 0x31299b17
Aug 1 07:40:59 pfgarga ppp: [wan_link0] LCP: SendConfigAck #2
Aug 1 07:40:59 pfgarga ppp: [wan_link0] AUTHPROTO CHAP MD5
Aug 1 07:40:59 pfgarga ppp: [wan_link0] MRU 1480
Aug 1 07:40:59 pfgarga ppp: [wan_link0] MAGICNUM 0x31299b17
Aug 1 07:40:59 pfgarga ppp: [wan_link0] LCP: state change Req-Sent --> Ack-Sent
Aug 1 07:41:00 pfgarga ppp: [wan_link0] LCP: rec'd Configure Request #3 (Ack-Sent)
Aug 1 07:41:00 pfgarga ppp: [wan_link0] AUTHPROTO CHAP MD5
Aug 1 07:41:00 pfgarga ppp: [wan_link0] MRU 1480
Aug 1 07:41:00 pfgarga ppp: [wan_link0] MAGICNUM 0x31299b17
Aug 1 07:41:00 pfgarga ppp: [wan_link0] LCP: SendConfigAck #3
Aug 1 07:41:00 pfgarga ppp: [wan_link0] AUTHPROTO CHAP MD5
Aug 1 07:41:00 pfgarga ppp: [wan_link0] MRU 1480
Aug 1 07:41:00 pfgarga ppp: [wan_link0] MAGICNUM 0x31299b17
Aug 1 07:41:00 pfgarga ppp: [wan_link0] LCP: SendConfigReq #2
Aug 1 07:41:00 pfgarga ppp: [wan_link0] PROTOCOMP
Aug 1 07:41:00 pfgarga ppp: [wan_link0] MRU 1492
Aug 1 07:41:00 pfgarga ppp: [wan_link0] MAGICNUM 0x7c8beca2
Aug 1 07:41:00 pfgarga ppp: [wan_link0] LCP: rec'd Configure Reject #2 (Ack-Sent)
Aug 1 07:41:00 pfgarga ppp: [wan_link0] PROTOCOMP
Aug 1 07:41:00 pfgarga ppp: [wan_link0] LCP: SendConfigReq #3
Aug 1 07:41:00 pfgarga ppp: [wan_link0] MRU 1492
Aug 1 07:41:00 pfgarga ppp: [wan_link0] MAGICNUM 0x7c8beca2
Aug 1 07:41:00 pfgarga ppp: [wan_link0] LCP: rec'd Configure Ack #3 (Ack-Sent)
Aug 1 07:41:00 pfgarga ppp: [wan_link0] MRU 1492
Aug 1 07:41:00 pfgarga ppp: [wan_link0] MAGICNUM 0x7c8beca2
Aug 1 07:41:00 pfgarga ppp: [wan_link0] LCP: state change Ack-Sent --> Opened
Aug 1 07:41:00 pfgarga ppp: [wan_link0] LCP: auth: peer wants CHAP, I want nothing
Aug 1 07:41:00 pfgarga ppp: [wan_link0] LCP: LayerUp
Aug 1 07:41:00 pfgarga ppp: [wan_link0] CHAP: rec'd CHALLENGE #1 len: 56
Aug 1 07:41:00 pfgarga ppp: [wan_link0] Name: "BRAS Iracemapolis - Telecom IntePe^S"
Aug 1 07:41:00 pfgarga ppp: [wan_link0] CHAP: Using authname "renato.couto"
Aug 1 07:41:00 pfgarga ppp: [wan_link0] CHAP: sending RESPONSE #1 len: 33
Aug 1 07:41:00 pfgarga ppp: [wan_link0] CHAP: rec'd SUCCESS #1 len: 12
Aug 1 07:41:00 pfgarga ppp: [wan_link0] MESG: Welcome.
Aug 1 07:41:00 pfgarga ppp: [wan_link0] LCP: authorization successful
Aug 1 07:41:00 pfgarga ppp: [wan_link0] Link: Matched action 'bundle "wan" ""'
Aug 1 07:41:00 pfgarga ppp: [wan_link0] Link: Join bundle "wan"
Aug 1 07:41:00 pfgarga ppp: [wan] Bundle: Status update: up 1 link, total bandwidth 64000 bps
Aug 1 07:41:00 pfgarga ppp: [wan] IPCP: Open event
Aug 1 07:41:00 pfgarga ppp: [wan] IPCP: state change Initial --> Starting
Aug 1 07:41:00 pfgarga ppp: [wan] IPCP: LayerStart
Aug 1 07:41:00 pfgarga ppp: [wan] IPV6CP: Open event
Aug 1 07:41:00 pfgarga ppp: [wan] IPV6CP: state change Initial --> Starting
Aug 1 07:41:00 pfgarga ppp: [wan] IPV6CP: LayerStart
Aug 1 07:41:00 pfgarga ppp: [wan] IPCP: Up event
Aug 1 07:41:00 pfgarga ppp: [wan] IPCP: state change Starting --> Req-Sent
Aug 1 07:41:00 pfgarga ppp: [wan] IPCP: SendConfigReq #1
Aug 1 07:41:00 pfgarga ppp: [wan] IPADDR 0.0.0.0
Aug 1 07:41:00 pfgarga ppp: [wan] COMPPROTO VJCOMP, 16 comp. channels, no comp-cid
Aug 1 07:41:00 pfgarga ppp: [wan] IPV6CP: Up event
Aug 1 07:41:00 pfgarga ppp: [wan] IPV6CP: state change Starting --> Req-Sent
Aug 1 07:41:00 pfgarga ppp: [wan] IPV6CP: SendConfigReq #1
Aug 1 07:41:00 pfgarga ppp: [wan] IPCP: rec'd Configure Request #1 (Req-Sent)
Aug 1 07:41:00 pfgarga ppp: [wan] IPADDR 177.53.80.8
Aug 1 07:41:00 pfgarga ppp: [wan] 177.53.80.8 is OK
Aug 1 07:41:00 pfgarga ppp: [wan] IPCP: SendConfigAck #1
Aug 1 07:41:00 pfgarga ppp: [wan] IPADDR 177.53.80.8
Aug 1 07:41:00 pfgarga ppp: [wan] IPCP: state change Req-Sent --> Ack-Sent
Aug 1 07:41:00 pfgarga ppp: [wan_link0] rec'd unexpected protocol MPLS Control Protocol (RFC 3032), rejecting
Aug 1 07:41:00 pfgarga ppp: [wan] IPCP: rec'd Configure Reject #1 (Ack-Sent)
Aug 1 07:41:00 pfgarga ppp: [wan] COMPPROTO VJCOMP, 16 comp. channels, no comp-cid
Aug 1 07:41:00 pfgarga ppp: [wan] IPCP: SendConfigReq #2
Aug 1 07:41:00 pfgarga ppp: [wan] IPADDR 0.0.0.0
Aug 1 07:41:00 pfgarga ppp: [wan_link0] LCP: rec'd Protocol Reject #4 (Opened)
Aug 1 07:41:00 pfgarga ppp: [wan_link0] LCP: protocol IPV6CP was rejected
Aug 1 07:41:00 pfgarga ppp: [wan] IPV6CP: protocol was rejected by peer
Aug 1 07:41:00 pfgarga ppp: [wan] IPV6CP: state change Req-Sent --> Stopped
Aug 1 07:41:00 pfgarga ppp: [wan] IPV6CP: LayerFinish
Aug 1 07:41:00 pfgarga ppp: [wan] IPCP: rec'd Configure Nak #2 (Ack-Sent)
Aug 1 07:41:00 pfgarga ppp: [wan] IPADDR 177.53.86.172
Aug 1 07:41:00 pfgarga ppp: [wan] 177.53.86.172 is OK
Aug 1 07:41:00 pfgarga ppp: [wan] IPCP: SendConfigReq #3
Aug 1 07:41:00 pfgarga ppp: [wan] IPADDR 177.53.86.172
Aug 1 07:41:00 pfgarga ppp: [wan] IPCP: rec'd Configure Ack #3 (Ack-Sent)
Aug 1 07:41:00 pfgarga ppp: [wan] IPADDR 177.53.86.172
Aug 1 07:41:00 pfgarga ppp: [wan] IPCP: state change Ack-Sent --> Opened
Aug 1 07:41:00 pfgarga ppp: [wan] IPCP: LayerUp
Aug 1 07:41:00 pfgarga ppp: [wan] 177.53.86.172 -> 177.53.80.8
Aug 1 07:41:00 pfgarga ppp: [wan] IFACE: Up event
Aug 1 07:41:00 pfgarga ppp: [wan] IFACE: Rename interface ng0 to pppoe0
# ifconfig pppoe0
pppoe0: flags=88d1<UP,POINTOPOINT,RUNNING,NOARP,SIMPLEX,MULTICAST> metric 0 mtu 1480
inet 177.53.86.172 --> 177.53.80.8 netmask 0xffffffff
inet6 fe80::208:a2ff:fe09:5b54%pppoe0 prefixlen 64 scopeid 0xc
nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL>
# netstat -nrWf inet
Routing tables
Internet:
Destination Gateway Flags Use Mtu Netif Expire
default 177.53.80.8 UGS 171 1480 pppoe0
10.250.250.0/24 link#11 U 0 1500 igb0.666
10.250.250.1 link#11 UHS 0 16384 lo0
127.0.0.1 link#8 UH 7785 16384 lo0
172.21.4.0/24 link#1 U 9969928 1500 igb0
172.21.4.1 link#1 UHS 0 16384 lo0
177.53.80.4 pppoe0 UHS 446 1480 pppoe0
177.53.80.8 link#12 UH 0 1480 pppoe0
177.53.86.172 link#12 UHS 0 16384 lo0
201.77.127.155 link#13 UHS 0 16384 lo0
216.66.22.2 177.53.80.8 UGHS 539 1480 pppoe0
And then after I upgrade mpd5 to 5.8_5:
Aug 1 07:47:07 pfgarga ppp: [wan] IFACE: Close event
Aug 1 07:47:07 pfgarga ppp: [wan] IPCP: Close event
Aug 1 07:47:07 pfgarga ppp: [wan] IPCP: state change Opened --> Closing
Aug 1 07:47:07 pfgarga ppp: [wan] IPCP: SendTerminateReq #4
Aug 1 07:47:07 pfgarga ppp: [wan] IPCP: LayerDown
Aug 1 07:47:08 pfgarga ppp: [wan] IFACE: Down event
Aug 1 07:47:08 pfgarga ppp: [wan] IFACE: Rename interface pppoe0 to pppoe0
Aug 1 07:47:08 pfgarga ppp: [wan] IPV6CP: Close event
Aug 1 07:47:08 pfgarga ppp: [wan] IPV6CP: state change Stopped --> Closed
Aug 1 07:47:08 pfgarga ppp: [wan] IPCP: rec'd Terminate Ack #4 (Closing)
Aug 1 07:47:08 pfgarga ppp: [wan] IPCP: state change Closing --> Closed
Aug 1 07:47:08 pfgarga ppp: [wan] IPCP: LayerFinish
Aug 1 07:47:08 pfgarga ppp: [wan] Bundle: No NCPs left. Closing links...
Aug 1 07:47:08 pfgarga ppp: [wan] Bundle: closing link "wan_link0"...
Aug 1 07:47:08 pfgarga ppp: [wan_link0] Link: CLOSE event
Aug 1 07:47:08 pfgarga ppp: [wan_link0] LCP: Close event
Aug 1 07:47:08 pfgarga ppp: [wan_link0] LCP: state change Opened --> Closing
Aug 1 07:47:08 pfgarga ppp: [wan_link0] Link: Leave bundle "wan"
Aug 1 07:47:08 pfgarga ppp: [wan] Bundle: Status update: up 0 links, total bandwidth 9600 bps
Aug 1 07:47:08 pfgarga ppp: [wan] IPCP: Close event
Aug 1 07:47:08 pfgarga ppp: [wan] IPV6CP: Close event
Aug 1 07:47:08 pfgarga ppp: [wan] IPCP: Down event
Aug 1 07:47:08 pfgarga ppp: [wan] IPCP: state change Closed --> Initial
Aug 1 07:47:08 pfgarga ppp: [wan] IPV6CP: Down event
Aug 1 07:47:08 pfgarga ppp: [wan] IPV6CP: state change Closed --> Initial
Aug 1 07:47:08 pfgarga ppp: [wan_link0] LCP: SendTerminateReq #4
Aug 1 07:47:08 pfgarga ppp: [wan_link0] LCP: LayerDown
Aug 1 07:47:08 pfgarga ppp: [wan_link0] LCP: rec'd Terminate Ack #4 (Closing)
Aug 1 07:47:08 pfgarga ppp: [wan_link0] LCP: state change Closing --> Closed
Aug 1 07:47:08 pfgarga ppp: [wan_link0] LCP: LayerFinish
Aug 1 07:47:08 pfgarga ppp: [wan_link0] Link: DOWN event
Aug 1 07:47:08 pfgarga ppp: [wan_link0] LCP: Down event
Aug 1 07:47:08 pfgarga ppp: [wan_link0] LCP: state change Closed --> Initial
Aug 1 07:47:10 pfgarga ppp: [wan] Bundle: Shutdown
Aug 1 07:47:10 pfgarga ppp: [wan_link0] Link: Shutdown
Aug 1 07:47:10 pfgarga ppp: [wan] Bundle: Interface ng0 created
Aug 1 07:47:10 pfgarga ppp: [wan_link0] Link: OPEN event
Aug 1 07:47:10 pfgarga ppp: [wan_link0] LCP: Open event
Aug 1 07:47:10 pfgarga ppp: [wan_link0] LCP: state change Initial --> Starting
Aug 1 07:47:10 pfgarga ppp: [wan_link0] LCP: LayerStart
Aug 1 07:47:11 pfgarga ppp: [wan_link0] PPPoE: Connecting to ''
Aug 1 07:47:11 pfgarga ppp: [wan_link0] PPPoE: connection successful
Aug 1 07:47:11 pfgarga ppp: [wan_link0] Link: UP event
Aug 1 07:47:11 pfgarga ppp: [wan_link0] LCP: Up event
Aug 1 07:47:11 pfgarga ppp: [wan_link0] LCP: state change Starting --> Req-Sent
Aug 1 07:47:11 pfgarga ppp: [wan_link0] LCP: SendConfigReq #1
Aug 1 07:47:11 pfgarga ppp: [wan_link0] PROTOCOMP
Aug 1 07:47:11 pfgarga ppp: [wan_link0] MRU 1492
Aug 1 07:47:11 pfgarga ppp: [wan_link0] MAGICNUM 0xe5091981
Aug 1 07:47:12 pfgarga ppp: [wan_link0] LCP: rec'd Configure Request #1 (Req-Sent)
Aug 1 07:47:12 pfgarga ppp: [wan_link0] AUTHPROTO CHAP MD5
Aug 1 07:47:12 pfgarga ppp: [wan_link0] MRU 1480
Aug 1 07:47:12 pfgarga ppp: [wan_link0] MAGICNUM 0x21c40f19
Aug 1 07:47:12 pfgarga ppp: [wan_link0] MP MRRU 1600
Aug 1 07:47:12 pfgarga ppp: [wan_link0] LCP: SendConfigRej #1
Aug 1 07:47:12 pfgarga ppp: [wan_link0] MP MRRU 1600
Aug 1 07:47:12 pfgarga ppp: [wan_link0] LCP: rec'd Configure Request #2 (Req-Sent)
Aug 1 07:47:12 pfgarga ppp: [wan_link0] AUTHPROTO CHAP MD5
Aug 1 07:47:12 pfgarga ppp: [wan_link0] MRU 1480
Aug 1 07:47:12 pfgarga ppp: [wan_link0] MAGICNUM 0x21c40f19
Aug 1 07:47:12 pfgarga ppp: [wan_link0] LCP: SendConfigAck #2
Aug 1 07:47:12 pfgarga ppp: [wan_link0] AUTHPROTO CHAP MD5
Aug 1 07:47:12 pfgarga ppp: [wan_link0] MRU 1480
Aug 1 07:47:12 pfgarga ppp: [wan_link0] MAGICNUM 0x21c40f19
Aug 1 07:47:12 pfgarga ppp: [wan_link0] LCP: state change Req-Sent --> Ack-Sent
Aug 1 07:47:12 pfgarga ppp: [wan_link0] LCP: rec'd Configure Request #3 (Ack-Sent)
Aug 1 07:47:12 pfgarga ppp: [wan_link0] AUTHPROTO CHAP MD5
Aug 1 07:47:12 pfgarga ppp: [wan_link0] MRU 1480
Aug 1 07:47:12 pfgarga ppp: [wan_link0] MAGICNUM 0x21c40f19
Aug 1 07:47:12 pfgarga ppp: [wan_link0] LCP: SendConfigAck #3
Aug 1 07:47:12 pfgarga ppp: [wan_link0] AUTHPROTO CHAP MD5
Aug 1 07:47:12 pfgarga ppp: [wan_link0] MRU 1480
Aug 1 07:47:12 pfgarga ppp: [wan_link0] MAGICNUM 0x21c40f19
Aug 1 07:47:13 pfgarga ppp: [wan_link0] LCP: SendConfigReq #2
Aug 1 07:47:13 pfgarga ppp: [wan_link0] PROTOCOMP
Aug 1 07:47:13 pfgarga ppp: [wan_link0] MRU 1492
Aug 1 07:47:13 pfgarga ppp: [wan_link0] MAGICNUM 0xe5091981
Aug 1 07:47:13 pfgarga ppp: [wan_link0] LCP: rec'd Configure Reject #2 (Ack-Sent)
Aug 1 07:47:13 pfgarga ppp: [wan_link0] PROTOCOMP
Aug 1 07:47:13 pfgarga ppp: [wan_link0] LCP: SendConfigReq #3
Aug 1 07:47:13 pfgarga ppp: [wan_link0] MRU 1492
Aug 1 07:47:13 pfgarga ppp: [wan_link0] MAGICNUM 0xe5091981
Aug 1 07:47:13 pfgarga ppp: [wan_link0] LCP: rec'd Configure Ack #3 (Ack-Sent)
Aug 1 07:47:13 pfgarga ppp: [wan_link0] MRU 1492
Aug 1 07:47:13 pfgarga ppp: [wan_link0] MAGICNUM 0xe5091981
Aug 1 07:47:13 pfgarga ppp: [wan_link0] LCP: state change Ack-Sent --> Opened
Aug 1 07:47:13 pfgarga ppp: [wan_link0] LCP: auth: peer wants CHAP, I want nothing
Aug 1 07:47:13 pfgarga ppp: [wan_link0] LCP: LayerUp
Aug 1 07:47:13 pfgarga ppp: [wan_link0] CHAP: rec'd CHALLENGE #1 len: 56
Aug 1 07:47:13 pfgarga ppp: [wan_link0] Name: "BRAS Iracemapolis - Telecom Inte�^_^X"
Aug 1 07:47:13 pfgarga ppp: [wan_link0] CHAP: Using authname "renato.couto"
Aug 1 07:47:13 pfgarga ppp: [wan_link0] CHAP: sending RESPONSE #1 len: 33
Aug 1 07:47:13 pfgarga ppp: [wan_link0] CHAP: rec'd SUCCESS #1 len: 12
Aug 1 07:47:13 pfgarga ppp: [wan_link0] MESG: Welcome.
Aug 1 07:47:13 pfgarga ppp: [wan_link0] LCP: authorization successful
Aug 1 07:47:13 pfgarga ppp: [wan_link0] Link: Matched action 'bundle "wan" ""'
Aug 1 07:47:13 pfgarga ppp: [wan_link0] Link: Join bundle "wan"
Aug 1 07:47:13 pfgarga ppp: [wan] Bundle: Status update: up 1 link, total bandwidth 64000 bps
Aug 1 07:47:13 pfgarga ppp: [wan] IPCP: Open event
Aug 1 07:47:13 pfgarga ppp: [wan] IPCP: state change Initial --> Starting
Aug 1 07:47:13 pfgarga ppp: [wan] IPCP: LayerStart
Aug 1 07:47:13 pfgarga ppp: [wan] IPV6CP: Open event
Aug 1 07:47:13 pfgarga ppp: [wan] IPV6CP: state change Initial --> Starting
Aug 1 07:47:13 pfgarga ppp: [wan] IPV6CP: LayerStart
Aug 1 07:47:13 pfgarga ppp: [wan] IPCP: Up event
Aug 1 07:47:13 pfgarga ppp: [wan] IPCP: state change Starting --> Req-Sent
Aug 1 07:47:13 pfgarga ppp: [wan] IPCP: SendConfigReq #1
Aug 1 07:47:13 pfgarga ppp: [wan] IPADDR 0.0.0.0
Aug 1 07:47:13 pfgarga ppp: [wan] COMPPROTO VJCOMP, 16 comp. channels, no comp-cid
Aug 1 07:47:13 pfgarga ppp: [wan] IPV6CP: Up event
Aug 1 07:47:13 pfgarga ppp: [wan] IPV6CP: state change Starting --> Req-Sent
Aug 1 07:47:13 pfgarga ppp: [wan] IPV6CP: SendConfigReq #1
Aug 1 07:47:13 pfgarga ppp: [wan_link0] rec'd unexpected protocol MPLS Control Protocol (RFC 3032), rejecting
Aug 1 07:47:13 pfgarga ppp: [wan] IPCP: rec'd Configure Reject #1 (Req-Sent)
Aug 1 07:47:13 pfgarga ppp: [wan] COMPPROTO VJCOMP, 16 comp. channels, no comp-cid
Aug 1 07:47:13 pfgarga ppp: [wan] IPCP: SendConfigReq #2
Aug 1 07:47:13 pfgarga ppp: [wan] IPADDR 0.0.0.0
Aug 1 07:47:13 pfgarga ppp: [wan_link0] LCP: rec'd Protocol Reject #4 (Opened)
Aug 1 07:47:13 pfgarga ppp: [wan_link0] LCP: protocol IPV6CP was rejected
Aug 1 07:47:13 pfgarga ppp: [wan] IPV6CP: protocol was rejected by peer
Aug 1 07:47:13 pfgarga ppp: [wan] IPV6CP: state change Req-Sent --> Stopped
Aug 1 07:47:13 pfgarga ppp: [wan] IPV6CP: LayerFinish
Aug 1 07:47:13 pfgarga ppp: [wan] IPCP: rec'd Configure Nak #2 (Req-Sent)
Aug 1 07:47:13 pfgarga ppp: [wan] IPADDR 177.53.86.172
Aug 1 07:47:13 pfgarga ppp: [wan] 177.53.86.172 is OK
Aug 1 07:47:13 pfgarga ppp: [wan] IPCP: SendConfigReq #3
Aug 1 07:47:13 pfgarga ppp: [wan] IPADDR 177.53.86.172
Aug 1 07:47:13 pfgarga ppp: [wan] IPCP: rec'd Configure Ack #3 (Req-Sent)
Aug 1 07:47:13 pfgarga ppp: [wan] IPADDR 177.53.86.172
Aug 1 07:47:13 pfgarga ppp: [wan] IPCP: state change Req-Sent --> Ack-Rcvd
Aug 1 07:47:13 pfgarga ppp: [wan] IPCP: rec'd Configure Request #2 (Ack-Rcvd)
Aug 1 07:47:13 pfgarga ppp: [wan] IPADDR 177.53.80.8
Aug 1 07:47:13 pfgarga ppp: [wan] 177.53.80.8 is OK
Aug 1 07:47:13 pfgarga ppp: [wan] IPCP: SendConfigAck #2
Aug 1 07:47:13 pfgarga ppp: [wan] IPADDR 177.53.80.8
Aug 1 07:47:13 pfgarga ppp: [wan] IPCP: state change Ack-Rcvd --> Opened
Aug 1 07:47:13 pfgarga ppp: [wan] IPCP: LayerUp
Aug 1 07:47:13 pfgarga ppp: [wan] 177.53.86.172 -> 177.53.80.8
Aug 1 07:47:13 pfgarga ppp: [wan] IFACE: Up event
Aug 1 07:47:13 pfgarga ppp: [wan] IFACE: Rename interface ng0 to pppoe0
# ifconfig pppoe0
pppoe0: flags=88d1<UP,POINTOPOINT,RUNNING,NOARP,SIMPLEX,MULTICAST> metric 0 mtu 1492
inet 177.53.86.172 --> 177.53.80.8 netmask 0xffffffff
inet6 fe80::208:a2ff:fe09:5b54%pppoe0 prefixlen 64 scopeid 0xc
nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL>
# netstat -nrWf inet
Routing tables
Internet:
Destination Gateway Flags Use Mtu Netif Expire
default 177.53.80.8 UGS 43 1492 pppoe0
10.250.250.0/24 link#11 U 0 1500 igb0.666
10.250.250.1 link#11 UHS 0 16384 lo0
127.0.0.1 link#8 UH 7868 16384 lo0
172.21.4.0/24 link#1 U 9972647 1500 igb0
172.21.4.1 link#1 UHS 0 16384 lo0
177.53.80.4 pppoe0 UHS 94 1492 pppoe0
177.53.80.8 link#12 UH 0 1492 pppoe0
177.53.86.172 link#12 UHS 0 16384 lo0
201.77.127.155 link#13 UHS 0 16384 lo0
216.66.22.2 177.53.80.8 UGHS 115 1492 pppoe0
Using 5.8_5 I have problems to access many hosts.
There are more information I should bring here.
If I force MTU and MRU to be 1480, using the following config it works:
But if I comment out both MTU and MRU lines the problem is back
The command "set log ..." is wrong, it should be "log +iface +iface2" without "set". Because of this, there is not enough details in the log. Please correct the configuration and repeat the test using new version (no need to re-test using old one).
Last edit: Eugene Grosbein 2018-08-01
Sure, follow you can see the one that fails
Last edit: Renato Botelho 2018-08-01
And here the one that works:
It is possible that your build environment for net/mpd5 port is unexpected and the binary is built without HAVE_NG_TCPMSS / USE_NG_TCPMSS support and that would be bad. Please show output of "ngctl ls" command for the system running PPPoE client connection that uses new version and has problems. Also, show messages produced by mpd5 port building process starting from the line "===> Configuring for mpd5-5.8_6" and until the line "===> Building for mpd5-5.8_6"
Sure. I can see -DUSE_NG_TCPMSS all around during build phase
At this moment it's working because I set MTU and MRU to 1480 on mpd.conf. Let me know if you need me to force the error before collect ngctl ls output
```
$ ngctl ls
There are 25 total nodes:
Name: igb1 Type: ether ID: 00000002 Num hooks: 1
Name: igb2 Type: ether ID: 00000003 Num hooks: 1
Name: <unnamed> Type: socket ID: 00000009 Num hooks: 0
Name: igb0_666 Type: ether ID: 0000000c Num hooks: 0
Name: mpd11854-lso Type: socket ID: 0000028f Num hooks: 1
Name: mpd11854-cso Type: socket ID: 00000290 Num hooks: 0
Name: mpd11854-eso Type: socket ID: 00000291 Num hooks: 0
Name: ng0 Type: iface ID: 00000292 Num hooks: 1
Name: mpd11854-wan Type: ppp ID: 00000293 Num hooks: 3
Name: mpd11854-wan_link0-lt Type: tee ID: 00000294 Num hooks: 2
Name: <unnamed> Type: socket ID: 00000295 Num hooks: 0
Name: mpd11854-stats Type: socket ID: 00000296 Num hooks: 0
Name: mpd11854-wan-mss Type: tcpmss ID: 00000297 Num hooks: 2
Name: <unnamed> Type: pppoe ID: 00000017 Num hooks: 2
Name: <unnamed> Type: pppoe ID: 00000022 Num hooks: 2
Name: ngctl80863 Type: socket ID: 000002a9 Num hooks: 0
Name: mpd57847-lso Type: socket ID: 00000270 Num hooks: 1
Name: mpd57847-cso Type: socket ID: 00000271 Num hooks: 0
Name: mpd57847-eso Type: socket ID: 00000272 Num hooks: 0
Name: ng1 Type: iface ID: 00000273 Num hooks: 1
Name: mpd57847-opt1 Type: ppp ID: 00000274 Num hooks: 3
Name: mpd57847-opt1_link0-lt Type: tee ID: 00000275 Num hooks: 2
Name: <unnamed> Type: socket ID: 00000276 Num hooks: 0
Name: mpd57847-stats Type: socket ID: 00000277 Num hooks: 0
Name: mpd57847-opt1-mss Type: tcpmss ID: 00000278 Num hooks: 2</unnamed></unnamed></unnamed></unnamed></unnamed>
Aug 1 08:28:55 pfgarga ppp: [wan_link0] LCP: SendConfigReq #1
Aug 1 08:28:55 pfgarga ppp: [wan_link0] PROTOCOMP
Aug 1 08:28:55 pfgarga ppp: [wan_link0] MRU 1492
Aug 1 08:28:55 pfgarga ppp: [wan_link0] MAGICNUM 0xa8790a74
Aug 1 08:28:56 pfgarga ppp: [wan_link0] LCP: rec'd Configure Request #1 (Req-Sent)
Aug 1 08:28:56 pfgarga ppp: [wan_link0] AUTHPROTO CHAP MD5
Aug 1 08:28:56 pfgarga ppp: [wan_link0] MRU 1480
Aug 1 08:28:56 pfgarga ppp: [wan_link0] MAGICNUM 0x9468ac2b
Aug 1 08:28:56 pfgarga ppp: [wan_link0] MP MRRU 1600
```
If I'm reading it right ISP is proposing me to use 1480, no? If it's correct, why it ends up configured as 1492?
Last edit: Renato Botelho 2018-08-01
It seems the binary builds just fine.
The interface ends up configured with mtu=1492 because ISP later agrees with this value by "LCP: rec'd Configure Ack #3" message to mpd's proposal.
Please put attached file to /usr/ports/net/mpd5 directory and rebuild latest version of mpd5, restart it and post the log it produces. No need to to force the error but use latest version.
That's just fine and expected: "IFACE: Configuring tcpmssfix" line shows value lesser than interface MTU by exactly 40 bytes. Now please comment out all "mtu/mru" lines from the mpd.conf and re-establish PPPoE and post the log again and output of "ifconfig pppoe0" too.
Last edit: Eugene Grosbein 2018-08-01
This is fine too and no connectivity problems should occur. Does it work if you try to run the following command?
ping -D -s 1464 177.53.80.8
ping works as expected.
The connectivity problem I face in this case is not for all hosts I try to connect but for some specific ones. For example, if I try to access https://www.ubnt.com it fails like this until timeout:
Please create an attachment with captured outgoing TCP traffic (pcap file) for such connection.
I waited a few time and then pressed ctrl+C on curl command. Let me know if you want it to go until timeout
That's enough. The very first TCP SYN segment has option MSS=1460 that is more than value in the line of the log "IFACE: Configuring tcpmssfix mpd4417-wan-mss:: 1452" and this is the reason of timeouts. It must not exceed 1452 for this configuration.
MSS=1460 corresponds to MTU=1500 and/or non-functioning tcpmssfix but the log assures us that tcpmss is configured properly. And ping assures us that mpd5 configured PPPoE connection properly too.
There should be something in your local setup making bad interference that breaks MSS fix. Do you have any kind of packet filtering or "sanitizing" like pf(4) configured? If so, could you please disable it completely for a test?
And comment out "set iface up-script /usr/local/sbin/ppp-linkup" in the mpd.conf, if possible, too. If not, post its contents.
I'll get some sleep and will back to the case several hours later.
Last edit: Eugene Grosbein 2018-08-01
Yes, I have pf running, it's a pfSense. I tried after do a
pfctl -dto disable it and the problem persisted.Here is ppp-linkup script:
An hour in the morning is worth two in the evening. I was wrong in my pcap-file analysis: packet capture on virtual PPPoE interface shows traffic before MSS fix obtains it and does its job. Please repeat same test but this time capture traffic using underlying interface corresponding physical NIC like this:
tcpdump -nps0 -w file.pcap -i igb0
Here it is, and it also has MSS=1460
It seems you have used wrong interface as the file contains plain IPoE frames with internal IP addresses instead of PPPoE frames running over NIC corresponding to WAN interface. Please double-check and re-do using external NIC.
You are right and I need more coffee. Attached you will find a capture on igb1, the right interface. I couldn't filter it on tcpdump, the target IP is 52.34.248.163
This capture's packet #37 confirms that tcpmssfix works as expected changing original 1460 to 1452 (1492-40)
Just a note, If I add the following scrub rule to my pf.conf it makes the connection to work fine again:
scrub on pppoe0 all max-mss 1440 fragment reassembleWhat happens if you use 1441 here instead if 1440?
It doesn't work anymore
It's interesting to note that MSS is also 1460 when MTU is configured to 1480 and connection works as you can see on attached capture