#393 ixgbevf - vrrp not working

open
Emil Tantilov
None
in-kernel_driver
1
2014-05-19
2014-01-15
No

I cannot see vrrp packets on sr-iov device inside virtual machine. I can see vrrp packets on physical interface on hypervisor. Any idea how to make this working or it is a bug ?

Related

Bugs: #393

Discussion

  • Todd Fujinaka
    Todd Fujinaka
    2014-01-15

    I'm not completely familiar with VRRP. It shouln't be blocked unless you have perfect filters turned on, or if VRRP is using an odd packet. Maybe it's being sent to a queue you're not expecting because it doesn't look like a "normal" packet?

     
    • vrrp use multicast so maybe problem is with multicasts ?
      On Jan 15, 2014 9:54 PM, "Todd Fujinaka" htfujina@users.sf.net wrote:

      I'm not completely familiar with VRRP. It shouln't be blocked unless you
      have perfect filters turned on, or if VRRP is using an odd packet. Maybe
      it's being sent to a queue you're not expecting because it doesn't look
      like a "normal" packet?


      Status: open
      Created: Wed Jan 15, 2014 04:34 PM UTC by Krzysztof Pawlowski
      Last Updated: Wed Jan 15, 2014 04:34 PM UTC
      Owner: nobody

      I cannot see vrrp packets on sr-iov device inside virtual machine. I can
      see vrrp packets on physical interface on hypervisor. Any idea how to make
      this working or it is a bug ?


      Sent from sourceforge.net because you indicated interest in
      https://sourceforge.net/p/e1000/bugs/393/

      To unsubscribe from further messages, please visit
      https://sourceforge.net/auth/subscriptions/

       

      Related

      Bugs: #393

      Attachments
  • vrrp is a multicast packet so maybe problem is with multicasts ?

     
  • Emil Tantilov
    Emil Tantilov
    2014-01-16

    Which version of ixgbe are you using? We did see an issue with VF to VF traffic related to the MTA table being cleared on reset. The fix is in the current (as of this writing) ixgbe 3.19.1 driver, you may want to give it a try, or if you already using it try an older version to see if it is a regression.

     
  • I'm using xenserver 6.2:

    ethtool -i eth4

    driver: ixgbe
    version: 3.14.5
    firmware-version: 0x61bd0001

     
  • I've managed to upgrade citrix ixgbe driver do version 3.19.1 but multicast packets are still broken.

     
  • Emil Tantilov
    Emil Tantilov
    2014-01-24

    If you could provide detatiled information about yuor setup and preferably steps to reproduce the issue it will help us in getting a better understanding of the issue you are seeing.

     
  • Our configuration is:

    HyperVisor:
    - xenserver 6.2 sp1 + ixgbe 3.19.1 (options ixgbe max_vfs=40,40)
    - dell r620 + intel x520 adapter

    Guest:
    - centos 6.5 + ixgbevf 2.12.1 (options ixgbevf InterruptThrottleRate=3000,3000,3000,3000)

    Each guest has two sr-iov interfaces bonded into one interface(round robin mode) and tagged vlans on it.

    Is it enough ?

     
    • Emil Tantilov
      Emil Tantilov
      2014-02-10

      Thanks for the info. This explains the configuration, but not how vrrp is being used. Are you running vrrpd?

      We are looking into this and I will update with more info as we have it. Meanwhile I have a couple of questions:

      1. Have you tried this with an older driver? If not please give ixgbevf 2.11.3 a try.

      2. Have you tried using vrrpd without bonding and/or vlans? If you are setting up the vlan tags from the PF the current driver has some issues with it.

       
        1. I'm using keepalived for vrrp.
        2. Yes, I've tried with stock centos 6.5 driver (2.7.12 and 2.6.2 versions) and it's also was not working. I'll try tommorow with 2.11.3 version.
        3. I was sending vrrp packets from physical machine and nothing was received on eth0. But it was with tagged vlan on sr-iov network interface. I'll try tommorow without tagged vlan.
         
        • I've testested:

          version: 2.7.12-k
          version: 2.11.3

          Without bonding and tagged vlans but still i can not see multicast packets on sr-iov interface inside virtual machine but i can see them on network interface on hypervisor.

           
  • Any solution to dropped multicast packets ?

     
  • Todd Fujinaka
    Todd Fujinaka
    2014-02-19

    I think we're still waiting for you to answer Emil's questions.

     
  • Emil Tantilov
    Emil Tantilov
    2014-02-21

    I ran a touch test with multicast packets and the VF driver had no trouble receiving. We will attempt to repro with vrrp packets using keepalived.

     
    • Any results with keepalived ?

       
  • Emil Tantilov
    Emil Tantilov
    2014-03-21

    Sorry for the delay. We are looking into it.

     
  • Emil Tantilov
    Emil Tantilov
    2014-03-21

    We were unable to reproduce this issue. With keepalived in the following setup:

    Host OS: RHEL 6.5 (default kernel), guest OS (over KVM) RHEL 6.5
    Host OS: Linux kernel 3.3.6, guest OS (ober KVM) RHEL6.5

    Looks like in your case you are using Citrix as a host OS? I don't know much about Citrix and it's not an OS that we usually test with. Which version of Citrix are you using and what kernel is it based on?

     
    Last edit: Emil Tantilov 2014-03-21
    • We are using Citrix Xenserver 6.2 SP1. It's loaded with kernel: 2.6.32.43-0.4.1.xs1.8.0.847.170785xen. I can see vrrp packets on physical interface all the time but nothing is passed into virtual interface inside virtual machine.

       
  • Emil Tantilov
    Emil Tantilov
    2014-03-27

    The issue with vrrp packets is that they modify the destination MAC address which results in the packet not being forwarded to the VF. This is not a bug per se, just something we don't currently support. I don't know if there is a good way to let the packets get to the VF, but we'll look into it.

     
  • Todd Fujinaka
    Todd Fujinaka
    2014-05-19

    • assigned_to: Emil Tantilov