Menu ▾ ▴

NetDB - Collecting Speed on VMware - Slow?

Help
Skip Meyer
2014-05-05
2014-05-14

  • Skip Meyer

    Skip Meyer - 2014-05-05

    I have the VMware appliance version of NetDB up and running on a large VCE VBlock system and the performance seems to be off. It takes roughly 10 minutes to run through 10,000 entries. See below.

    Does this seem slow to anyone else?

    Mon May 5 14:01:46 2014: netdbctl(29587): Importing 9573 intstatus entries in to switchstatus table
    Mon May 5 14:04:25 2014: netdbctl(29587): Importing 5170 MAC entries in to switchports table
    Mon May 5 14:05:53 2014: netdbctl(29587): Importing 315 neighbor discovery entries in to neighbor table
    Mon May 5 14:05:59 2014: netdbctl(29587): Importing 10409 ARP Entries in to ipmac table
    Mon May 5 14:09:56 2014: netdbctl(29587): NetDB update complete

     

  • Jonathan Yantis

    Jonathan Yantis - 2014-05-06

    Skip,

    That does seem slower than on my system here but I don't see anything that stands out as a usual issue, such as DNS creating slow ARP imports etc. It just seems rather slow over all on the database side. I would look in to tweaking MySQL in this case and make sure you are not doing binary sync logs or transactions commits. Here are some of my MySQL my.cnf tweaks to try. Backup your existing my.cnf and give some of this a try. I would assume the issue is storage related, check your CPU usage during input to make sure. It's not terrible performance but it's not fast either compared to my 5 year old dedicated run of the mill dell server.

    I will be out of town for the rest of the month but Andrew may chime in. He's got a network 10x as large doing 5min inputs, but on a dedicated server. Still he might know some tweaks as well.

    * Fine Tuning

    key_buffer = 16M
    max_allowed_packet = 16M
    thread_stack = 192K
    thread_cache_size = 16
    table_cache=2048
    binlog_cache_size=1048576
    max_heap_table_size=67108864
    sort_buffer_size=65536
    join_buffer_size=1048576
    thread_concurrency=32
    ft_min_word_len=4

    * Query Cache Configuration

    query-cache-type = 1
    query_cache_limit = 4M
    query_cache_size = 32M
    query_cache_min_res_unit = 1024

    * InnoDB

    InnoDB is enabled by default with a 10MB datafile in /var/lib/mysql/.

    Read the manual for more InnoDB related options. There are many!

    innodb_buffer_pool_size=500M
    innodb_additional_mem_pool_size=50M
    innodb_log_buffer_size=10M
    innodb_lock_wait_timeout=120
    innodb_max_dirty_pages_pct=90
    innodb_thread_concurrency=32

    NST Performance

    innodb_flush_log_at_trx_commit=0
    sync_binlog=0

     

    • Skip Meyer

      Skip Meyer - 2014-05-12

      Holy crap. I made the MySQL changes and you would not believe the performance gain. All done in less than a minute.

      I can add the rest of our infrastructure now.

      Thank you very much.

      Mon May 12 15:46:39 2014: netdbctl(1913): Importing 9573 intstatus entries in to switchstatus table
      Mon May 12 15:46:42 2014: netdbctl(1913): Importing 5181 MAC entries in to switchports table
      Mon May 12 15:46:46 2014: netdbctl(1913): Importing 315 neighbor discovery entries in to neighbor table
      Mon May 12 15:46:47 2014: netdbctl(1913): Importing 10544 ARP Entries in to ipmac table
      Mon May 12 15:47:07 2014: netdbctl(1913): NetDB update complete

       

      • Jonathan Yantis

        Jonathan Yantis - 2014-05-14

        Great Skip, good to know that did it.

        --
        Jonathan Yantis

        On May 12, 2014, at 4:49 PM, Skip Meyer wcmeyer@users.sf.net wrote:

        Holy crap. I made the MySQL changes and you would not believe the
        performance gain. All done in less than a minute.

        I can add the rest of our infrastructure now.

        Thank you very much.

        Mon May 12 15:46:39 2014: netdbctl(1913): Importing 9573 intstatus entries
        in to switchstatus table
        Mon May 12 15:46:42 2014: netdbctl(1913): Importing 5181 MAC entries in to
        switchports table
        Mon May 12 15:46:46 2014: netdbctl(1913): Importing 315 neighbor discovery
        entries in to neighbor table
        Mon May 12 15:46:47 2014: netdbctl(1913): Importing 10544 ARP Entries in to
        ipmac table
        Mon May 12 15:47:07 2014: netdbctl(1913): NetDB update complete

        NetDB - Collecting Speed on VMware -
        Slow?https://sourceforge.net/p/netdbtracking/discussion/939989/thread/8ad3d440/?limit=25#6246/6e71

        Sent from sourceforge.net because you indicated interest in
        https://sourceforge.net/p/netdbtracking/discussion/939989/

        To unsubscribe from further messages, please visit
        https://sourceforge.net/auth/subscriptions/

         

Log in to post a comment.