Thread: [Aoetools-discuss] [ANNOUNCE] ggaoed 1.0
Brought to you by:
ecashin,
elcapitansam
From: Gabor G. <go...@sz...> - 2009-11-12 10:46:31
|
Hi, I've released ggaoed 1.0, my AoE target implementation for Linux. It is available at: http://code.google.com/p/ggaoed Highlights: - Event-based model where a single process can serve a large number of devices and network interfaces - Uses Linux AIO for I/O submission, eventfd for notification, and epoll for event processing - Supports the memory mapped packet interface for receiving and sending data (sending needs kernel 2.6.31 or later), reducing the number of system calls needed for communication - Request merging: read/write requests for adjacent data blocks can be submitted as a single I/O request - Request batching: multiple I/O requests can be submitted using a single system call - Fixes a few bugs that were present in 0.9 You need at least kernel 2.6.27 to run ggaoed. Known bugs: - The README says you need xsltproc to build the man pages but I have switched to docbook2x-man in the last minute. Oh well. Gabor -- --------------------------------------------------------- MTA SZTAKI Computer and Automation Research Institute Hungarian Academy of Sciences --------------------------------------------------------- |
From: Ed C. <ec...@co...> - 2009-11-12 12:59:31
|
On Thu Nov 12 05:47:47 EST 2009, go...@sz... wrote: > Hi, > > I've released ggaoed 1.0, my AoE target implementation for Linux. It is > available at: > > http://code.google.com/p/ggaoed Congratulations on the 1.0 release! ... > - Uses Linux AIO for I/O submission, eventfd for notification, and epoll > for event processing If you ever do a presentation or talk about your experiences using AIO and AoE together in today's kernels, please videotape it and put the slides up somewhere. I'd like to see a presentation like that. :) -- Ed |
From: Gabor G. <go...@sz...> - 2009-11-13 08:50:59
|
On Thu, Nov 12, 2009 at 07:59:10AM -0500, Ed Cashin wrote: > On Thu Nov 12 05:47:47 EST 2009, go...@sz... wrote: > > Hi, > > > > I've released ggaoed 1.0, my AoE target implementation for Linux. It is > > available at: > > > > http://code.google.com/p/ggaoed > > Congratulations on the 1.0 release! Thanks! > > - Uses Linux AIO for I/O submission, eventfd for notification, and epoll > > for event processing > > If you ever do a presentation or talk about your experiences using AIO > and AoE together in today's kernels, please videotape it and put the > slides up somewhere. I'd like to see a presentation like that. :) I do not plan a presentation currently but if I do one I'll let you know :-) Gabor -- --------------------------------------------------------- MTA SZTAKI Computer and Automation Research Institute Hungarian Academy of Sciences --------------------------------------------------------- |
From: Tracy R. <tr...@ul...> - 2009-11-12 20:19:25
|
On Thu, Nov 12, 2009 at 11:46:18AM +0100, Gabor Gombas spake thusly: > I've released ggaoed 1.0, my AoE target implementation for Linux. It is > available at: Nice! How does this compare with the official coraid vblade target? Does it also implement any of your highlights? Any benchmarks yet? -- Tracy Reed http://tracyreed.org |
From: Gabor G. <go...@sz...> - 2009-11-13 09:52:26
|
Hi! On Thu, Nov 12, 2009 at 11:56:22AM -0800, Tracy Reed wrote: > Nice! How does this compare with the official coraid vblade target? > Does it also implement any of your highlights? Any benchmarks yet? vblade uses a completely different model so it does not have any of the features I mentioned. I have done some benchmarking, but I had no time to put the results all together yet. However here are some of the results. The target machine had 8G RAM, 10 500G SATA disks in RAID10 on a 3ware 9650SE controller with 10GigE connection. On top of the RAID there is LVM and I've exported LVM volumes of 10G in size. I've used kernel 2.6.31 from Debian unstable. The initiators had a single GigE connection and 512M of memory. There was an HP Procurve 2900-24 switch between the initiators and the target. Running 12 parallel bonnie processes locally: storage2,8G,,,11296,8,4787,1,,,17128,2,93.2,0,16,4026,16,+++++,+++,4794,16,4130,16,+++++,+++,4843,16 storage2,8G,,,11186,8,4780,1,,,19885,2,92.2,0,16,3935,16,+++++,+++,4739,16,4044,16,+++++,+++,4827,16 storage2,8G,,,11476,8,4760,1,,,20012,2,89.0,0,16,3949,16,+++++,+++,4697,16,4012,16,+++++,+++,4767,16 storage2,8G,,,11276,8,4743,1,,,17126,2,94.1,0,16,4019,17,+++++,+++,4801,17,4158,17,+++++,+++,4705,17 storage2,8G,,,11439,8,4767,1,,,17100,2,94.7,0,16,3985,16,+++++,+++,4816,16,4072,16,+++++,+++,4669,16 storage2,8G,,,11936,9,4729,1,,,19812,2,89.9,0,16,4004,16,+++++,+++,4696,16,4036,16,+++++,+++,4628,16 storage2,8G,,,11546,8,4742,1,,,18160,2,91.1,0,16,3925,16,+++++,+++,4569,16,4158,17,+++++,+++,4673,17 storage2,8G,,,11210,8,4905,1,,,17086,1,95.9,0,16,3897,16,+++++,+++,4718,16,4044,16,+++++,+++,4637,16 storage2,8G,,,11404,8,4733,1,,,18172,2,92.3,0,16,3880,16,+++++,+++,4772,17,4055,16,+++++,+++,4756,17 storage2,8G,,,11242,8,4892,1,,,17110,1,96.7,0,16,4098,17,+++++,+++,4903,17,4148,17,+++++,+++,4814,18 storage2,8G,,,11202,8,4838,1,,,17113,2,96.1,0,16,3959,16,+++++,+++,4855,18,4227,17,+++++,+++,4789,17 Running 12 parallel bonnie processes over AoE, using qaoed (r721 of http://svn.fubra.com/storage/qaoed/trunk): ariel,1G,,,8763,2,3829,0,,,14941,0,103.8,0,16,+++++,+++,+++++,+++,+++++,+++,+++++,+++,+++++,+++,+++++,+++ ariel,1G,,,9555,2,3798,0,,,17589,0,94.6,0,16,+++++,+++,+++++,+++,+++++,+++,+++++,+++,+++++,+++,+++++,+++ umbriel,1G,,,7353,2,4122,0,,,20471,0,91.8,0,16,18559,45,+++++,+++,+++++,+++,+++++,+++,+++++,+++,+++++,+++ umbriel,1G,,,8912,2,3570,0,,,17353,0,142.0,0,16,18770,46,+++++,+++,+++++,+++,+++++,+++,+++++,+++,+++++,+++ oberon,1G,,,8225,2,3732,0,,,10436,0,3023.9,2,16,+++++,+++,+++++,+++,+++++,+++,+++++,+++,+++++,+++,+++++,+++ oberon,1G,,,9636,2,4198,0,,,23301,0,80.6,0,16,+++++,+++,+++++,+++,+++++,+++,+++++,+++,+++++,+++,+++++,+++ titania,1G,,,5420,1,2428,0,,,17945,0,319.1,0,16,+++++,+++,+++++,+++,+++++,+++,+++++,+++,+++++,+++,+++++,+++ titania,1G,,,5393,1,2432,0,,,19691,1,163.4,0,16,+++++,+++,+++++,+++,+++++,+++,+++++,+++,+++++,+++,+++++,+++ miranda,1G,,,8759,2,4415,0,,,35293,0,68.4,0,16,17565,43,+++++,+++,+++++,+++,+++++,+++,+++++,+++,+++++,+++ miranda,1G,,,8143,2,2388,0,,,19095,0,100.3,0,16,17656,43,+++++,+++,+++++,+++,+++++,+++,+++++,+++,+++++,+++ ophelia,1G,,,5685,1,2329,0,,,9477,0,3360.6,2,16,+++++,+++,+++++,+++,+++++,+++,+++++,+++,+++++,+++,+++++,+++ ophelia,1G,,,12021,3,3656,0,,,5632,0,536.1,0,16,+++++,+++,+++++,+++,+++++,+++,+++++,+++,+++++,+++,+++++,+++ Running 12 parallel bonnie processes over AoE, using vblade-20: miranda,1G,,,12835,3,4149,0,,,26095,0,58.5,0,16,+++++,+++,+++++,+++,+++++,+++,+++++,+++,+++++,+++,+++++,+++ miranda,1G,,,11399,3,4105,0,,,12526,0,73.3,0,16,+++++,+++,+++++,+++,+++++,+++,+++++,+++,+++++,+++,+++++,+++ oberon,1G,,,11209,3,4106,0,,,8243,0,92.4,0,16,+++++,+++,+++++,+++,+++++,+++,+++++,+++,+++++,+++,+++++,+++ oberon,1G,,,13071,4,4407,0,,,16810,0,73.5,0,16,+++++,+++,+++++,+++,+++++,+++,+++++,+++,+++++,+++,+++++,+++ umbriel,1G,,,11088,3,4066,0,,,9356,0,85.3,0,16,+++++,+++,+++++,+++,+++++,+++,+++++,+++,+++++,+++,+++++,+++ umbriel,1G,,,12506,3,4047,0,,,7399,0,114.8,0,16,+++++,+++,+++++,+++,+++++,+++,+++++,+++,+++++,+++,+++++,+++ ariel,1G,,,12209,3,4095,0,,,9972,0,83.9,0,16,+++++,+++,+++++,+++,+++++,+++,+++++,+++,+++++,+++,+++++,+++ ariel,1G,,,11743,3,3647,0,,,8861,0,96.5,0,16,+++++,+++,+++++,+++,+++++,+++,+++++,+++,+++++,+++,+++++,+++ titania,1G,,,11857,3,4085,0,,,6281,0,103.3,0,16,+++++,+++,+++++,+++,+++++,+++,+++++,+++,+++++,+++,+++++,+++ titania,1G,,,13359,3,4035,0,,,6385,0,95.0,0,16,+++++,+++,+++++,+++,+++++,+++,+++++,+++,+++++,+++,+++++,+++ ophelia,1G,,,13073,3,4114,0,,,21061,0,81.5,0,16,24019,55,+++++,+++,+++++,+++,+++++,+++,+++++,+++,+++++,+++ ophelia,1G,,,11833,3,3623,0,,,8414,0,2999.6,1,16,+++++,+++,+++++,+++,+++++,+++,+++++,+++,+++++,+++,+++++,+++ Running 12 parallel bonnie processes over AoE, using ggaoed SVN r104: umbriel,1G,,,12102,3,6563,0,,,21796,0,93.1,0,16,+++++,+++,+++++,+++,+++++,+++,+++++,+++,+++++,+++,+++++,+++ umbriel,1G,,,10465,2,6275,0,,,21633,0,93.1,0,16,+++++,+++,+++++,+++,+++++,+++,+++++,+++,+++++,+++,+++++,+++ titania,1G,,,11734,3,6153,0,,,22046,1,92.6,0,16,27418,65,+++++,+++,+++++,+++,+++++,+++,+++++,+++,+++++,+++ ariel,1G,,,10630,2,6899,0,,,21383,0,92.2,0,16,+++++,+++,+++++,+++,+++++,+++,+++++,+++,+++++,+++,+++++,+++ titania,1G,,,10666,3,6345,0,,,22260,0,92.3,0,16,+++++,+++,+++++,+++,+++++,+++,+++++,+++,+++++,+++,+++++,+++ ariel,1G,,,11353,3,6246,0,,,21189,1,93.7,0,16,23961,55,+++++,+++,+++++,+++,+++++,+++,+++++,+++,+++++,+++ ophelia,1G,,,10751,3,6076,0,,,24096,0,91.8,0,16,+++++,+++,+++++,+++,+++++,+++,+++++,+++,+++++,+++,+++++,+++ ophelia,1G,,,11924,3,5907,0,,,23976,1,92.1,0,16,+++++,+++,+++++,+++,+++++,+++,+++++,+++,+++++,+++,+++++,+++ oberon,1G,,,11919,3,6285,0,,,23608,0,90.9,0,16,+++++,+++,+++++,+++,+++++,+++,+++++,+++,+++++,+++,+++++,+++ oberon,1G,,,10518,2,6041,0,,,23115,0,92.5,0,16,+++++,+++,+++++,+++,+++++,+++,32453,73,+++++,+++,+++++,+++ miranda,1G,,,10896,2,5915,0,,,23514,0,91.2,0,16,32092,76,+++++,+++,+++++,+++,+++++,+++,+++++,+++,+++++,+++ miranda,1G,,,12201,3,6149,0,,,22934,0,94.2,0,16,+++++,+++,+++++,+++,+++++,+++,+++++,+++,+++++,+++,+++++,+++ CPU time used on the target (note that this includes some other tests beside the bonnie runs shown above): user nice system idle iowait irq softirq qaoed 17743 0 97690 372088 219027 11764 36914 vblade 2997 0 76768 4194 259915 10764 47072 ggaoed 17057 0 17075 95122 157 4605 30170 Gabor -- --------------------------------------------------------- MTA SZTAKI Computer and Automation Research Institute Hungarian Academy of Sciences --------------------------------------------------------- |
From: Tim P. <ec...@ec...> - 2009-11-13 04:24:19
|
Hi, On Thu, 2009-11-12 at 11:46 +0100, Gabor Gombas wrote: > Hi, > > I've released ggaoed 1.0, my AoE target implementation for Linux. It is > available at: > > http://code.google.com/p/ggaoed I'll be trying this on a production NAS with 2.6.31.6 sometime next week. I'm really happy to see the effort for a more advanced / elegant user space target is alive (not that I see anything wrong with vblade). Cheers, --Tim -- Monkey + Typewriter = Echoreply ( http://echoreply.us ) |