Menu
▾
▴
Re: [mpgraph-developers] The compilation does not go through for PageRank.
|
From: leon s. <s5...@vt...> - 2015-03-31 22:56:35
|
Hi all, Thank you for helping us resolving our problems and now everything works well. I am trying to reproduce the runs you guys did for your paper "MapGraph: A High Level API for Fast Development of High Performance Graph Analytics on GPUs " on comparing with Medusha and b40c. I know mapgraph is based on b40c and I saw a folder inside of mapgraph trunk. Could you please direct me to the implementations of b40c and Medusha you used to compare in your paper? Can I directly run test cases using b40c using the current mapgraph source codes? I want to test the four algorithms you have right now , which are CC, SSSP, BFS and PageRank. Thanks! On Thu, Feb 26, 2015 at 4:59 PM, James Lewis <jl...@sy...> wrote: > Leon, > > With regards to your problem (2): to set the max queue sizing to a > non-default value add `-p max_queue_sizing=X.X` where X.X is replaced by a > floating point number. The max queue size is the specified number > multiplied by the number of nodes (for vertex frontiers) or the number of > edges (for edge frontiers). > > Hope this helps. > > Cheers, > > James > > ________________ > James Lewis > CUDA Researcher > Systap LLC > jl...@sy... > > Blazegraph™ <http://www.blazegraph.com/> is our ultra high-performance > graph database that supports both RDF/SPARQL and Tinkerpop/Blueprints APIs. > MapGraph™ <http://www.systap.com/mapgraph> is our disruptive new > technology to use GPUs to accelerate data-parallel graph analytics. > > CONFIDENTIALITY NOTICE: This email and its contents and attachments are > for the sole use of the intended recipient(s) and are confidential or > proprietary to SYSTAP, LLC. Any unauthorized review, use, disclosure, > dissemination or copying of this email or its contents or attachments is > prohibited. If you have received this communication in error, please notify > the sender by reply email and permanently delete all copies of the email > and its contents and attachments. > > On Thu, Feb 26, 2015 at 2:50 PM, leon sung <s5...@vt...> wrote: > >> Hi Brad, >> >> I just tested the new code on our k20 node and it compiles successfully >> with PageRank. Also, I tested all the large data sets and PageRank number >> looks fine. I am still having the following two problems though: >> >> 1. bitcoin.mtx: Error parsing MARKET graph: invalid problem description >> when parsing Market coo format. This error happens for all four >> algorithms (BFS, SSSP, CC and PageRank). >> 2. CC algorithm has frontier queue overflow problems. For example, an >> error like this: queue size: 217098, Frontier queue overflow (162823). >> Please increase queue-sizing factor. CC fails for the large datasets right >> now because of the same reason. My question is how to properly increase the >> queue-sizing factor for the case of CC? >> >> Other than the two above, the rest datasets run without problems and >> results seem correct. >> >> >> Thanks, >> >> >> On Thu, Feb 26, 2015 at 8:20 AM, Brad Bebee <be...@sy...> wrote: >> >>> Leon, >>> >>> This compiled under CUDA 6.5 with Macbook running Darwin. >>> >>> Thanks, --Brad >>> >>> On Thu, Feb 26, 2015 at 11:18 AM, leon sung <s5...@vt...> wrote: >>> >>>> cool. thanks. Let me try it and let you know. >>>> >>>> On Thu, Feb 26, 2015 at 8:15 AM, Brad Bebee <be...@sy...> wrote: >>>> >>>>> Leon, >>>>> >>>>> I just committed a change that resolves the compilation issue. Let >>>>> us know how things go with the research effort. >>>>> >>>>> >>>>> https://sourceforge.net/p/mpgraph/code_git/ci/dc87493367d13d06477b7b8b931ac6f7fac4e99a/ >>>>> >>>>> Thanks, --Brad >>>>> >>>>> On Thu, Feb 26, 2015 at 10:51 AM, Brad Bebee <be...@sy...> wrote: >>>>> >>>>>> Leon, >>>>>> >>>>>> Thanks. We've move the repository over to Git on SF. We're working >>>>>> to track down where the error was introduced. >>>>>> >>>>>> Thanks, --Brad >>>>>> >>>>>> On Thu, Feb 26, 2015 at 3:55 AM, leon sung <s5...@vt...> wrote: >>>>>> >>>>>>> Hi Brad, >>>>>>> >>>>>>> Me and my student Dipanjian are just trying to use mapgraph results >>>>>>> for a research paper study. If you guys can fix this within 3 weeks, that >>>>>>> will be great. The other three algorithms compile fine . It is just >>>>>>> pagerank is giving me problems for compilation.' >>>>>>> >>>>>>> Thanks for the quick response. >>>>>>> >>>>>>> cheers, >>>>>>> >>>>>>> On Wed, Feb 25, 2015 at 2:11 PM, Brad Bebee <be...@sy...> >>>>>>> wrote: >>>>>>> >>>>>>>> Leon, >>>>>>>> >>>>>>>> Thank you for your interest in mapgraph. We recognize that you are >>>>>>>> having a difficulty with the page rank compilation. We resolved this in >>>>>>>> our development version and have this on our backlog to resolve the matter >>>>>>>> against the published open source version of mapgraph. Unfortunately, we >>>>>>>> are quite busy this week and next getting ready for our presentations at >>>>>>>> the upcoming NVIDIA GTC conference. >>>>>>>> >>>>>>>> Would it make sense to setup a time to chat next week about your >>>>>>>> application? >>>>>>>> >>>>>>>> Thanks, --Brad >>>>>>>> >>>>>>>> On Wed, Feb 25, 2015 at 2:14 PM, leon sung <s5...@vt...> wrote: >>>>>>>> >>>>>>>>> To whom it may concern, >>>>>>>>> >>>>>>>>> >>>>>>>>> We are using a Tesla K20c card. And CUDA is 6.5. computing >>>>>>>>> compability is 3.5. >>>>>>>>> The problem I have is that when I compiled the code you linked to >>>>>>>>> me ( http://sourceforge.net/p/mpgraph/code/HEAD/tree/trunk ), it >>>>>>>>> does not pass pagerank. errors are like this: >>>>>>>>> >>>>>>>>> .... >>>>>>>>> make -C Algorithms/PageRank >>>>>>>>> make[1]: Entering directory >>>>>>>>> `/home/song/mapgraph/mpgraph-code/trunk/Algorithms/PageRank' >>>>>>>>> nvcc -c -o config.o config.cpp -O3 -lineinfo -I. -I../../ >>>>>>>>> -I../../moderngpu2/include -L../../moderngpu2 >>>>>>>>> -gencode=arch=compute_20,code=\"sm_20,compute_20\" >>>>>>>>> -gencode=arch=compute_35,code=\"sm_35,compute_35\" >>>>>>>>> nvcc -c -o PageRank.o PageRank.cu -O3 -lineinfo -I. -I../../ >>>>>>>>> -I../../moderngpu2/include -L../../moderngpu2 >>>>>>>>> -gencode=arch=compute_20,code=\"sm_20,compute_20\" >>>>>>>>> -gencode=arch=compute_35,code=\"sm_35,compute_35\" >>>>>>>>> ../../GASengine/enactor_vertex_centric.cuh(612): error: argument >>>>>>>>> of type "pagerank::MiscType *" is incompatible with parameter of type >>>>>>>>> "pagerank::DataType *" >>>>>>>>> detected during: >>>>>>>>> instantiation of "void >>>>>>>>> GASengine::EnactorVertexCentric<CsrProblem, Program, >>>>>>>>> INSTRUMENT>::expand_mgpu(CsrProblem::GraphSlice *, int &, int, int) [with >>>>>>>>> CsrProblem=GASengine::CsrProblem<pagerank, int, int, pagerank::DataType, >>>>>>>>> false, true>, Program=pagerank, INSTRUMENT=true]" >>>>>>>>> (2697): here >>>>>>>>> >>>>>>>>> >>>>>>>>> blah blah blah >>>>>>>>> >>>>>>>>> 6 errors detected in the compilation of "/tmp/tmpxft_00005686_ >>>>>>>>> 00000000-9_PageRank.compute_35.cpp1.ii". >>>>>>>>> make[1]: *** [PageRank.o] Error 2 >>>>>>>>> make[1]: Leaving directory >>>>>>>>> `/home/song/mapgraph/mpgraph-code/trunk/Algorithms/PageRank' >>>>>>>>> make: *** [Algorithms/PageRank.all] Error 2 >>>>>>>>> >>>>>>>>> >>>>>>>>> >>>>>>>>> Could you please help me with this? Thanks! >>>>>>>>> -- >>>>>>>>> Shuaiwen Leon Song >>>>>>>>> Research Scientist >>>>>>>>> High Performance Computing Group, >>>>>>>>> Pacific Northwest National Lab, >>>>>>>>> Washington, US, >>>>>>>>> office Phone:5093724189 >>>>>>>>> cell phone: 5409981906 >>>>>>>>> Email: shu...@pn... >>>>>>>>> HomePage: https://sites.google.com/site/shuaiwensongsresearch/ >>>>>>>>> >>>>>>>>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ >>>>>>>>> It is never too late to become what you might have been. ^ >>>>>>>>> -- George Elliot >>>>>>>>> ^ >>>>>>>>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ >>>>>>>>> >>>>>>>>> >>>>>>>>> ------------------------------------------------------------------------------ >>>>>>>>> Dive into the World of Parallel Programming The Go Parallel >>>>>>>>> Website, sponsored >>>>>>>>> by Intel and developed in partnership with Slashdot Media, is your >>>>>>>>> hub for all >>>>>>>>> things parallel software development, from weekly thought >>>>>>>>> leadership blogs to >>>>>>>>> news, videos, case studies, tutorials and more. Take a look and >>>>>>>>> join the >>>>>>>>> conversation now. http://goparallel.sourceforge.net/ >>>>>>>>> _______________________________________________ >>>>>>>>> mpgraph-developers mailing list >>>>>>>>> mpg...@li... >>>>>>>>> https://lists.sourceforge.net/lists/listinfo/mpgraph-developers >>>>>>>>> >>>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> -- >>>>>>>> _______________ >>>>>>>> Brad Bebee >>>>>>>> Managing Partner >>>>>>>> SYSTAP, LLC >>>>>>>> e: be...@sy... >>>>>>>> m: 202.642.7961 >>>>>>>> f: 571.367.5000 >>>>>>>> w: www.systap.com >>>>>>>> >>>>>>>> Blazegraph™ <http://www.blazegraph.com> is our ultra >>>>>>>> high-performance graph database that supports both RDF/SPARQL and >>>>>>>> Tinkerpop/Blueprints APIs. MapGraph™ >>>>>>>> <http://www.systap.com/mapgraph> is our disruptive new technology >>>>>>>> to use GPUs to accelerate data-parallel graph analytics. >>>>>>>> >>>>>>>> CONFIDENTIALITY NOTICE: This email and its contents and >>>>>>>> attachments are for the sole use of the intended recipient(s) and are >>>>>>>> confidential or proprietary to SYSTAP, LLC. Any unauthorized review, use, >>>>>>>> disclosure, dissemination or copying of this email or its contents or >>>>>>>> attachments is prohibited. If you have received this communication in >>>>>>>> error, please notify the sender by reply email and permanently delete all >>>>>>>> copies of the email and its contents and attachments. >>>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> -- >>>>>>> Shuaiwen Leon Song >>>>>>> Research Scientist >>>>>>> High Performance Computing Group, >>>>>>> Pacific Northwest National Lab, >>>>>>> Washington, US, >>>>>>> office Phone:5093724189 >>>>>>> cell phone: 5409981906 >>>>>>> Email: shu...@pn... >>>>>>> HomePage: https://sites.google.com/site/shuaiwensongsresearch/ >>>>>>> >>>>>>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ >>>>>>> It is never too late to become what you might have been. ^ >>>>>>> -- George Elliot >>>>>>> ^ >>>>>>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ >>>>>>> >>>>>> >>>>>> >>>>>> >>>>>> -- >>>>>> _______________ >>>>>> Brad Bebee >>>>>> Managing Partner >>>>>> SYSTAP, LLC >>>>>> e: be...@sy... >>>>>> m: 202.642.7961 >>>>>> f: 571.367.5000 >>>>>> w: www.systap.com >>>>>> >>>>>> Blazegraph™ <http://www.blazegraph.com> is our ultra >>>>>> high-performance graph database that supports both RDF/SPARQL and >>>>>> Tinkerpop/Blueprints APIs. MapGraph™ >>>>>> <http://www.systap.com/mapgraph> is our disruptive new technology to >>>>>> use GPUs to accelerate data-parallel graph analytics. >>>>>> >>>>>> CONFIDENTIALITY NOTICE: This email and its contents and attachments >>>>>> are for the sole use of the intended recipient(s) and are confidential or >>>>>> proprietary to SYSTAP, LLC. Any unauthorized review, use, disclosure, >>>>>> dissemination or copying of this email or its contents or attachments is >>>>>> prohibited. If you have received this communication in error, please notify >>>>>> the sender by reply email and permanently delete all copies of the email >>>>>> and its contents and attachments. >>>>>> >>>>> >>>>> >>>>> >>>>> -- >>>>> _______________ >>>>> Brad Bebee >>>>> Managing Partner >>>>> SYSTAP, LLC >>>>> e: be...@sy... >>>>> m: 202.642.7961 >>>>> f: 571.367.5000 >>>>> w: www.systap.com >>>>> >>>>> Blazegraph™ <http://www.blazegraph.com> is our ultra high-performance >>>>> graph database that supports both RDF/SPARQL and Tinkerpop/Blueprints >>>>> APIs. MapGraph™ <http://www.systap.com/mapgraph> is our disruptive >>>>> new technology to use GPUs to accelerate data-parallel graph analytics. >>>>> >>>>> CONFIDENTIALITY NOTICE: This email and its contents and attachments >>>>> are for the sole use of the intended recipient(s) and are confidential or >>>>> proprietary to SYSTAP, LLC. Any unauthorized review, use, disclosure, >>>>> dissemination or copying of this email or its contents or attachments is >>>>> prohibited. If you have received this communication in error, please notify >>>>> the sender by reply email and permanently delete all copies of the email >>>>> and its contents and attachments. >>>>> >>>>> >>>>> ------------------------------------------------------------------------------ >>>>> Dive into the World of Parallel Programming The Go Parallel Website, >>>>> sponsored >>>>> by Intel and developed in partnership with Slashdot Media, is your hub >>>>> for all >>>>> things parallel software development, from weekly thought leadership >>>>> blogs to >>>>> news, videos, case studies, tutorials and more. Take a look and join >>>>> the >>>>> conversation now. http://goparallel.sourceforge.net/ >>>>> _______________________________________________ >>>>> mpgraph-developers mailing list >>>>> mpg...@li... >>>>> https://lists.sourceforge.net/lists/listinfo/mpgraph-developers >>>>> >>>>> >>>> >>>> >>>> -- >>>> Shuaiwen Leon Song >>>> Research Scientist >>>> High Performance Computing Group, >>>> Pacific Northwest National Lab, >>>> Washington, US, >>>> office Phone:5093724189 >>>> cell phone: 5409981906 >>>> Email: shu...@pn... >>>> HomePage: https://sites.google.com/site/shuaiwensongsresearch/ >>>> >>>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ >>>> It is never too late to become what you might have been. ^ >>>> -- George Elliot >>>> ^ >>>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ >>>> >>> >>> >>> >>> -- >>> _______________ >>> Brad Bebee >>> Managing Partner >>> SYSTAP, LLC >>> e: be...@sy... >>> m: 202.642.7961 >>> f: 571.367.5000 >>> w: www.systap.com >>> >>> Blazegraph™ <http://www.blazegraph.com> is our ultra high-performance >>> graph database that supports both RDF/SPARQL and Tinkerpop/Blueprints >>> APIs. MapGraph™ <http://www.systap.com/mapgraph> is our disruptive new >>> technology to use GPUs to accelerate data-parallel graph analytics. >>> >>> CONFIDENTIALITY NOTICE: This email and its contents and attachments >>> are for the sole use of the intended recipient(s) and are confidential or >>> proprietary to SYSTAP, LLC. Any unauthorized review, use, disclosure, >>> dissemination or copying of this email or its contents or attachments is >>> prohibited. If you have received this communication in error, please notify >>> the sender by reply email and permanently delete all copies of the email >>> and its contents and attachments. >>> >>> >>> ------------------------------------------------------------------------------ >>> Dive into the World of Parallel Programming The Go Parallel Website, >>> sponsored >>> by Intel and developed in partnership with Slashdot Media, is your hub >>> for all >>> things parallel software development, from weekly thought leadership >>> blogs to >>> news, videos, case studies, tutorials and more. Take a look and join the >>> conversation now. http://goparallel.sourceforge.net/ >>> _______________________________________________ >>> mpgraph-developers mailing list >>> mpg...@li... >>> https://lists.sourceforge.net/lists/listinfo/mpgraph-developers >>> >>> >> >> >> -- >> Shuaiwen Leon Song >> Research Scientist >> High Performance Computing Group, >> Pacific Northwest National Lab, >> Washington, US, >> office Phone:5093724189 >> cell phone: 5409981906 >> Email: shu...@pn... >> HomePage: https://sites.google.com/site/shuaiwensongsresearch/ >> >> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ >> It is never too late to become what you might have been. ^ >> -- George Elliot >> ^ >> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ >> >> >> ------------------------------------------------------------------------------ >> Dive into the World of Parallel Programming The Go Parallel Website, >> sponsored >> by Intel and developed in partnership with Slashdot Media, is your hub >> for all >> things parallel software development, from weekly thought leadership >> blogs to >> news, videos, case studies, tutorials and more. Take a look and join the >> conversation now. http://goparallel.sourceforge.net/ >> _______________________________________________ >> mpgraph-developers mailing list >> mpg...@li... >> https://lists.sourceforge.net/lists/listinfo/mpgraph-developers >> >> > -- Shuaiwen Leon Song Research Scientist High Performance Computing Group, Pacific Northwest National Lab, Washington, US, office Phone:5093724189 cell phone: 5409981906 Email: shu...@pn... HomePage: https://sites.google.com/site/shuaiwensongsresearch/ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ It is never too late to become what you might have been. ^ -- George Elliot ^ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ |
