RE: Query random paths?
Status: Alpha
Brought to you by:
coroberti
From: Val S. <Val...@no...> - 2009-07-24 18:25:46
|
I'm not an expert on curl-loader and I have not used the url templates yet. The way I do it is literally generate all the urls in the urls section and set FETCH_PROBABILITY on each url to a low value, e.g 2., so it looks like this: ########### GENERAL SECTION ################################ BATCH_NAME = random-picked-urls CLIENTS_NUM_MAX = 35 INTERFACE = eth1 NETMASK = 255.255.0.0 IP_ADDR_MIN = 10.2.1.2 IP_ADDR_MAX = 10.2.1.201 CYCLES_NUM = -1 URLS_NUM = 5000 ########### URL SECTION #################################### URL = http://www.XYZ.NET/ URL_SHORT_NAME = "badurl1" REQUEST_TYPE = GET TIMER_URL_COMPLETION = 0 TIMER_AFTER_URL_SLEEP = 0 FETCH_PROBABILITY = 2 FETCH_PROBABILITY_ONCE = 0 URL = http://www.XYZ1.NET/ URL_SHORT_NAME = "badurl2" REQUEST_TYPE = GET TIMER_URL_COMPLETION = 0 TIMER_AFTER_URL_SLEEP = 0 FETCH_PROBABILITY = 2 FETCH_PROBABILITY_ONCE = 0 .... >-----Original Message----- >From: Jan Wielemaker [mailto:J.W...@cs...] >Sent: Friday, July 24, 2009 6:25 AM >To: cur...@li... >Subject: Query random paths? > >Hi, > >Just trying my first steps into curl-loader :-) I looked through the FAQ >and config files, but I couldn't find an answer on how to query a *lot* of >random paths using a pool of -lets say- 20 clients. > >I see we have FORM_RECORDS_RANDOM, which seems to do the trick for >form-data. I am trying to debug server crashes, where I know it is >related to concurrency, but otherwise I have little clue on whether or >not it is related to the actual query paths. > >Just to bash the server, I collected a list of 6,000 paths that have >been queried on the server recently and then I use the config below, but >curl-loader only seems to use the first 20 paths of the file :-( > >Did I overlook something trivial? > > Cheers --- Jan > >================================================================ >BATCH_NAME= bulk >CLIENTS_NUM_MAX=20 >CLIENTS_NUM_START=20 >CLIENTS_RAMPUP_INC=0 >INTERFACE=eth0 >NETMASK=16 >IP_ADDR_MIN= 192.168.1.1 >IP_ADDR_MAX= 192.168.1.200 >IP_SHARED_NUM=200 >CYCLES_NUM= -1 >URLS_NUM= 1 > >URL_TEMPLATE=http://localhost:3040%s >URL_TOKEN_FILE=paths >URL_SHORT_NAME="local-server" >REQUEST_TYPE=GET >TIMER_URL_COMPLETION = 5000 >TIMER_AFTER_URL_SLEEP = 0 >================================================================ > > > > >--------------------------------------------------------------------------- >--- >_______________________________________________ >curl-loader-devel mailing list >cur...@li... >https://lists.sourceforge.net/lists/listinfo/curl-loader-devel |