ffnet-users Mailing List for Feed-forward neural network for python
Status: Beta
Brought to you by:
mwojc
You can subscribe to this list here.
2008 |
Jan
|
Feb
|
Mar
|
Apr
|
May
|
Jun
|
Jul
|
Aug
|
Sep
|
Oct
|
Nov
(6) |
Dec
|
---|---|---|---|---|---|---|---|---|---|---|---|---|
2010 |
Jan
|
Feb
(2) |
Mar
|
Apr
|
May
|
Jun
|
Jul
|
Aug
|
Sep
|
Oct
|
Nov
|
Dec
|
2012 |
Jan
|
Feb
|
Mar
|
Apr
|
May
|
Jun
|
Jul
|
Aug
|
Sep
(2) |
Oct
(1) |
Nov
|
Dec
|
From: Sheila t. a. <fro...@gm...> - 2012-10-17 15:58:18
|
Thanks for kind response. It will be very helpful to new users if this information can be added to documentation :) Also is it possible to change the learning rate in this function or it optimize the learning rate also. On Mon, Sep 10, 2012 at 8:34 PM, Marek Wojciechowski <mwojc@p.lodz.pl>wrote: > Dnia poniedziałek 10 wrzesień 2012 18:57:05 Sheila the angel pisze: > > Hello ffnet-users, > > I am new to ANN and ffnet. > > I would like to know what do the function ffnet.train_tnc is for. > > In the document other training function have description like > > > > ffnet.train_momentum(input, target[, eta, ...]) Simple backpropagation > > training with momentum. > > > > but there is no description for ffnet.train_tnc ?? > > > > train_tnc calls `scipy.optimize.fmin_tnc` for minimization of the standard > cost fuction - the same as in train_momentum. This is the second order > quasi- > newton optimizer - it is generally faster and it generates usually better > results. > > Read the following for `scipy.optimize.fmin_tnc` documentation: > > http://docs.scipy.org/doc/scipy/reference/generated/scipy.optimize.fmin_tnc.html > > -- > Marek > > > ------------------------------------------------------------------------------ > Live Security Virtual Conference > Exclusive live event will cover all the ways today's security and > threat landscape has changed and how IT managers can respond. Discussions > will include endpoint security, mobile security and the latest in malware > threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/ > _______________________________________________ > Ffnet-users mailing list > Ffn...@li... > https://lists.sourceforge.net/lists/listinfo/ffnet-users > |
From: Marek W. <mwojc@p.lodz.pl> - 2012-09-10 18:49:40
|
Dnia poniedziałek 10 wrzesień 2012 18:57:05 Sheila the angel pisze: > Hello ffnet-users, > I am new to ANN and ffnet. > I would like to know what do the function ffnet.train_tnc is for. > In the document other training function have description like > > ffnet.train_momentum(input, target[, eta, ...]) Simple backpropagation > training with momentum. > > but there is no description for ffnet.train_tnc ?? > train_tnc calls `scipy.optimize.fmin_tnc` for minimization of the standard cost fuction - the same as in train_momentum. This is the second order quasi- newton optimizer - it is generally faster and it generates usually better results. Read the following for `scipy.optimize.fmin_tnc` documentation: http://docs.scipy.org/doc/scipy/reference/generated/scipy.optimize.fmin_tnc.html -- Marek |
From: Sheila t. a. <fro...@gm...> - 2012-09-10 16:57:11
|
Hello ffnet-users, I am new to ANN and ffnet. I would like to know what do the function ffnet.train_tnc is for. In the document other training function have description like ffnet.train_momentum(input, target[, eta, ...]) Simple backpropagation training with momentum. but there is no description for ffnet.train_tnc ?? Thanks -- Sheila |
From: Marek W. <mwojc@p.lodz.pl> - 2010-02-02 13:27:31
|
Dnia 02-02-2010 o 11:19:39 <Jan...@uk...> napisał(a): > > Hello everyone, > > The past couple of hours I have desperately tried to install ffnet on my > computer (Ubuntu 9.10 with a Linux 2.6.31-17-generic kernel on an x86 64 > bit architecture). > > My main problem is that there seems to be a problem with the --fcompiler > option of the setup.py script. > > Here's what I have tried so far: > > After downloading the lastest version I ran "sudo easy_install ffnet": > > Processing ffnet > Running setup.py -q bdist_egg --dist-dir > /home/fell/src/ffnet/egg-dist-tmp-scMbH4 > Could not locate executable g77 > Could not locate executable f77 > Could not locate executable ifort > Could not locate executable ifc > Could not locate executable lf95 > Could not locate executable pgf90 > Could not locate executable pgf77 > Could not locate executable f90 > Found executable /usr/bin/f95 > Could not locate executable fort > Could not locate executable efort > Could not locate executable efc > Found executable /usr/bin/gfortran > zip_safe flag not set; analyzing archive contents... > Adding ffnet 0.6.2 to easy-install.pth file > > Installed > /usr/local/lib/python2.6/dist-packages/ffnet-0.6.2-py2.6-linux-x86_64.egg > Processing dependencies for ffnet==0.6.2 > Finished processing dependencies for ffnet==0.6.2 > > Python returns "ImportError: No module named _ffnet" upon "import ffnet". > It seems you try to immport ffnet being in installation directory. Change working directory. Greetings, -- Marek |
From: <Jan...@uk...> - 2010-02-02 10:24:06
|
Hello everyone, The past couple of hours I have desperately tried to install ffnet on my computer (Ubuntu 9.10 with a Linux 2.6.31-17-generic kernel on an x86 64 bit architecture). My main problem is that there seems to be a problem with the --fcompiler option of the setup.py script. Here's what I have tried so far: After downloading the lastest version I ran "sudo easy_install ffnet": Processing ffnet Running setup.py -q bdist_egg --dist-dir /home/fell/src/ffnet/egg-dist-tmp-scMbH4 Could not locate executable g77 Could not locate executable f77 Could not locate executable ifort Could not locate executable ifc Could not locate executable lf95 Could not locate executable pgf90 Could not locate executable pgf77 Could not locate executable f90 Found executable /usr/bin/f95 Could not locate executable fort Could not locate executable efort Could not locate executable efc Found executable /usr/bin/gfortran zip_safe flag not set; analyzing archive contents... Adding ffnet 0.6.2 to easy-install.pth file Installed /usr/local/lib/python2.6/dist-packages/ffnet-0.6.2-py2.6-linux-x86_64.egg Processing dependencies for ffnet==0.6.2 Finished processing dependencies for ffnet==0.6.2 Python returns "ImportError: No module named _ffnet" upon "import ffnet". 'f2py -c --help-fcompiler" suggests gnu95 to be used as Fortran compiler, so I tried "python setup.py install --fcompiler=intel" resulting in "error: option --fcompiler not recognized". I am lost here and would appreciate any help. Cheers, Jan |
From: Marek W. <mwojc@p.lodz.pl> - 2008-11-11 10:45:49
|
Dnia wtorek 11 listopad 2008, napisałeś: > Dear Mr Wojciechowski, > > Please excuse the unsolicited contact, I found your email address in the > copyright notice of (the excellent) ffnet.f which I downloaded via > scipy.org .. > > I am evaluating neural network implementations for a private project and > have a question which I would very much appreciate your answer to. > > I have a requirement to have an unseeen validation set alongside the > training set. Periodically during training I need to compute the error > against the unseeen validation set to test whether the network has true > predictive capabilities as a safeguard against over-fitting. The objective > is to select the network which gives the best balance between the overall > error and the error against the unseen data. > > I have not yet found a network implementation which allows this and am > contemplating creating it for myself. In practice all I think I need is > the ability to provide a callback and a parameter which governs how many > training iterations pass between calls. My question is whether you think > it is possible to extend the implementation you have provided to have this > additional feature, and if so, where would it best be placed? > > My preliminary investigation suggests that it would require alteration to > _ffnet.f. Not being a Fortran expert I am not sure whether the language > even supports callbacks, but if it does I am sure I can figure out how to > do it. > > I would appreciate any guidance you feel able to provide and look forward > to hearing from you. > > Kind regards > Simon Palmer Hallo! You can do this externally in python, and i think this is the best way to do so: validation_error = 1e20 best_weights = net.weights.copy() for iter in xrange(0, maxiter, 50): net.train_tnc(input, target, maxiter = iter, messages = 1) verr = net.sqerror(validation_input, validation_target) if verr < validation_error: best_weights = net.weights.copy() validation_error = verr print "Validation OK" else: net.weights = best_weights.copy() print "Validation failed. Keeped weights from previous step." break Obviously this is raw recipe and it can be extended. Maybe you're right i should add something like that in ffnet... Greetings, -- Marek Wojciechowski P.S. I invite you at ffn...@li... |
From: Josh K. <sch...@gm...> - 2008-11-06 22:40:04
|
On Thu, Nov 6, 2008 at 5:28 PM, Marek Wojciechowski <mwojc@p.lodz.pl> wrote: > >> INSTRUCTIONS: >> Don't forget to install the "python-dev" package on Ubuntu to get >> ffnet to build. The compiling of ffnet's C code (e.g. _ffnetmodule.c) >> depends on finding "Python.h", which is included only in this extra >> package, not the stock python install. I recommend ffnet's README file >> be updated to note that you do need the Python header files available >> under the Requirements section. Right now, only "python 2.3.5 or >> above", numpy, scipy, and networkx are listed under the Requirements. >> >> Apart from the "python-dev" package, the other packages I needed to >> install ffnet on Ubuntu were: >> >> * subversion (to check out the latest code) >> * python-numpy >> * python-scipy >> * g77 >> * gfortran (I think you should only need g77 OR gfortran) >> > > Hi! > I updated README to reflect your considerations. However, in the future, i > think it would be nice to have binary packages of ffnet for main Linux > distributions (just to avoid compiling)... > > Greetings, > -- > Marek Wojciechowski Marek, Thanks for the quick update. And I definitely agree on the importance of having binary packages available. Seems like just about everyone is using Ubuntu these days, and I was a little surprised to discover there wasn't a .deb out there for ffnet. I've learned the hard way how handy it is to have prebuilt binaries around. I spent the last two days, unsuccessfully, trying to get ffnet to build under a local user account on minimal installs of Centos 4.x / 5.x . Getting BLAS and the stuff that scipy/numpy depend on is a *nightmare* when building from source. I eventually just gave up and moved to Ubuntu images running under VMWare. I've never tried building .deb's before, but I suppose it can't be that hard.. I'll give it a shot. Josh > > ------------------------------------------------------------------------- > This SF.Net email is sponsored by the Moblin Your Move Developer's challenge > Build the coolest Linux based applications with Moblin SDK & win great prizes > Grand prize is a trip for two to an Open Source event anywhere in the world > http://moblin-contest.org/redirect.php?banner_id=100&url=/ > _______________________________________________ > Ffnet-users mailing list > Ffn...@li... > https://lists.sourceforge.net/lists/listinfo/ffnet-users > |
From: Marek W. <mwojc@p.lodz.pl> - 2008-11-06 22:27:33
|
> INSTRUCTIONS: > Don't forget to install the "python-dev" package on Ubuntu to get > ffnet to build. The compiling of ffnet's C code (e.g. _ffnetmodule.c) > depends on finding "Python.h", which is included only in this extra > package, not the stock python install. I recommend ffnet's README file > be updated to note that you do need the Python header files available > under the Requirements section. Right now, only "python 2.3.5 or > above", numpy, scipy, and networkx are listed under the Requirements. > > Apart from the "python-dev" package, the other packages I needed to > install ffnet on Ubuntu were: > > * subversion (to check out the latest code) > * python-numpy > * python-scipy > * g77 > * gfortran (I think you should only need g77 OR gfortran) > Hi! I updated README to reflect your considerations. However, in the future, i think it would be nice to have binary packages of ffnet for main Linux distributions (just to avoid compiling)... Greetings, -- Marek Wojciechowski |
From: Josh K. <sch...@gm...> - 2008-11-06 20:41:57
|
Hello, So this was going to be a long email asking for help getting ffnet to build on clean VMWare images of Ubuntu 7.10 and 8.04. Right before I was about to send, though, I figured out what I was missing. I'm changing this email to be short install instructions for Ubuntu users who might run into the same problem I was. INSTRUCTIONS: Don't forget to install the "python-dev" package on Ubuntu to get ffnet to build. The compiling of ffnet's C code (e.g. _ffnetmodule.c) depends on finding "Python.h", which is included only in this extra package, not the stock python install. I recommend ffnet's README file be updated to note that you do need the Python header files available under the Requirements section. Right now, only "python 2.3.5 or above", numpy, scipy, and networkx are listed under the Requirements. Apart from the "python-dev" package, the other packages I needed to install ffnet on Ubuntu were: * subversion (to check out the latest code) * python-numpy * python-scipy * g77 * gfortran (I think you should only need g77 OR gfortran) Josh |
From: Marek W. <mwojc@p.lodz.pl> - 2008-11-05 09:25:01
|
Dnia wtorek 04 listopad 2008, Josh Kupershmidt napisał: > Hello, > Apologies if this is being sent to the wrong mailing list; I didn't > see a dev-specific mailing list for ffnet. I've recently started using > fffnet for some in-house data classification (identifying domains > responsible for sending spam emails) with fantastic results, and > wanted to contribute a small set of changes (just a few typofixes and > error logging fixes). I wasn't sure how actively this project is being > maintained, so I'm sort of testing the waters to see whether it's > worthwile sending further patches in :) > > Anyway, a small patch is attached, against SVN revision r260 (should > be the most recent). I was able to apply the patch using "patch -p0 < > ffnet_diff.out" in the main "ffnet" directory. Hope this helps. > > Josh Kupershmidt Hallo! Thanks for patches. Applied in r263. Do not hesitate to send more... Greetings, -- Marek Wojciechowski |
From: Josh K. <sch...@gm...> - 2008-11-04 20:28:50
|
Hello, Apologies if this is being sent to the wrong mailing list; I didn't see a dev-specific mailing list for ffnet. I've recently started using fffnet for some in-house data classification (identifying domains responsible for sending spam emails) with fantastic results, and wanted to contribute a small set of changes (just a few typofixes and error logging fixes). I wasn't sure how actively this project is being maintained, so I'm sort of testing the waters to see whether it's worthwile sending further patches in :) Anyway, a small patch is attached, against SVN revision r260 (should be the most recent). I was able to apply the patch using "patch -p0 < ffnet_diff.out" in the main "ffnet" directory. Hope this helps. Josh Kupershmidt |