Re: [Kaldi-developers] Memory grows when running latgen-faster-mapped

[Daniel P. <dp...@gm...>]

Guys, when looking at the code I discovered the memory leak.  It wasn't
detectable by valgrind, and the memory was deleted at the end of the
program, but it had the same effect as a memory leak.  It's fixed in the
trunk now.
Dan



On Wed, Aug 28, 2013 at 9:01 AM, Daniel Povey <dp...@gm...> wrote:

> That does sound like a memory leak-- try running it for just a few
> utterances with valgrind.   It's possible the memory leak happens only
> under certain rare circumstances, so if you don't see it there you may
> have to run for a thousand utterances or so and see if valgrind
> reports a leak.
> Dan
>
>
> On Wed, Aug 28, 2013 at 3:48 PM, Li Peng <lip...@gm...> wrote:
> > Sorry for that I don't know the details of how the program works, so I'm
> not
> > sure how to tune the options properly.
> >
> > The memory consumption grows little by little as the number of processed
> > utterances increases. When the program runs for one day, it grows from
> the
> > starting 100MB to several GB.
> >
> > 在 2013年8月28日 下午9:33，"Arnab Ghoshal" <ar...@gm...>写道：
> >
> >> It is possible for the lattice generation to take a lot of memory.
> >> Have you tried changing the --max-mem, --lattice-beam, --beam options
> >> to see if it runs properly? Also, does this happen for a particular
> >> utterance or all utterances?
> >> -Arnab
> >>
> >> On Wed, Aug 28, 2013 at 7:22 AM, Li Peng <lip...@gm...> wrote:
> >> > Hi,
> >> >
> >> > When I used latgen-faster-mapped with DNN model to generate lattices,
> I
> >> > observed that the memory usage keeps growing and exhausts the system's
> >> > memory at last. I tried to use valgrind to find if there's a memory
> >> > leak,
> >> > but got no clues. So I write to report this problem, but I'm not sure
> if
> >> > there is a bug or it is just my own case.
> >> >
> >> > Best regards,
> >> >
> >> > Li Peng
> >> >
> >> >
> >> >
> ------------------------------------------------------------------------------
> >> > Learn the latest--Visual Studio 2012, SharePoint 2013, SQL 2012, more!
> >> > Discover the easy way to master current and previous Microsoft
> >> > technologies
> >> > and advance your career. Get an incredible 1,500+ hours of
> step-by-step
> >> > tutorial videos with LearnDevNow. Subscribe today and save!
> >> >
> >> >
> http://pubads.g.doubleclick.net/gampad/clk?id=58040911&iu=/4140/ostg.clktrk
> >> > _______________________________________________
> >> > Kaldi-developers mailing list
> >> > Kal...@li...
> >> > https://lists.sourceforge.net/lists/listinfo/kaldi-developers
> >> >
> >
> >
> >
> ------------------------------------------------------------------------------
> > Learn the latest--Visual Studio 2012, SharePoint 2013, SQL 2012, more!
> > Discover the easy way to master current and previous Microsoft
> technologies
> > and advance your career. Get an incredible 1,500+ hours of step-by-step
> > tutorial videos with LearnDevNow. Subscribe today and save!
> >
> http://pubads.g.doubleclick.net/gampad/clk?id=58040911&iu=/4140/ostg.clktrk
> > _______________________________________________
> > Kaldi-developers mailing list
> > Kal...@li...
> > https://lists.sourceforge.net/lists/listinfo/kaldi-developers
> >
>