[Lame-dev] crash when using assembler routines

[Michael F. <fi...@as...>]

Hello,

I am compiling lame with HAVE_NASM, USE_FFT3DN, USE_FFTSSE and USE_FFTFPU 
defined. To encode, I call
lame_init(), lame_set_*(), lame_init_params(), lame_encode_buffer() (several 
times), lame_encode_flush() and lame_close().

When I restart encoding (e.g. when user has stopped it), I get an access 
violation in fft_long(), more exactly in the assembler routine that gets called 
by
    gfc->fft_fht(x, BLKSIZE/2);

As I'm currently working with a P2 (I suppose), no 3DNow or SSE routines get 
called, but the fht_FPU. The exact position of the crash is in line 104 of 
libmp3lame/i386/fftfpu.nas:

	fadd	dword [r1+r3]

	fld	dword [D_1_41421]
	fmul	dword [r1+r2]        <<--- access violation

	fld	dword [D_1_41421]

r1 obviously contains a pointer to a memory location, that is of length 0x2c, 
but r2 contains 0x30 as value. r1 points to a larger buffer that seems to hold 
some values. I can reproduce the crash and serve with more information if there 
is need.

bye
Michael
-- 
winlame: http://winlame.sourceforge.net
mic...@as... - http://www.vividos.de - icq: 6323332