[RADIATOR] Memory leak in Radiator 4.5-1
Francisco Rodrigo Cortinas Maseda
francisco.cortinas at jazztel.com
Tue Jan 26 03:12:09 CST 2010
The way i insert requests is by this command:
radpwtst -time -iterations 10000 -trace 1 -s 192.168.2.3 -secret radius-2G-local -user vihy0007 at adsl -password acc03106 -auth_port 1850 -noacct NAS-Port-Id="ADSH2899999MAD01 atm 0/13/0/1:8.35%Up:1022kbps Down:20474kbps
I run this command in parallel from 4 machines, each running 4 processes. To be sure that Radiator is processing all the packets, i have configured this options on the client clause.
-----Mensaje original-----
De: Hugh Irvine [mailto:hugh at open.com.au]
Enviado el: martes 26 de enero de 2010 8:11
Para: Francisco Rodrigo Cortinas Maseda
CC: 'radiator at open.com.au'
Asunto: Re: [RADIATOR] Memory leak in Radiator 4.5-1
Hello Francisco -
Why are you using DupInterval 0 and NoIgnoreDuplicates?
regards
Hugh
On 26 Jan 2010, at 04:30, Francisco Rodrigo Cortinas Maseda wrote:
> Hi Hugh,
>
> I think i have found where the problem is; i have made this test:
>
> 1º Operating system: Fedora Core 12
> 2º Radiator software: 4.5.1
>
> The config i have used is:
>
> DefineFormattedGlobalVar operaciones 192.168.2.3
> DefineFormattedGlobalVar gestion 10.0.255.67 DefineFormattedGlobalVar
> i2p 192.168.2.3
>
> BindAddress %{GlobalVar:operaciones}
> FarmSize 6
> DbDir /opt/etc/radiator
> LogDir /var/log/radiator
> DictionaryFile %D/dictionary
> LogFile
> Trace 3
> AuthPort 1850
> AcctPort
> PidFile /var/run/radiusd_1850.pid
> <Log FILE>
> Filename %L/proxy2g-auth-%Y%m%d
> Trace 3
> </Log>
> <AuthBy INTERNAL>
> Identifier RAD2GDEF
> DefaultResult ACCEPT
> </AuthBy>
> <Handler Realm=/^adsl$/>
> AuthBy RAD2GDEF
> </Handler>
> <Handler>
> RewriteUsername s/(.*)@(.*)/$1/
> AuthBy RAD2GDEF
> </Handler>
>
> <Client 192.168.2.1>
> Secret radius-2G-local
> </Client>
> <Client 192.168.2.2>
> Secret radius-2G-local
> </Client>
> <Client 192.168.2.3>
> Secret radius-2G-local
> </Client>
> <Client 192.168.2.4>
> Secret radius-2G-local
> UseContentsForDuplicateDetection
> </Client>
> <Client 192.168.2.5>
> Secret radius-2G-local
> UseContentsForDuplicateDetection
> </Client>
> <Client 192.168.2.7>
> Secret radius-2G-local
> UseContentsForDuplicateDetection
> </Client>
> <Client 192.168.2.8>
> Secret radius-2G-local
> UseContentsForDuplicateDetection
> </Client>
>
>
> The memory is going off because the config of this clauses on the
> configuration of the clients:
>
> DupInterval 0
> NoIgnoreDuplicates Access-Request
>
> When removed, the process is not consuming memory. I have configured
> the option "UseContentsForDuplicateDetection" and randomize the
> username in order to confirm that launching the tests again the
> process is managing memory normally.
>
> Can you confirm that my tests can be reproduced by you?
>
> Regards,
>
> Francisco Rodrigo Cortiñas
>
> -----Mensaje original-----
> De: Francisco Rodrigo Cortinas Maseda
> Enviado el: viernes 22 de enero de 2010 11:09
> Para: 'Hugh Irvine'
> Asunto: RE: [RADIATOR] Memory leak in Radiator 4.5-1
>
>
> Hi,
>
> I have commented the FarmSize option on the config, and i had made
> another set of tests with this results:
>
> 1º On the first set of tests, the radiator process have consumed the
> 29% of the memory of the server:
>
> top - 10:27:35 up 3 days, 14:55, 3 users, load average: 0.04, 0.11, 0.12
> Tasks: 168 total, 1 running, 167 sleeping, 0 stopped, 0 zombie
> Cpu(s): 0.0%us, 0.0%sy, 0.0%ni, 99.9%id, 0.1%wa, 0.0%hi, 0.0%si, 0.0%st
> Mem: 4148640k total, 2105336k used, 2043304k free, 120344k buffers
> Swap: 5406712k total, 0k used, 5406712k free, 608076k cached
>
> PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND
> 23354 root 15 0 1208m 1.2g 1708 S 0.0 29.7 4:03.17 perl
> 3180 root 15 0 43612 11m 5048 S 0.0 0.3 0:00.26 setroubleshootd
> 3616 root 34 19 25656 10m 2152 S 0.0 0.3 0:00.02 yum-updatesd
> 3001 root 15 0 11584 9960 240 S 0.0 0.2 0:00.00 restorecond
>
> 2º We dont do any more tests; we wait 1 hour to check if the process
> is freeing memory. 3º After this, the process has not reduced his
> memory footprint:
>
> top - 11:24:48 up 3 days, 15:53, 3 users, load average: 0.07, 0.02, 0.00
> Tasks: 168 total, 1 running, 167 sleeping, 0 stopped, 0 zombie
> Cpu(s): 0.8%us, 0.0%sy, 0.0%ni, 99.2%id, 0.0%wa, 0.0%hi, 0.0%si, 0.0%st
> Mem: 4148640k total, 2110544k used, 2038096k free, 122512k buffers
> Swap: 5406712k total, 0k used, 5406712k free, 611904k cached
>
> PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND
> 23354 root 15 0 1208m 1.2g 1708 S 0.0 29.7 4:05.45 perl
> 3180 root 15 0 43612 11m 5048 S 0.0 0.3 0:00.26 setroubleshootd
> 3616 root 34 19 25656 10m 2152 S 0.0 0.3 0:00.02 yum-updatesd
> 3001 root 15 0 11584 9960 240 S 0.0 0.2 0:00.00 restorecond
> 3316 haldaemo 17 0 6008 4208 1688 S 0.0 0.1 0:00.65 hald
>
>
> 4º We made another set of test, and after this, we see that the
> process has consumed another 33% of the memory, to a total of 63%:
>
> top - 11:32:12 up 3 days, 16:00, 2 users, load average: 0.65, 0.65, 0.31
> Tasks: 167 total, 1 running, 166 sleeping, 0 stopped, 0 zombie
> Cpu(s): 0.0%us, 0.0%sy, 0.0%ni,100.0%id, 0.0%wa, 0.0%hi, 0.0%si, 0.0%st
> Mem: 4148640k total, 3507532k used, 641108k free, 122792k buffers
> Swap: 5406712k total, 0k used, 5406712k free, 612416k cached
>
> PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND
> 23354 root 15 0 2570m 2.5g 1708 S 0.0 63.3 10:28.36 perl
> 3180 root 15 0 43612 11m 5048 S 0.0 0.3 0:00.26 setroubleshootd
> 3616 root 34 19 25656 10m 2152 S 0.0 0.3 0:00.02 yum-updatesd
>
>
>
> 5º I have made another thing, stop the process, clean up the config,
> and run another test; with this new configuration (attached to this
> email) it shows that the process is very "hungry":
>
> top - 11:54:29 up 3 days, 16:22, 2 users, load average: 0.03, 0.29, 0.24
> Tasks: 167 total, 1 running, 166 sleeping, 0 stopped, 0 zombie
> Cpu(s): 0.0%us, 0.0%sy, 0.0%ni,100.0%id, 0.0%wa, 0.0%hi, 0.0%si, 0.0%st
> Mem: 4148640k total, 2228344k used, 1920296k free, 123340k buffers
> Swap: 5406712k total, 0k used, 5406712k free, 613092k cached
>
> PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND
> 23582 root 15 0 1322m 1.3g 1200 S 0.0 32.5 4:19.90 perl
> 3180 root 15 0 43612 11m 5048 S 0.0 0.3 0:00.26 setroubleshootd
> 3616 root 34 19 25656 10m 2152 S 0.0 0.3 0:00.02 yum-updatesd
>
>
>
> What else can we do to see why is it consuming so much memory and not
> freeing it?
>
> Thanks,
>
> Francisco Rodrigo Cortiñas
>
> -----Mensaje original-----
> De: Hugh Irvine [mailto:hugh at open.com.au]
> Enviado el: jueves 21 de enero de 2010 23:56
> Para: Francisco Rodrigo Cortinas Maseda
> Asunto: Re: [RADIATOR] Memory leak in Radiator 4.5-1
>
>
>
> Hello Francisco -
>
> Can you remind me whether you have the same problem without the
> FarmSize parameter enabled?
>
> Ie. is it only a problem with multiple processes?
>
> regards
>
> Hugh
>
>
> On 19 Jan 2010, at 22:00, Francisco Rodrigo Cortinas Maseda wrote:
>
>> Hi hugh,
>>
>> I have the debug output of 1 test, inserting 210K auth requests; the
>> compressed file is a 33MB file!! I have also recorded the output of
>> "vmstat 1", showing that the processes are not freeing the memory
>> they reclaim (attached to this email). The test is made with Perl
>> 5.10.
>>
>> Where can in upload the debug file?
>>
>> Also, we can do whatever check or test you want, we are doing the
>> tests in a "closed" enviroment, similar to a Lab.
>>
>> -----Mensaje original-----
>> De: radiator-bounces at open.com.au
>> [mailto:radiator-bounces at open.com.au]
>> En nombre de Francisco Rodrigo Cortinas Maseda Enviado el: martes 19
>> de enero de 2010 10:06
>> Para: 'Hugh Irvine'
>> CC: radiator at open.com.au
>> Asunto: Re: [RADIATOR] Memory leak in Radiator 4.5-1
>>
>>
>> Hi Hugh,
>>
>> Find attached my configuration; ill send you the traces as soon as i
>> finish some other test i have arranged today with other platforms and
>> services.
>>
>> Regards,
>>
>> -----Mensaje original-----
>> De: Hugh Irvine [mailto:hugh at open.com.au]
>> Enviado el: lunes 18 de enero de 2010 22:35
>> Para: Francisco Rodrigo Cortinas Maseda
>> CC: radiator at open.com.au
>> Asunto: Re: [RADIATOR] Memory leak in Radiator 4.5-1
>>
>>
>>
>> Hello Francisco -
>>
>> Without seeing a copy of your configuration file and a corresponding
>> trace 4 debug it is impossible to say what might be happening.
>>
>> Please send us the additional information and we'll take a look.
>>
>> regards
>>
>> Hugh
>>
>>
>> On 19 Jan 2010, at 02:01, Francisco Rodrigo Cortinas Maseda wrote:
>>
>>> Hi everybody,
>>>
>>> im suffering a memory leak on Radiator 4.5-1. My enviroment:
>>>
>>> RHEL AS 5.4 i386
>>>
>>> Installed perl stuff (from the default installation):
>>>
>>> perl-5.8.8-27.el5
>>> perl-String-CRC32-1.4-2.fc6
>>>
>>> Radiator has been installed as an RPM.
>>>
>>> Is there any memory leak bug detected on this version of Radiator?
>>>
>>> Note:: i have tested this also with RHEL AS 4.6 i386
>>>
>>>
>>> --------------------------------------------------------------------
>>> -
>>> -
>>> ----------
>>>
>>> Este mensaje es privado y CONFIDENCIAL y se dirige exclusivamente a
>>> su destinatario. Si usted ha recibido este mensaje por error, no
>>> debe revelar, copiar, distribuir o usarlo en ningún sentido. Le
>>> rogamos lo comunique al remitente y borre dicho mensaje y cualquier
>>> documento adjunto que pudiera contener. El correo electrónico via
>>> Internet no permite asegurar la confidencialidad de los mensajes que
>>> se transmiten ni su integridad o correcta recepción. JAZZTEL no
>>> asume responsabilidad por estas circunstancias. Si el destinatario
>>> de este mensaje no consintiera la utilización del correo electrónico
>>> via Internet y la grabación de los mensajes, rogamos lo ponga en
>>> nuestro conocimiento de forma inmediata.Cualquier opinión expresada
>>> en este mensaje pertenece únicamente al autor remitente, y no
>>> representa necesariamente la opinión de JAZZTEL, a no ser que
>>> expresamente se diga y el remitente esté autorizado para hacerlo.
>>>
>>>
>>> --------------------------------------------------------------------
>>> -
>>> -
>>> ----------
>>>
>>>
>>> This message is private and CONFIDENTIAL and it is intended
>>> exclusively for its addressee. If you receive this message in error,
>>> you should not disclose, copy, distribute this e-mail or use it in
>>> any other way. Please inform the sender and delete the message and
>>> attachments from your system.Internet e-mail neither guarantees the
>>> confidentiality nor the integrity or proper receipt of the messages
>>> sent. JAZZTEL does not assume any liability for those circumstances.
>>> If the addressee of this message does not consent to the use of
>>> Internet e-mail and message recording, please notify us
>>> immediately.Any views or opinions contained in this message are
>>> solely those of the author, and do not necessarily represent those
>>> of JAZZTEL, unless otherwise specifically stated and the sender is
>>> authorised to do so.
>>>
>>>
>>> --------------------------------------------------------------------
>>> -
>>> -
>>> ----------
>>> _______________________________________________
>>> radiator mailing list
>>> radiator at open.com.au http://www.open.com.au/mailman/listinfo/radiator
>>
>>
>>
>> NB:
>>
>> Have you read the reference manual ("doc/ref.html")?
>> Have you searched the mailing list archive
>> (www.open.com.au/archives/radiator)?
>> Have you had a quick look on Google (www.google.com)?
>> Have you included a copy of your configuration file (no secrets),
>> together with a trace 4 debug showing what is happening?
>>
>> --
>> Radiator: the most portable, flexible and configurable RADIUS server
>> anywhere. Available on *NIX, *BSD, Windows, MacOS X. Includes support
>> for reliable RADIUS transport (RadSec), and DIAMETER translation agent.
>> -
>> Nets: internetwork inventory and management - graphical, extensible, flexible with hardware, software, platform and database independence.
>> -
>> CATool: Private Certificate Authority for Unix and Unix-like systems.
>>
>>
>>
>>
>> Antes de imprimir este e-mail piense bien si es necesario hacerlo.
>>
>>
>> ---------------------------------------------------------------------
>> -
>> ----------
>>
>> Este mensaje es privado y CONFIDENCIAL y se dirige exclusivamente a
>> su destinatario. Si usted ha recibido este mensaje por error, no debe
>> revelar, copiar, distribuir o usarlo en ningún sentido. Le rogamos lo
>> comunique al remitente y borre dicho mensaje y cualquier documento
>> adjunto que pudiera contener. El correo electrónico via Internet no
>> permite asegurar la confidencialidad de los mensajes que se
>> transmiten ni su integridad o correcta recepción. JAZZTEL no asume
>> responsabilidad por estas circunstancias. Si el destinatario de este
>> mensaje no consintiera la utilización del correo electrónico via
>> Internet y la grabación de los mensajes, rogamos lo ponga en nuestro
>> conocimiento de forma inmediata.Cualquier opinión expresada en este
>> mensaje pertenece únicamente al autor remitente, y no representa
>> necesariamente la opinión de JAZZTEL, a no ser que expresamente se
>> diga y el remitente esté autorizado para hacerlo.
>>
>>
>> ---------------------------------------------------------------------
>> -
>> ----------
>>
>>
>> This message is private and CONFIDENTIAL and it is intended
>> exclusively for its addressee. If you receive this message in error,
>> you should not disclose, copy, distribute this e-mail or use it in
>> any other way. Please inform the sender and delete the message and
>> attachments from your system.Internet e-mail neither guarantees the
>> confidentiality nor the integrity or proper receipt of the messages
>> sent. JAZZTEL does not assume any liability for those circumstances.
>> If the addressee of this message does not consent to the use of
>> Internet e-mail and message recording, please notify us
>> immediately.Any views or opinions contained in this message are
>> solely those of the author, and do not necessarily represent those of
>> JAZZTEL, unless otherwise specifically stated and the sender is
>> authorised to do so.
>>
>>
>> ---------------------------------------------------------------------
>> -
>> ----------
>>
>> Antes de imprimir este e-mail piense bien si es necesario hacerlo.
>>
>>
>> ---------------------------------------------------------------------
>> -
>> ----------
>>
>> Este mensaje es privado y CONFIDENCIAL y se dirige exclusivamente a
>> su destinatario. Si usted ha recibido este mensaje por error, no debe
>> revelar, copiar, distribuir o usarlo en ningún sentido. Le rogamos lo
>> comunique al remitente y borre dicho mensaje y cualquier documento
>> adjunto que pudiera contener. El correo electrónico via Internet no
>> permite asegurar la confidencialidad de los mensajes que se
>> transmiten ni su integridad o correcta recepción. JAZZTEL no asume
>> responsabilidad por estas circunstancias. Si el destinatario de este
>> mensaje no consintiera la utilización del correo electrónico via
>> Internet y la grabación de los mensajes, rogamos lo ponga en nuestro
>> conocimiento de forma inmediata.Cualquier opinión expresada en este
>> mensaje pertenece únicamente al autor remitente, y no representa
>> necesariamente la opinión de JAZZTEL, a no ser que expresamente se
>> diga y el remitente esté autorizado para hacerlo.
>>
>>
>> ---------------------------------------------------------------------
>> -
>> ----------
>>
>>
>> This message is private and CONFIDENTIAL and it is intended
>> exclusively for its addressee. If you receive this message in error,
>> you should not disclose, copy, distribute this e-mail or use it in
>> any other way. Please inform the sender and delete the message and
>> attachments from your system.Internet e-mail neither guarantees the
>> confidentiality nor the integrity or proper receipt of the messages
>> sent. JAZZTEL does not assume any liability for those circumstances.
>> If the addressee of this message does not consent to the use of
>> Internet e-mail and message recording, please notify us
>> immediately.Any views or opinions contained in this message are
>> solely those of the author, and do not necessarily represent those of
>> JAZZTEL, unless otherwise specifically stated and the sender is
>> authorised to do so.
>>
>>
>> ---------------------------------------------------------------------
>> -
>> ----------
>> <vmstat_output.txt>
>
>
>
> NB:
>
> Have you read the reference manual ("doc/ref.html")?
> Have you searched the mailing list archive
> (www.open.com.au/archives/radiator)?
> Have you had a quick look on Google (www.google.com)?
> Have you included a copy of your configuration file (no secrets), together with a trace 4 debug showing what is happening?
>
> --
> Radiator: the most portable, flexible and configurable RADIUS server
> anywhere. Available on *NIX, *BSD, Windows, MacOS X. Includes support for reliable RADIUS transport (RadSec), and DIAMETER translation agent.
> -
> Nets: internetwork inventory and management - graphical, extensible, flexible with hardware, software, platform and database independence.
> -
> CATool: Private Certificate Authority for Unix and Unix-like systems.
>
>
>
>
> Antes de imprimir este e-mail piense bien si es necesario hacerlo.
>
>
> ----------------------------------------------------------------------
> ----------
>
> Este mensaje es privado y CONFIDENCIAL y se dirige exclusivamente a su
> destinatario. Si usted ha recibido este mensaje por error, no debe
> revelar, copiar, distribuir o usarlo en ningún sentido. Le rogamos lo
> comunique al remitente y borre dicho mensaje y cualquier documento
> adjunto que pudiera contener. El correo electrónico via Internet no
> permite asegurar la confidencialidad de los mensajes que se transmiten
> ni su integridad o correcta recepción. JAZZTEL no asume
> responsabilidad por estas circunstancias. Si el destinatario de este
> mensaje no consintiera la utilización del correo electrónico via
> Internet y la grabación de los mensajes, rogamos lo ponga en nuestro
> conocimiento de forma inmediata.Cualquier opinión expresada en este
> mensaje pertenece únicamente al autor remitente, y no representa
> necesariamente la opinión de JAZZTEL, a no ser que expresamente se
> diga y el remitente esté autorizado para hacerlo.
>
>
> ----------------------------------------------------------------------
> ----------
>
>
> This message is private and CONFIDENTIAL and it is intended
> exclusively for its addressee. If you receive this message in error,
> you should not disclose, copy, distribute this e-mail or use it in any
> other way. Please inform the sender and delete the message and
> attachments from your system.Internet e-mail neither guarantees the
> confidentiality nor the integrity or proper receipt of the messages
> sent. JAZZTEL does not assume any liability for those circumstances.
> If the addressee of this message does not consent to the use of
> Internet e-mail and message recording, please notify us
> immediately.Any views or opinions contained in this message are solely
> those of the author, and do not necessarily represent those of
> JAZZTEL, unless otherwise specifically stated and the sender is
> authorised to do so.
>
>
> ----------------------------------------------------------------------
> ----------
NB:
Have you read the reference manual ("doc/ref.html")?
Have you searched the mailing list archive (www.open.com.au/archives/radiator)?
Have you had a quick look on Google (www.google.com)?
Have you included a copy of your configuration file (no secrets), together with a trace 4 debug showing what is happening?
--
Radiator: the most portable, flexible and configurable RADIUS server anywhere. Available on *NIX, *BSD, Windows, MacOS X. Includes support for reliable RADIUS transport (RadSec), and DIAMETER translation agent.
-
Nets: internetwork inventory and management - graphical, extensible, flexible with hardware, software, platform and database independence.
-
CATool: Private Certificate Authority for Unix and Unix-like systems.
Antes de imprimir este e-mail piense bien si es necesario hacerlo.
--------------------------------------------------------------------------------
Este mensaje es privado y CONFIDENCIAL y se dirige exclusivamente a su destinatario. Si usted ha recibido este mensaje por error, no debe revelar, copiar, distribuir o usarlo en ningún sentido. Le rogamos lo comunique al remitente y borre dicho mensaje y cualquier documento adjunto que pudiera contener. El correo electrónico via Internet no permite asegurar la confidencialidad de los mensajes que se transmiten ni su integridad o correcta recepción. JAZZTEL no asume responsabilidad por estas circunstancias. Si el destinatario de este mensaje no consintiera la utilización del correo electrónico via Internet y la grabación de los mensajes, rogamos lo ponga en nuestro conocimiento de forma inmediata.Cualquier opinión expresada en este mensaje pertenece únicamente al autor remitente, y no representa necesariamente la opinión de JAZZTEL, a no ser que expresamente se diga y el remitente esté autorizado para hacerlo.
--------------------------------------------------------------------------------
This message is private and CONFIDENTIAL and it is intended exclusively for its addressee. If you receive this message in error, you should not disclose, copy, distribute this e-mail or use it in any other way. Please inform the sender and delete the message and attachments from your system.Internet e-mail neither guarantees the confidentiality nor the integrity or proper receipt of the messages sent. JAZZTEL does not assume any liability for those circumstances. If the addressee of this message does not consent to the use of Internet e-mail and message recording, please notify us immediately.Any views or opinions contained in this message are solely those of the author, and do not necessarily represent those of JAZZTEL, unless otherwise specifically stated and the sender is authorised to do so.
--------------------------------------------------------------------------------
More information about the radiator
mailing list