linuxdcpp-team team mailing list archive

[beefstick <951217@xxxxxxxxxxxxxxxxxx>]

Sorry forgot about this, work work work...

With change in source
idle
  PID USER      PR  NI  VIRT  RES  SHR S   %CPU %MEM    TIME+  COMMAND                                                                                                              
11787 me     21   1 1028m 146m  14m S      7  7.4   0:22.22 linuxdcpp

first file list 38.45MB
11787 me     21   1 1508m 387m  14m S      1 19.5   1:00.28 linuxdcpp

Closed no change

second file list 608.85kB
11787 me     21   1 1501m 387m  14m S      1 19.5   1:09.60 linuxdcpp

closed no change

match queue on file, memory increase
12152 me     21   1 1688m 434m  15m S      5 21.7   1:15.13 linuxdcpp


without change in source
idle
12061 me     21   1 1034m 148m  14m S      1  7.4   0:19.12 linuxdcpp

first file list
12061 me     21   1 1362m 374m  14m S      1 18.7   0:57.09 linuxdcpp

Closed no change

second file list
12061 me     21   1 1434m 374m  14m S      2 18.7   1:00.74 linuxdcpp          

closed no change

match queue on file, memory increase
12061 me     21   1 1642m 402m  14m S      0 20.0   1:18.76 linuxdcpp


As you can see the change in the source might even be a bad idea. When downloading a file list there is a bigger increase compared to the unchanged source. However, a match on queue shows a simmilar increase for both configurations.

As for now I have no further ideas what might be causing this behavior.
At the moment I manage by restarting my client after all file list
transfers are finished.

-- 
You received this bug notification because you are a member of LinuxDC++
Team, which is subscribed to LinuxDC++.
https://bugs.launchpad.net/bugs/951217

Title:
  excessive memory usage on file list download

Status in Linux DC++:
  Confirmed

Bug description:
  Description of the issue

  I have just downloaded a number of file lists ranging from several kB
  to several MB and this is what happens

  Mem:   2053260k total,  1891236k used,   162024k free,     2496k buffers
  Swap:  2095100k total,   255924k used,  1839176k free,   384880k cached

    PID USER      PR  NI  VIRT  RES  SHR S   %CPU %MEM    TIME+  COMMAND                                                                                                              
  27935 me      21   1 2250m 1.1g 8540 S      2    56.1   1:20.87 linuxdcpp 

  The filelists are all parsed correctly as they should but the memory usage increases to <insane> and stays that way forever.
  Since filelists are never re-used by the program in any way they should be unloaded from memory as well or at least placed into cached so that it can be overwritten.
  An other option is to create the possibility for downloading partial file lists to limit the use of RAM.

  Steps to reproduce

  Download several filelists of up to 60 MB or even more

  Expected result

  Increase of RAM usage to accommodate for parsing filelist, take out
  info needed, dump filelist to reduce RAM usage.

  Actual result

  Increase or RAM usage to accommodate for parsing filelist, take out
  info needed, leave unneeded info in RAM

  Version

  Compiled from latest BZR

  OS

  Opensuse 11.3 to 12.1

  No backtrace since no crash

To manage notifications about this bug go to:
https://bugs.launchpad.net/linuxdcpp/+bug/951217/+subscriptions