sts-sponsors team mailing list archive

[Simon Poirier <1685885@xxxxxxxxxxxxxxxxxx>]

** Description changed:

+ [Impact]
+ 
+  * Memory usage of landscape processes abnormally grows, over time,
+    even for processes which are generally idle and have no reason to
+    grow.
+ 
+  * Most of that memory leak is due to uninitialized python-twisted
+    logging facilities buffering logs and their context. This fix
+    Initializes logging with a null handler to have those unused log
+    entries discarded.
+ 
+  * Upstream twisted has mitigated part of the issue in recent releases
+    by reducing the default buffer size. Because of that, the impact
+    of this bug is greater on xenial. 
+ 
+ [Test Case]
+ 
+  * register a landscape client and log the memory growth over a day
+ 
+  * the effect is most noticeable on /usr/bin/landscape-client and less on
+    the other processes
+ 
+  * the memory difference on recent releases (bionic and up) is
+    expected to be smaller (~10mb on bionic instead of 200mb on xenial) 
+ 
+ [Regression Potential]
+ 
+  * The fix initializes twisted logging, which is unused by landscape
+    so it is unlikely to have an impact.
+ 
+  * The fix comes from recommendations on the upstream bug:
+    https://twistedmatrix.com/trac/ticket/8164
+ 
+ [Original description]
+ 
  This has been noticed on several systems of mine, all 16.04.
  
  Landscape Client takes up, over time, an *extreme* amount of system
  resources.
  
  On a 1024MB RAM system, within 3 days to a month, Landscape Client and
  it's python scripts (possibly cached data?) are consuming massive
  quantities of memory - in the realm of 512MB RAM and over 400MB of the
  Swap on the system.
  
  This is repeatably shown in other systems of mine as well.  Is there a
  memory leak or something in landscape-client that would contribute to
  this issue?
  
  ProblemType: Bug
  DistroRelease: Ubuntu 16.04
  Package: landscape-client 16.03-0ubuntu2.16.04.1
  ProcVersionSignature: Ubuntu 4.4.0-72.93-generic 4.4.49
  Uname: Linux 4.4.0-72-generic x86_64
  NonfreeKernelModules: talpa_vfshook talpa_pedconnector talpa_vcdevice talpa_core talpa_linux talpa_syscallhook talpa_pedevice
  ApportVersion: 2.20.1-0ubuntu2.5
  Architecture: amd64
  Date: Mon Apr 24 14:42:37 2017
  InstallationDate: Installed on 2017-04-02 (21 days ago)
  InstallationMedia: Ubuntu-Server 16.04 LTS "Xenial Xerus" - Release amd64 (20160420.3)
  ProcEnviron:
-  TERM=xterm-256color
-  PATH=(custom, no user)
-  XDG_RUNTIME_DIR=<set>
-  LANG=en_US.UTF-8
-  SHELL=/bin/bash
+  TERM=xterm-256color
+  PATH=(custom, no user)
+  XDG_RUNTIME_DIR=<set>
+  LANG=en_US.UTF-8
+  SHELL=/bin/bash
  SourcePackage: landscape-client
  UpgradeStatus: No upgrade log present (probably fresh install)
- --- 
+ ---
  ApportVersion: 2.20.1-0ubuntu2.5
  Architecture: amd64
  DistroRelease: Ubuntu 16.04
  InstallationDate: Installed on 2017-04-02 (21 days ago)
  InstallationMedia: Ubuntu-Server 16.04 LTS "Xenial Xerus" - Release amd64 (20160420.3)
  Package: landscape-client 16.03-0ubuntu2.16.04.1
  PackageArchitecture: amd64
  ProcEnviron:
-  TERM=xterm-256color
-  PATH=(custom, no user)
-  XDG_RUNTIME_DIR=<set>
-  LANG=en_US.UTF-8
-  SHELL=/bin/bash
+  TERM=xterm-256color
+  PATH=(custom, no user)
+  XDG_RUNTIME_DIR=<set>
+  LANG=en_US.UTF-8
+  SHELL=/bin/bash
  ProcVersionSignature: Ubuntu 4.4.0-72.93-generic 4.4.49
  Tags: third-party-packages xenial
  Uname: Linux 4.4.0-72-generic x86_64
  UpgradeStatus: No upgrade log present (probably fresh install)
  UserGroups: adm cdrom dip lpadmin lxd plugdev sambashare sudo
  _MarkForUpload: True

-- 
You received this bug notification because you are a member of STS
Sponsors, which is subscribed to the bug report.
https://bugs.launchpad.net/bugs/1685885

Title:
  Extreme RAM and SWAP usage

Status in Landscape Client:
  Fix Committed
Status in landscape-client package in Ubuntu:
  In Progress
Status in landscape-client source package in Xenial:
  In Progress
Status in landscape-client source package in Bionic:
  In Progress
Status in landscape-client source package in Cosmic:
  In Progress

Bug description:
  [Impact]

   * Memory usage of landscape processes abnormally grows, over time,
     even for processes which are generally idle and have no reason to
     grow.

   * Most of that memory leak is due to uninitialized python-twisted
     logging facilities buffering logs and their context. This fix
     Initializes logging with a null handler to have those unused log
     entries discarded.

   * Upstream twisted has mitigated part of the issue in recent releases
     by reducing the default buffer size. Because of that, the impact
     of this bug is greater on xenial. 

  [Test Case]

   * register a landscape client and log the memory growth over a day

   * the effect is most noticeable on /usr/bin/landscape-client and less on
     the other processes

   * the memory difference on recent releases (bionic and up) is
     expected to be smaller (~10mb on bionic instead of 200mb on xenial) 

  [Regression Potential]

   * The fix initializes twisted logging, which is unused by landscape
     so it is unlikely to have an impact.

   * The fix comes from recommendations on the upstream bug:
     https://twistedmatrix.com/trac/ticket/8164

  [Original description]

  This has been noticed on several systems of mine, all 16.04.

  Landscape Client takes up, over time, an *extreme* amount of system
  resources.

  On a 1024MB RAM system, within 3 days to a month, Landscape Client and
  it's python scripts (possibly cached data?) are consuming massive
  quantities of memory - in the realm of 512MB RAM and over 400MB of the
  Swap on the system.

  This is repeatably shown in other systems of mine as well.  Is there a
  memory leak or something in landscape-client that would contribute to
  this issue?

  ProblemType: Bug
  DistroRelease: Ubuntu 16.04
  Package: landscape-client 16.03-0ubuntu2.16.04.1
  ProcVersionSignature: Ubuntu 4.4.0-72.93-generic 4.4.49
  Uname: Linux 4.4.0-72-generic x86_64
  NonfreeKernelModules: talpa_vfshook talpa_pedconnector talpa_vcdevice talpa_core talpa_linux talpa_syscallhook talpa_pedevice
  ApportVersion: 2.20.1-0ubuntu2.5
  Architecture: amd64
  Date: Mon Apr 24 14:42:37 2017
  InstallationDate: Installed on 2017-04-02 (21 days ago)
  InstallationMedia: Ubuntu-Server 16.04 LTS "Xenial Xerus" - Release amd64 (20160420.3)
  ProcEnviron:
   TERM=xterm-256color
   PATH=(custom, no user)
   XDG_RUNTIME_DIR=<set>
   LANG=en_US.UTF-8
   SHELL=/bin/bash
  SourcePackage: landscape-client
  UpgradeStatus: No upgrade log present (probably fresh install)
  ---
  ApportVersion: 2.20.1-0ubuntu2.5
  Architecture: amd64
  DistroRelease: Ubuntu 16.04
  InstallationDate: Installed on 2017-04-02 (21 days ago)
  InstallationMedia: Ubuntu-Server 16.04 LTS "Xenial Xerus" - Release amd64 (20160420.3)
  Package: landscape-client 16.03-0ubuntu2.16.04.1
  PackageArchitecture: amd64
  ProcEnviron:
   TERM=xterm-256color
   PATH=(custom, no user)
   XDG_RUNTIME_DIR=<set>
   LANG=en_US.UTF-8
   SHELL=/bin/bash
  ProcVersionSignature: Ubuntu 4.4.0-72.93-generic 4.4.49
  Tags: third-party-packages xenial
  Uname: Linux 4.4.0-72-generic x86_64
  UpgradeStatus: No upgrade log present (probably fresh install)
  UserGroups: adm cdrom dip lpadmin lxd plugdev sambashare sudo
  _MarkForUpload: True

To manage notifications about this bug go to:
https://bugs.launchpad.net/landscape-client/+bug/1685885/+subscriptions