group.of.nepali.translators team mailing list archive
-
group.of.nepali.translators team
-
Mailing list archive
-
Message #45165
[Bug 1987738] Re: invalid json was written to "/var/lib/ubuntu-advantage/notices.json"
This bug was fixed in the package ubuntu-advantage-tools - 27.14.4~16.04
---------------
ubuntu-advantage-tools (27.14.4~16.04) xenial; urgency=medium
* Backport new upstream release: (LP: #2011477) to xenial
ubuntu-advantage-tools (27.14.4) lunar; urgency=medium
* timer: disable update_contract_info job (LP: #2015302)
* livepatch: prevent livepatch from auto-enabling and subsequently failing
on non-amd64 systems (LP: #2015241)
ubuntu-advantage-tools (27.14.3) lunar; urgency=medium
* livepatch: prevent livepatch from auto-enabling and subsequently failing
on interim releases (LP: #2013409)
ubuntu-advantage-tools (27.14.2~23.04.1) lunar; urgency=medium
* status:
- always use dpkg instead of lscpu for fetching architecture
information (LP: #2012735)
ubuntu-advantage-tools (27.14.1~23.04.1) lunar; urgency=medium
* New upstream release 27.14.1
- apt: fix a configuration leak in the apt.get_pkg_candidate_version
function (LP: #2012642)
ubuntu-advantage-tools (27.14~23.04.1) lunar; urgency=medium
* d/ubuntu-advantage-tools.{postinst,postrm,preinst}:
- migrate certain settings out of uaclient.conf to a new file managed by
the pro config subcommand (LP: #2004280)
* d/ubuntu-advantage-tools.postinst:
- refactor PREVIOUS_PKG_VER as a global variable
- simplify how we add notices
* New upstream release 27.14 (LP: #2011477)
- api: new u.unattended_upgrades.status.v1 endpoint for querying status of
unattended upgrades
- apt:
+ remove legacy apt-hook
+ deliver json apt-hook for interim releases
+ fix cloud identification logic in json apt-hook
+ make all calls to esm-cache isolated from system configuration
(LP: #2008280)
+ only set up the esm cache on supported systems (LP: #2004018)
- fix:
+ format the output to be more readable (LP: #1926182)
+ add option to attach during a fix without a token
+ verify if fixed version can be installed before trying (LP: #2006705)
- livepatch: show warning if current kernel is not supported
- locks: alert user about corrupted lock files (LP: #1996931)
- logging: logs are now formatted as jsonlines
- motd: remove esm-apps announcement
- notices: new representation on disk as separate files (LP: #1987738)
- realtime: remove ubuntu-realtime package on disablement
- status:
+ removed contract info update check network call
+ no longer includes warnings about notices when non-root (LP: #2006138)
+ unattached status sends virt type to contract server for better
resource availability calculation
- timer jobs: add daily job to check for contract updates
- yaml: always import distro-provided pyyaml (LP: #2007234, LP: #2007241)
-- Renan Rodrigo <renanrodrigo@xxxxxxxxxxxxx> Thu, 06 Apr 2023
10:50:05 -0300
** Changed in: ubuntu-advantage-tools (Ubuntu Xenial)
Status: Fix Committed => Fix Released
--
You received this bug notification because you are a member of नेपाली
भाषा समायोजकहरुको समूह, which is subscribed to Xenial.
Matching subscriptions: Ubuntu 16.04 Bugs
https://bugs.launchpad.net/bugs/1987738
Title:
invalid json was written to "/var/lib/ubuntu-advantage/notices.json"
Status in ubuntu-advantage-tools package in Ubuntu:
Fix Released
Status in ubuntu-advantage-tools source package in Xenial:
Fix Released
Status in ubuntu-advantage-tools source package in Bionic:
Fix Released
Status in ubuntu-advantage-tools source package in Focal:
Fix Released
Status in ubuntu-advantage-tools source package in Jammy:
Fix Released
Status in ubuntu-advantage-tools source package in Kinetic:
Fix Released
Bug description:
[Impact]
The /var/lib/ubuntu-advantage/notices.json file may get corrupted, as it is written by the CLI applications on specific situations (for example: contract change, reboot required), but it's also modified by the background services executed by the tool.
The mitigation here is done through three changes:
- writing each notice to its own file, so different notices are not written to the same file
- do not use JSON, but save plain text files instead
- make sure writes are atomic (write to tmp, move to the correct directory)
[Test Case]
On a VM running u-a-t 27.13.6:
- attach a token
- create an invalid notices.json, with the content below
```
[["", "FIPS support requires system reboot to complete configuration."]] ["", "Operation in progress: timer metering job"]]]
```
- run `pro status`, see that it fails
- upgrade to version >= 27.14
- run `pro status`, see that a) it runs and b) the reboot message is kept at best effort
- verify the /var/run/ubuntu-advantage/notices directory exists and has the reboot notice
- verify this reboot notice has no json content
- verify that /var/lib/ubuntu-advantage/notices.json does not exist anymore.
[Regression Potential]
Notices are now defined in the code, and just represented in files in /var/lib or /var/run.
The changes in the code will ignore any unknown notice file - which means that if we create some valid file with the wrong name, this notice will not be shown and users won't see it. We think this is acceptable, as it is better than having the exception, and we re-check for the existence of those notices in several flows of execution.
If we made some mistake in the transition to the one-file to the many-
files, all notices may be lost.
[Discussion]
It is very hard to simulate this bug, as this is a very well timed race condition. Therefore, we are simulating it by corrupting the JSON ourselves for the test and verification.
We are arguing that invalid notices won't show in this new model,
because our notices are now code-controlled, and invalid notices will
not be taken into consideration. They are also unlikely to happen now
because files are atomically written. The only case is not showing a
valid notice, as discussed above.
[Original Description]
```log
2022-08-25 14:08:16,982 - util.py:(696) [DEBUG]: Failed running command '/snap/bin/canonical-livepatch status' [exit(1)]. Message: cannot change profile for the next exec call: No such file or directory
Retrying 2 more times.
2022-08-25 14:08:17,528 - util.py:(696) [DEBUG]: Failed running command '/snap/bin/canonical-livepatch status' [exit(1)]. Message: cannot change profile for the next exec call: No such file or directory
Retrying 1 more times.
2022-08-25 14:08:18,567 - livepatch.py:(285) [DEBUG]: Livepatch not enabled. Failed running command '/snap/bin/canonical-livepatch status' [exit(1)]. Message: cannot change profile for the next exec call: No such file or directory
2022-08-25 14:08:18,567 - util.py:(437) [DEBUG]: Reading file: /var/lib/ubuntu-advantage/notices.json
2022-08-25 14:08:18,568 - util.py:(725) [DEBUG]: Writing file: /var/lib/ubuntu-advantage/notices.json
2022-08-25 14:08:18,569 - util.py:(437) [DEBUG]: Reading file: /var/lib/ubuntu-advantage/notices.json
2022-08-25 14:08:18,569 - util.py:(725) [DEBUG]: Writing file: /var/lib/ubuntu-advantage/notices.json
2022-08-25 14:08:18,569 - util.py:(437) [DEBUG]: Reading file: /var/lib/ubuntu-advantage/notices.json
2022-08-25 14:08:18,569 - util.py:(725) [DEBUG]: Writing file: /var/lib/ubuntu-advantage/notices.json
2022-08-25 14:08:18,570 - util.py:(437) [DEBUG]: Reading file: /var/lib/ubuntu-advantage/notices.json
2022-08-25 14:08:18,570 - cli.py:(1841) [ERROR]: Unhandled exception, please file a bug
Traceback (most recent call last):
File "/usr/lib/python3/dist-packages/uaclient/cli.py", line 1791, in wrapper
return func(*args, **kwargs)
File "/usr/lib/python3/dist-packages/uaclient/cli.py", line 1897, in main
return args.action(args, cfg=cfg)
File "/usr/lib/python3/dist-packages/uaclient/cli.py", line 1613, in action_status
cfg, simulate_with_token=token, show_beta=show_beta
File "/usr/lib/python3/dist-packages/uaclient/actions.py", line 118, in status
status = ua_status.status(cfg=cfg, show_beta=show_beta)
File "/usr/lib/python3/dist-packages/uaclient/status.py", line 339, in status
response = _attached_status(cfg)
File "/usr/lib/python3/dist-packages/uaclient/status.py", line 201, in _attached_status
_attached_service_status(ent, inapplicable_resources)
File "/usr/lib/python3/dist-packages/uaclient/status.py", line 115, in _attached_service_status
ent_status, details = ent.user_facing_status()
File "/usr/lib/python3/dist-packages/uaclient/entitlements/base.py", line 917, in user_facing_status
applicability, details = self.applicability_status()
File "/usr/lib/python3/dist-packages/uaclient/entitlements/base.py", line 562, in applicability_status
for error_message, functor, expected_result in self.static_affordances:
File "/usr/lib/python3/dist-packages/uaclient/entitlements/livepatch.py", line 124, in static_affordances
fips_ent.application_status()[0] == ApplicationStatus.ENABLED
File "/usr/lib/python3/dist-packages/uaclient/entitlements/fips.py", line 337, in application_status
self.cfg.remove_notice("", messages.FIPS_DISABLE_REBOOT_REQUIRED)
File "/usr/lib/python3/dist-packages/uaclient/config.py", line 357, in remove_notice
for notice_label, notice_descr in cached_notices:
ValueError: not enough values to unpack (expected 2, got 1)
2022-08-25 14:08:18,901 - cli.py:(1878) [DEBUG]: Executed with sys.argv: ['/usr/bin/ua', 'attach', '<REDACTED>']
2022-08-25 14:08:18,901 - cli.py:(1826) [ERROR]: This machine is already attached to 'zendesk'
To use a different subscription first run: sudo ua detach.
2022-08-25 14:08:19,247 - cli.py:(1878) [DEBUG]: Executed with sys.argv: ['/usr/bin/ua', 'status']
2
```
```
2022-08-25 14:08:19,423 - cli.py:(1841) [ERROR]: Unhandled exception, please file a bug
Traceback (most recent call last):
File "/usr/lib/python3/dist-packages/uaclient/cli.py", line 1791, in wrapper
return func(*args, **kwargs)
File "/usr/lib/python3/dist-packages/uaclient/cli.py", line 1897, in main
return args.action(args, cfg=cfg)
File "/usr/lib/python3/dist-packages/uaclient/cli.py", line 1604, in action_status
cfg.add_notice("", messages.NOTICE_REFRESH_CONTRACT_WARNING)
File "/usr/lib/python3/dist-packages/uaclient/config.py", line 343, in add_notice
if notice not in notices:
TypeError: 'in <string>' requires string as left operand, not list
2022-08-25 14:43:13,241 - cli.py:(1878) [DEBUG]: Executed with sys.argv: ['/usr/bin/ua', 'status']
2
```
The json is:
```sh
~# cat /var/lib/ubuntu-advantage/notices.json
[["", "A change has been detected in your contract.\nPlease run `sudo ua refresh`."]] ["", "Operation in progress: timer metering job"]]
```
Notice there's an unmatched "]".
ProblemType: Bug
DistroRelease: Ubuntu 16.04
Package: ubuntu-advantage-tools 27.9~16.04.1
ProcVersionSignature: Ubuntu 4.4.0-1134.148-aws 4.4.262
Uname: Linux 4.4.0-1134-aws x86_64
NonfreeKernelModules: lkp_Ubuntu_4_4_0_1134_148_aws_89 lkp_Ubuntu_4_4_0_1134_148_aws_87 lkp_Ubuntu_4_4_0_1134_148_aws_86 lkp_Ubuntu_4_4_0_1134_148_aws_85
ApportVersion: 2.20.1-0ubuntu2.30+esm3
Architecture: amd64
Date: Fri Aug 26 08:15:46 2022
Ec2AMI: ami-08d0f633da7d3c35d
Ec2AMIManifest: (unknown)
Ec2AvailabilityZone: eu-west-1c
Ec2InstanceType: m6i.2xlarge
Ec2Kernel: unavailable
Ec2Ramdisk: unavailable
ProcEnviron:
TERM=xterm-256color
SHELL=/bin/bash
PATH=(custom, no user)
LANG=en_US.UTF-8
LC_CTYPE=en_US.UTF-8
SourcePackage: ubuntu-advantage-tools
UpgradeStatus: No upgrade log present (probably fresh install)
To manage notifications about this bug go to:
https://bugs.launchpad.net/ubuntu/+source/ubuntu-advantage-tools/+bug/1987738/+subscriptions
