← Back to team overview

debcrafters-packages team mailing list archive

[Bug 2062568] Re: nfsd gets unresponsive after some hours of operation

 

I'm currently on 6.8.0-60-generic and still get this kernel crash:

```
025-06-20T03:20:17.265121+00:00 nuc1 kernel: message repeated 5 times: [ nfs: server 192.168.0.25 not responding, still trying]
2025-06-20T03:21:10.513290+00:00 nuc1 kernel: INFO: task nfsd:1278 blocked for more than 122 seconds.
2025-06-20T03:21:10.514206+00:00 nuc1 kernel:       Not tainted 6.8.0-60-generic #63-Ubuntu
2025-06-20T03:21:10.514214+00:00 nuc1 kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
2025-06-20T03:21:10.514218+00:00 nuc1 kernel: task:nfsd            state:D stack:0     pid:1278  tgid:1278  ppid:2      flags:0x00004000
2025-06-20T03:21:10.514221+00:00 nuc1 kernel: Call Trace:
2025-06-20T03:21:10.514223+00:00 nuc1 kernel:  <TASK>
2025-06-20T03:21:10.514225+00:00 nuc1 kernel:  __schedule+0x27c/0x6b0
2025-06-20T03:21:10.514227+00:00 nuc1 kernel:  ? osq_lock+0x99/0x160
2025-06-20T03:21:10.514229+00:00 nuc1 kernel:  schedule+0x33/0x110
2025-06-20T03:21:10.514230+00:00 nuc1 kernel:  schedule_preempt_disabled+0x15/0x30
2025-06-20T03:21:10.514232+00:00 nuc1 kernel:  rwsem_down_write_slowpath+0x27e/0x550
2025-06-20T03:21:10.514234+00:00 nuc1 kernel:  ? __pfx_nfsd_acceptable+0x10/0x10 [nfsd]
2025-06-20T03:21:10.514236+00:00 nuc1 kernel:  ? __pfx_nfsd_acceptable+0x10/0x10 [nfsd]
2025-06-20T03:21:10.514246+00:00 nuc1 kernel:  ? aa_file_perm+0x147/0x2f0
2025-06-20T03:21:10.514329+00:00 nuc1 kernel:  down_write+0x5c/0x80
2025-06-20T03:21:10.514731+00:00 nuc1 kernel:  ext4_buffered_write_iter+0x39/0x130
2025-06-20T03:21:10.514743+00:00 nuc1 kernel:  ext4_file_write_iter+0x4c/0x80
2025-06-20T03:21:10.514745+00:00 nuc1 kernel:  do_iter_readv_writev+0x149/0x1d0
2025-06-20T03:21:10.514747+00:00 nuc1 kernel:  vfs_iter_write+0xbc/0x230
2025-06-20T03:21:10.514749+00:00 nuc1 kernel:  nfsd_vfs_write+0x1b7/0x5e0 [nfsd]
2025-06-20T03:21:10.514785+00:00 nuc1 kernel:  nfsd4_write+0x14e/0x1e0 [nfsd]
2025-06-20T03:21:10.514787+00:00 nuc1 kernel:  nfsd4_proc_compound+0x3b4/0x780 [nfsd]
2025-06-20T03:21:10.515250+00:00 nuc1 kernel:  nfsd_dispatch+0xd4/0x220 [nfsd]
2025-06-20T03:21:10.515261+00:00 nuc1 kernel:  svc_process_common+0x4fd/0x750 [sunrpc]
2025-06-20T03:21:10.515264+00:00 nuc1 kernel:  ? __pfx_nfsd_dispatch+0x10/0x10 [nfsd]
2025-06-20T03:21:10.515287+00:00 nuc1 kernel:  svc_process+0x132/0x1b0 [sunrpc]
2025-06-20T03:21:10.515291+00:00 nuc1 kernel:  svc_handle_xprt+0x4d3/0x5d0 [sunrpc]
2025-06-20T03:21:10.516395+00:00 nuc1 kernel:  svc_recv+0x18b/0x2e0 [sunrpc]
2025-06-20T03:21:10.516424+00:00 nuc1 kernel:  ? __pfx_nfsd+0x10/0x10 [nfsd]
2025-06-20T03:21:10.516429+00:00 nuc1 kernel:  nfsd+0x8b/0xe0 [nfsd]
2025-06-20T03:21:10.516432+00:00 nuc1 kernel:  kthread+0xef/0x120
2025-06-20T03:21:10.516435+00:00 nuc1 kernel:  ? __pfx_kthread+0x10/0x10
2025-06-20T03:21:10.516438+00:00 nuc1 kernel:  ret_from_fork+0x44/0x70
2025-06-20T03:21:10.516441+00:00 nuc1 kernel:  ? __pfx_kthread+0x10/0x10
2025-06-20T03:21:10.516444+00:00 nuc1 kernel:  ret_from_fork_asm+0x1b/0x30
2025-06-20T03:21:10.516448+00:00 nuc1 kernel:  </TASK>
```

-- 
You received this bug notification because you are a member of
Debcrafters packages, which is subscribed to nfs-utils in Ubuntu.
https://bugs.launchpad.net/bugs/2062568

Title:
  nfsd gets unresponsive after some hours of operation

Status in linux package in Ubuntu:
  In Progress
Status in nfs-utils package in Ubuntu:
  Incomplete
Status in linux source package in Noble:
  In Progress
Status in nfs-utils source package in Noble:
  Incomplete

Bug description:
  I installed the 24.04 Beta on two test machines that were running
  22.04 without issues before. One of them exports two volumes that are
  mounted by the other machine, which primarily uses them as a secondary
  storage for ccache.

  After being up for a couple of hours (happened twice since yesterday
  evening) it seems that nfsd on the machine exporting the volumes hangs
  on something.

  From dmesg on the server (repeated a few times):

  [11183.290548] INFO: task nfsd:1419 blocked for more than 1228 seconds.
  [11183.290558]       Not tainted 6.8.0-22-generic #22-Ubuntu
  [11183.290563] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
  [11183.290582] task:nfsd            state:D stack:0     pid:1419  tgid:1419  ppid:2      flags:0x00004000
  [11183.290587] Call Trace:
  [11183.290602]  <TASK>
  [11183.290606]  __schedule+0x27c/0x6b0
  [11183.290612]  schedule+0x33/0x110
  [11183.290615]  schedule_timeout+0x157/0x170
  [11183.290619]  wait_for_completion+0x88/0x150
  [11183.290623]  __flush_workqueue+0x140/0x3e0
  [11183.290629]  nfsd4_probe_callback_sync+0x1a/0x30 [nfsd]
  [11183.290689]  nfsd4_destroy_session+0x186/0x260 [nfsd]
  [11183.290744]  nfsd4_proc_compound+0x3af/0x770 [nfsd]
  [11183.290798]  nfsd_dispatch+0xd4/0x220 [nfsd]
  [11183.290851]  svc_process_common+0x44d/0x710 [sunrpc]
  [11183.290924]  ? __pfx_nfsd_dispatch+0x10/0x10 [nfsd]
  [11183.290976]  svc_process+0x132/0x1b0 [sunrpc]
  [11183.291041]  svc_handle_xprt+0x4d3/0x5d0 [sunrpc]
  [11183.291105]  svc_recv+0x18b/0x2e0 [sunrpc]
  [11183.291168]  ? __pfx_nfsd+0x10/0x10 [nfsd]
  [11183.291220]  nfsd+0x8b/0xe0 [nfsd]
  [11183.291270]  kthread+0xef/0x120
  [11183.291274]  ? __pfx_kthread+0x10/0x10
  [11183.291276]  ret_from_fork+0x44/0x70
  [11183.291279]  ? __pfx_kthread+0x10/0x10
  [11183.291281]  ret_from_fork_asm+0x1b/0x30
  [11183.291286]  </TASK>

  From dmesg on the client (repeated a number of times):
  [ 6596.911785] RPC: Could not send backchannel reply error: -110
  [ 6596.972490] RPC: Could not send backchannel reply error: -110
  [ 6837.281307] RPC: Could not send backchannel reply error: -110

  ProblemType: Bug
  DistroRelease: Ubuntu 24.04
  Package: nfs-kernel-server 1:2.6.4-3ubuntu5
  ProcVersionSignature: Ubuntu 6.8.0-22.22-generic 6.8.1
  Uname: Linux 6.8.0-22-generic x86_64
  .etc.request-key.d.id_resolver.conf: create	id_resolver	*	*	/usr/sbin/nfsidmap -t 600 %k %d
  ApportVersion: 2.28.1-0ubuntu1
  Architecture: amd64
  CasperMD5CheckResult: pass
  Date: Fri Apr 19 14:10:25 2024
  InstallationDate: Installed on 2024-04-16 (3 days ago)
  InstallationMedia: Ubuntu-Server 24.04 LTS "Noble Numbat" - Beta amd64 (20240410.1)
  NFSMounts:

  NFSv4Mounts:

  ProcEnviron:
   LANG=en_US.UTF-8
   PATH=(custom, no user)
   SHELL=/bin/bash
   TERM=xterm-256color
   XDG_RUNTIME_DIR=<set>
  SourcePackage: nfs-utils
  UpgradeStatus: No upgrade log present (probably fresh install)

To manage notifications about this bug go to:
https://bugs.launchpad.net/ubuntu/+source/linux/+bug/2062568/+subscriptions