kernel-packages team mailing list archive

[Bjoern Teipel <bjoern.teipel@xxxxxxxxxxxxx>]

Public bug reported:

We noticed a XFS metadata corruption once we ran a lot of small write
IOs on SSDs in our OpenStack swift environment:


[1468860.211158] XFS (sdax): Metadata corruption detected at xfs_attr3_leaf_write_verify+0xd7/0xf0 [xfs], block 0x7c99480
[1468860.211195] XFS (sdax): Unmount and run xfs_repair
[1468860.211215] XFS (sdax): First 64 bytes of corrupted metadata buffer:
[1468860.211247] ffff880630f66000: 00 00 00 00 00 00 00 00 fb ee 00 00 00 00 00 00  ................
[1468860.211268] ffff880630f66010: 10 00 00 00 00 20 0f e0 00 00 00 00 00 00 00 00  ..... ..........
[1468860.211289] ffff880630f66020: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00  ................
[1468860.211309] ffff880630f66030: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00  ................
[1468860.211328] XFS (sdax): xfs_do_force_shutdown(0x8) called from line 1254 of file /build/linux-lts-xenial-7RlTta/linux-lts-xenial-4.4.0/fs/xfs/xfs_buf.c.  Return address = 0x
ffffffffc068f616
[1468860.212214] XFS (sdax): Corruption of in-memory data detected.  Shutting down filesystem
[1468860.212232] XFS (sdax): Please umount the filesystem and rectify the problem(s)
[1468860.212323] XFS (sdax): xfs_do_force_shutdown(0x1) called from line 315 of file /build/linux-lts-xenial-7RlTta/linux-lts-xenial-4.4.0/fs/xfs/xfs_trans_buf.c.  Return address
 = 0xffffffffc06bdda2
[1468860.261436] XFS (sdax): xfs_log_force: error -5 returned.

This error is reported with linux-generic-lts-xenial @4.4.0.22.12 on a XFS filesystem formatted with 1024 as inode size and mounted with rw,noatime,nodiratime,nobarrier,logbufs=8,noquota
For us this issue seems to be reproducible after several hours of stress testing.

cat /proc/version_signature
Ubuntu 4.4.0-22.40~14.04.1-generic 4.4.8

Description:    Ubuntu 14.04.3 LTS
Release:        14.04

** Affects: linux (Ubuntu)
     Importance: Undecided
         Status: New

-- 
You received this bug notification because you are a member of Kernel
Packages, which is subscribed to linux in Ubuntu.
https://bugs.launchpad.net/bugs/1596550

Title:
  Metadata corruption detected at xfs_attr3_leaf_write_verify+0xd7/0xf0

Status in linux package in Ubuntu:
  New

Bug description:
  We noticed a XFS metadata corruption once we ran a lot of small write
  IOs on SSDs in our OpenStack swift environment:

  
  [1468860.211158] XFS (sdax): Metadata corruption detected at xfs_attr3_leaf_write_verify+0xd7/0xf0 [xfs], block 0x7c99480
  [1468860.211195] XFS (sdax): Unmount and run xfs_repair
  [1468860.211215] XFS (sdax): First 64 bytes of corrupted metadata buffer:
  [1468860.211247] ffff880630f66000: 00 00 00 00 00 00 00 00 fb ee 00 00 00 00 00 00  ................
  [1468860.211268] ffff880630f66010: 10 00 00 00 00 20 0f e0 00 00 00 00 00 00 00 00  ..... ..........
  [1468860.211289] ffff880630f66020: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00  ................
  [1468860.211309] ffff880630f66030: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00  ................
  [1468860.211328] XFS (sdax): xfs_do_force_shutdown(0x8) called from line 1254 of file /build/linux-lts-xenial-7RlTta/linux-lts-xenial-4.4.0/fs/xfs/xfs_buf.c.  Return address = 0x
  ffffffffc068f616
  [1468860.212214] XFS (sdax): Corruption of in-memory data detected.  Shutting down filesystem
  [1468860.212232] XFS (sdax): Please umount the filesystem and rectify the problem(s)
  [1468860.212323] XFS (sdax): xfs_do_force_shutdown(0x1) called from line 315 of file /build/linux-lts-xenial-7RlTta/linux-lts-xenial-4.4.0/fs/xfs/xfs_trans_buf.c.  Return address
   = 0xffffffffc06bdda2
  [1468860.261436] XFS (sdax): xfs_log_force: error -5 returned.

  This error is reported with linux-generic-lts-xenial @4.4.0.22.12 on a XFS filesystem formatted with 1024 as inode size and mounted with rw,noatime,nodiratime,nobarrier,logbufs=8,noquota
  For us this issue seems to be reproducible after several hours of stress testing.

  cat /proc/version_signature
  Ubuntu 4.4.0-22.40~14.04.1-generic 4.4.8

  Description:    Ubuntu 14.04.3 LTS
  Release:        14.04

To manage notifications about this bug go to:
https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1596550/+subscriptions