← Back to team overview

maria-developers team mailing list archive

Re: replication tests crash mysqld in mariadb 5.5.25

 

Hi Rich,

This looks like the problem described in http://bugs.mysql.com/bug.php?id=61575. The recommended solution was so far to increase aio-max-nr on the host; but as you can see in the last Monty's comment, in MariaDB it has now been fixed (by switching off Linux Native AIO if we fail to initialize the system aio structures). The fix should be in the next release.

Apart from the stack trace, the indication of the problem is the following sequence of error messages in your log file:

InnoDB: Warning: io_setup() failed with EAGAIN. Will make 5 attempts before giving up.
InnoDB: Warning: io_setup() attempt 1 failed.
InnoDB: Warning: io_setup() attempt 2 failed.
InnoDB: Warning: io_setup() attempt 3 failed.
InnoDB: Warning: io_setup() attempt 4 failed.
InnoDB: Warning: io_setup() attempt 5 failed.
InnoDB: Error: io_setup() failed with EAGAIN after 5 attempts.


To continue testing on 5.5.25, you can either adjust the OS parameter, or decrease the number of parallel servers (or maybe not to use native AIO at all).


Regards,
Elena


On 6/28/2012 6:47 PM, Rich Prohaska wrote:
with mariadb-5.5.25 on a centos 5.8 machine, when i run this:

./mysql-test-run.pl <http://mysql-test-run.pl> --suite=rpl --force
--max-test-fail=0 --nowarnings --parallel=4

mysqld crashes in the xtradb code trying to deref a NULL pointer.  core
files are available.

Core was generated by
`/home/prohaska/distros/mariadb-5.5.25-linux-x86_64/bin/mysqld
--defaults-group-'.
Program terminated with signal 11, Segmentation fault.
#0  0x000000000095aa15 in os_aio_get_array_and_local_segment
(global_seg=4, message1=0x43b910d8, message2=0x43b910d0,
type=0x43b910c8, space_id=0x43b910c0)
     at /home/buildbot/buildbot/build/storage/xtradb/os/os0file.c:3787
3787/home/buildbot/buildbot/build/storage/xtradb/os/os0file.c: No such
file or directory.
in /home/buildbot/buildbot/build/storage/xtradb/os/os0file.c
(gdb) bt
#0  0x000000000095aa15 in os_aio_get_array_and_local_segment
(global_seg=4, message1=0x43b910d8, message2=0x43b910d0,
type=0x43b910c8, space_id=0x43b910c0)
     at /home/buildbot/buildbot/build/storage/xtradb/os/os0file.c:3787
#1  os_aio_linux_handle (global_seg=4, message1=0x43b910d8,
message2=0x43b910d0, type=0x43b910c8, space_id=0x43b910c0) at
/home/buildbot/buildbot/build/storage/xtradb/os/os0file.c:4671
#2  0x00000000009114d7 in fil_aio_wait (segment=4) at
/home/buildbot/buildbot/build/storage/xtradb/fil/fil0fil.c:5530
#3  0x000000000088d1ee in io_handler_thread (arg=<value optimized out>)
at /home/buildbot/buildbot/build/storage/xtradb/srv/srv0start.c:483
#4  0x000000310e60677d in start_thread () from /lib64/libpthread.so.0
#5  0x000000310dad325d in clone () from /lib64/libc.so.6
(gdb) p os_aio_read_array
$1 = (os_aio_array_t *) 0x0



_______________________________________________
Mailing list: https://launchpad.net/~maria-developers
Post to     : maria-developers@xxxxxxxxxxxxxxxxxxx
Unsubscribe : https://launchpad.net/~maria-developers
More help   : https://help.launchpad.net/ListHelp




References