pbxt-discuss team mailing list archive
-
pbxt-discuss team
-
Mailing list archive
-
Message #00109
Re: question about support for concurrent IO
On Sat, Oct 30, 2010 at 9:19 AM, Paul McCullagh
<paul.mccullagh@xxxxxxxxx> wrote:
> Hi Mark,
>
> What has happened here is the index cache is full of dirty pages, and needs
> to be flushed.
>
> When a thread hits this situation it starts a background thread to flush the
> indexes. That is why we have xt_wait_for_async_tasks() in the top-most stack
> trace.
>
> The background tasks are all busy flushing the indexes. One of the problems
> here is that indexes are actually synced to disk before anything can
> continue (although this is unnecessary for an import - but there is no way
> to tell PBXT that this is the case).
>
> Also, writing an index is "all-or-nothing" so since about 20 GB of index
> data is dirty it probably all has to be written.
These stacks occur long before the database files are 20G on disk.
--
Mark Callaghan
mdcallag@xxxxxxxxx
Follow ups
References