← Back to team overview

mahara-contributors team mailing list archive

[Bug 1732565] [NEW] Allow faster indexing of elasticsearch via cli script

 

Public bug reported:

When one re-indexes a large site it can take hours before the site is
fully re-indexed. This is because even though we index via the bulk
system it is restricted by number of records we can read into memory and
speed of cron run.

A way we could speed this up is via a fast index CLI script that allows
us to fire off the next cron run for elasticsearch indexing immediately
after previous one finishes

This way we would save the 'dead time' between runs waiting for the
server clock to tick over to the next minute

** Affects: mahara
     Importance: Wishlist
         Status: In Progress

-- 
You received this bug notification because you are a member of Mahara
Contributors, which is subscribed to Mahara.
Matching subscriptions: Subscription for all Mahara Contributors -- please ask on #mahara-dev or mahara.org forum before editing or unsubscribing it!
https://bugs.launchpad.net/bugs/1732565

Title:
  Allow faster indexing of elasticsearch via cli script

Status in Mahara:
  In Progress

Bug description:
  When one re-indexes a large site it can take hours before the site is
  fully re-indexed. This is because even though we index via the bulk
  system it is restricted by number of records we can read into memory
  and speed of cron run.

  A way we could speed this up is via a fast index CLI script that
  allows us to fire off the next cron run for elasticsearch indexing
  immediately after previous one finishes

  This way we would save the 'dead time' between runs waiting for the
  server clock to tick over to the next minute

To manage notifications about this bug go to:
https://bugs.launchpad.net/mahara/+bug/1732565/+subscriptions


Follow ups