mahara-contributors team mailing list archive

Thread
Date
[Bug 680710] Re: Revive the Solr plugin using elasticsearch

To: mahara-contributors@xxxxxxxxxxxxxxxxxxx
From: François Marier <francois@xxxxxxxxxx>
Date: Mon, 21 Nov 2011 05:29:31 -0000
Reply-to: Bug 680710 <680710@xxxxxxxxxxxxxxxxxx>
Sender: bounces@xxxxxxxxxxxxx
We should replace solr with http://www.elasticsearch.org/

** Summary changed:

- Revive the Solr plugin
+ Revive the Solr plugin using elasticsearch

** Tags removed: cron exhausted index indexing memory php.ini rebuild
solr

** Tags added: solr

-- 
You received this bug notification because you are a member of Mahara
Contributors, which is subscribed to Mahara.
https://bugs.launchpad.net/bugs/680710

Title:
  Revive the Solr plugin using elasticsearch

Status in Mahara ePortfolio:
  Triaged

Bug description:
  - exact version of Mahara : 1.2.3
  - operating system : Linux
  - database : MySQL

  My mah_artifact table contains over 91000 records, i'm on mysql db,
  and the server has 2GB ram. i tried increasing the mem_limit_max to
  2048M in php.ini and still am getting the following problems. I'm also
  expecting this table to increase to over a million records in the next
  couple of months.

  This repeats everyday at 4:00 and 4:30 AM.

  Any help would be appreciated.

  
  Solr Stuff...
  -------------
  [21-Nov-2010 04:00:22] PHP Fatal error:  Allowed memory size of 134217728 bytes exhausted (tried to allocate 7680 bytes) in /var/www/mahara/lib/dml.php(46) : runtime-created function on line 1
  [21-Nov-2010 04:01:22] PHP Fatal error:  Allowed memory size of 134217728 bytes exhausted (tried to allocate 7680 bytes) in /var/www/mahara/lib/dml.php(46) : runtime-created function on line 1
  [21-Nov-2010 04:02:21] PHP Fatal error:  Allowed memory size of 134217728 bytes exhausted (tried to allocate 7680 bytes) in /var/www/mahara/lib/dml.php(46) : runtime-created function on line 1
  [21-Nov-2010 04:03:20] PHP Fatal error:  Allowed memory size of 134217728 bytes exhausted (tried to allocate 7680 bytes) in /var/www/mahara/lib/dml.php(46) : runtime-created function on line 1
  [21-Nov-2010 04:04:20] PHP Fatal error:  Allowed memory size of 134217728 bytes exhausted (tried to allocate 7680 bytes) in /var/www/mahara/lib/dml.php(46) : runtime-created function on line 1
  [21-Nov-2010 04:05:01] [DBG] a3 (lib/cron.php:70) ---------- cron running Sun, 21 Nov 2010 04:05:01 +0200 ----------
  [21-Nov-2010 04:05:01] [DBG] a3 (lib/cron.php:90) Running PluginInteractionInvite::interaction_invite_send
  [21-Nov-2010 04:05:01] [DBG] a3 (lib/cron.php:149) Running core cron rebuild_artefact_parent_cache_dirty
  [21-Nov-2010 04:05:01] [WAR] a3 (lib/cron.php:167) core cronjob "rebuild_artefact_parent_cache_complete" didn't get run because the nextrun time (2010-11-21 04:00:00) was too old (less than 1290304801)
  [21-Nov-2010 04:05:01] Call stack (most recent first):
  [21-Nov-2010 04:05:01]   * log_message("core cronjob "rebuild_artefact_parent_cache_comple...", 8, true, true) at /var/www/mahara/lib/errors.php:111
  [21-Nov-2010 04:05:01]   * log_warn("core cronjob "rebuild_artefact_parent_cache_comple...") at /var/www/mahara/lib/cron.php:167
  [21-Nov-2010 04:05:01]
  [21-Nov-2010 04:05:01] [WAR] a3 (lib/cron.php:167) core cronjob "activity_process_queue" didn't get run because the nextrun time (2010-11-21 04:00:00) was too old (less than 1290304801)
  [21-Nov-2010 04:05:01] Call stack (most recent first):
  [21-Nov-2010 04:05:01]   * log_message("core cronjob "activity_process_queue" didn't get r...", 8, true, true) at /var/www/mahara/lib/errors.php:111
  [21-Nov-2010 04:05:01]   * log_warn("core cronjob "activity_process_queue" didn't get r...") at /var/www/mahara/lib/cron.php:167
  [21-Nov-2010 04:05:01]
  [21-Nov-2010 04:05:01] [WAR] a3 (lib/cron.php:167) core cronjob "import_process_queue" didn't get run because the nextrun time (2010-11-21 04:00:00) was too old (less than 1290304801)
  [21-Nov-2010 04:05:01] Call stack (most recent first):
  [21-Nov-2010 04:05:01]   * log_message("core cronjob "import_process_queue" didn't get run...", 8, true, true) at /var/www/mahara/lib/errors.php:111
  [21-Nov-2010 04:05:01]   * log_warn("core cronjob "import_process_queue" didn't get run...") at /var/www/mahara/lib/cron.php:167
  [21-Nov-2010 04:05:01]
  [21-Nov-2010 04:05:01] [WAR] a3 (lib/cron.php:167) core cronjob "import_cleanup_old_imports" didn't get run because the nextrun time (2010-11-21 04:00:00) was too old (less than 1290304801)
  [21-Nov-2010 04:05:01] Call stack (most recent first):
  [21-Nov-2010 04:05:01]   * log_message("core cronjob "import_cleanup_old_imports" didn't g...", 8, true, true) at /var/www/mahara/lib/errors.php:111
  [21-Nov-2010 04:05:01]   * log_warn("core cronjob "import_cleanup_old_imports" didn't g...") at /var/www/mahara/lib/cron.php:167
  [21-Nov-2010 04:05:01]

  
  Solr again at 4:30am...
  -------------
  [21-Nov-2010 04:29:01] [DBG] 2a (lib/cron.php:70) ---------- cron running Sun, 21 Nov 2010 04:29:01 +0200 ----------
  [21-Nov-2010 04:29:01] [DBG] 2a (lib/cron.php:90) Running PluginSearchSolr::rebuild_all
  [21-Nov-2010 04:29:01] [DBG] 2a (search/solr/lib.php:427) Starting rebuild_users()
  [21-Nov-2010 04:29:24] PHP Fatal error:  Allowed memory size of 134217728 bytes exhausted (tried to allocate 7680 bytes) in /var/www/mahara/lib/dml.php(46) : runtime-created function on line 1
  [21-Nov-2010 04:30:01] [DBG] 92 (lib/cron.php:70) ---------- cron running Sun, 21 Nov 2010 04:30:01 +0200 ----------
  [21-Nov-2010 04:30:01] [WAR] 92 (lib/cron.php:126) cronjob "solr.rebuild_all" didn't get run because the nextrun time was too old
  [21-Nov-2010 04:30:01] Call stack (most recent first):
  [21-Nov-2010 04:30:01]   * log_message("cronjob "solr.rebuild_all" didn't get run because ...", 8, true, true) at /var/www/mahara/lib/errors.php:111
  [21-Nov-2010 04:30:01]   * log_warn("cronjob "solr.rebuild_all" didn't get run because ...") at /var/www/mahara/lib/cron.php:126
  [21-Nov-2010 04:30:01]
  [21-Nov-2010 04:30:03] [DBG] 92 (lib/cron.php:90) Running PluginInteractionForum::interaction_forum_new_post
  [21-Nov-2010 04:30:03] [WAR] 92 (lib/cron.php:126) cronjob "invite.interaction_invite_send" didn't get run because the nextrun time was too old
  [21-Nov-2010 04:30:03] Call stack (most recent first):
  [21-Nov-2010 04:30:03]   * log_message("cronjob "invite.interaction_invite_send" didn't ge...", 8, true, true) at /var/www/mahara/lib/errors.php:111
  [21-Nov-2010 04:30:03]   * log_warn("cronjob "invite.interaction_invite_send" didn't ge...") at /var/www/mahara/lib/cron.php:126
  [21-Nov-2010 04:30:03]
  [21-Nov-2010 04:30:03] [WAR] 92 (lib/cron.php:167) core cronjob "rebuild_artefact_parent_cache_dirty" didn't get run because the nextrun time (2010-11-21 04:25:00) was too old (less than 1290306301)
  [21-Nov-2010 04:30:03] Call stack (most recent first):
  [21-Nov-2010 04:30:03]   * log_message("core cronjob "rebuild_artefact_parent_cache_dirty"...", 8, true, true) at /var/www/mahara/lib/errors.php:111
  [21-Nov-2010 04:30:03]   * log_warn("core cronjob "rebuild_artefact_parent_cache_dirty"...") at /var/www/mahara/lib/cron.php:167
  [21-Nov-2010 04:30:03]
  [21-Nov-2010 04:30:03] [WAR] 92 (lib/cron.php:167) core cronjob "activity_process_queue" didn't get run because the nextrun time (2010-11-21 04:25:00) was too old (less than 1290306301)
  [21-Nov-2010 04:30:03] Call stack (most recent first):
  [21-Nov-2010 04:30:03]   * log_message("core cronjob "activity_process_queue" didn't get r...", 8, true, true) at /var/www/mahara/lib/errors.php:111
  [21-Nov-2010 04:30:03]   * log_warn("core cronjob "activity_process_queue" didn't get r...") at /var/www/mahara/lib/cron.php:167
  [21-Nov-2010 04:30:03]
  [21-Nov-2010 04:30:03] [WAR] 92 (lib/cron.php:167) core cronjob "import_process_queue" didn't get run because the nextrun time (2010-11-21 04:25:00) was too old (less than 1290306301)
  [21-Nov-2010 04:30:03] Call stack (most recent first):
  [21-Nov-2010 04:30:03]   * log_message("core cronjob "import_process_queue" didn't get run...", 8, true, true) at /var/www/mahara/lib/errors.php:111
  [21-Nov-2010 04:30:03]   * log_warn("core cronjob "import_process_queue" didn't get run...") at /var/www/mahara/lib/cron.php:167
  [21-Nov-2010 04:30:03]

To manage notifications about this bug go to:
https://bugs.launchpad.net/mahara/+bug/680710/+subscriptions
References

[Bug 680710] [NEW] Solr Problems
From: Mahmoud Abdalla, 2010-11-23