mahara-contributors team mailing list archive

[Aaron Wells <1284887@xxxxxxxxxxxxxxxxxx>]

Public bug reported:

In Bug 778254, we added a system to make it so that notifications to
large numbers of users are processed in chunks, instead of all at once.

So, when you post to the mahara.org news forum, to which 30,000 users
are subscribed, each run of the activity_process_queue cron task only
sends out 500 notifications, instead of sending out all 30,000 on the
first run.

The problem, is that this limit is enforced per notification, *not* per
cron task. So if you make two news forum posts a minute apart, they'll
both get processed each time activity_process_queue runs, and they'll
both send out 500 notifications, making 1000 on each cron run.

Make 5 posts, and you get 2500 notifications, etc.

** Affects: mahara
     Importance: Medium
         Status: In Progress


** Tags: notifications scalability

-- 
You received this bug notification because you are a member of Mahara
Contributors, which is subscribed to Mahara.
Matching subscriptions: Subscription for all Mahara Contributors -- please ask on #mahara-dev or mahara.org forum before editing or unsubscribing it!
https://bugs.launchpad.net/bugs/1284887

Title:
  Notifications chunking needs to chunk per-cron-run, not per-message

Status in Mahara ePortfolio:
  In Progress

Bug description:
  In Bug 778254, we added a system to make it so that notifications to
  large numbers of users are processed in chunks, instead of all at
  once.

  So, when you post to the mahara.org news forum, to which 30,000 users
  are subscribed, each run of the activity_process_queue cron task only
  sends out 500 notifications, instead of sending out all 30,000 on the
  first run.

  The problem, is that this limit is enforced per notification, *not*
  per cron task. So if you make two news forum posts a minute apart,
  they'll both get processed each time activity_process_queue runs, and
  they'll both send out 500 notifications, making 1000 on each cron run.

  Make 5 posts, and you get 2500 notifications, etc.

To manage notifications about this bug go to:
https://bugs.launchpad.net/mahara/+bug/1284887/+subscriptions