mosquitto-users team mailing list archive
-
mosquitto-users team
-
Mailing list archive
-
Message #00107
Re: Build up a MQTT server with about 20, 000+ subscribers
Hello all,
I’ll answer Joe’s questions based on my experience:
- You’ll hit kernel limits pretty early on but many of those are easy to modify with ulimit and sysctl, those will be hurdles before Mosquitto is
- There’s not much special, EC2 mediums can do 200k+ (yes, two hundred) with QoS 2, SSL off, and a moderate number of messages publishing constantly.
- You can have a client that listens to $SYS/# or specific subtopics; a UI is a totally different matter though
- Not out of the box
Sharon, the problem that I can already tell you that will arise with SSL is memory usage. I forget the exact numbers but calling the consumption noticeable would be an understatement. With SSL off Mosquitto uses such a small amount of RAM which is why EC2 high CPU mediums are perfect.
- Mike
From: mosquitto-users-bounces+michael.frisch=nuance.com@xxxxxxxxxxxxxxxxxxx [mailto:mosquitto-users-bounces+michael.frisch=nuance.com@xxxxxxxxxxxxxxxxxxx] On Behalf Of Sharon Ben-Asher
Sent: Wednesday, November 14, 2012 5:17 AM
To: Joe Zhu; mosquitto-users@xxxxxxxxxxxxxxxxxxx
Subject: Re: [Mosquitto-users] Build up a MQTT server with about 20, 000+ subscribers
Hi Joe,
We are investigating MQTT and mosquitto for the same purpose (push notifications for Android)
As I said earlier. I was able to achieve 100K concurrent connections to one broker installed on medium sized AWS EC2 instance.
However, for the purpose of benchmark, I used the most basic scenario: QoS 0 only, no persistence, no SSL/encryption.
I imagine that if you add those features, the number will go down.
I will test with SSL connection in the upcoming days and will report my findings.
I also had to tweak the OS configuration (Ubuntu 12.04) to support such high number of TCP connections. If needed, I will share the settings I used.
I also found a working way to connect from Eclipse Paho to mosquitto using SSL and server and client authentication. I will publish this as git gist shortly.
For any more info, will be glad to help.
Sharon.
From: mosquitto-users-bounces+sharon.ben-asher=avg.com@xxxxxxxxxxxxxxxxxxx<mailto:mosquitto-users-bounces+sharon.ben-asher=avg.com@xxxxxxxxxxxxxxxxxxx> [mailto:mosquitto-users-bounces+sharon.ben-asher=avg.com@xxxxxxxxxxxxxxxxxxx]<mailto:[mailto:mosquitto-users-bounces+sharon.ben-asher=avg.com@xxxxxxxxxxxxxxxxxxx]> On Behalf Of Joe Zhu
Sent: Monday, November 12, 2012 6:18 PM
To: mosquitto-users@xxxxxxxxxxxxxxxxxxx<mailto:mosquitto-users@xxxxxxxxxxxxxxxxxxx>
Subject: [Mosquitto-users] Build up a MQTT server with about 20, 000+ subscribers
Our project need to setup and Android push notification service. I noticed many of projects are using MQTT protocol and I found this mosquitto.
* Any people has this experience for this? Will it be a problem while the subscribers grow up?
* What configuration do I need to handle for 20,000+ subscribers with QoS >1?
* Any dashboard and UI for mosquitto to monitor?
* Is it possible to integrate DB/Memcache/Mongodb for message tracking?
I'm not sure if it is a right place to ask this type of question in this mailing list, if not, sorry about it.
Thanks.
--
Joe Zhu
Follow ups
References