Scalability of rate-limiting?

[wilcooley]

We are considering implementing limits on recipients per message and per
time period using the features that we have now in IMP. We have a fairly
sizable user base; it's hard to estimate concurrent connnections with
HTTP being stateless and our IMAP connections being cached with up-
imapproxyd, but I'd guess we peak around 3k concurrent users across 5
webmail front-ends.

Assuming we use the SQL driver for permissions and not DataTree, what
kind of additional overhead should we expect between the permissions
check and the outgoing e-mail logging?

Are people using these rate-limiting features with sizable installations
with success?

Wil

--
IMP mailing list - Join the hunt: http://horde.org/bounties/#imp
Frequently Asked Questions: http://horde.org/faq/
To unsubscribe, mail: imp-unsubscribe@...

[Andrew Morgan]

On Tue, 6 Oct 2009, Wil Cooley wrote:

>
> We are considering implementing limits on recipients per message and per
> time period using the features that we have now in IMP. We have a fairly
> sizable user base; it's hard to estimate concurrent connnections with
> HTTP being stateless and our IMAP connections being cached with up-
> imapproxyd, but I'd guess we peak around 3k concurrent users across 5
> webmail front-ends.
>
> Assuming we use the SQL driver for permissions and not DataTree, what
> kind of additional overhead should we expect between the permissions
> check and the outgoing e-mail logging?
>
> Are people using these rate-limiting features with sizable installations
> with success?

We use rate-limiting here to control accounts that have been phished (a
fairly regular occurrence).  I think our installation is very similar in
size to yours...  We peak around 3k concurrent IMAP connections (most from
Webmail) and have 3 webmail frontends.  We are still using the Datatree
though.

Our limit is set to 500 messages per 24 hours, for all users.  I've never
tried setting per-user limits.

  Andy
--
IMP mailing list - Join the hunt: http://horde.org/bounties/#imp
Frequently Asked Questions: http://horde.org/faq/
To unsubscribe, mail: imp-unsubscribe@...

[wilcooley]

Andrew Morgan wrote:

> We use rate-limiting here to control accounts that have been phished (a
> fairly regular occurrence).  I think our installation is very similar in
> size to yours...  We peak around 3k concurrent IMAP connections (most
> from Webmail) and have 3 webmail frontends.  We are still using the
> Datatree though.
>
> Our limit is set to 500 messages per 24 hours, for all users.  I've
> never tried setting per-user limits.

Let me make sure I'm not reading this wrong... this limit is 500
messages per user per 24 hours, right? That's not 500 messages per 24
hours for the whole webmail installation (I can't imagine that you'd
have fewer than 10k messages per day.)

What about recipients per message?

Wil



--
IMP mailing list - Join the hunt: http://horde.org/bounties/#imp
Frequently Asked Questions: http://horde.org/faq/
To unsubscribe, mail: imp-unsubscribe@...

[Andrew Morgan]

On Tue, 6 Oct 2009, Wil Cooley wrote:

> Andrew Morgan wrote:
>
>> We use rate-limiting here to control accounts that have been phished (a
>> fairly regular occurrence).  I think our installation is very similar in
>> size to yours...  We peak around 3k concurrent IMAP connections (most
>> from Webmail) and have 3 webmail frontends.  We are still using the
>> Datatree though.
>>
>> Our limit is set to 500 messages per 24 hours, for all users.  I've
>> never tried setting per-user limits.
>
> Let me make sure I'm not reading this wrong... this limit is 500
> messages per user per 24 hours, right? That's not 500 messages per 24
> hours for the whole webmail installation (I can't imagine that you'd
> have fewer than 10k messages per day.)

Correct, 500 messages per user per 24 hours.

> What about recipients per message?

We don't limit that here.  If they want to send to 500 recipients at once,
that is okay by me.

(I know I already answered this on IRC, but I'm following up here for the
archives)

  Andy
--
IMP mailing list - Join the hunt: http://horde.org/bounties/#imp
Frequently Asked Questions: http://horde.org/faq/
To unsubscribe, mail: imp-unsubscribe@...