Re: [Fwd: squirrel mail sucks]

[Piet Slaghekke-2]

Jonathan Angliss wrote:

On Thu, 11 Jun 2009 11:47:27 -0400, Piet Slaghekke
pslaghekke@... wrote:

  

Hello everyone,

I am sure more people have had issues with this and perhaps some of your 
solutions could be shared with me.

I am using SM version: 1.4.10a
    

Upgrade, 1.4.10 is 2 years old, and has several known security issues.
  

Yes  agreed.

If a user as an inbox of more than 2000 messages it may take SM 1 + 
minutes to load.  Sometimes it will give the folloing error message:
*ERROR: Connection dropped by IMAP server.*
Query: SEARCH CHARSET ISO-8859-1 ALL UNDELETED From {11} cron daemon
    

Despite the fact in another email you say you don't have filtering
turned on, this error alone says you do.  The user has defined a
filter that searches ALL emails from cron daemon.  That means that
it's going to ask your imap server to search all 2000+ messages every
time you go into the inbox, or refresh the left frame.
  

Correct,  the particular error  message did come from a SM instance with two filters enabled.   I have other users with no filters that are have a long delay before the inbox is loaded.      I thought SM would only run filters on incoming messages.. but then it would miss emails that came into the inbox using another email client, is there a way to set SM to only filter incoming messages and ignore the messages already in the inbox?

and then load correctly after a page refresh.
    

Is there a recommended amount of email to be held in the inbox? (I can 
run an archiving script to cleanup everyones inboxes moving old mail to 
archive folders)
    

or are there some settings I can tweak to make squirrelmail load faster 
and without errors after logging.
    

Again this slowness only occurs after the initial login. After 
squirremail has loaded the inbox it works well.
    

Look in the config/config.php and search for plugins, and see if you
have one defined for filters.  If you do, disable the filters plugin
(put // at the beginning of the line) and see if you get an
improvement.
  

Thanks will try this.

------------------------------------------------------------------------------
Crystal Reports - New Free Runtime and 30 Day Trial
Check out the new simplified licensing option that enables unlimited
royalty-free distribution of the report engine for externally facing
server and web deployment.
http://p.sf.net/sfu/businessobjects
-----
squirrelmail-users mailing list
Posting guidelines: http://squirrelmail.org/postingguidelines
List address: squirrelmail-users@...
List archives: http://news.gmane.org/gmane.mail.squirrelmail.user
List info (subscribe/unsubscribe/change options): https://lists.sourceforge.net/lists/listinfo/squirrelmail-users

[Fredrik Jervfors-4]

>>> I am sure more people have had issues with this and perhaps some of
>>> your solutions could be shared with me.
>>>
>>> I am using SM version: 1.4.10a
>>
>> Upgrade, 1.4.10 is 2 years old, and has several known security issues.
>
> Yes  agreed.
>
>>> If a user as an inbox of more than 2000 messages it may take SM 1 +
>>> minutes to load.  Sometimes it will give the folloing error message:
>>> *ERROR: Connection dropped by IMAP server.*
>>> Query: SEARCH CHARSET ISO-8859-1 ALL UNDELETED From {11} cron daemon
>>
>> Despite the fact in another email you say you don't have filtering
>> turned on, this error alone says you do.  The user has defined a filter
>> that searches ALL emails from cron daemon.  That means that it's going
>> to ask your imap server to search all 2000+ messages every time you go
>> into the inbox, or refresh the left frame.
>
> Correct,  the particular error  message did come from a SM instance with
> two filters enabled.   I have other users with no filters that are have a
> long delay before the inbox is loaded.      I thought SM would only run
> filters on incoming messages.. but then it would miss emails that came
> into the inbox using another email client, is there a way to set SM to
> only filter incoming messages and ignore the messages already in the
> inbox?

SquirrelMail isn't part of the chain delivering mail to your inbox. If the
mail isn't in the mailbox already, SquirrelMail can't work with it. Mail
in the inbox have flags though, which indicate if the mail is a newly
arrived one or old stuff, if the mail is read or not, etc. Those flags can
be used when filtering, allowing the filter to work only with mail that
has the flag for newly arrived set. I don't know if that's supported in
the filter plugin, but at least it's possible in theory.

>>> and then load correctly after a page refresh.
>>>
>>> Is there a recommended amount of email to be held in the inbox? (I
>>> can run an archiving script to cleanup everyones inboxes moving old
>>> mail to archive folders) or are there some settings I can tweak to make
>>> squirrelmail load faster and without errors after logging.
>>>
>>> Again this slowness only occurs after the initial login. After
>>> squirremail has loaded the inbox it works well.
>>
>> Look in the config/config.php and search for plugins, and see if you
>> have one defined for filters.  If you do, disable the filters plugin (put
>> // at the beginning of the line) and see if you get an
>> improvement.
>
> Thanks will try this.

Sincerely,
Fredrik

------------------------------------------------------------------------------
Crystal Reports - New Free Runtime and 30 Day Trial
Check out the new simplified licensing option that enables unlimited
royalty-free distribution of the report engine for externally facing
server and web deployment.
http://p.sf.net/sfu/businessobjects
-----
squirrelmail-users mailing list
Posting guidelines: http://squirrelmail.org/postingguidelines
List address: squirrelmail-users@...
List archives: http://news.gmane.org/gmane.mail.squirrelmail.user
List info (subscribe/unsubscribe/change options): https://lists.sourceforge.net/lists/listinfo/squirrelmail-users

[Oguzhan Kayhan]

Using an IMAP Proxy might fix some issues on serverside.
Specially on large installations with lots of users with large inboxes, it
helps on decreasing disk access everytime u refresh ur inbox..

>>>> I am sure more people have had issues with this and perhaps some of
>>>> your solutions could be shared with me.
>>>>
>>>> I am using SM version: 1.4.10a
>>>
>>> Upgrade, 1.4.10 is 2 years old, and has several known security issues.
>>
>> Yes  agreed.
>>
>>>> If a user as an inbox of more than 2000 messages it may take SM 1 +
>>>> minutes to load.  Sometimes it will give the folloing error message:
>>>> *ERROR: Connection dropped by IMAP server.*
>>>> Query: SEARCH CHARSET ISO-8859-1 ALL UNDELETED From {11} cron daemon
>>>
>>> Despite the fact in another email you say you don't have filtering
>>> turned on, this error alone says you do.  The user has defined a filter
>>> that searches ALL emails from cron daemon.  That means that it's going
>>> to ask your imap server to search all 2000+ messages every time you go
>>> into the inbox, or refresh the left frame.
>>
>> Correct,  the particular error  message did come from a SM instance with
>> two filters enabled.   I have other users with no filters that are have
>> a
>> long delay before the inbox is loaded.      I thought SM would only run
>> filters on incoming messages.. but then it would miss emails that came
>> into the inbox using another email client, is there a way to set SM to
>> only filter incoming messages and ignore the messages already in the
>> inbox?
>
> SquirrelMail isn't part of the chain delivering mail to your inbox. If the
> mail isn't in the mailbox already, SquirrelMail can't work with it. Mail
> in the inbox have flags though, which indicate if the mail is a newly
> arrived one or old stuff, if the mail is read or not, etc. Those flags can
> be used when filtering, allowing the filter to work only with mail that
> has the flag for newly arrived set. I don't know if that's supported in
> the filter plugin, but at least it's possible in theory.
>
>>>> and then load correctly after a page refresh.
>>>>
>>>> Is there a recommended amount of email to be held in the inbox? (I
>>>> can run an archiving script to cleanup everyones inboxes moving old
>>>> mail to archive folders) or are there some settings I can tweak to
>>>> make
>>>> squirrelmail load faster and without errors after logging.
>>>>
>>>> Again this slowness only occurs after the initial login. After
>>>> squirremail has loaded the inbox it works well.
>>>
>>> Look in the config/config.php and search for plugins, and see if you
>>> have one defined for filters.  If you do, disable the filters plugin
>>> (put
>>> // at the beginning of the line) and see if you get an
>>> improvement.
>>
>> Thanks will try this.
>
> Sincerely,
> Fredrik
>
> ------------------------------------------------------------------------------
> Crystal Reports - New Free Runtime and 30 Day Trial
> Check out the new simplified licensing option that enables unlimited
> royalty-free distribution of the report engine for externally facing
> server and web deployment.
> http://p.sf.net/sfu/businessobjects
> -----
> squirrelmail-users mailing list
> Posting guidelines: http://squirrelmail.org/postingguidelines
> List address: squirrelmail-users@...
> List archives: http://news.gmane.org/gmane.mail.squirrelmail.user
> List info (subscribe/unsubscribe/change options):
> https://lists.sourceforge.net/lists/listinfo/squirrelmail-users
>

------------------------------------------------------------------------------
Crystal Reports - New Free Runtime and 30 Day Trial
Check out the new simplified licensing option that enables unlimited
royalty-free distribution of the report engine for externally facing
server and web deployment.
http://p.sf.net/sfu/businessobjects
-----
squirrelmail-users mailing list
Posting guidelines: http://squirrelmail.org/postingguidelines
List address: squirrelmail-users@...
List archives: http://news.gmane.org/gmane.mail.squirrelmail.user
List info (subscribe/unsubscribe/change options): https://lists.sourceforge.net/lists/listinfo/squirrelmail-users

[Jon Angliss]

On Fri, 12 Jun 2009 10:03:56 -0400, Piet Slaghekke
<pslaghekke@...> wrote:

>
>Jonathan Angliss wrote:
>> On Thu, 11 Jun 2009 11:47:27 -0400, Piet Slaghekke
>> <pslaghekke@...> wrote:
>>
>>  
>>> Hello everyone,
>>>
>>> I am sure more people have had issues with this and perhaps some of your
>>> solutions could be shared with me.
>>>
>>> I am using SM version: 1.4.10a
>>>    
>>
>> Upgrade, 1.4.10 is 2 years old, and has several known security issues.
>>  
>Yes  agreed.
>>  
>>> If a user as an inbox of more than 2000 messages it may take SM 1 +
>>> minutes to load.  Sometimes it will give the folloing error message:
>>> *ERROR: Connection dropped by IMAP server.*
>>> Query: SEARCH CHARSET ISO-8859-1 ALL UNDELETED From {11} cron daemon
>>>    
>>
>> Despite the fact in another email you say you don't have filtering
>> turned on, this error alone says you do.  The user has defined a
>> filter that searches ALL emails from cron daemon.  That means that
>> it's going to ask your imap server to search all 2000+ messages every
>> time you go into the inbox, or refresh the left frame.

As a side note, there is a bug in the filters plugin [1] that is
generating an invalid IMAP call.


>Correct,  the particular error  message did come from a SM instance with
>two filters enabled.   I have other users with no filters that are have
>a long delay before the inbox is loaded.      I thought SM would only
>run filters on incoming messages.. but then it would miss emails that
>came into the inbox using another email client, is there a way to set SM
>to only filter incoming messages and ignore the messages already in the
>inbox?

As Frederick explained, the filters plugin in SquirrelMail is run on
the folder post delivery, akin to using filters in desktop mail client
such as Thunderbird or Outlook when downloading POP3 mail.  You can
tell the filters to only apply to unread messages, which limits the
scope, but that's a per user option.

I've not seen an issue with loading a mailbox when using Maildir, and
having the server side sorting options enabled, especially not with
2000 messages.  I used to run my SquirrelMail archives from a similar
setup, and had 120k+ messages in one folder alone without any issues.

Do you have threading enabled?  If so, try turning it off.  You're
saying this is impacting multiple users? Have you checked the state of
the server? Disk i/o? How about running some of the calls from a
telnet session, and see what the performance is like.

telnet serverip 143
A01 LOGIN "username" "password"
A02 SELECT INBOX
A03 SEARCH UID 1:*
A04 UID FETCH 1:* (FLAGS UID RFC822.SIZE BODY.PEEK[HEADERS.FIELDS
(Date To Cc From Subject X-Priority Important Priority Content-Type)])
A05 LOGOUT

The A04 line should be on one line, client wrapped it.

If you notice any delays, you may be looking at an IMAP server issue.

Something you might want to check, and an issue I had with courier in
the past, was the trash retention policy.  There is/was a
configuration entry in the imap configuration that defined an age for
emails in the trash folder.  This is checked on every login, and scans
the content of the trash folder for emails older than a certain date
to purge. For some reason, I cannot find any details on it, so it
might not be a valid option (has been a few years).

[1]: http://www.squirrelmail.org/bugs/2805201

--
Jonathan Angliss
<jon@...>


------------------------------------------------------------------------------
Crystal Reports - New Free Runtime and 30 Day Trial
Check out the new simplified licensing option that enables unlimited
royalty-free distribution of the report engine for externally facing
server and web deployment.
http://p.sf.net/sfu/businessobjects
-----
squirrelmail-users mailing list
Posting guidelines: http://squirrelmail.org/postingguidelines
List address: squirrelmail-users@...
List archives: http://news.gmane.org/gmane.mail.squirrelmail.user
List info (subscribe/unsubscribe/change options): https://lists.sourceforge.net/lists/listinfo/squirrelmail-users

[Paul Lesniewski]

>> FWIW, I use a large number of filters. Turning them off significantly
>> speeds up inbox load time. But, increases my wasted
>> human-sorting time
>> :-)
>>
>> Do you use a lot of message filters?
>
> I have a lot of filters, but I put them on the server using procmail, so
> my inbox loads quickly. I know the Squirrelmail filters are for
> individual users, but are they for users without OS-level access?

Sure, of course they are (they're merely filters embedded in the mail
client).  So are server side filters too (procmail, maildrop, etc.),
especially if you have an interface for them to edit such filters.

> I've never implemented the SQM filtering.
>
> It's nice to know that doing so slows down INBOX parsing... I think I'll
> keep using procmail on the server.

------------------------------------------------------------------------------
-----
squirrelmail-users mailing list
Posting guidelines: http://squirrelmail.org/postingguidelines
List address: squirrelmail-users@...
List archives: http://news.gmane.org/gmane.mail.squirrelmail.user
List info (subscribe/unsubscribe/change options): https://lists.sourceforge.net/lists/listinfo/squirrelmail-users

[Karl Pearson]

On Wed, June 24, 2009 5:25 pm, Paul Lesniewski wrote:

>>> FWIW, I use a large number of filters. Turning them off significantly
>>> speeds up inbox load time. But, increases my wasted
>>> human-sorting time
>>> :-)
>>>
>>> Do you use a lot of message filters?
>>
>> I have a lot of filters, but I put them on the server using procmail,
>> so
>> my inbox loads quickly. I know the Squirrelmail filters are for
>> individual users, but are they for users without OS-level access?
>
> Sure, of course they are (they're merely filters embedded in the mail
> client).  So are server side filters too (procmail, maildrop, etc.),
> especially if you have an interface for them to edit such filters.

I run my own server, so if anyone wants a procmail recipe written, I do
it for them. They are pretty easy at the basic level. The more advanced
ones don't come out of my head very easily. I have to look things up...

Thanks for your response.

>
>> I've never implemented the SQM filtering.
>>
>> It's nice to know that doing so slows down INBOX parsing... I think
>> I'll
>> keep using procmail on the server.
>
> ------------------------------------------------------------------------------
> -----
> squirrelmail-users mailing list
> Posting guidelines: http://squirrelmail.org/postingguidelines
> List address: squirrelmail-users@...
> List archives: http://news.gmane.org/gmane.mail.squirrelmail.user
> List info (subscribe/unsubscribe/change options):
> https://lists.sourceforge.net/lists/listinfo/squirrelmail-users
>

---
Karl Pearson
Karlp@...
Owner/Administrator of the sites at
http://ourldsfamily.com
---
"To mess up your Linux PC, you have to really work at it;
 to mess up a microsoft PC you just have to work on it."
---
 Democracy is two wolves and a lamb voting on what to have
 for lunch. Liberty is a well-armed lamb contesting the vote.
 --Benjamin Franklin
---


------------------------------------------------------------------------------
-----
squirrelmail-users mailing list
Posting guidelines: http://squirrelmail.org/postingguidelines
List address: squirrelmail-users@...
List archives: http://news.gmane.org/gmane.mail.squirrelmail.user
List info (subscribe/unsubscribe/change options): https://lists.sourceforge.net/lists/listinfo/squirrelmail-users