[Bug 949924] [NEW] UnicodeDecodeError when delivering message

[Antti Kaihola-7]

Public bug reported:

I did a fresh install of Mailman 3.0.0a8 on a Debian Squeeze box,
created a list, subscribed a few people and sent a message to the list.
The message didn't come through, and var/logs/mailman.log has:

Mar 08 13:21:08 2012 (23645) Uncaught runner exception: 'ascii' codec can't decode byte 0xe4 in position 20: ordinal not in range(128)
Mar 08 13:21:08 2012 (23645) Traceback (most recent call last):
  File "/home/mailman/lib/python2.6/site-packages/mailman/core/runner.py", line 138, in _one_iteration
    self._process_one_file(msg, msgdata)
  File "/home/mailman/lib/python2.6/site-packages/mailman/core/runner.py", line 220, in _process_one_file
    keepqueued = self._dispose(mlist, msg, msgdata)
  File "/home/mailman/lib/python2.6/site-packages/mailman/runners/incoming.py", line 64, in _dispose
    process(mlist, msg, msgdata, mlist.start_chain)
  File "/home/mailman/lib/python2.6/site-packages/mailman/core/chains.py", line 68, in process
    if link.rule.check(mlist, msg, msgdata):
  File "/home/mailman/lib/python2.6/site-packages/mailman/rules/approved.py", line 81, in check
    if ':' in line:
UnicodeDecodeError: 'ascii' codec can't decode byte 0xe4 in position 20: ordinal not in range(128)
Mar 08 13:21:08 2012 (23645) SHUNTING: 1331212867.805197+9daec32c73ac20978b856348ada1a60fd97a364c

The message did contain an u'\xe4' in both the subject and the body. I
sent the message using Thunderbird 10.0.2 on Linux Mint 12.

** Affects: mailman
     Importance: Undecided
         Status: New

--
You received this bug notification because you are a member of Mailman
Coders, which is subscribed to GNU Mailman.
https://bugs.launchpad.net/bugs/949924

Title:
  UnicodeDecodeError when delivering message

To manage notifications about this bug go to:
https://bugs.launchpad.net/mailman/+bug/949924/+subscriptions
_______________________________________________
Mailman-coders mailing list
Mailman-coders@...
http://mail.python.org/mailman/listinfo/mailman-coders

[Antti Kaihola-7]

I updated to mailman revno 7103, threw away the database and tried
again, and still get this traceback (file paths truncated):

Mar 08 13:45:42 2012 (24526) Uncaught runner exception: 'ascii' codec can't decode byte 0xe4 in position 20: ordinal not in range(128)
Mar 08 13:45:42 2012 (24526) Traceback (most recent call last):
  File "mailman/core/runner.py", line 138, in _one_iteration
    self._process_one_file(msg, msgdata)
  File "mailman/core/runner.py", line 220, in _process_one_file
    keepqueued = self._dispose(mlist, msg, msgdata)
  File "mailman/runners/incoming.py", line 64, in _dispose
    process(mlist, msg, msgdata, mlist.posting_chain)
  File "mailman/core/chains.py", line 68, in process
    if link.rule.check(mlist, msg, msgdata):
  File "mailman/rules/approved.py", line 81, in check
    if ':' in line:
UnicodeDecodeError: 'ascii' codec can't decode byte 0xe4 in position 20: ordinal not in range(128)
Mar 08 13:45:42 2012 (24526) SHUNTING: 1331214342.4443481+a044725593fde952570648a22d7cc36546cb4a70

--
You received this bug notification because you are a member of Mailman
Coders, which is subscribed to GNU Mailman.
https://bugs.launchpad.net/bugs/949924

Title:
  UnicodeDecodeError when delivering message

To manage notifications about this bug go to:
https://bugs.launchpad.net/mailman/+bug/949924/+subscriptions
_______________________________________________
Mailman-coders mailing list
Mailman-coders@...
http://mail.python.org/mailman/listinfo/mailman-coders

[Antti Kaihola-7]

The mailing list's preferred language is 'fi', and I have the following
in my mailman.cfg:

[language.fi]
description: Finnish
charset: utf-8
enabled: yes

--
You received this bug notification because you are a member of Mailman
Coders, which is subscribed to GNU Mailman.
https://bugs.launchpad.net/bugs/949924

Title:
  UnicodeDecodeError when delivering message

To manage notifications about this bug go to:
https://bugs.launchpad.net/mailman/+bug/949924/+subscriptions
_______________________________________________
Mailman-coders mailing list
Mailman-coders@...
http://mail.python.org/mailman/listinfo/mailman-coders

[Mark Sapiro-3]

** Also affects: mailman/3.0
   Importance: Undecided
       Status: New

--
You received this bug notification because you are a member of Mailman
Coders, which is subscribed to GNU Mailman.
https://bugs.launchpad.net/bugs/949924

Title:
  UnicodeDecodeError when delivering message

To manage notifications about this bug go to:
https://bugs.launchpad.net/mailman/+bug/949924/+subscriptions
_______________________________________________
Mailman-coders mailing list
Mailman-coders@...
http://mail.python.org/mailman/listinfo/mailman-coders

[Mark Sapiro-3]

I'm adding a patch I think will fix this.

** Changed in: mailman/3.0
   Importance: Undecided => High

** Changed in: mailman/3.0
       Status: New => Confirmed

** Changed in: mailman/3.0
    Milestone: None => 3.0.0b1

** Changed in: mailman/3.0
     Assignee: (unassigned) => Mark Sapiro (msapiro)

--
You received this bug notification because you are a member of Mailman
Coders, which is subscribed to GNU Mailman.
https://bugs.launchpad.net/bugs/949924

Title:
  UnicodeDecodeError when delivering message

To manage notifications about this bug go to:
https://bugs.launchpad.net/mailman/+bug/949924/+subscriptions
_______________________________________________
Mailman-coders mailing list
Mailman-coders@...
http://mail.python.org/mailman/listinfo/mailman-coders

[Mark Sapiro-3]

** Patch added: "approved.patch"
   https://bugs.launchpad.net/mailman/3.0/+bug/949924/+attachment/2878394/+files/approved.patch

--
You received this bug notification because you are a member of Mailman
Coders, which is subscribed to GNU Mailman.
https://bugs.launchpad.net/bugs/949924

Title:
  UnicodeDecodeError when delivering message

To manage notifications about this bug go to:
https://bugs.launchpad.net/mailman/+bug/949924/+subscriptions
_______________________________________________
Mailman-coders mailing list
Mailman-coders@...
http://mail.python.org/mailman/listinfo/mailman-coders

[Launchpad Bug Tracker-231]

** Branch linked: lp:~msapiro/mailman/bug_949924

--
You received this bug notification because you are a member of Mailman
Coders, which is subscribed to GNU Mailman.
https://bugs.launchpad.net/bugs/949924

Title:
  UnicodeDecodeError when delivering message

To manage notifications about this bug go to:
https://bugs.launchpad.net/mailman/+bug/949924/+subscriptions
_______________________________________________
Mailman-coders mailing list
Mailman-coders@...
http://mail.python.org/mailman/listinfo/mailman-coders

[Bernard-38]

all my by this program receives mistake how one can put down it, thanks

2012/3/16 Launchpad Bug Tracker <949924@...>

> ** Branch linked: lp:~msapiro/mailman/bug_949924
>
> --
> You received this bug notification because you are subscribed to GNU
> Mailman.
> Matching subscriptions: 24/7
> https://bugs.launchpad.net/bugs/949924
>
> Title:
>  UnicodeDecodeError when delivering message
>
> Status in GNU Mailman:
>  Confirmed
> Status in GNU Mailman 3.0 series:
>  Confirmed
>
> Bug description:
>  I did a fresh install of Mailman 3.0.0a8 on a Debian Squeeze box,
>  created a list, subscribed a few people and sent a message to the
>  list. The message didn't come through, and var/logs/mailman.log has:
>
>  Mar 08 13:21:08 2012 (23645) Uncaught runner exception: 'ascii' codec
> can't decode byte 0xe4 in position 20: ordinal not in range(128)
>  Mar 08 13:21:08 2012 (23645) Traceback (most recent call last):
>    File
> "/home/mailman/lib/python2.6/site-packages/mailman/core/runner.py", line
> 138, in _one_iteration
>      self._process_one_file(msg, msgdata)
>    File
> "/home/mailman/lib/python2.6/site-packages/mailman/core/runner.py", line
> 220, in _process_one_file
>      keepqueued = self._dispose(mlist, msg, msgdata)
>    File
> "/home/mailman/lib/python2.6/site-packages/mailman/runners/incoming.py",
> line 64, in _dispose
>      process(mlist, msg, msgdata, mlist.start_chain)
>    File
> "/home/mailman/lib/python2.6/site-packages/mailman/core/chains.py", line
> 68, in process
>      if link.rule.check(mlist, msg, msgdata):
>    File
> "/home/mailman/lib/python2.6/site-packages/mailman/rules/approved.py", line
> 81, in check
>      if ':' in line:
>  UnicodeDecodeError: 'ascii' codec can't decode byte 0xe4 in position 20:
> ordinal not in range(128)
>  Mar 08 13:21:08 2012 (23645) SHUNTING:
> 1331212867.805197+9daec32c73ac20978b856348ada1a60fd97a364c
>
>  The message did contain an u'\xe4' in both the subject and the body. I
>  sent the message using Thunderbird 10.0.2 on Linux Mint 12.
>
> To manage notifications about this bug go to:
> https://bugs.launchpad.net/mailman/+bug/949924/+subscriptions
>

--
You received this bug notification because you are a member of Mailman
Coders, which is subscribed to GNU Mailman.
https://bugs.launchpad.net/bugs/949924

Title:
  UnicodeDecodeError when delivering message

To manage notifications about this bug go to:
https://bugs.launchpad.net/mailman/+bug/949924/+subscriptions
_______________________________________________
Mailman-coders mailing list
Mailman-coders@...
http://mail.python.org/mailman/listinfo/mailman-coders

[Launchpad Bug Tracker-231]

** Changed in: mailman/3.0
    Milestone: 3.0.0b1 => postponed

--
You received this bug notification because you are a member of Mailman
Coders, which is subscribed to GNU Mailman.
https://bugs.launchpad.net/bugs/949924

Title:
  UnicodeDecodeError when delivering message

To manage notifications about this bug go to:
https://bugs.launchpad.net/mailman/+bug/949924/+subscriptions
_______________________________________________
Mailman-coders mailing list
Mailman-coders@...
http://mail.python.org/mailman/listinfo/mailman-coders

[Antti Kaihola-7]

I applied Mark's patch on r7141 and it does fix my original problem.
Thanks!

--
You received this bug notification because you are a member of Mailman
Coders, which is subscribed to GNU Mailman.
https://bugs.launchpad.net/bugs/949924

Title:
  UnicodeDecodeError when delivering message

To manage notifications about this bug go to:
https://bugs.launchpad.net/mailman/+bug/949924/+subscriptions
_______________________________________________
Mailman-coders mailing list
Mailman-coders@...
http://mail.python.org/mailman/listinfo/mailman-coders

[Launchpad Bug Tracker-231]

** Changed in: mailman/3.0
    Milestone: postponed => 3.0.0b2

** Changed in: mailman/3.0
       Status: Confirmed => Fix Committed

--
You received this bug notification because you are a member of Mailman
Coders, which is subscribed to GNU Mailman.
https://bugs.launchpad.net/bugs/949924

Title:
  UnicodeDecodeError when delivering message

To manage notifications about this bug go to:
https://bugs.launchpad.net/mailman/+bug/949924/+subscriptions
_______________________________________________
Mailman-coders mailing list
Mailman-coders@...
http://mail.python.org/mailman/listinfo/mailman-coders

[Launchpad Bug Tracker-231]

** Changed in: mailman/3.0
       Status: Fix Committed => Fix Released

--
You received this bug notification because you are a member of Mailman
Coders, which is subscribed to GNU Mailman.
https://bugs.launchpad.net/bugs/949924

Title:
  UnicodeDecodeError when delivering message

To manage notifications about this bug go to:
https://bugs.launchpad.net/mailman/+bug/949924/+subscriptions
_______________________________________________
Mailman-coders mailing list
Mailman-coders@...
http://mail.python.org/mailman/listinfo/mailman-coders