Skip to content
This repository has been archived by the owner on May 10, 2023. It is now read-only.

UnicodeEncodeError while parsing logs #38

Open
tonioo opened this issue Feb 2, 2018 · 1 comment
Open

UnicodeEncodeError while parsing logs #38

tonioo opened this issue Feb 2, 2018 · 1 comment
Labels
bug

Comments

@tonioo
Copy link
Member

tonioo commented Feb 2, 2018 

Traceback (most recent call last):
  File "/srv/modoboa/instance/manage.py", line 22, in <module>
    execute_from_command_line(sys.argv)
  File "/srv/modoboa/env/lib/python2.7/site-packages/django/core/management/__init__.py", line 364, in execute_from_command_line
    utility.execute()
  File "/srv/modoboa/env/lib/python2.7/site-packages/django/core/management/__init__.py", line 356, in execute
    self.fetch_command(subcommand).run_from_argv(self.argv)
  File "/srv/modoboa/env/lib/python2.7/site-packages/django/core/management/base.py", line 283, in run_from_argv
    self.execute(*args, **cmd_options)
  File "/srv/modoboa/env/lib/python2.7/site-packages/django/core/management/base.py", line 330, in execute
    output = self.handle(*args, **options)
  File "/srv/modoboa/env/lib/python2.7/site-packages/modoboa_stats/management/commands/logparser.py", line 589, in handle
    p.process()
  File "/srv/modoboa/env/lib/python2.7/site-packages/modoboa_stats/management/commands/logparser.py", line 555, in process
    self._parse_line(line)
  File "/srv/modoboa/env/lib/python2.7/site-packages/modoboa_stats/management/commands/logparser.py", line 546, in _parse_line
    "[parser] no log handler for \"{}\": {}".format(prog, log))
UnicodeEncodeError: 'ascii' codec can't encode character u'\xe9' in position 109: ordinal not in range(128)
@tonioo tonioo added the bug label Feb 2, 2018
@jaesivsm
Copy link
Contributor

I think it'd be solved by #43

tsabi pushed a commit to tsabi/modoboa-stats that referenced this issue Dec 1, 2019
FIX: UnicodeDecodeError during logfile parsing
5cfa88c 
If you use postfix internationally, you will hit this error.
I believe this is the right fix, because those log files are NOT utf-8 encoded,
so you should not read it as utf-8, but with the real encoding of that file.

Fixes: modoboa/modoboa#1788, modoboa#55, modoboa#38, 

```
root@h7-mailsrv:/etc/cron.d# /srv/modoboa/env/bin/python /srv/modoboa/instance/manage.py logparser
Traceback (most recent call last):
  File "/srv/modoboa/instance/manage.py", line 22, in <module>
    execute_from_command_line(sys.argv)
  File "/srv/modoboa/env/local/lib/python2.7/site-packages/django/core/management/__init__.py", line 364, in execute_from_command_line
    utility.execute()
  File "/srv/modoboa/env/local/lib/python2.7/site-packages/django/core/management/__init__.py", line 356, in execute
    self.fetch_command(subcommand).run_from_argv(self.argv)
  File "/srv/modoboa/env/local/lib/python2.7/site-packages/django/core/management/base.py", line 283, in run_from_argv
    self.execute(*args, **cmd_options)
  File "/srv/modoboa/env/local/lib/python2.7/site-packages/django/core/management/base.py", line 330, in execute
    output = self.handle(*args, **options)
  File "/srv/modoboa/env/local/lib/python2.7/site-packages/modoboa_stats/management/commands/logparser.py", line 587, in handle
    p.process()
  File "/srv/modoboa/env/local/lib/python2.7/site-packages/modoboa_stats/management/commands/logparser.py", line 552, in process
    for line in self.f.readlines():
  File "/srv/modoboa/env/lib/python2.7/codecs.py", line 314, in decode
    (result, consumed) = self._buffer_decode(data, self.errors, final)
UnicodeDecodeError: 'utf8' codec can't decode byte 0xc1 in position 949: invalid start byte
```
@tsabi tsabi mentioned this issue Dec 1, 2019
Open
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Assignees
No one assigned
Labels
bug
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@tonioo @jaesivsm