Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

malloc: double free on Mac M1 #1697

Closed
DSLituiev opened this issue May 15, 2024 · 6 comments
Closed

malloc: double free on Mac M1 #1697

DSLituiev opened this issue May 15, 2024 · 6 comments

Comments

@DSLituiev
Copy link

Versions:

  • OS: Mac M1
  • Psycopg version: '2.9.9 (dt dec pq3 ext lo64)' (from master
  • Python version: 3.10.14

Describe the bug
Upon psycopg2.connect,

python(46885,0x203d8fac0) malloc: double free for ptr 0x1243fd200
python(46885,0x203d8fac0) malloc: *** set a breakpoint in malloc_error_break to debug
Abort trap: 6
@dvarrazzo dvarrazzo mentioned this issue May 16, 2024
Closed
@dvarrazzo
Copy link
Member

Did you upgrade the system recently and have a mix of new and old libraries?

Can we have more information? Such as:

  • are you using the binary or c extension? What does psycopg.pq.impl say?
  • are you connecting using ldap or other authentication systems
  • are you using an encrypted connection? What happens if you disable encryption?
  • can you connect using psql and using exactly the same connection string?
  • can you create a core dump and check where the crash happened?

@dvarrazzo
Copy link
Member

Not enough info. Probably caused by some buggy macOS library.

@nrodnova
Copy link

@DSLituiev were you able to resolve the error? We are experiencing the same issue.

@dvarrazzo
Copy link
Member

@nrodnova Any chance to have a core dump to debug it?

@nrodnova
Copy link

@dvarrazzo Unfortunately, no. My colleague had this problem, and he fixed it by now - by cleaning up his environment and reinstalling latest versions of everything. We use Python 3.10. If I find out more, I will post here.

@nickodell
Copy link

nickodell commented Jul 29, 2024 •
edited
Loading

Any chance to have a core dump to debug it?

I'm having a similar problem, and I have a core dump.

I get the following error message:

$ python manage.py migrate           
[...]
python(41275,0x7ff8566c37c0) malloc: double free for ptr 0x7faeb0a4c600
python(41275,0x7ff8566c37c0) malloc: *** set a breakpoint in malloc_error_break to debug
[1]    41275 abort (core dumped)  python manage.py migrate

Investingating the core dump, it crashes with the following backtrace:

$ lldb python --core /cores/core.41275
(lldb) target create "python" --core "/cores/core.41275"
Core file '/cores/core.41275' (x86_64) was loaded.
(lldb) bt
* thread #1
  * frame #0: 0x00007ff812faf196 libsystem_kernel.dylib`__pthread_kill + 10
    frame #1: 0x00007ff812fe6ee6 libsystem_pthread.dylib`pthread_kill + 263
    frame #2: 0x00007ff812f0db45 libsystem_c.dylib`abort + 123
    frame #3: 0x00007ff812e24752 libsystem_malloc.dylib`malloc_vreport + 888
    frame #4: 0x00007ff812e39a08 libsystem_malloc.dylib`malloc_zone_error + 183
    frame #5: 0x000000010b7174ee libpq.5.14.dylib`freePGconn + 1031
    frame #6: 0x000000010b6c9a33 _psycopg.cpython-310-darwin.so`conn_close + 83
    frame #7: 0x000000010b6ca568 _psycopg.cpython-310-darwin.so`connection_dealloc + 40
    frame #8: 0x0000000107ff42ad libpython3.10.dylib`type_call + 397
    frame #9: 0x0000000107f982e5 libpython3.10.dylib`_PyObject_MakeTpCall + 373
    frame #10: 0x0000000107f98f45 libpython3.10.dylib`_PyObject_CallFunctionVa + 709
    frame #11: 0x0000000107f99166 libpython3.10.dylib`_PyObject_CallFunction_SizeT + 166
    frame #12: 0x000000010b6d7475 _psycopg.cpython-310-darwin.so`psyco_connect + 213
    frame #13: 0x0000000107fdc295 libpython3.10.dylib`cfunction_call + 69
    frame #14: 0x0000000107f987fc libpython3.10.dylib`_PyObject_Call + 140
    frame #15: 0x0000000108073326 libpython3.10.dylib`_PyEval_EvalFrameDefault + 25942
    frame #16: 0x000000010806cca2 libpython3.10.dylib`_PyEval_Vector + 146
    frame #17: 0x0000000107f986ab libpython3.10.dylib`PyVectorcall_Call + 155
    frame #18: 0x0000000108073326 libpython3.10.dylib`_PyEval_EvalFrameDefault + 25942
    frame #19: 0x000000010806cca2 libpython3.10.dylib`_PyEval_Vector + 146
    frame #20: 0x0000000108073326 libpython3.10.dylib`_PyEval_EvalFrameDefault + 25942
    frame #21: 0x000000010806cca2 libpython3.10.dylib`_PyEval_Vector + 146
    frame #22: 0x00000001080769bc libpython3.10.dylib`call_function + 428
    frame #23: 0x0000000108072e95 libpython3.10.dylib`_PyEval_EvalFrameDefault + 24773
    frame #24: 0x000000010806cca2 libpython3.10.dylib`_PyEval_Vector + 146
    frame #25: 0x0000000108073326 libpython3.10.dylib`_PyEval_EvalFrameDefault + 25942
    frame #26: 0x000000010806cca2 libpython3.10.dylib`_PyEval_Vector + 146
    frame #27: 0x00000001080769bc libpython3.10.dylib`call_function + 428
    frame #28: 0x0000000108072e95 libpython3.10.dylib`_PyEval_EvalFrameDefault + 24773
    frame #29: 0x000000010806cca2 libpython3.10.dylib`_PyEval_Vector + 146
    frame #30: 0x0000000108073326 libpython3.10.dylib`_PyEval_EvalFrameDefault + 25942
    frame #31: 0x000000010806cca2 libpython3.10.dylib`_PyEval_Vector + 146
    frame #32: 0x00000001080769bc libpython3.10.dylib`call_function + 428
    frame #33: 0x0000000108072e95 libpython3.10.dylib`_PyEval_EvalFrameDefault + 24773
    frame #34: 0x000000010806cca2 libpython3.10.dylib`_PyEval_Vector + 146
    frame #35: 0x00000001080769bc libpython3.10.dylib`call_function + 428
    frame #36: 0x0000000108072e95 libpython3.10.dylib`_PyEval_EvalFrameDefault + 24773
    frame #37: 0x000000010806cca2 libpython3.10.dylib`_PyEval_Vector + 146
    frame #38: 0x0000000108073326 libpython3.10.dylib`_PyEval_EvalFrameDefault + 25942
    frame #39: 0x000000010806cca2 libpython3.10.dylib`_PyEval_Vector + 146
    frame #40: 0x00000001080769bc libpython3.10.dylib`call_function + 428
    frame #41: 0x0000000108072e95 libpython3.10.dylib`_PyEval_EvalFrameDefault + 24773
    frame #42: 0x0000000107facf8f libpython3.10.dylib`gen_send_ex2 + 431
    frame #43: 0x0000000107fac016 libpython3.10.dylib`gen_iternext + 22
    frame #44: 0x000000010806a608 libpython3.10.dylib`builtin_next + 88
    frame #45: 0x0000000107fdbb95 libpython3.10.dylib`cfunction_vectorcall_FASTCALL + 197
    frame #46: 0x00000001080769bc libpython3.10.dylib`call_function + 428
    frame #47: 0x000000010806d3e2 libpython3.10.dylib`_PyEval_EvalFrameDefault + 1554
    frame #48: 0x000000010806cca2 libpython3.10.dylib`_PyEval_Vector + 146
    frame #49: 0x0000000107f9accf libpython3.10.dylib`method_vectorcall + 479
    frame #50: 0x0000000108072c73 libpython3.10.dylib`_PyEval_EvalFrameDefault + 24227
    frame #51: 0x000000010806cca2 libpython3.10.dylib`_PyEval_Vector + 146
    frame #52: 0x00000001080769bc libpython3.10.dylib`call_function + 428
    frame #53: 0x0000000108072ec1 libpython3.10.dylib`_PyEval_EvalFrameDefault + 24817
    frame #54: 0x000000010806cca2 libpython3.10.dylib`_PyEval_Vector + 146
    frame #55: 0x0000000107f99c51 libpython3.10.dylib`object_vacall + 353
    frame #56: 0x0000000107f99fb6 libpython3.10.dylib`PyObject_CallFunctionObjArgs + 166
    frame #57: 0x0000000107fe020e libpython3.10.dylib`_PyObject_GenericGetAttrWithDict + 494
    frame #58: 0x0000000107fdf9d5 libpython3.10.dylib`PyObject_GetAttr + 85
    frame #59: 0x0000000108071253 libpython3.10.dylib`_PyEval_EvalFrameDefault + 17539
    frame #60: 0x000000010806cca2 libpython3.10.dylib`_PyEval_Vector + 146
    frame #61: 0x00000001080769bc libpython3.10.dylib`call_function + 428
    frame #62: 0x0000000108072ec1 libpython3.10.dylib`_PyEval_EvalFrameDefault + 24817
    frame #63: 0x000000010806cca2 libpython3.10.dylib`_PyEval_Vector + 146
    frame #64: 0x0000000107f99c51 libpython3.10.dylib`object_vacall + 353
    frame #65: 0x0000000107f99fb6 libpython3.10.dylib`PyObject_CallFunctionObjArgs + 166
    frame #66: 0x0000000107fe020e libpython3.10.dylib`_PyObject_GenericGetAttrWithDict + 494
    frame #67: 0x0000000107fdf9d5 libpython3.10.dylib`PyObject_GetAttr + 85
    frame #68: 0x0000000108101d8e libpython3.10.dylib`attrgetter_call + 142
    frame #69: 0x0000000107f982e5 libpython3.10.dylib`_PyObject_MakeTpCall + 373
    frame #70: 0x0000000107fa26f7 libpython3.10.dylib`property_descr_get + 183
    frame #71: 0x0000000107fe00dd libpython3.10.dylib`_PyObject_GenericGetAttrWithDict + 189
    frame #72: 0x0000000107fdf9d5 libpython3.10.dylib`PyObject_GetAttr + 85
    frame #73: 0x0000000108071253 libpython3.10.dylib`_PyEval_EvalFrameDefault + 17539
    frame #74: 0x000000010806cca2 libpython3.10.dylib`_PyEval_Vector + 146
    frame #75: 0x0000000107f9ac42 libpython3.10.dylib`method_vectorcall + 338
    frame #76: 0x00000001080769bc libpython3.10.dylib`call_function + 428
    frame #77: 0x0000000108072ec1 libpython3.10.dylib`_PyEval_EvalFrameDefault + 24817
    frame #78: 0x000000010806cca2 libpython3.10.dylib`_PyEval_Vector + 146
    frame #79: 0x0000000107f9ac42 libpython3.10.dylib`method_vectorcall + 338
    frame #80: 0x0000000107f986ab libpython3.10.dylib`PyVectorcall_Call + 155
    frame #81: 0x0000000108073326 libpython3.10.dylib`_PyEval_EvalFrameDefault + 25942
    frame #82: 0x000000010806cca2 libpython3.10.dylib`_PyEval_Vector + 146
    frame #83: 0x00000001080769bc libpython3.10.dylib`call_function + 428
    frame #84: 0x0000000108072f65 libpython3.10.dylib`_PyEval_EvalFrameDefault + 24981
    frame #85: 0x000000010806cca2 libpython3.10.dylib`_PyEval_Vector + 146
    frame #86: 0x0000000107f9ac42 libpython3.10.dylib`method_vectorcall + 338
    frame #87: 0x00000001080769bc libpython3.10.dylib`call_function + 428
    frame #88: 0x0000000108072f65 libpython3.10.dylib`_PyEval_EvalFrameDefault + 24981
    frame #89: 0x000000010806cca2 libpython3.10.dylib`_PyEval_Vector + 146
    frame #90: 0x0000000107f9ac42 libpython3.10.dylib`method_vectorcall + 338
    frame #91: 0x00000001080769bc libpython3.10.dylib`call_function + 428
    frame #92: 0x0000000108072f65 libpython3.10.dylib`_PyEval_EvalFrameDefault + 24981
    frame #93: 0x000000010806cca2 libpython3.10.dylib`_PyEval_Vector + 146
    frame #94: 0x0000000107f986ab libpython3.10.dylib`PyVectorcall_Call + 155
    frame #95: 0x0000000108073326 libpython3.10.dylib`_PyEval_EvalFrameDefault + 25942
    frame #96: 0x000000010806cca2 libpython3.10.dylib`_PyEval_Vector + 146
    frame #97: 0x0000000107f9ac42 libpython3.10.dylib`method_vectorcall + 338
    frame #98: 0x0000000107f986ab libpython3.10.dylib`PyVectorcall_Call + 155
    frame #99: 0x0000000108073326 libpython3.10.dylib`_PyEval_EvalFrameDefault + 25942
    frame #100: 0x000000010806cca2 libpython3.10.dylib`_PyEval_Vector + 146
    frame #101: 0x0000000107f9ac42 libpython3.10.dylib`method_vectorcall + 338
    frame #102: 0x0000000107f986ab libpython3.10.dylib`PyVectorcall_Call + 155
    frame #103: 0x0000000108073326 libpython3.10.dylib`_PyEval_EvalFrameDefault + 25942
    frame #104: 0x000000010806cca2 libpython3.10.dylib`_PyEval_Vector + 146
    frame #105: 0x00000001080769bc libpython3.10.dylib`call_function + 428
    frame #106: 0x0000000108072e95 libpython3.10.dylib`_PyEval_EvalFrameDefault + 24773
    frame #107: 0x000000010806cca2 libpython3.10.dylib`_PyEval_Vector + 146
    frame #108: 0x00000001080769bc libpython3.10.dylib`call_function + 428
    frame #109: 0x0000000108072e95 libpython3.10.dylib`_PyEval_EvalFrameDefault + 24773
    frame #110: 0x000000010806cca2 libpython3.10.dylib`_PyEval_Vector + 146
    frame #111: 0x00000001080769bc libpython3.10.dylib`call_function + 428
    frame #112: 0x000000010806d3e2 libpython3.10.dylib`_PyEval_EvalFrameDefault + 1554
    frame #113: 0x000000010806cca2 libpython3.10.dylib`_PyEval_Vector + 146
    frame #114: 0x00000001080769bc libpython3.10.dylib`call_function + 428
    frame #115: 0x000000010806d3e2 libpython3.10.dylib`_PyEval_EvalFrameDefault + 1554
    frame #116: 0x000000010806cca2 libpython3.10.dylib`_PyEval_Vector + 146
    frame #117: 0x000000010806cbf8 libpython3.10.dylib`PyEval_EvalCode + 120
    frame #118: 0x00000001080bb305 libpython3.10.dylib`run_mod + 149
    frame #119: 0x00000001080b946a libpython3.10.dylib`_PyRun_SimpleFileObject + 954
    frame #120: 0x00000001080b8ecb libpython3.10.dylib`_PyRun_AnyFileObject + 123
    frame #121: 0x00000001080d7bcf libpython3.10.dylib`Py_RunMain + 2447
    frame #122: 0x00000001080d7e7a libpython3.10.dylib`pymain_main + 314
    frame #123: 0x00000001080d7ecb libpython3.10.dylib`Py_BytesMain + 43
    frame #124: 0x00007ff812c8c41f dyld`start + 1903

My situation has the following similarities and differences to OP's case.

  • OS: OS X 13.6.7
  • Architecture: x86_64
  • Python version: Python 3.10.10
  • pyscopg2 version: 2.9.9

I also attempted to get it to crash under GDB, but I could not reproduce the crash in that case.

I can't provide the core dump itself - it contains proprietary data that I don't know how to remove. However, I can provide information from the core dump, if that's helpful.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
4 participants
@dvarrazzo @nickodell @nrodnova @DSLituiev