Unable to build on MacOSX

[matejsp]

Describe the bug, including details regarding any error messages, version, and platform.

Latest pyarrow is unable to build on Macosx Sonoma

exceptions.
      [ 13%] Built target lib_pyx
      [ 15%] Generating pyarrow/src/arrow/python/lib_api.h, pyarrow/src/arrow/python/lib.h
      [ 15%] Built target cython_api_headers
      [ 18%] Building CXX object CMakeFiles/arrow_python.dir/cmake_pch_arm64.hxx.pch
      [ 18%] Building CXX object CMakeFiles/arrow_python.dir/pyarrow/src/arrow/python/init.cc.o
      [ 26%] Building CXX object CMakeFiles/arrow_python.dir/pyarrow/src/arrow/python/benchmark.cc.o
      [ 26%] Building CXX object CMakeFiles/arrow_python.dir/pyarrow/src/arrow/python/arrow_to_pandas.cc.o
      [ 26%] Building CXX object CMakeFiles/arrow_python.dir/pyarrow/src/arrow/python/datetime.cc.o
      [ 26%] Building CXX object CMakeFiles/arrow_python.dir/pyarrow/src/arrow/python/common.cc.o
      [ 28%] Building CXX object CMakeFiles/arrow_python.dir/pyarrow/src/arrow/python/decimal.cc.o
      [ 30%] Building CXX object CMakeFiles/arrow_python.dir/pyarrow/src/arrow/python/deserialize.cc.o
      [ 32%] Building CXX object CMakeFiles/arrow_python.dir/pyarrow/src/arrow/python/extension_type.cc.o
      In file included from /private/var/folders/l6/sfgrxfn92t180ltdcfc6_4l40000gp/T/pip-req-build-l9f1ldv3/pyarrow/src/arrow/python/extension_type.cc:22:
      /private/var/folders/l6/sfgrxfn92t180ltdcfc6_4l40000gp/T/pip-req-build-l9f1ldv3/pyarrow/src/arrow/python/extension_type.h:36:58: error: non-virtual member function marked 'override' hides virtual member function
        std::string ToString(bool show_metadata = false) const override;
                                                               ^
      /opt/homebrew/include/arrow/extension_type.h:53:15: note: hidden overloaded virtual function 'arrow::ExtensionType::ToString' declared here: different number of parameters (0 vs 1)
        std::string ToString() const override;
                    ^
      1 error generated.
      make[2]: *** [CMakeFiles/arrow_python.dir/pyarrow/src/arrow/python/extension_type.cc.o] Error 1
      make[2]: *** Waiting for unfinished jobs....
      make[1]: *** [CMakeFiles/arrow_python.dir/all] Error 2
      make: *** [all] Error 2
      error: command '/opt/homebrew/bin/cmake' failed with exit code 2
      [end of output]
 
  note: This error originates from a subprocess, and is likely not a problem with pip.
  ERROR: Failed building wheel for pyarrow
Failed to build pyarrow
ERROR: Failed to build one or more wheels
[notice] A new release of pip is available: 23.3.2 -> 24.0
[notice] To update, run: pip install --upgrade pip

Component(s)

Python

[llama90]

Would you like to refer to this document?

• https://arrow.apache.org/docs/developers/python.html#building-on-linux-and-macos

[kou]

It's strange that your pip didn't use wheel.
We have wheels for macOS: https://pypi.org/project/pyarrow/#files

[matejsp]

We don't use prebuilded wheel but build them ourselves since it is our company policy, because we don't know where the binaries where built. However the same process worked for older versions of pyarrow.

It says:
On macOS, any modern XCode (6.4 or higher; the current version is 13) or Xcode Command Line Tools (xcode-select --install) are sufficient.

gcc --version
Apple clang version 15.0.0 (clang-1500.3.9.4)
Target: x86_64-apple-darwin23.4.0
Thread model: posix
InstalledDir: /Library/Developer/CommandLineTools/usr/bin

[kou]

If you want to build from source, you should remove Apache Arrow C++ installed by Homebrew and build Apache Arrow C++ by yourself. Or you should wait for Homebrew/homebrew-core#169664 .

[matejsp]

Ouch ... tnx! that is the problem (invalid brew arrow version ... closing