Search Criteria
Package Details: arrow 3.0.0-1
Git Clone URL: | https://aur.archlinux.org/arrow.git (read-only, click to copy) |
---|---|
Package Base: | arrow |
Description: | A columnar in-memory analytics layer for big data. |
Upstream URL: | https://arrow.apache.org |
Licenses: | |
Conflicts: | |
Provides: | |
Submitter: | thrasibule |
Maintainer: | thrasibule |
Last Packager: | thrasibule |
Votes: | 9 |
Popularity: | 0.035894 |
First Submitted: | 2017-05-03 17:55 |
Last Updated: | 2021-02-03 20:34 |
Dependencies (22)
- boost-libs (boost171, boost-libs-git)
- brotli (brotli-git)
- c-ares-cmake
- double-conversion (double-conversion-git)
- gflags (gflags-static, gflags-git)
- google-glog (google-glog-static, glog-git)
- libutf8proc (libutf8proc-git)
- lz4 (lz4-git, lz4-static-musl, lz4-static)
- protobuf (protobuf3-git, protobuf-git, protobuf-static)
- rapidjson (rapidjson-git)
- snappy (snappy-git, libsnappy, snappy-static)
- thrift (fbthrift-git, thrift-git, thrift-0.10.0, thrift-static, fbthrift)
- uriparser
- zstd (zstd-git, zstd-static, zstd-cmake)
- grpc>=1.27.0
- git (git-git) (check)
- apache-orc (make)
- boost (boost-git) (make)
- cmake (cmake-git) (make)
- flatbuffers (flatbuffers-git, flatbuffers-static) (make)
- gmock (googletest-git) (make)
- python-numpy (python-numpy-mkl-bin, python-numpy-openblas, python-numpy-git, python-numpy-mkl) (make)
Required by (5)
- groonga (optional)
- luasandbox-extensions (requires parquet-cpp) (make)
- luasandbox-extensions (requires parquet-cpp)
- parquet-cpp
- python-pyarrow
Latest Comments
1 2 3 4 5 6 Next › Last »
lnicola commented on 2021-02-04 18:59
extra/c-ares 1.17.1-1 seems to have the cmake files.
sturu commented on 2020-11-05 12:34
Just a follow-up after a comment I left on 2020-06-07 about installing arrow for use in R:
I just had to update both via aur & in R & everything worked fine by following the instructions from @thrasibule to first install apache-orc after switching to protobuf-static, zstd-static, lz4-static & snappy-static. Then I installed protobuf, zstd, lz4 & snappy, and then arrow. During arrow install I could now leave -DARROW_FLIGHT=ON, though I still added -DARROW_WITH_SNAPPY=ON as mentioned previously. R install was as standard, with no need for the 'NOT_CRAN' environment variable or the arrow::install_arrow() step.
Thanks for the guidance on this.
galvez_65 commented on 2020-09-02 20:36
Hopefully c-ares that will get sorted out soon. Also I had to add python-pytz for the check to work, otherwise it would error out and not finish the build. You may need to add that as a check dependency.
thrasibule commented on 2020-09-02 18:46
I guess technically c-ares-cmake is just makedepends and c-ares is depends. Ideally c-ares starts shipping the cmake file which would make things easier. There is a bug report for it: https://bugs.archlinux.org/task/61918?project=1&string=c-ares
galvez_65 commented on 2020-09-02 16:56
is c-ares-cmake a dependency or a build dependency? The reason I ask is that cmake is a build dependency not a regular dependency so I'm not sure why the cmake variant of c-ares would be needed beyond the build.
khughitt commented on 2020-08-31 13:26
I think the cmake.patch file may need to be updated: it appears to point to 1.0.0 files and fails on my system.
khughitt commented on 2020-08-07 12:28
@thrasibule That was the case. I was, however, able to get everything working by just sticking to the static libraries (I still had to replace
zstd-static
withzstd
before buildingarrow
though). Everything appears to be working smoothly now though! I appreciate you taking the time to update the package and respond to my messages. Hopefully things will stabilize some down the road as the package matures and you won't have to go through so much effort :)thrasibule commented on 2020-08-07 01:46
That's strange. So this is with -DARROW_ORC=OFF and -DARROW_WITH_SNAPPY=ON? I tried on my machine and it works fine, not sure what could be the cause.
khughitt commented on 2020-08-06 14:09
Thanks for the quick response and suggestions! I tried first with just disabling the ORC tests and it was able to get quite close:
From the test logs, the failures all appear to be related to missing Snappy support, e.g.:
Snappy appeared to be detected fine though:
Possibly related: https://issues.apache.org/jira/browse/PARQUET-1856# (similar failures, even when snappy tests are set to be skipped.. )
thrasibule commented on 2020-08-06 13:00
The issue is not plasma not flight but orc. Orc needs to be compiled statically, and if it's compiled with a different version of protobuf, there are missing references. So I would either recompile and install apache-orc (which depends on the static versions of protobuf, zstd, lz4 and snappy). Then reinstall the non static versions of protobuf, zstd and lz4 (which is fine since they were statically compiled in apache-orc). Then arrow should compile fine. Alternatively, you can disable orc (-DARROW_ORC=OFF), and it should compile fine too.