Package Details: arrow 0.15.0-1

Git Clone URL: https://aur.archlinux.org/arrow.git (read-only)
Package Base: arrow
Description: A columnar in-memory analytics layer for big data.
Upstream URL: https://arrow.apache.org
Licenses: Apache
Conflicts: parquet-cpp
Provides: parquet-cpp
Submitter: thrasibule
Maintainer: thrasibule
Last Packager: thrasibule
Votes: 4
Popularity: 1.99
First Submitted: 2017-05-03 17:55
Last Updated: 2019-10-08 19:30

Latest Comments

1 2 3 Next › Last »

znmeb commented on 2019-08-12 21:06

Yeah - same error message. I'm wanting to call it from R with the new CRAN arrow package, which points you to the upstream source. So I might as well do that; a side benefit is that the upstream appears to have a native port to Rust, which I can also use.

This stuff should all be up-voted so it can move to community ;-)

thrasibule commented on 2019-08-12 21:00

That's strange. Error message is the same as before? You can also disable orc which might be an easier fix (-DARROW_ORC=OFF in the PKGBUILD).

znmeb commented on 2019-08-12 20:47

Even with the downgraded protobuf-static it doesn't work. I'll have to build from upstream source

thrasibule commented on 2019-08-12 19:19

Well static libraries are only required at build time, so you can switch back to the non static versions afterwards if you want. I've just tried to recompile everything from scratch and it worked with one caveat. Basically the versions of protobuf-static and protobuf need to match. So you need to reinstall protobuf-static version 3.7 (the version in the AUR in 3.8), then install apache-orc, then you can switch snappy-static, lz4-static and protobuf-static to the dynamic version, then install arrow and everything should work. I'll downgrade protobuf in the AUR, since it basically needs to be kept in sync with the community version which I don't control.

znmeb commented on 2019-08-12 18:29

It's a dependency conflict then - some of the packages in the stack require static libraries and some require dynamic ones. Static libraries tend to break my system, as they do in this case.

$ yay -Syu arrow
:: Synchronizing package databases...
 core is up to date
 extra is up to date
 community is up to date
 multilib is up to date
 arcolinux_repo is up to date
 arcolinux_repo_3party is up to date
 arcolinux_repo_submicron is up to date
:: Starting full system upgrade...
 there is nothing to do
:: Searching databases for updates...
:: Searching AUR for updates...
 -> opencl-amd: local (19.30.838629-1) is newer than AUR (19.20.812932-1)
 -> Orphaned AUR Packages:  kubernetes
 -> Out Of Date AUR Packages:  kubernetes
:: Checking for conflicts...
:: Checking for inner conflicts...

==> Package conflicts found:
 -> Installing snappy-static will remove: snappy
 -> Installing zlib-static will remove: zlib
 -> Installing lz4-static will remove: lz4
 -> Installing protobuf-static will remove: protobuf

==> Conflicting packages will have to be confirmed manually

[Aur: 5]  lz4-static-1.9.1-1  zlib-static-1:1.2.11-2  protobuf-static-3.8.0-1  snappy-static-1.1.7-1  arrow-0.14.0-1
[Aur Make: 1]  apache-orc-1.5.6-1

thrasibule commented on 2019-08-12 18:17

Which version of apache-orc do you have? There is something a bit tricky with apache-orc which requires protobuf-static, and arrow which uses the non static version. I think if you reinstall protobuf-static, apache-orc and protobuf in that order it should work. I works on my machine at least. If you could also post which versions of the libraries are picked up by cmake at the beginning, maybe I'll spot something off.

znmeb commented on 2019-08-12 18:09

Nope:

$ yay protobuf|grep Installed
2 extra/protobuf-c 1.3.1-2 (90.6 KiB 307.0 KiB) (Installed)
1 extra/protobuf 3.7.0-1 (1.8 MiB 8.7 MiB) (Installed)

thrasibule commented on 2019-08-12 18:07

@znmeb I suspect you have protobuf-static installed. Can you try uninstall it and use protobuf instead?

znmeb commented on 2019-08-12 17:19

Doesn't build:

Scanning dependencies of target orc-adapter-test
[ 52%] Building CXX object src/arrow/adapters/orc/CMakeFiles/orc-adapter-test.dir/adapter-test.cc.o
[ 52%] Linking CXX executable ../../../../release/orc-adapter-test
/usr/bin/ld: /usr/lib/liborc.a(orc-proto-wrapper.cc.o): in function `orc::proto::IntegerStatistics::GetMetadata() const':
(.text+0x1c): undefined reference to `google::protobuf::internal::AssignDescriptors(google::protobuf::internal::DescriptorTable const*)'
/usr/bin/ld: /usr/lib/liborc.a(orc-proto-wrapper.cc.o): in function `orc::proto::DoubleStatistics::GetMetadata() const':
(.text+0x4c): undefined reference to `google::protobuf::internal::AssignDescriptors(google::protobuf::internal::DescriptorTable const*)'
/usr/bin/ld: /usr/lib/liborc.a(orc-proto-wrapper.cc.o): in function `orc::proto::StringStatistics::GetMetadata() const':
(.text+0x7c): undefined reference to `google::protobuf::internal::AssignDescriptors(google::protobuf::internal::DescriptorTable const*)'
/usr/bin/ld: /usr/lib/liborc.a(orc-proto-wrapper.cc.o): in function `orc::proto::BucketStatistics::GetMetadata() const':
(.text+0xac): undefined reference to `google::protobuf::internal::AssignDescriptors(google::protobuf::internal::DescriptorTable const*)'
/usr/bin/ld: /usr/lib/liborc.a(orc-proto-wrapper.cc.o): in function `orc::proto::DecimalStatistics::GetMetadata() const':
(.text+0xdc): undefined reference to `google::protobuf::internal::AssignDescriptors(google::protobuf::internal::DescriptorTable const*)'
/usr/bin/ld: /usr/lib/liborc.a(orc-proto-wrapper.cc.o):(.text+0x10c): more undefined references to `google::protobuf::internal::AssignDescriptors(google::protobuf::internal::DescriptorTable const*)' follow
/usr/bin/ld: /usr/lib/liborc.a(orc-proto-wrapper.cc.o): in function `_GLOBAL__sub_I_orc_proto_wrapper.cc':
(.text.startup+0x36): undefined reference to `google::protobuf::internal::AddDescriptors(google::protobuf::internal::DescriptorTable const*)'
collect2: error: ld returned 1 exit status
make[2]: *** [src/arrow/adapters/orc/CMakeFiles/orc-adapter-test.dir/build.make:106: release/orc-adapter-test] Error 1
make[1]: *** [CMakeFiles/Makefile2:2426: src/arrow/adapters/orc/CMakeFiles/orc-adapter-test.dir/all] Error 2
make[1]: *** Waiting for unfinished jobs....
[ 53%] Building CXX object src/parquet/CMakeFiles/parquet_objlib.dir/encoding.cc.o
[ 53%] Building CXX object src/parquet/CMakeFiles/parquet_objlib.dir/file_reader.cc.o
[ 53%] Building CXX object src/parquet/CMakeFiles/parquet_objlib.dir/file_writer.cc.o
[ 53%] Building CXX object src/parquet/CMakeFiles/parquet_objlib.dir/metadata.cc.o
[ 54%] Building CXX object src/parquet/CMakeFiles/parquet_objlib.dir/murmur3.cc.o
[ 54%] Building CXX object src/parquet/CMakeFiles/parquet_objlib.dir/parquet_constants.cpp.o
[ 54%] Building CXX object src/parquet/CMakeFiles/parquet_objlib.dir/parquet_types.cpp.o
[ 54%] Building CXX object src/parquet/CMakeFiles/parquet_objlib.dir/platform.cc.o
[ 55%] Building CXX object src/parquet/CMakeFiles/parquet_objlib.dir/printer.cc.o
[ 55%] Building CXX object src/parquet/CMakeFiles/parquet_objlib.dir/properties.cc.o
[ 55%] Building CXX object src/parquet/CMakeFiles/parquet_objlib.dir/schema.cc.o
[ 56%] Building CXX object src/parquet/CMakeFiles/parquet_objlib.dir/statistics.cc.o
[ 56%] Building CXX object src/parquet/CMakeFiles/parquet_objlib.dir/types.cc.o
[ 56%] Built target parquet_objlib
make: *** [Makefile:141: all] Error 2
==> ERROR: A failure occurred in build().
    Aborting...
Error making: arrow

BlueMacaw commented on 2019-03-18 12:44

Please, add flex package as dependency.