Search Criteria
Package Details: python-horovod 0.21.3-1
| Git Clone URL: | https://aur.archlinux.org/python-horovod.git (read-only, click to copy) |
|---|---|
| Package Base: | python-horovod |
| Description: | Distributed training framework for TensorFlow, Keras, PyTorch, and Apache MXNet |
| Upstream URL: | https://github.com/horovod/horovod |
| Licenses: | |
| Submitter: | hottea |
| Maintainer: | hottea (lilac) |
| Last Packager: | lilac |
| Votes: | 0 |
| Popularity: | 0.000000 |
| First Submitted: | 2020-03-26 17:35 |
| Last Updated: | 2021-02-16 06:28 |
Dependencies (24)
- cuda (cuda-11.0, cuda11.1)
- cudnn
- nccl (nccl-git)
- openmpi (openmpi-git, openmpi3, openmpi-gcc8, openmpi-gcc9)
- python-cloudpickle
- python-h5py (python-h5py-git, python-h5py-openmpi)
- python-mock
- python-mpi4py (python-mpi4py-intel)
- python-psutil
- python-pyaml
- python-pycparser
- python-scipy (python-scipy-mkl, python-scipy-mkl-bin)
- python-six
- python-tqdm
- cmake (cmake-git) (make)
- git (git-git) (make)
- mxnet-cuda (mxnet-cuda-git) (make)
- python-pip (make)
- python-pytorch-cuda (python-pytorch-mkl-cuda-git, python-pytorch-cuda-kepler, python-pytorch-opt-cuda) (make)
- python-setuptools (make)
- python-tensorflow-cuda (python-tensorflow114-opt-cuda, python-tensorflow-opt-native-cuda, python-tensorflow-cuda-git, python-tensorflow-opt-cuda) (make)
- mxnet-cuda (mxnet-cuda-git) (optional) – mxnet framework
- python-pytorch-cuda (python-pytorch-mkl-cuda-git, python-pytorch-cuda-kepler, python-pytorch-opt-cuda) (optional) – pytorch framework
- python-tensorflow-cuda (python-tensorflow114-opt-cuda, python-tensorflow-opt-native-cuda, python-tensorflow-cuda-git, python-tensorflow-opt-cuda) (optional) – tensorflow framework
Required by (1)
- python-pytorch-lightning (optional)
Latest Comments
olko commented on 2021-03-10 12:09
I want to build the applications from original repos!
You told me that you are able to build python-horovod but I get an error because simply building with yay. That's odd.
hottea commented on 2021-03-10 11:29
@olko I'm sure how yay build this pkg. However, I always build pkg in a clean chroot. Other pkgs/deps/compiler/environment settings might lead to failure buiding pkgs. What not simply add this repo, and
pacman -S python-horovod? As for the new ROCm issue, report to upstream, not here.olko commented on 2021-03-10 08:35
Could it be that an unmet dependency ist causing the error. Especially I see ROCm (I use only CUDA + mxnet) is referenced in the compiler output:
olko commented on 2021-03-10 08:28
I simply used
yay -S python-horovodwhy should this not work (for instance building mxnet was not a problem)? Or why is build in a change rooted env required?hottea commented on 2021-03-10 08:20
You could install it from ArchLinuc CN repo without building it from source. If you'd like to build it from source, try building it in a clean chroot. Check the latest build log here, I see no error.
olko commented on 2021-03-10 07:13
Fails with error: make: * [Makefile:149: all] Fehler 2 Traceback (most recent call last): File "/home/graemer/.cache/yay/python-horovod/src/horovod-0.21.3/setup.py", line 146, in <module> setup(name='horovod', File "/usr/lib/python3.9/site-packages/setuptools/init.py", line 153, in setup return distutils.core.setup(attrs) File "/usr/lib/python3.9/distutils/core.py", line 148, in setup dist.run_commands() File "/usr/lib/python3.9/distutils/dist.py", line 966, in run_commands self.run_command(cmd) File "/usr/lib/python3.9/distutils/dist.py", line 985, in run_command cmd_obj.run() File "/usr/lib/python3.9/distutils/command/build.py", line 135, in run self.run_command(cmd_name) File "/usr/lib/python3.9/distutils/cmd.py", line 313, in run_command self.distribution.run_command(command) File "/usr/lib/python3.9/distutils/dist.py", line 985, in run_command cmd_obj.run() File "/usr/lib/python3.9/site-packages/setuptools/command/build_ext.py", line 79, in run _build_ext.run(self) File "/usr/lib/python3.9/site-packages/Cython/Distutils/old_build_ext.py", line 186, in run _build_ext.build_ext.run(self) File "/usr/lib/python3.9/distutils/command/build_ext.py", line 340, in run self.build_extensions() File "/home/graemer/.cache/yay/python-horovod/src/horovod-0.21.3/setup.py", line 90, in build_extensions subprocess.check_call([cmake_bin, '--build', '.'] + cmake_build_args, File "/usr/lib/python3.9/subprocess.py", line 373, in check_call raise CalledProcessError(retcode, cmd) subprocess.CalledProcessError: Command '['cmake', '--build', '.', '--config', 'RelWithDebInfo', '--', 'VERBOSE=1']' returned non-zero exit status 2. ==> FEHLER: Ein Fehler geschah in build(). Breche ab... error making: python-horovod
I guess it is caused by:
Error copying file (if different) from "/home/graemer/.cache/yay/python-horovod/src/horovod-0.21.3/build/temp.linux-x86_64-3.9/horovod/common/ops/cuda/CMakeFiles/horovod_cuda_kernels.dir//horovod_cuda_kernels_generated_cuda_kernels.cu.o.depend.tmp" to "/home/graemer/.cache/yay/python-horovod/src/horovod-0.21.3/build/temp.linux-x86_64-3.9/horovod/common/ops/cuda/CMakeFiles/horovod_cuda_kernels.dir//horovod_cuda_kernels_generated_cuda_kernels.cu.o.depend". CMake Error at horovod_cuda_kernels_generated_cuda_kernels.cu.o.RelWithDebInfo.cmake:238 (message): Error generating /home/graemer/.cache/yay/python-horovod/src/horovod-0.21.3/build/temp.linux-x86_64-3.9/horovod/common/ops/cuda/CMakeFiles/horovod_cuda_kernels.dir//./horovod_cuda_kernels_generated_cuda_kernels.cu.o