spack: filter_compiler_wrappers() does not wok on Cray systems as advertised

My understanding is filter_compiler_wrappers() can be used to change spack compilers back to system compilers - aka mpicc wrappers [or similar use - user makefiles]. And this should work from both spack env [for dependent packages] - and outsite spack [for user compilers]

This is related to #10365

Here petsc creates a user-makefile that a dependant package pflotran uses. Also petsc users who are not in spack env also use this user-makefile for compiling user applications. [aka mpicc wrapper - which internally uses system compiler]

This works for me on linux - but not Cray systems [Theta/Cori]

On cray systems - when spack attempts to install dependent package using this system compiler - the build errors out

Steps to reproduce the issue

balay@cori05:~/spack> git describe
v0.8.17-10445-ge3f00750e
balay@cori05:~/spack> spack install --dirty -j8 pflotran ^hdf5+hl

Error Message

     9     ftn -c -fPIC     -I/global/u2/b/balay/spack/opt/spack/cray-cnl9-haswell/intel-18.0.3.222/petsc-3.11.0-rgzfigpowxqofxo5wtu5rgt6omjoxnwz/include -I/global/u2/
           b/balay/spack/opt/spack/cray-cnl9-haswell/intel-18.0.3.222/hypre-2.15.1-b7sedjuhnjsi4vjw3nqhjirxeysfekvh/include -I/global/u2/b/balay/spack/opt/spack/cray-c
           nl9-haswell/intel-18.0.3.222/superlu-dist-6.1.0-jcfujt5n7tfseukklffr5jkci3j3hkfb/include -I/global/u2/b/balay/spack/opt/spack/cray-cnl9-haswell/intel-18.0.3
           .222/hdf5-1.10.5-hk3pedgeh6zokqckjxnspqwa6ijaqodq/include -I/global/u2/b/balay/spack/opt/spack/cray-cnl9-haswell/intel-18.0.3.222/parmetis-4.0.3-kqtzwywdfbc
           plnrv62g7o6dcimvt623q/include -I/global/u2/b/balay/spack/opt/spack/cray-cnl9-haswell/intel-18.0.3.222/metis-5.1.0-2n3dm3mnxr2pq4ipm77l2vgesdue4rtm/include -
           I/usr/include   -I.  -o derivatives_utilities.o derivatives_utilities.F90
<snip>
     12    Error:
     13      cray-libsci/18.07.1 is not available for the INTEL compiler.
     14    /global/u2/b/balay/spack/opt/spack/cray-cnl9-haswell/intel-18.0.3.222/petsc-3.11.0-rgzfigpowxqofxo5wtu5rgt6omjoxnwz/lib/petsc/conf/petscrules:31: recipe for
            target 'derivatives_utilities.o' failed

Information on your system

Attaching config files and build logs from NERSC/Cori

console.txt petsc-build.env.txt petsc-build.out.txt petscvariables.txt pflotran-spack-build.env.txt pflotran-spack-build.out.txt

About this issue

  • Original URL
  • State: closed
  • Created 8 years ago
  • Comments: 33 (33 by maintainers)

Commits related to this issue

Most upvoted comments

@scheibelp, PR is now updated with ‘ftn’ in lib/spack/env

Here it is

balay@cori05:~/spack> script
Script started, file is typescript
balay@cori05:~/spack> spack -d build-env pflotran@develop^hdf5+hl bash
<snip>
balay@cori05:~/spack> module list |& grep libsci
  5) cray-libsci/18.07.1
balay@cori05:~/spack> exit
balay@cori05:~/spack> exit
Script done, file is typescript
balay@cori05:~/spack> grep libsci typescript
==> [2019-04-15-20:38:26.422220] Unloading module: cray-libsci
==> [2019-04-15-20:38:26.450186] '/opt/cray/pe/modules/3.2.10.6/bin/modulecmd' 'python' 'unload' 'cray-libsci'
balay@cori05:~/spack> module list |& grep libsci
  5) cray-libsci/18.07.1
balay@cori05:~/spack> 

Attaching the complete log from script

typescript.txt

Well I think this report is the primary issue with spack [or some conflict on cray] with using filter_compiler_wrappers()

#11010 is a symptom of this issue. So will keep this one open.