Cabal does not compile with recent versions of GHC

[LiraOnGithub]

Describe the bug
When building cabal from source, ./Setup configure cannot find any packages

To Reproduce
Steps to reproduce the behavior:

$ tar -xf ghc-9.2.1-x86_64-deb10-linux.tar.xz
$ cd ghc-9.2.1
$ ./configure
$ sudo make install
$ cd ../
$ tar -xf cabal-install-3.6.2.0.tar.gz
$ cd cabal-install-3.6.2.0/
$ sudo apt install libnuma-dev
$ ghc --make Setup.hs
$ ./Setup configure --user --enable-library-profiling
Configuring cabal-install-3.6.2.0...
Setup: Encountered missing or private dependencies:
HTTP >=4000.1.5 && <4000.4,
async >=2.0 && <2.3,
base >=4.8 && <4.15,
base16-bytestring >=0.1.1 && <1.1.0.0,
cryptohash-sha256 >=0.11 && <0.12,
echo >=0.1.3 && <0.2,
edit-distance >=0.2.2 && <0.3,
hackage-security >=0.6.0.1 && <0.7,
hashable >=1.0 && <1.4,
network-uri >=2.6.0.2 && <2.7,
random >=1.2 && <1.3,
regex-base >=0.94.0.0 && <0.95,
regex-posix >=0.96.0.0 && <0.97,
resolv >=0.1.1 && <0.2,
tar >=0.5.0.3 && <0.6,
time >=1.5.0.1 && <1.11,
zlib >=0.5.3 && <0.7

$ ./Setup build
Run the 'configure' command first.

$ /usr/local/bin/ghc --print-libdir
/usr/local/lib/ghc-9.2.1

$ ls /usr/local/lib/ghc-9.2.1
array-0.5.4.0   bytestring-0.11.1.0  directory-1.3.6.2  ghc-bignum-1.2       ghc-heap-9.2.1  ghc-usage.txt    include          llvm-passes     parsec-3.1.14.0   settings                   terminfo-0.4.1.5      unix-2.7.2.2
base-4.16.0.0   Cabal-3.6.0.0        exceptions-0.10.4  ghc-boot-9.2.1       ghci-9.2.1      haskeline-0.8.2  integer-gmp-1.1  llvm-targets    pretty-1.1.3.6    stm-2.5.0.0                text-1.2.5.0          xhtml-3000.2.2.1
bin             containers-0.6.5.1   filepath-1.4.2.1   ghc-boot-th-9.2.1    ghci-usage.txt  hpc-0.6.1.0      latex            mtl-2.2.2       process-1.6.13.2  template-haskell-2.18.0.0  time-1.11.1.1
binary-0.8.9.0  deepseq-1.4.6.0      ghc-9.2.1          ghc-compact-0.1.0.0  ghc-prim-0.8.0  html             libiserv-9.2.1   package.conf.d  rts               template-hsc.h             transformers-0.5.6.2

Please use version-prefixed commands (e.g. v2-build or v1-build) to avoid ambiguity.

Expected behavior
./Setup to be configured and ready to be used as ./Setup build

System information

• Ubuntu 20.04 LTS 64bit
• cabal, ghc versions: cabal 3.6.2.0 and ghc 9.2.1

Additional context
No other versions of cabal or ghc are installed

[Mikolaj]

Hi @PiJoKra,

So you are trying to boostrap cabal using only GHC? I'm afraid that's not trivial. Please look at the last line of https://github.com/haskell/cabal/blob/master/README.md and let us know if that works for you.

[LiraOnGithub]

Hello @Mikolaj
Thank you for pointing me there!
I only see json's for ghcversions going up to 8.10.7, can I use cabal for ghcversion 9.2.1?

The reason for trying to bootstrap is me not getting cabal via the package-manager to work for ghc 9.2.1
After sudo apt install cabal-install, running cabal configure --with-compiler=/usr/local/bin/ghc yields:

Warning: Unknown/unsupported 'ghc' version detected (Cabal 2.4.0.1 supports
'ghc' version < 8.7): /usr/local/bin/ghc is version 9.2.1

And running `cabal install cabal-install yields:

cabal v2-install cabal-install
Warning: Unknown/unsupported 'ghc' version detected (Cabal 2.4.0.1 supports
'ghc' version < 8.7): /usr/local/bin/ghc is version 9.2.1
Warning: Unknown/unsupported 'ghc' version detected (Cabal 2.4.0.1 supports
'ghc' version < 8.7): /usr/local/bin/ghc is version 9.2.1
Resolving dependencies...
cabal: Could not resolve dependencies:
[__0] trying: cabal-install-3.6.2.0 (user goal)
[__1] trying: cabal-install:+native-dns
[__2] trying: resolv-0.1.2.0 (dependency of cabal-install +native-dns)
[__3] next goal: time (dependency of cabal-install)
[__3] rejecting: time-1.11.1.1/installed-1.1... (conflict: cabal-install =>
time>=1.5.0.1 && <1.11)
[__3] rejecting: time-1.12.1, time-1.12 (unsupported spec-version 3.0)
[__3] rejecting: time-1.11.1.2, time-1.11.1.1, time-1.11.1, time-1.11
(conflict: cabal-install => time>=1.5.0.1 && <1.11)
[__3] trying: time-1.10
[__4] next goal: process (dependency of cabal-install)
[__4] rejecting: process-1.6.13.2/installed-1.6... (conflict: cabal-install =>
base>=4.8 && <4.15, process => base==4.16.0.0/installed-4.1...)
[__4] trying: process-1.6.13.2
[__5] next goal: pretty (dependency of cabal-install)
[__5] rejecting: pretty-1.1.3.6/installed-1.1... (conflict: cabal-install =>
base>=4.8 && <4.15, pretty => base==4.16.0.0/installed-4.1...)
[__5] trying: pretty-1.1.3.6
[__6] trying: hackage-security-0.6.0.1 (dependency of cabal-install)
[__7] next goal: template-haskell (dependency of hackage-security)
[__7] rejecting: template-haskell-2.18.0.0/installed-2.1... (conflict:
cabal-install => base>=4.8 && <4.15, template-haskell =>
base==4.16.0.0/installed-4.1...)
[__7] rejecting: template-haskell-2.18.0.0, template-haskell-2.17.0.0,
template-haskell-2.16.0.0, template-haskell-2.15.0.0,
template-haskell-2.14.0.0, template-haskell-2.13.0.0,
template-haskell-2.12.0.0, template-haskell-2.11.1.0,
template-haskell-2.11.0.0, template-haskell-2.10.0.0,
template-haskell-2.9.0.0, template-haskell-2.8.0.0, template-haskell-2.7.0.0,
template-haskell-2.6.0.0, template-haskell-2.5.0.0, template-haskell-2.4.0.1,
template-haskell-2.4.0.0, template-haskell-2.3.0.1, template-haskell-2.3.0.0,
template-haskell-2.2.0.0 (constraint from non-upgradeable package requires
installed instance)
[__7] fail (backjumping, conflict set: cabal-install, hackage-security,
template-haskell)
After searching the rest of the dependency tree exhaustively, these were the
goals I've had most trouble fulfilling: cabal-install, base, template-haskell,
directory, process, time, pretty, network, hackage-security, HTTP, resolv,
cabal-install:lib, cabal-install:native-dns

[Mikolaj]

I only see json's for ghcversions going up to 8.10.7, can I use cabal for ghcversion 9.2.1?

OOI, did you try the newest one and it didn't work?

I wouldn't worry about the warning. Which point of https://github.com/haskell/cabal/blob/master/README.md are you following now? If the "Installing cabal-install (preferred, with cabal-install)" one, did you do cabal update?

[LiraOnGithub]

OOI, did you try the newest one and it didn't work?

It did not work. This is was the result:

$ ./bootstrap/bootstrap.py -d ./bootstrap/linux-8.10.7.json -w /usr/local/bin/ghc
bootstrap: running /usr/local/bin/ghc-9.2.1 --info
Bootstrapping cabal-install with GHC 9.2.1 at /usr/local/bin/ghc-9.2.1...

DO NOT use this script if you have another recent cabal-install available.
This script is intended only for bootstrapping cabal-install on new
architectures.

Creating package database _build/packages.conf
bootstrap: running /usr/local/bin/ghc-pkg-9.2.1 init _build/packages.conf
bootstrap: running /usr/local/bin/ghc-pkg-9.2.1 describe rts-1.0.1
ghc-pkg: cannot find package rts-1.0.1
Traceback (most recent call last):
  File "./bootstrap/bootstrap.py", line 391, in <module>
    main()
  File "./bootstrap/bootstrap.py", line 359, in main
    bootstrap(info, ghc)
  File "./bootstrap/bootstrap.py", line 251, in bootstrap
    check_builtin(dep, ghc)
  File "./bootstrap/bootstrap.py", line 167, in check_builtin
    subprocess_run([str(ghc.ghc_pkg_path), 'describe', f'{dep.package}-{dep.version}'],
  File "./bootstrap/bootstrap.py", line 388, in subprocess_run
    return subprocess.run(args, **kwargs)
  File "/usr/lib/python3.8/subprocess.py", line 516, in run
    raise CalledProcessError(retcode, process.args,
subprocess.CalledProcessError: Command '['/usr/local/bin/ghc-pkg-9.2.1', 'describe', 'rts-1.0.1']' returned non-zero exit status 1.

I wouldn't worry about the warning. Which point of https://github.com/haskell/cabal/blob/master/README.md are you following now? If the "Installing cabal-install (preferred, with cabal-install)" one, did you do cabal update?
I did a sudo apt install cabal-install followed by point "Installing cabal-install (preferred, with cabal-install)". I also tried cabal update

$ cabal v2-update
Downloading the latest package list from hackage.haskell.org
To revert to previous state run:
    cabal new-update 'hackage.haskell.org,2022-01-13T10:14:09Z'
$ cabal --version
cabal-install version 2.4.0.0
compiled using version 2.4.0.1 of the Cabal library 
$ cabal v2-install cabal-install
Warning: Unknown/unsupported 'ghc' version detected (Cabal 2.4.0.1 supports
'ghc' version < 8.7): /usr/local/bin/ghc is version 9.2.1
Warning: Unknown/unsupported 'ghc' version detected (Cabal 2.4.0.1 supports
'ghc' version < 8.7): /usr/local/bin/ghc is version 9.2.1
Resolving dependencies...
cabal: Could not resolve dependencies:
[__0] trying: cabal-install-3.6.2.0 (user goal)
[__1] trying: cabal-install:+native-dns
[__2] trying: resolv-0.1.2.0 (dependency of cabal-install +native-dns)
[__3] next goal: time (dependency of cabal-install)
[__3] rejecting: time-1.11.1.1/installed-1.1... (conflict: cabal-install =>
time>=1.5.0.1 && <1.11)
[__3] rejecting: time-1.12.1, time-1.12 (unsupported spec-version 3.0)
[__3] rejecting: time-1.11.1.2, time-1.11.1.1, time-1.11.1, time-1.11
(conflict: cabal-install => time>=1.5.0.1 && <1.11)
[__3] trying: time-1.10
[__4] next goal: process (dependency of cabal-install)
[__4] rejecting: process-1.6.13.2/installed-1.6... (conflict: cabal-install =>
base>=4.8 && <4.15, process => base==4.16.0.0/installed-4.1...)
[__4] trying: process-1.6.13.2
[__5] next goal: pretty (dependency of cabal-install)
[__5] rejecting: pretty-1.1.3.6/installed-1.1... (conflict: cabal-install =>
base>=4.8 && <4.15, pretty => base==4.16.0.0/installed-4.1...)
[__5] trying: pretty-1.1.3.6
[__6] trying: hackage-security-0.6.0.1 (dependency of cabal-install)
[__7] next goal: template-haskell (dependency of hackage-security)
[__7] rejecting: template-haskell-2.18.0.0/installed-2.1... (conflict:
cabal-install => base>=4.8 && <4.15, template-haskell =>
base==4.16.0.0/installed-4.1...)
[__7] rejecting: template-haskell-2.18.0.0, template-haskell-2.17.0.0,
template-haskell-2.16.0.0, template-haskell-2.15.0.0,
template-haskell-2.14.0.0, template-haskell-2.13.0.0,
template-haskell-2.12.0.0, template-haskell-2.11.1.0,
template-haskell-2.11.0.0, template-haskell-2.10.0.0,
template-haskell-2.9.0.0, template-haskell-2.8.0.0, template-haskell-2.7.0.0,
template-haskell-2.6.0.0, template-haskell-2.5.0.0, template-haskell-2.4.0.1,
template-haskell-2.4.0.0, template-haskell-2.3.0.1, template-haskell-2.3.0.0,
template-haskell-2.2.0.0 (constraint from non-upgradeable package requires
installed instance)
[__7] fail (backjumping, conflict set: cabal-install, hackage-security,
template-haskell)
After searching the rest of the dependency tree exhaustively, these were the
goals I've had most trouble fulfilling: cabal-install, base, template-haskell,
directory, process, time, pretty, network, hackage-security, HTTP, resolv,
cabal-install:lib, cabal-install:native-dns

I also find it strange there are packages in both /usr/local/lib/ghc-9.2.1 and in ~/.cabal/packages/hackage.haskell.org, but not sure if it has anything to do with it.

[Mikolaj]

Thank you for the details about bootstrapping. Good to know.

Two locations for packages is fine --- one comes with the GHC, another stores user-downloaded packages.

Reading your log, it seems cabal 3.6.2 indeed rules out newer GHCs. Even GHC 9.0.2 is off-limits. The version in the repo probably accepts 9.0.2, but not 9.2.*.

I'm afraid, the only remaining options are downloading the binary, either via ghcup or as told in the README. Cabal doesn't mind being compiled with one GHC and used with different ones.

[Mikolaj]

I guess we should amend the README to say "but not with bleeding edge GHC" or something to that effect, so that others don't need to repeat our investigation. What text would help you, initially?

[Mikolaj]

Especially that the way that doesn't work two last versions of GHC is marked as "preferred".

[LiraOnGithub]

I think the "but not with bleeding edge GHC" would be good enough, or maybe state that the json-files with the ghcversion-naming dictate the last version you can use or something like that.

[Mikolaj]

Good idea, thank you.

[Mikolaj]

@fendor also suggests to add to the .cabal file (I'd say, the minimum would be cabal-install.cabal) the "tested-with section to indicate with which GHC version you are supposed to be able to build". That'd require some maintenance though, from both ends; in particular removing GHCs we no longer support.

[LiraOnGithub]

Seems like a good idea! Should I rename this issue to something to reflect cabal not working with recent GHC-versions?

I decided to try my luck with ghcup and now have cabal-install version 3.6.2.0, but now I always get the following when using cabal install PACKAGENAME:

Resolving dependencies...
cabal: Cannot build the executables in the package PACKAGENAME because it
does not contain any executables. Check the .cabal file for the package and
make sure that it properly declares the components that you expect.

I tried multiple packages. Is this related to the previous problem, or is this something I should create a new issue for?

[Mikolaj]

Seems like a good idea! Should I rename this issue to something to reflect cabal not working with recent GHC-versions?

That would make sense.

I tried multiple packages. Is this related to the previous problem, or is this something I should create a new issue for?

I think this works as expected. You normally don't install packages by hand, unless they have an exe you need. Cabal installs everything it needs automatically when you cabal build a package you are working with. Unless you have some special needs that require installing packages manually, in which case, please describe them.

[Mikolaj]

Again, if dev version of cabal docs is misleading in this respect, let's fix them: https://cabal.readthedocs.io/en/latest/