No way to use composite project where outDir is determined by build tool

In #37257 I discussed one way to host TS project references under Bazel, where each build step gets only .d.ts and tsconfig.json files from the referenced projects. This is broken because TS module resolution fails to locate the .d.ts files in their outDir.

In this issue, let's try a different approach for Bazel, to satisfy current TS module resolution, each build step should get the .ts sources of its referenced projects, and the .tsbuildinfo output as well.

Bazel is picky about the setting of --outDir, because it supports cross-compiled builds in distinct output locations. For example if you're on a Mac and building for local platform, the outDir is <workspace root>/bazel-out/darwin-fastbuild/bin. But if you're on a Mac and building for a docker image, you need native binaries to be for the target platform so outDir is <workspace root>/bazel-out/k8-fastbuild/bin and if you want binaries with debug information it's <workspace root>/bazel-out/k8-dbg/bin.

Since the outDir is platform-specific, we don't want to check in a config file that hard-codes it. So we prefer to always have Bazel pass the --outDir option on the command-line to tsc, rather than include it in the tsconfig files.

Now we come to the problem. TypeScript "composite" setting enables up-to-dateness checking in tsc. With this input structure, and trying to tsc -p b

a/a.ts
a/tsconfig.json (no outDir specified; a was compiled with tsc --outDir=bazel-out/darwin-fastbuild/bin/a)
b/b.ts
b/tsconfig.json
bazel-out/darwin-fastbuild/bin/a/a.d.ts
bazel-out/darwin-fastbuild/bin/a/tsconfig.tsbuildinfo

we get b/b.ts(1,17): error TS6305: Output file '/private/var/tmp/_bazel_alx/df60115ea7f2a64e10fb4aa64b7d827f/sandbox/darwin-sandbox/54/execroot/ts_composite/a/a.d.ts' has not been built from source file '/private/var/tmp/_bazel_alx/df60115ea7f2a64e10fb4aa64b7d827f/sandbox/darwin-sandbox/54/execroot/ts_composite/a/a.ts'.

This indicates that TS is looking for a.d.ts next to a.ts. If we hard-code the platform-dependent outDir into a/tsconfig.json like I've done here
https://github.com/alexeagle/ts_composite/pull/5 it solves this problem, but not in a way we can ship.

Note that the compilation of a/tsconfig.json produces a .tsbuildinfo file with a correct "outDir" (based on the --outDir flag that was passed to compilation of a

 "options": {
      "project": "../../../../a/tsconfig.json",
      "outDir": "./",
  }

So it seems like the behavior for compiling b is to read the outDir setting from a/tsconfig.json rather than trust the options.outDir reflected in the .tsbuildinfo output.

when doing tsc -p b you are only building the project b and not a so there is no way to tell if a was built with extra options or not. Whatever is present in the config file of a is the only truth compiler can assume.

Daniel Rosenwasser (@DanielRosenwasser)

Yes, I can see that. The only way tsc could do what I'm asking here is if the --outDir setting of b was considered to match a - that is, my output directory scheme always preserves the same directory structure as the sources, so if a was imported from ../a and b is compiled into --outDir=bazel-out/b then we could know that a may be in bazel-out/a

I think I should take Daniel Rosenwasser (@DanielRosenwasser) up on a suggestion that we have a brief design discussion. After studying this problem for a week, it seems that Bazel's output directory is simply incompatible with typescript project references and one of them needs to change. Do you have a design meeting this week? Thanks!

I hoped that --incremental false would disable this up-to-date checking (Bazel already does it) but I get

error TS6379: Composite projects may not disable incremental compilation.

is there any other way to avoid this checking?

Ryan Cavanaugh (@RyanCavanaugh)

Ryan Cavanaugh (@RyanCavanaugh) thanks for the discussion today. I noted that you said TS repo itself is affected by this issue, requiring that you have multiple tsconfig files to express the difference between two different build options.

I have another proposal based on some more experimentation.

Take this scenario. We've already compiled lib and now want to compile app.

lib/
    tsconfig.json   // composite: true
bazel-out/mac/lib
    index.js
    index.d.ts
    tsconfig.tsbuildinfo
app/
    tsconfig.json   // "references": [  {"path": "../lib"}  ]}
    index.ts

tsc -p app --outDir bazel-out/mac/app

As we know with TS today, this fails because the reference goes to the lib/tsconfig which doesn't specify an outDir, so TS will look for lib/index.d.ts and not find it.

Let's say the semantics for references were expanded (maybe under some new flag) so that path: ../lib could be resolved relative to the outDir of the current build, meaning bazel-out/mac/app/../lib
(I think you suggested in the meeting that this makes sense to you)

This can work, but only if we also add a build step to copy the tsconfig file to the output directory - and we know that's complex because the paths need to be made relative to the new location.

So instead, since there is no tsconfig.json file in the output directory, we'd want this to resolve one step further to bazel-out/mac/lib/tsconfig.tsbuildinfo.

I could imagine that a reference to a tsbuildinfo file could be made to work in place of a reference to a tsconfig file? If so this seems simple and in my basic testing it works.

#37509 shows the change to resolving reference paths that I'm currently using for prototyping. Along with a hack in Bazel to copy tsconfig into the outDir, this seems to work.

Sheetal Nandi (@sheetalkamat)

Sheetal Nandi (@sheetalkamat) FYI we shipped the new TS support for Bazel with a bunch of ugly caveats about this and related bugs
https://bazelbuild.github.io/rules_nodejs/TypeScript#ts_project

What do you or Ryan think of the proposal to resolve reference paths into the outDir?

Ryan Cavanaugh (@RyanCavanaugh)

c:: Ryan Cavanaugh (@RyanCavanaugh) Daniel Rosenwasser (@DanielRosenwasser)
I am not sure if that's what we are looking for.. Resolving project reference from two different places means that (not only project but when processing dependencies and everything) I remember that design mentting we needed more general approach rather than solving just outDir issue?

As that last reference points out, this problem has gotten worse. Bazel has more potential values for --outDir and it's really not feasible to require Bazel users to include all of these in the rootDirs of a downstream tsc project.

Let's say the semantics for references were expanded (maybe under some new flag) so that path: ../lib could be resolved relative to the outDir of the current build, meaning

Daniel and I chatted about this for a while and I think this is sensible and very implementable. Basically just add a new flag (name TBD) where we compute the outDir of a referenced project as follows:

Compute the relative path from the referencing tsconfig to the referenced tsconfig
Apply that relative path to the outDir of the referenced project

This means that if you had

foo/
  tsconfig.json
  blah.ts
bar/
  tsconfig.json
  blub.ts
out1/
  foo/
    blah.d.ts
  bar/
    blub.d.ts
out2/
  foo/
    blah.d.ts
  bar/
    blub.d.ts

Then if foo references bar and foo's outDir is out1/foo, under this flag, we compute the path ../bar/, and instead of looking for bar/blub.d.ts, we look for out1/foo/../bar/blub.d.ts, which would resolve properly

Just to confirm: Would that solve your problem?

I think the key is that this flag only really makes sense when the entire source-tree is mirrored by a corresponding output tree. The above output format would work, and maybe would more specifically look like this for Bazel and similar systems:

projects/
├── src/
│   ├── foo
│   ├── bar
│   └── baz
├── win-out/
│   ├── foo
│   ├── bar
│   └── baz
├── mac-out/
│   ├── foo
│   ├── bar
│   └── baz
└── linux-out/
    ├── foo
    ├── bar
    └── baz

But it would not work for the following layout:

projects/
├── foo/
│   ├── src
│   ├── win-out
│   ├── mac-out
│   └── linux-out
├── bar/
│   ├── src
│   ├── win-out
│   ├── mac-out
│   └── linux-out
└── baz/
    ├── src
    ├── win-out
    ├── mac-out
    └── linux-out

So that's why we're curious whether it fits the bill for you.

Alex Eagle (@alexeagle)

Alex Eagle (@alexeagle) we'll talk about it again this week, I think your suggestion is pretty sound. A PR would be nice as an anchoring point if you're willing

Note, the proposal would also solve #22208 since out1/bar/../foo/blah.d.ts would be resolved before ../foo/blah.ts.

I'll try to work up a PR, any help would be appreciated to get something closer to landable :)

hack: resolve from outDir

Ryan Cavanaugh (@RyanCavanaugh)

Ryan Cavanaugh (@RyanCavanaugh) the PR is up. I think if you accept this issue that will clue the bot into putting nicer labels on it :)

Alex Eagle (@alexeagle)

Alex Eagle (@alexeagle) I think Ryan Cavanaugh (@RyanCavanaugh) suggested changing outDir computation for the referenced project instead of module resolution. #48190 does changes to module resolution which is not what the suggestion was.

Ryan Cavanaugh (@RyanCavanaugh)

Project References is just one use case that the PR fixes. As I explained above most Bazel users are simply compiling a project with tsc -p, and relying on earlier compilations to have populated the outDir with transitive typings.

#37378 (comment) is where I think Ryan Cavanaugh (@RyanCavanaugh) agreed to the change in the module resolver.

Yeah I think the idea of resolving modules relative to their outputs was what we agreed to in #48042.

Ryan Cavanaugh (@RyanCavanaugh)

But then that doesnt solve project reference issue... how do you know if the d.ts file you got is from project reference? there is definitely some confusion here since i was under impression that we want outDir for the project reference instead as i discussed this with Ryan Cavanaugh (@RyanCavanaugh) this morning.
Not being able to see the file is from project reference will have impact on what the tsc -build does as well as editor experience.

Could you be more specific what problem this introduces for tsc -build or language service users who enable the flag?

Ping! Some large Bazel users are now on a fork of TypeScript to get this.

Appologies that this slipped through other notifications..
tsc --build uses .d.ts ouptut checks of referenced project(Shared) to determine if project(App) needs to be completely rebuilt or just needs timestamps need update.. How is that suppose to work with change to only module resolution..

In editors, when say app project referecnes output d.ts of shared project through module resolution or any other way, we use its source file instead so we can walk through edits without having to save it.. This functionality might be affected with this change since we dont know resolved module is from project reference.

Ping! Some large Bazel users are now on a fork of TypeScript to get this.

Where is the fork code?

Update: we now have better Bazel rules which don't require this at all. They copy all the sources and the node_modules tree to the bazel-out folder, then run tsc with that working directory, so there is a single root and TypeScript works properly as-is.

https://github.com/aspect-build/rules_ts

Alex Eagle (@alexeagle)

Alex Eagle (@alexeagle) when attempting to use a "references" key in a tsconfig.json using Aspect's rules_ts, I'm observing the error:

bazel build //typescript:compile_all_ts

ERROR: /Users/ray/private_repo/BUILD.bazel:251:11: Compiling TypeScript project //typescript:compile_all_ts [tsc -p typescript/tsconfig.json] failed: (Exit 2): tsc.sh failed: error executing command bazel-out/darwin-opt-exec-2B5CBBC6/bin/external/npm_typescript/tsc.sh --project typescript/tsconfig.json --outDir typescript --rootDir typescript

typescript/tsconfig.json(65,5): error TS6053: File '/private/var/tmp/_bazel_ray/0a45558874bc1f97bcaab4f86b774d47/sandbox/darwin-sandbox/9289/execroot/private_repo/bazel-out/darwin-fastbuild/bin/typescript/core' not found.

I'm noting a lack of tsconfig.json's with a references key in the examples with this rules_ts codesearch. Is it possible to use project references with rules_ts? Is there a workaround that hasn't made it into the examples yet?

Raymond Carino (@rc-glean)

Raymond Carino (@rc-glean) it's probably better to file that on the rules_ts repo than on TypeScript, I don't think there's a bug in this repo

edit: I see aspect-build/rules_ts#163 now - when you cross-post an issue to more than one repo, it's good practice to link to the other one :)

Navigation Menu

Repository navigation

No way to use composite project where outDir is determined by build tool #37378

6 remaining items

Metadata

Assignees

Labels

Type

Projects

Milestone

Relationships

Development

No way to use composite project where outDir is determined by build tool #37378

Description

Activity

sheetalkamat commented on Mar 13, 2020

alexeagle commented on Mar 16, 2020

alexeagle commented on Mar 17, 2020

alexeagle commented on Mar 20, 2020

alexeagle commented on Mar 21, 2020

alexeagle commented on Mar 29, 2020

sheetalkamat commented on Mar 30, 2020

alexeagle commented on Jan 26, 2022

RyanCavanaugh commented on Feb 2, 2022

DanielRosenwasser commented on Feb 2, 2022

6 remaining items

RyanCavanaugh commented on Feb 23, 2022

alexeagle commented on Mar 9, 2022

alexeagle commented on Mar 10, 2022

sheetalkamat commented on Mar 22, 2022

alexeagle commented on Mar 22, 2022

DanielRosenwasser commented on Mar 22, 2022

sheetalkamat commented on Mar 22, 2022

alexeagle commented on Mar 22, 2022

alexeagle commented on Apr 4, 2022

sheetalkamat commented on Apr 5, 2022

gonzojive commented on Jun 17, 2022

alexeagle commented on Jun 17, 2022

rc-glean commented on Oct 10, 2022

alexeagle commented on Oct 10, 2022

Metadata

Metadata

Assignees

Labels

Type

Projects

Milestone

Relationships

Development

Issue actions