DOC: editable: clarify file guarantees with non-Python files

[lucascolley]

closes numpy/numpy#29490 @rgommers

[dnicolodi]

Uh? This is actually false. Where did you get the impression that only Python files are exposed?

[lucascolley]

Where did you get the impression that only Python files are exposed?

I didn't get the impression that only Python files are exposed — that isn't what this says!

I did get the impression that some files in other languages may not be available: see numpy/numpy#29490.

[dnicolodi]

All installed files are available, if you look them up with the proper Python API.

I really don't understand what you are trying to communicate with these edits. Most likely I don't understand what you mean with "Python file". After all, meson-python is mostly used to build packages that contain Python modules written in other languages that Python, therefore, if these sometimes were to go missing, it would be a major issue.

I guess that you are trying to access installed files by their (expected) filesystem location rather than through the Python API. A few lines above the text you are amending we have this sentence:

This will install a stub in the Python site packages directory that loads the package content from the sources and build directory.

I thought that this should be indication enough that the installed files do not exist in the filesystem at the location where they would be in an normal isntallation. But I have the impression that this is not picked up by most readers. What we really need is a "Accessing data files" in the editable install documentation that spells this out.

[eli-schwartz]

What's a "proper python API"?

Meson-python certainly installs an editable loader that makes import xxxx work for any xxxx that the non-editable install would provide.

It's less clear how "data files" should be accessed. For a non-editable install the answer is simple, you use importlib.resources to acquire file contents, and if you need a file tree suitable for e.g. the C compiler's -I -L arguments you try to map that to a directory.

The question is not what alternative API should be used for data files in an editable install. I'm not aware that there's an alternative answer to give.

The question is how an editable loader is expected to arrange for importlib.resources to give a correct answer. People expect specific directory structures, among other things, which may not make any sense in an editable install e.g. files that at build time are in different directories and at install time are in a single directory.

Data files are hard. Getting the import system to correctly import *.py and *.so files is much easier.

[eli-schwartz]

@dnicolodi

(In the linked numpy issue, the specific topic at hand was numpy's C headers.)

[lucascolley]

I'm personally a bit lost at synthesising the information I have read from you both, @rgommers and @dnicolodi, so I will mark this as draft until there is more which makes this click for me.