Loaders: Ensure all loaders properly label and convert color textures and colors to sRGB / Linear correctly

[gkjohnson]

Is your feature request related to a problem? Please describe.

From what I can tell these are the loader examples that still are not setting renderer.outputEncoding = sRGBEncoding on the page meaning they don't appropriately set the model color spaces for linear lighting calculations on load where I think the color space should be known at parse time:

Material Colors & Textures

• ColladaLoader examples (ColladaLoader: Convert color from srgb to linear on load #23401)
• OBJLoader examples (OBJ / MTLLoader: Label and convert textures and colors correctly in MTLLoader #23296)
• SVGLoader (example logic only) (SVGLoader Example: Use srgb output in the svg example #23280)
• ColladaExporter (ColladaExporter: Convert vertex, material colors to sRGB before export #23400)
• KMZLoader Example (ColladaLoader: Convert color from srgb to linear on load #23401)
• FBXLoader examples (Examples: Update FBXLoader examples to .outputEncoding = sRGBEncoding #25441)
• IFCjs example (Examples: Move IFC demo to sRGB. #26121)
• MMDLoader example (Examples: Updates for color management (pt3) #25889)
• VOXLoader example (Examples: Clean up legacy .outputColorSpace = LinearSRGBColorSpace examples (part 2) #25849)
• LottieLoader example (Examples: Clean up legacy .outputColorSpace = LinearSRGBColorSpace examples (part 2) #25849)
• VRMLLoader example (VRMLLoader: Move to sRGB. #26111)

Vertex Colors

• ColladaLoader (ColladaLoader: Convert color from srgb to linear on load #23401)
• ColladaExporter (ColladaExporter: Convert vertex, material colors to sRGB before export #23400)
• DRACOLoader (DRACOLoader, DRACOExporter: Convert vertex colors to/from Linear-sRGB #25390)
• DRACOExporter (DRACOLoader, DRACOExporter: Convert vertex colors to/from Linear-sRGB #25390)
• FBXLoader(Examples: Update FBXLoader examples to .outputEncoding = sRGBEncoding #25441)
• OBJLoader (OBJLoader: Convert vertex colors to Linear from sRGB #23340)
• OBJExporter (OBJExporter: Convert Linear vertex colors to sRGB #23374)
• PCDLoader (Examples: More sRGB usage. #26119)
• PLYLoader (PLYLoader: convert vertex colors to linear #23342)
• PLYExporter (PLYExporter: convert vertex colors to srgb before export #23399)
• STLLoader (Examples: More sRGB migration. #26120)
• VRMLLoader (VRMLLoader: Move to sRGB. #26111)
• VTKLoader (#Examples: More sRGB migration. #26120)
• XYZLoader (Examples: More sRGB usage. #26119)

I was taking a look at ColladaLoader and OBJLoader, as well. It doesn't look like there's very explicit documentation on color spaces for these formats and they're more specification by convention. Given that our demos don't adjust the default output color space for the renderer it seems like the assumption is that the textures and colors are sRGB. Is there any evidence or example models that show this isn't always the right thing to do?

Describe the solution you'd like

All loaders look correct when setting WebGLRenderer.outputEncoding to sRGBEncoding by appropriately labeling all color textures and converting colors to Linear before setting materials.

Describe alternatives you've considered

--

Additional context

#23272

#23280

[Mugen87]

I was taking a look at ColladaLoader and OBJLoader, as well. It doesn't look like there's very explicit documentation on color spaces for these formats and they're more specification by convention.

There is a note in the Collada spec that says color space information can added to a <hint> attribute:

If this element or a higher precedence element is not present then use a common format R8G8B8A8 with linear
color gradient, not sRGB.

However, if we want sRGB to be the default at some point, it makes sense to update ColladaLoader, too.

[gkjohnson]

Something isn't lining up, then. The Collada "Elf" model doesn't specify a <format> tag for any of its textures meaning if that's true then we're displaying our Collada models in the examples incorrectly but the model really doesn't look right if the textures are assumed to be linear:

outputEncoding=LinearEncoding	outputEncoding=sRGBEncoding

So is the right image above correct? Or is the elf Collada model incorrect? Does Blender not label exported Collada textures correctly? Or is there something else going on?

[Mugen87]

The left image is right. If you just set outputEncoding to sRGBEncoding, the sRGB workflow is incomplete.

[Mugen87]

Meaning we have to update the loader and hack in sRGB support.

[Mugen87]

I wonder if it is really a good idea to force sRGB with 3D formats that do not properly support it 🤔 .

[gkjohnson]

If you just set outputEncoding to sRGBEncoding, the sRGB workflow is incomplete.

Can you explain this? It should never be correct to display the canvas as Linear on the page. Is the Collada format assuming a linear output color to the display? If interpreting Collada textures as linear colors only looks correct if you are not transforming them before outputting to an sRGB display then I don't understand how they can correctly be considered linear.

[Mugen87]

AFAICT, the Collada spec does not really care about color spaces. Most times applications just load the Collada, parse the colors/load textures and display the values as they are.

You are right with your assumption that the textures are not linear. When you inspect the color profiles of Collada textures, they are usually sRGB (which is contradictory regarding the spec).

If we want to display sRGB colors, we have to make assumptions when loading the Collada asset which are not necessarily true. For example the standard does not explain in what color space material, light or vertex colors are.

Because of this, I would not touch loaders with no clear color space specification. If we default outputEncoding to sRGBEncoding at some point, I suggest to set LinearEncoding to all Collada examples.

Devs who want a proper color space workflow should work with glTF.

[gkjohnson]

I'm certainly not advocating against preferring glTF when possible but the point of this issue is to get the three.js loaders to behave consistently in the correct labeling and conversion of colors. If it's demonstrable that Collada files are specifying colors and textures in sRGB then they should be loaded such that they behave consistently with the three.js renderer settings. As it is you cannot just load a glTF model and Collada model in the same scene and have them look correct. I see there was an issue on the forum related to the editor in this regard, as well.

When it comes to some of these specs that are ambiguous about color spaces (OBJ, Collada) my assumption has always been that colors and color textures were specified as sRGB just because of the limitations of Linear colors when converting to sRGB for display and the age of the formats. In my experience OBJ files are the same. If it really is ambiguous in practice and there are use cases, example files, or exporters out there using linear textures and colors then maybe a Loader flag can be added to set the color space to load as. Otherwise it sRGB colors seems like the more likely assumption.

[mrdoob]

I agree with @gkjohnson. I think it's fair to assume that the colors and textures in obj and collada files are in srgb (unless specified somehow).

And yes, we should aim to set WebGLRenderer.outputEncoding to sRGBEncoding by default. It'll be easier to assume that anything that it's passed to the renderer is in linear. Easier to spot bugs that way.

[gkjohnson]

It occurs to me that Vertex colors would need to be converted, as well, which might not be such an easily "undoable" change for anyone relying on them being sRGB right now since three.js relies on them being linear. I imagine this would affect both ColladaLoader and PLYLoader, at least. Not sure if we have any vertex colored test models, though.

[scurest]

FWIW, you may want to know that Blender (at least recent versions) exports material colors (eg. Kd) as linear (obj, dae), but vertex colors as sRGB (dae). I don't think this is by intent (this is how it stores it internally, so probably just no one ever thought about it) but it is how it works. I don't know about other formats.

(Personally I agree with gkjohnson that sRGB should be the default assumption.)