Plugins can be installed and used from any directory but tests expect them to ONLY be in $GEOIPS_PACKAGES_DIR

[biosafetylvl5]

Requested Update

Description

• Plugins installed outside of $GEOIPS_PACKAGES_DIR work just fine
• But the tests fail for them because they cannot write the associated log files

Alternative Solutions

• Ignore

Environment

• Docker

Code to demonstrate issue

Thu Oct 31 20:42:25 UTC 2024  Running ahi.Temp-3p75.imagery_clean.sh
/app/geoips_packages/geoips_clavrx/tests/scripts/ahi.Temp-3p75.imagery_clean.sh
/output/logs/20241031/20241031.203959_geoips_clavrx/test_all_geoips_clavrx.log_ahi.Temp-3p75.imagery_clean.sh.log
        Return: 127


Thu Oct 31 20:42:25 UTC 2024  Running post, final results in /output/logs/20241031/20241031.203959_geoips_clavrx/test_all_geoips_clavrx.log

Package: geoips_clavrx
Total run time: 146 seconds
Number data types run: 14
Number data types failed: 13
Thu Oct 31 20:42:25 UTC 2024
geoips_user@1400017fafb0:/workspaces/geoips_clavrx$ ./
.devcontainer/          .git/                   .github/                .pytest_cache/          .vscode/                build/                  docs/                   geoips_clavrx/          geoips_clavrx.egg-info/ tests/
geoips_user@1400017fafb0:/workspaces/geoips_clavrx$ ./tests/scripts/ahi.Temp-3p75.imagery_clean.sh
Failed to import data_fusion at /app/geoips_packages/geoips/geoips/commandline/geoips_run.py:18. If you need it, install it.
31_204417 run_procflow.py:47   INTERACTIVE:


Starting single_source procflow...


31_204418 run_procflow.py:62   INTERACTIVE:


Running on filenames: ['/mnt/geoips_testdata/test_data_clavrx/data/himawari9_2023101_0300/clavrx_H09_20230411_0300_B01_FLDK_DK_R10_S0110.DAT.level2.hdf']


31_204418 single_source.py:1848 INTERACTIVE: Reading metadata from dataset with reader 'clavrx_hdf4'...
31_204418 single_source.py:1349 INTERACTIVE: Getting all area defs from command line args:
31_204418 single_source.py:1352 INTERACTIVE:   sector_list: ['himawari']
31_204418 single_source.py:1355 INTERACTIVE:   tcdb_sector_list: None
31_204418 single_source.py:1358 INTERACTIVE:   tcdb: False
31_204418 single_source.py:1361 INTERACTIVE:   trackfile_sector_list: None
31_204418 single_source.py:1364 INTERACTIVE:   trackfiles: None
31_204418 single_source.py:1367 INTERACTIVE:   trackfile_parser: None
31_204418 single_source.py:1370 INTERACTIVE:   tc_spec_template: None
31_204418 single_source.py:1891 INTERACTIVE: Reading full dataset with reader 'clavrx_hdf4'...
31_204420 single_source.py:2011 INTERACTIVE: Sectoring xarrays, variables ['temp_3_75um_nom', 'latitude', 'longitude']...
31_204420 single_source.py:2050 INTERACTIVE: Producing sectored outputs...
31_204421 single_source.py:1546 INTERACTIVE: Applying algorithms and interpolation...
31_204421 single_source.py:247  INTERACTIVE: Resectoring xarrays without padding...
31_204421 single_source.py:1613 INTERACTIVE:   Applying interpolators...
31_204421 single_source.py:752  INTERACTIVE:   Interpolating data with interpolator 'interp_nearest' args '{'varlist': ['temp_3_75um_nom', 'longitude', 'latitude']}'...
31_204427 single_source.py:752  INTERACTIVE:   Interpolating data with interpolator 'interp_nearest' args '{'varlist': []}'...
31_204427 single_source.py:752  INTERACTIVE:   Interpolating data with interpolator 'interp_nearest' args '{'varlist': []}'...
31_204427 single_source.py:1636 INTERACTIVE:   Applying algorithms after interpolators...
31_204427 single_source.py:520  INTERACTIVE:   Applying 'list_numpy_to_numpy' family algorithm 'single_channel' to data...
31_204427 single_source.py:1656 INTERACTIVE:   Setting metadata on final xarray...
31_204427 single_source.py:2266 INTERACTIVE: Required coverage 0.0 for product Temp-3p75, actual coverage 71.7027
31_204427 single_source.py:1152 INTERACTIVE: Producing product 'Temp-3p75' final outputs as type 'imagery_clean'...
31_204427 single_source.py:1196 INTERACTIVE:   Producing 'image' family final outputs 'imagery_clean'...
31_204429 single_source.py:2331 INTERACTIVE:


Processing complete! Checking outputs...


31_204429 single_source.py:2371 INTERACTIVE:


The following products were produced from procflow single_source.py


31_204429 single_source.py:2376 INTERACTIVE:     SINGLESOURCESUCCESS ${GEOIPS_OUTDIRS}/preprocessed/annotated_imagery/Global-x-Himawari/x-x-x/Temp-3p75/clavrx/20230411.030000.him9.clavrx.Temp-3p75.himawari.71p70.cira.10p0.png
31_204429 single_source.py:2387 INTERACTIVE: READER_NAME: clavrx_hdf4
31_204429 single_source.py:2388 INTERACTIVE: PRODUCT_NAME: Temp-3p75
31_204429 single_source.py:2389 INTERACTIVE: NUM_PRODUCTS: 1
31_204429 single_source.py:2390 INTERACTIVE: NUM_DELETED_PRODUCTS: 0
31_204429 run_procflow.py:68   INTERACTIVE: Completed geoips PROCFLOW single_source processing, done!
31_204429 run_procflow.py:74   INTERACTIVE: Total time: 0:00:11.640566
31_204429 run_procflow.py:94   INTERACTIVE: Return value: 0