ansible-collections
diff --git a/‎.ansible-lint‎
Lines changed: 8 additions & 0 deletions b/‎.ansible-lint‎
Lines changed: 8 additions & 0 deletions
diff --git a/‎.gitignore‎
Lines changed: 1 addition & 1 deletion b/‎.gitignore‎
Lines changed: 1 addition & 1 deletion
diff --git a/‎CHANGELOG.rst‎
Lines changed: 40 additions & 4 deletions b/‎CHANGELOG.rst‎
Lines changed: 40 additions & 4 deletions
diff --git a/‎README.md‎
Lines changed: 10 additions & 2 deletions b/‎README.md‎
Lines changed: 10 additions & 2 deletions
diff --git a/‎ac‎
Lines changed: 3 additions & 3 deletions b/‎ac‎
Lines changed: 3 additions & 3 deletions
diff --git a/‎changelogs/.plugin-cache.yaml‎
Lines changed: 6 additions & 1 deletion b/‎changelogs/.plugin-cache.yaml‎
Lines changed: 6 additions & 1 deletion
diff --git a/‎changelogs/changelog.yaml‎
Lines changed: 96 additions & 3 deletions b/‎changelogs/changelog.yaml‎
Lines changed: 96 additions & 3 deletions
diff --git a/‎changelogs/fragments/1176-copy-members.yml‎
Lines changed: 3 additions & 0 deletions b/‎changelogs/fragments/1176-copy-members.yml‎
Lines changed: 3 additions & 0 deletions
@@ -1,6 +1,11 @@
+################################################################################
+# Copyright (c) IBM Corporation 2024
+################################################################################
+# For additonal doc, see https://ansible.readthedocs.io/projects/lint/configuring/
 exclude_paths:
   - .tar.gz
   - __pycache__/
+  - .ansible-lint
   - .cache/
   - .DS_Store
   - .git/
@@ -35,3 +40,6 @@ parseable: true
 quiet: false
 use_default_rules: true
 verbosity: 1
+# Offline mode disables installation of requirements.yml and schema refreshing often
+# found in project_root/collections/requirements.yml.
+offline: true
@@ -245,7 +245,6 @@ venv/
 ENV/
 env.bak/
 venv.bak/
- 
 ###################################
 # Ansible z/OS Core Development   #
 ###################################
@@ -256,6 +255,7 @@ venv.bak/
 .pytest_cache
 info.env
 shell_exploits.txt
+importer_result.json
 
 ################################################################################
 # Debugging .ignore, if you want to know why a particular file is being ignored
 
@@ -5,6 +5,42 @@ ibm.ibm_zos_core Release Notes
 .. contents:: Topics
 
 
+v1.9.0-beta.1
+=============
+
+Release Summary
+---------------
+
+Release Date: '2024-01-31'
+This changelog describes all changes made to the modules and plugins included
+in this collection. The release date is the date the changelog is created.
+For additional details such as required dependencies and availability review
+the collections `release notes <https://ibm.github.io/z_ansible_collections_doc/ibm_zos_core/docs/source/release_notes.html>`__
+
+Minor Changes
+-------------
+
+- zos_apf - Improves exception handling if there is a failure parsing the command response when operation selected is list. (https://github.com/ansible-collections/ibm_zos_core/pull/1036).
+- zos_copy - Improve zos_copy performance when copying multiple members from one PDS/E to another. (https://github.com/ansible-collections/ibm_zos_core/pull/1176).
+- zos_job_output - When passing a job ID and owner the module take as mutually exclusive. Change now allows the use of a job ID and owner at the same time. (https://github.com/ansible-collections/ibm_zos_core/pull/1078).
+- zos_job_submit - Improve error messages in zos_job_submit to be clearer. (https://github.com/ansible-collections/ibm_zos_core/pull/1074).
+- zos_job_submit - The module had undocumented parameter and uses as temporary file when the location of the file is LOCAL. Change now uses the same name as the src for the temporary file removing the addition of tmp_file to the arguments. (https://github.com/ansible-collections/ibm_zos_core/pull/1091).
+- zos_job_submit - The module handling ZOAU import errors obscured the original traceback when an import error ocurred. Fix now passes correctly the context to the user. (https://github.com/ansible-collections/ibm_zos_core/pull/1091).
+- zos_mvs_raw - when using the dd_input content option for instream-data, if the content was not properly indented according to the program which is generally a blank in columns 1 & 2, those columns would be truncated. Now, when setting instream-data, the module will ensure that all lines contain a blank in columns 1 and 2 and add blanks when not present while retaining a maximum length of 80 columns for any line. This is true for all content types; string, list of strings and when using a YAML block indicator. (https://github.com/ansible-collections/ibm_zos_core/pull/1057). - zos_mvs_raw - no examples were included with the module that demonstrated using a YAML block indicator, this now includes examples using a YAML block indicator.
+- zos_tso_command - add example for executing explicitly a REXX script from a data set. (https://github.com/ansible-collections/ibm_zos_core/pull/1065).
+
+Bugfixes
+--------
+
+- zos_copy - When copying an executable data set with aliases and destination did not exist, destination data set was created with wrong attributes. Fix now creates destination data set with the same attributes as the source. (https://github.com/ansible-collections/ibm_zos_core/pull/1066).
+- zos_copy - When performing a copy operation to an existing file, the copied file resulted in having corrupted contents. Fix now implements a workaround to not use the specific copy routine that corrupts the file contents. (https://github.com/ansible-collections/ibm_zos_core/pull/1064).
+- zos_job_output - When passing a job ID or name less than 8 characters long, the module sent the full stack trace as the module's message. Change now allows the use of a shorter job ID or name, as well as wildcards. (https://github.com/ansible-collections/ibm_zos_core/pull/1078).
+- zos_job_query - The module handling ZOAU import errors obscured the original traceback when an import error ocurred. Fix now passes correctly the context to the user. (https://github.com/ansible-collections/ibm_zos_core/pull/1042).
+- zos_job_query - When passing a job ID or name less than 8 characters long, the module sent the full stack trace as the module's message. Change now allows the use of a shorter job ID or name, as well as wildcards. (https://github.com/ansible-collections/ibm_zos_core/pull/1078).
+- zos_operator - The module handling ZOAU import errors obscured the original traceback when an import error ocurred. Fix now passes correctly the context to the user. (https://github.com/ansible-collections/ibm_zos_core/pull/1042).
+- zos_unarchive - Using a local file with a USS format option failed when sending to remote because dest_data_set option had an empty dictionary. Fix now leaves dest_data_set as None when using a USS format option. (https://github.com/ansible-collections/ibm_zos_core/pull/1045).
+- zos_unarchive - When unarchiving USS files, the module left temporary files on the remote. Change now removes temporary files. (https://github.com/ansible-collections/ibm_zos_core/pull/1073).
+
 v1.8.0
 ======
 
@@ -29,18 +65,18 @@ Minor Changes
 - zos_copy - introduces a new option 'aliases' to enable preservation of member aliases when copying data to partitioned data sets (PDS) destinations from USS or other PDS sources. Copying aliases of text based members to/from USS is not supported. (https://github.com/ansible-collections/ibm_zos_core/pull/1014)
 - zos_fetch - Add validation into path joins to detect unauthorized path traversals. (https://github.com/ansible-collections/ibm_zos_core/pull/962)
 - zos_job_submit - Change action plugin call from copy to zos_copy. (https://github.com/ansible-collections/ibm_zos_core/pull/951)
+- zos_job_submit - Previous code did not return output, but still requested job data from the target system. This changes to honor return_output=false by not querying the job dd segments at all. (https://github.com/ansible-collections/ibm_zos_core/pull/1063).
 - zos_operator - Changed system to call 'wait=true' parameter to zoau call. Requires zoau 1.2.5 or later. (https://github.com/ansible-collections/ibm_zos_core/pull/976)
 - zos_operator_action_query - Add a max delay of 5 seconds on each part of the operator_action_query. Requires zoau 1.2.5 or later. (https://github.com/ansible-collections/ibm_zos_core/pull/976)
-- zos_script - add support for remote_tmp from the Ansible configuration to setup where temporary files will be created, replacing the module option tmp_path. (https://github.com/ansible-collections/ibm_zos_core/pull/1068).
-- zos_submit_job - Previous code did not return output, but still requested job data from the target system. This changes to honor return_output=false by not querying the job dd segments at all. (https://github.com/ansible-collections/ibm_zos_core/pull/1063).
-- zos_tso_command - add example for executing explicitly a REXX script from a data set. (https://github.com/ansible-collections/ibm_zos_core/pull/1072).
+- zos_script - Add support for remote_tmp from the Ansible configuration to setup where temporary files will be created, replacing the module option tmp_path. (https://github.com/ansible-collections/ibm_zos_core/pull/1068).
+- zos_tso_command - Add example for executing explicitly a REXX script from a data set. (https://github.com/ansible-collections/ibm_zos_core/pull/1072).
 - zos_unarchive -  Add validation into path joins to detect unauthorized path traversals. (https://github.com/ansible-collections/ibm_zos_core/pull/1029)
 - zos_unarchive - Enhanced test cases to use test lines the same length of the record length. (https://github.com/ansible-collections/ibm_zos_core/pull/965)
 
 Deprecated Features
 -------------------
 
-- zos_blockinfile - debug is deprecated in favor of 'as_json' (https://github.com/ansible-collections/ibm_zos_core/pull/904).
+- zos_blockinfile debug - is deprecated in favor of 'as_json' (https://github.com/ansible-collections/ibm_zos_core/pull/904).
 
 Bugfixes
 --------
 
@@ -31,7 +31,7 @@ The **IBM z/OS core collection** is following the
 **Red Hat® Ansible Certified Content for IBM Z®** method of distributing
 content. Collections will be developed in the open, and when content is ready
 for use, it is released to
-[Ansible Galaxy](https://galaxy.ansible.com/search?keywords=zos_&order_by=-relevance&deprecated=false&type=collection&page=1)
+[Ansible Galaxy](https://galaxy.ansible.com/ui/)
 for community adoption. Once contributors review community usage, feedback,
 and are satisfied with the content published, the collection will then be
 released to [Ansible Automation Hub](https://www.ansible.com/products/automation-hub)
@@ -62,9 +62,17 @@ For **Ansible Automation Platform** (AAP) users, review the
 and [AAP Life Cycle](https://access.redhat.com/support/policy/updates/ansible-automation-platform)
 for more more information on supported versions of Ansible.
 
+Other Dependencies
+==================
+This release of the **IBM z/OS core collection** requires the z/OS managed node have:
+- [z/OS](https://www.ibm.com/docs/en/zos) V2R4 or later.
+- [z/OS shell](https://www.ibm.com/support/knowledgecenter/en/SSLTBW_2.4.0/com.ibm.zos.v2r4.bpxa400/part1.htm).
+- [IBM Open Enterprise SDK for Python](https://www.ibm.com/products/open-enterprise-python-zos) 3.9 - 3.11.
+- [IBM Z Open Automation Utilities](https://www.ibm.com/docs/en/zoau/1.2.x) 1.2.5 (or later) but prior to version 1.3.
+
 Copyright
 =========
-© Copyright IBM Corporation 2020-2023.
+© Copyright IBM Corporation 2020-2024.
 
 License
 =======
 
@@ -70,7 +70,7 @@ MAG=$'\e[1;35m'
 CYN=$'\e[1;36m'
 ENDC=$'\e[0m'
 # 0 Docker is up, 1 docker is not up
-DOCKER_INFO=`docker info> /dev/null 2>&1;echo $?`
+DOCKER_INFO=`podman info> /dev/null 2>&1;echo $?`
 
 # ==============================================================================
 # Arg parsing helpers
@@ -298,12 +298,12 @@ ac_sanity(){
     if [ "${DOCKER_INFO}" == "0" ]; then
         if [ "${option_version}" ]; then
             message "Running ansible-test with docker container and python version ${option_version}."
-            . $VENV_BIN/activate && cd ~/.ansible/collections/ansible_collections/ibm/ibm_zos_core && \
+            . $VENV_BIN/activate && export ANSIBLE_TEST_PREFER_PODMAN=1 && cd ~/.ansible/collections/ansible_collections/ibm/ibm_zos_core && \
                  ${VENV_BIN}/ansible-test sanity --python ${option_version} --requirements --docker default && \
                     cd ${CURR_DIR};
         else
             message "Running ansible-test with docker container and all python versions."
-            . $VENV_BIN/activate && cd ~/.ansible/collections/ansible_collections/ibm/ibm_zos_core && \
+            . $VENV_BIN/activate && export ANSIBLE_TEST_PREFER_PODMAN=1 && cd ~/.ansible/collections/ansible_collections/ibm/ibm_zos_core && \
                 ${VENV_BIN}/ansible-test sanity --requirements --docker default && \
                     cd ${CURR_DIR};
         fi
 
@@ -106,6 +106,11 @@ plugins:
       name: zos_ping
       namespace: ''
       version_added: 1.1.0
+    zos_script:
+      description: Run scripts in z/OS
+      name: zos_script
+      namespace: ''
+      version_added: 1.8.0
     zos_tso_command:
       description: Execute TSO commands
       name: zos_tso_command
@@ -126,4 +131,4 @@ plugins:
   strategy: {}
   test: {}
   vars: {}
-version: 1.7.0
+version: 1.9.0-beta.1
@@ -1043,12 +1043,12 @@ releases:
         terse it does not clean the temporary data sets created. Fix now removes the
         temporary data sets. (https://github.com/ansible-collections/ibm_zos_core/pull/1054).
       minor_changes:
-      - zos_script - Add support for remote_tmp from the Ansible configuration to
-        setup where temporary files will be created, replacing the module option tmp_path.
-        (https://github.com/ansible-collections/ibm_zos_core/pull/1068).
       - zos_job_submit - Previous code did not return output, but still requested
         job data from the target system. This changes to honor return_output=false
         by not querying the job dd segments at all. (https://github.com/ansible-collections/ibm_zos_core/pull/1063).
+      - zos_script - Add support for remote_tmp from the Ansible configuration to
+        setup where temporary files will be created, replacing the module option tmp_path.
+        (https://github.com/ansible-collections/ibm_zos_core/pull/1068).
       - zos_tso_command - Add example for executing explicitly a REXX script from
         a data set. (https://github.com/ansible-collections/ibm_zos_core/pull/1072).
       release_summary: 'Release Date: ''2023-12-08''
@@ -1176,3 +1176,96 @@ releases:
       name: zos_script
       namespace: ''
     release_date: '2023-10-24'
+  1.9.0-beta.1:
+    changes:
+      bugfixes:
+      - zos_copy - When copying an executable data set with aliases and destination
+        did not exist, destination data set was created with wrong attributes. Fix
+        now creates destination data set with the same attributes as the source. (https://github.com/ansible-collections/ibm_zos_core/pull/1066).
+      - zos_copy - When performing a copy operation to an existing file, the copied
+        file resulted in having corrupted contents. Fix now implements a workaround
+        to not use the specific copy routine that corrupts the file contents. (https://github.com/ansible-collections/ibm_zos_core/pull/1064).
+      - zos_job_output - When passing a job ID or name less than 8 characters long,
+        the module sent the full stack trace as the module's message. Change now allows
+        the use of a shorter job ID or name, as well as wildcards. (https://github.com/ansible-collections/ibm_zos_core/pull/1078).
+      - zos_job_query - The module handling ZOAU import errors obscured the original
+        traceback when an import error ocurred. Fix now passes correctly the context
+        to the user. (https://github.com/ansible-collections/ibm_zos_core/pull/1042).
+      - zos_job_query - When passing a job ID or name less than 8 characters long,
+        the module sent the full stack trace as the module's message. Change now allows
+        the use of a shorter job ID or name, as well as wildcards. (https://github.com/ansible-collections/ibm_zos_core/pull/1078).
+      - zos_operator - The module handling ZOAU import errors obscured the original
+        traceback when an import error ocurred. Fix now passes correctly the context
+        to the user. (https://github.com/ansible-collections/ibm_zos_core/pull/1042).
+      - zos_unarchive - Using a local file with a USS format option failed when sending
+        to remote because dest_data_set option had an empty dictionary. Fix now leaves
+        dest_data_set as None when using a USS format option. (https://github.com/ansible-collections/ibm_zos_core/pull/1045).
+      - zos_unarchive - When unarchiving USS files, the module left temporary files
+        on the remote. Change now removes temporary files. (https://github.com/ansible-collections/ibm_zos_core/pull/1073).
+      minor_changes:
+      - zos_apf - Improves exception handling if there is a failure parsing the command
+        response when operation selected is list. (https://github.com/ansible-collections/ibm_zos_core/pull/1036).
+      - zos_copy - Improve zos_copy performance when copying multiple members from
+        one PDS/E to another. (https://github.com/ansible-collections/ibm_zos_core/pull/1176).
+      - zos_job_output - When passing a job ID and owner the module take as mutually
+        exclusive. Change now allows the use of a job ID and owner at the same time.
+        (https://github.com/ansible-collections/ibm_zos_core/pull/1078).
+      - zos_job_submit - Improve error messages in zos_job_submit to be clearer. (https://github.com/ansible-collections/ibm_zos_core/pull/1074).
+      - zos_job_submit - The module had undocumented parameter and uses as temporary
+        file when the location of the file is LOCAL. Change now uses the same name
+        as the src for the temporary file removing the addition of tmp_file to the
+        arguments. (https://github.com/ansible-collections/ibm_zos_core/pull/1091).
+      - zos_job_submit - The module handling ZOAU import errors obscured the original
+        traceback when an import error ocurred. Fix now passes correctly the context
+        to the user. (https://github.com/ansible-collections/ibm_zos_core/pull/1091).
+      - zos_mvs_raw - when using the dd_input content option for instream-data, if
+        the content was not properly indented according to the program which is generally
+        a blank in columns 1 & 2, those columns would be truncated. Now, when setting
+        instream-data, the module will ensure that all lines contain a blank in columns
+        1 and 2 and add blanks when not present while retaining a maximum length of
+        80 columns for any line. This is true for all content types; string, list
+        of strings and when using a YAML block indicator. (https://github.com/ansible-collections/ibm_zos_core/pull/1057).
+        - zos_mvs_raw - no examples were included with the module that demonstrated
+        using a YAML block indicator, this now includes examples using a YAML block
+        indicator.
+      - zos_tso_command - add example for executing explicitly a REXX script from
+        a data set. (https://github.com/ansible-collections/ibm_zos_core/pull/1065).
+      release_summary: 'Release Date: ''2024-01-31''
+
+        This changelog describes all changes made to the modules and plugins included
+
+        in this collection. The release date is the date the changelog is created.
+
+        For additional details such as required dependencies and availability review
+
+        the collections `release notes <https://ibm.github.io/z_ansible_collections_doc/ibm_zos_core/docs/source/release_notes.html>`__'
+    fragments:
+    - 1016-remove-randint.yml
+    - 1036-apf-try-except.yml
+    - 1042-missing-zoau-imports.yml
+    - 1045-local-uss-unarchive.yml
+    - 1048-Update_sanity_tests_ignore.yml
+    - 1048-update-ac-tool-pyyaml-version.yml
+    - 1051-try-except-pass-zos_mvs_raw.yml
+    - 1052-try-except-pass-dd-statement.yml
+    - 1053-Enabler_1002_test_collections_on_ansible_core_2_16.yml
+    - 1055-remove-subprocess-encode.yml
+    - 1056-Update_sanity_ignore_2_16.yml
+    - 1057-module_zos_mvs_raw_errors_with_long_multi_line_quoted_string_in_content_field.yml
+    - 1064-corruped-second-copy.yml
+    - 1065-rexx-exec-tso_command.yml
+    - 1066-Mvs_to_non_existent_mvs_copy_destination_attrs_match_up.yml
+    - 1073-action_plugin_does_not_clean_up_remote_temporary_files_after_completion.yml
+    - 1074-improve-job-submit-error-msgs.yml
+    - 1077-modify-uss-extraction.yml
+    - 1078-short_job_name_sends_back_a_value_error.yaml
+    - 1091-Update_undocumented_argument_and_import_exception.yml
+    - 1101-fix-undefined-var.yml
+    - 1158-Test-zos-fetch-find-remove-hardcoded-datasets.yml
+    - 1163-Refactor_calls_to_use_new_alias_and_execute_options.yml
+    - 1176-copy-members.yml
+    - 1195-Add_prefer_volumes_user.yml
+    - 1200-zos_backup_restore-sanity-issues.yml
+    - 977-remove-hard-coded-vols-and-datasets.yml
+    - v1.9.0-beta.1_summary.yml
+    release_date: '2024-02-01'
@@ -0,0 +1,3 @@
+minor_changes:
+  - zos_copy - Improve zos_copy performance when copying multiple members from one PDS/E to another.
+    (https://github.com/ansible-collections/ibm_zos_core/pull/1176).
Original file line number	Diff line number	Diff line change
`@@ -0,0 +1,3 @@`
	`1`	`+minor_changes:`
	`2`	`+ - zos_copy - Improve zos_copy performance when copying multiple members from one PDS/E to another.`
	`3`	`+ (https://github.com/ansible-collections/ibm_zos_core/pull/1176).`