Update extract

[tomjemmett]

switch to using app registration with client secret credentials over sas tokens. also extracts the synth data

[Copilot]

Pull request overview

Updates the Databricks extraction/upload script to authenticate to Azure Storage via an app registration (client secret credential) instead of SAS tokens, and adds extraction of the “synth” dataset alongside existing dev datasets.

Changes:

• Replaces SAS-token-based storage access with ClientSecretCredential built from Databricks secrets.
• Updates the internal move/upload helper to accept an AAD credential and wires it through callers.
• Adds a new move_synth_data(...) path to upload model_data/synth under the synth/ prefix.

Comments suppressed due to low confidence (1)

src/nhp/data/extract_data.py:96

• This error message still references SAS token setup, but the script now uses an app registration (client secret) credential. Update the message (and ideally the module docstring/instructions) so operators know what to configure.

        print(
            "Error moving files, have you followed the instructions for generating the SAS token?"
        )

---

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

[yiwen-h]

Talked through on a call. Better than using SAS tokens, thank you