Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
Merge feature branch with backup changes to dev (home-assistant#132954)
* Reapply "Make WS command backup/generate send events" (home-assistant#131530) This reverts commit 9b8316d. * MVP implementation of Backup sync agents (home-assistant#126122) * init sync agent * add syncing * root import * rename list to info and add sync state * Add base backup class * Revert unneded change * adjust tests * move to kitchen_sink * split * move * Adjustments * Adjustment * update * Tests * Test unknown agent * adjust * Adjust for different test environments * Change /info WS to contain a dictinary * reorder * Add websocket command to trigger sync from the supervisor * cleanup * Make mypy happier --------- Co-authored-by: Erik <erik@montnemery.com> * Make BackupSyncMetadata model a dataclass (home-assistant#130555) Make backup BackupSyncMetadata model a dataclass * Rename backup sync agent to backup agent (home-assistant#130575) * Rename sync agent module to agent * Rename BackupSyncAgent to BackupAgent * Fix test typo * Rename async_get_backup_sync_agents to async_get_backup_agents * Rename and clean up remaining sync things * Update kitchen sink * Apply suggestions from code review * Update test_manager.py --------- Co-authored-by: Erik Montnemery <erik@montnemery.com> * Add additional options to WS command backup/generate (home-assistant#130530) * Add additional options to WS command backup/generate * Improve test * Improve test * Align parameter names in backup/agents/* WS commands (home-assistant#130590) * Allow setting password for backups (home-assistant#110630) * Allow setting password for backups * use is_hassio from helpers * move it * Fix getting psw * Fix restoring with psw * Address review comments * Improve docstring * Adjust kitchen sink * Adjust --------- Co-authored-by: Erik <erik@montnemery.com> * Export relevant names from backup integration (home-assistant#130596) * Tweak backup agent interface (home-assistant#130613) * Tweak backup agent interface * Adjust kitchen_sink * Test kitchen sink backup (home-assistant#130609) * Test agents_list_backups * Test agents_info * Test agents_download * Export Backup from manager * Test agents_upload * Update tests after rebase * Use backup domain * Remove WS command backup/upload (home-assistant#130588) * Remove WS command backup/upload * Disable failing kitchen_sink test * Make local backup a backup agent (home-assistant#130623) * Make local backup a backup agent * Adjust * Adjust * Adjust * Adjust tests * Adjust * Adjust * Adjust docstring * Adjust * Protect members of CoreLocalBackupAgent * Remove redundant check for file * Make the backup.create service use the first local agent * Add BackupAgent.async_get_backup * Fix some TODOs * Add support for downloading backup from a remote agent * Fix restore * Fix test * Adjust kitchen_sink test * Remove unused method BackupManager.async_get_backup_path * Re-enable kitchen sink test * Remove BaseBackupManager.async_upload_backup * Support restore from remote agent * Fix review comments * Include backup agent error in response to WS command backup/info (home-assistant#130884) * Adjust code related to WS command backup/info (home-assistant#130890) * Include backup agent error in response to WS command backup/details (home-assistant#130892) * Remove LOCAL_AGENT_ID constant from backup manager (home-assistant#130895) * Add backup config storage (home-assistant#130871) * Add base for backup config * Allow updating backup config * Test loading backup config * Add backup config update method * Add temporary check for BackupAgent.async_remove_backup (home-assistant#130893) * Rename backup slug to backup_id (home-assistant#130902) * Improve backup websocket API tests (home-assistant#130912) * Improve backup websocket API tests * Add missing snapshot * Fix tests leaving files behind * Improve backup manager backup creation tests (home-assistant#130916) * Remove class backup.backup.LocalBackup (home-assistant#130919) * Add agent delete backup (home-assistant#130921) * Add backup agent delete backup * Remove agents delete websocket command * Update docstring Co-authored-by: Erik Montnemery <erik@montnemery.com> --------- Co-authored-by: Erik Montnemery <erik@montnemery.com> * Disable core local backup agent in hassio (home-assistant#130933) * Rename remove backup to delete backup (home-assistant#130940) * Rename remove backup to delete backup * Revert "backup/delete" * Refactor BackupManager (home-assistant#130947) * Refactor BackupManager * Adjust * Adjust backup creation * Copy in executor * Fix BackupManager.async_get_backup (home-assistant#130975) * Fix typo in backup tests (home-assistant#130978) * Adjust backup NewBackup class (home-assistant#130976) * Remove class backup.BackupUploadMetadata (home-assistant#130977) Remove class backup.BackupMetadata * Report backup size in bytes instead of MB (home-assistant#131028) Co-authored-by: Robert Resch <robert@resch.dev> * Speed up CI for feature branch (home-assistant#131030) * Speed up CI for feature branch * adjust * fix * fix * fix * fix * Rename remove to delete in backup websocket type (home-assistant#131023) * Revert "Speed up CI for feature branch" (home-assistant#131074) Revert "Speed up CI for feature branch (home-assistant#131030)" This reverts commit 7912805. * Rename class BaseBackup to AgentBackup (home-assistant#131083) * Rename class BaseBackup to AgentBackup * Update tests * Speed up CI for backup feature branch (home-assistant#131079) * Add backup platform to the hassio integration (home-assistant#130991) * Add backup platform to the hassio integration * Add hassio to after_dependencies of backup * Address review comments * Remove redundant hassio parametrization of tests * Add tests * Address review comments * Bump CI cache version * Revert "Bump CI cache version" This reverts commit 2ab4d2b. * Extend backup info class AgentBackup (home-assistant#131110) * Extend backup info class AgentBackup * Update kitchen sink * Update kitchen sink test * Update kitchen sink test * Exclude cloud and hassio from core files (home-assistant#131117) * Remove unnecessary **kwargs from backup API (home-assistant#131124) * Fix backup tests (home-assistant#131128) * Freeze backup dataclasses (home-assistant#131122) * Protect CoreLocalBackupAgent.load_backups (home-assistant#131126) * Use backup metadata v2 in core/container backups (home-assistant#131125) * Extend backup creation API (home-assistant#131121) * Extend backup creation API * Add tests * Fix merge * Fix merge * Return agent errors when deleting a backup (home-assistant#131142) * Return agent errors when deleting a backup * Remove redundant calls to dict.keys() * Add enum type for backup folder (home-assistant#131158) * Add method AgentBackup.from_dict (home-assistant#131164) * Remove WS command backup/agents/list_backups (home-assistant#131163) * Handle backup schedule (home-assistant#131127) * Add backup schedule handling * Fix unrelated incorrect type annotation in test * Clarify delay save * Make the backup time compatible with the recorder nightly job * Update create backup parameters * Use typed dict for create backup parameters * Simplify schedule state * Group create backup parameters * Move parameter * Fix typo * Use Folder model * Handle deserialization of folders better * Fail on attempt to include addons or folders in core backup (home-assistant#131204) * Fix AgentBackup test (home-assistant#131201) * Add options to WS command backup/restore (home-assistant#131194) * Add options to WS command backup/restore * Add tests * Fix test * Teach core backup to restore only database or only settings (home-assistant#131225) * Exclude tmp_backups/*.tar from backups (home-assistant#131243) * Add WS command backup/subscribe_events (home-assistant#131250) * Clean up temporary directory after restoring backup (home-assistant#131263) * Improve hassio backup agent list (home-assistant#131268) * Include `last_automatic_backup` in reply to backup/info (home-assistant#131293) Include last_automatic_backup in reply to backup/info * Handle backup delete after config (home-assistant#131259) * Handle delete after copies * Handle delete after days * Add some test examples * Test config_delete_after_logic * Test config_delete_after_copies_logic * Test more delete after days * Add debug logs * Always delete the oldest backup first * Never remove the last backup * Clean up words Co-authored-by: Erik Montnemery <erik@montnemery.com> * Fix after cleaning words * Use utcnow * Remove duplicate guard * Simplify sorting * Delete backups even if there are agent errors on get backups --------- Co-authored-by: Erik Montnemery <erik@montnemery.com> * Rename backup delete after to backup retention (home-assistant#131364) * Rename backup delete after to backup retention * Tweak * Remove length limit on `agent_ids` when configuring backup (home-assistant#132057) Remove length limit on agent_ids when configuring backup * Rename backup retention_config to retention (home-assistant#132068) * Modify backup agent API to be stream oriented (home-assistant#132090) * Modify backup agent API to be stream oriented * Fix tests * Adjust after code review * Remove no longer needed pylint override * Improve test coverage * Change BackupAgent API to work with AsyncIterator objects * Don't close files in the event loop * Don't close files in the event loop * Fix backup manager create backup log (home-assistant#132174) * Fix debug log level (home-assistant#132186) * Add cloud backup agent (home-assistant#129621) * Init cloud backup sync * Add more metadata * Fix typo * Adjust to base changes * Don't raise on list if more than one backup is available * Adjust to base branch * Fetch always and verify on download * Update homeassistant/components/cloud/backup.py Co-authored-by: Martin Hjelmare <marhje52@gmail.com> * Adjust to base branch changes * Not required anymore * Workaround * Fix blocking event loop * Fix * Add some tests * some tests * Add cloud backup delete functionality * Enable check * Fix ruff * Use fixture * Use iter_chunks instead * Remove read * Remove explicit export of read_backup * Align with BackupAgent API changes * Improve test coverage * Improve error handling * Adjust docstrings * Catch aiohttp.ClientError bubbling up from hass_nabucasa * Improve iteration --------- Co-authored-by: Erik <erik@montnemery.com> Co-authored-by: Robert Resch <robert@resch.dev> Co-authored-by: Martin Hjelmare <marhje52@gmail.com> Co-authored-by: Krisjanis Lejejs <krisjanis.lejejs@gmail.com> * Extract file receiver from `BackupManager.async_receive_backup` to util (home-assistant#132271) * Extract file receiver from BackupManager.async_receive_backup to util * Apply suggestions from code review Co-authored-by: Martin Hjelmare <marhje52@gmail.com> --------- Co-authored-by: Martin Hjelmare <marhje52@gmail.com> * Make sure backup directory exists (home-assistant#132269) * Make sure backup directory exists * Hand off directory creation to executor * Use mkdir's exist_ok feeature * Organize BackupManager instance attributes (home-assistant#132277) * Don't store received backups in a TempDir (home-assistant#132272) * Don't store received backups in a TempDir * Fix tests * Make sure backup directory exists * Address review comments * Fix tests * Rewrite backup manager state handling (home-assistant#132375) * Rewrite backup manager state handling * Address review comments * Modify backup reader/writer API to be stream oriented (home-assistant#132464) * Internalize backup tasks (home-assistant#132482) * Internalize backup tasks * Update test after rebase * Handle backup error during automatic backup (home-assistant#132511) * Improve backup manager state logging (home-assistant#132549) * Fix backup manager state when restore completes (home-assistant#132548) * Remove WS command backup/agents/download (home-assistant#132664) * Add WS command backup/generate_with_stored_settings (home-assistant#132671) * Add WS command backup/generate_with_stored_settings * Register the new command, add tests * Refactor local agent backup tests (home-assistant#132683) * Refactor test_load_backups * Refactor test loading agents * Refactor test_delete_backup * Refactor test_upload * Clean up duplicate tests * Refactor backup manager receive tests (home-assistant#132701) * Refactor backup manager receive tests * Clean up * Refactor pre and post platform tests (home-assistant#132708) * Refactor backup pre platform test * Refactor backup post platform test * Bump aiohasupervisor to version 0.2.2b0 (home-assistant#132704) * Bump aiohasupervisor to version 0.2.2b0 * Adjust tests * Publish event when manager is idle after creating backup (home-assistant#132724) * Handle busy backup manager when uploading backup (home-assistant#132736) * Adjust hassio backup agent to supervisor changes (home-assistant#132732) * Adjust hassio backup agent to supervisor changes * Fix typo * Refactor test for create backup with wrong parameters (home-assistant#132763) * Refactor test not loading bad backup platforms (home-assistant#132769) * Improve receive backup coverage (home-assistant#132758) * Refactor initiate backup test (home-assistant#132829) * Rename Backup to ManagerBackup (home-assistant#132841) * Refactor backup config (home-assistant#132845) * Refactor backup config * Remove unnecessary condition * Adjust tests * Improve initiate backup test (home-assistant#132858) * Store the time of automatic backup attempts (home-assistant#132860) * Store the time of automatic backup attempts * Address review comments * Update test * Update cloud test * Save agent failures when creating backups (home-assistant#132850) * Save agent failures when creating backups * Update tests * Store KnownBackups * Add test * Only clear known_backups on no error, add tests * Address review comments * Store known backups as a list * Update tests * Track all backups created with backup strategy settings (home-assistant#132916) * Track all backups created with saved settings * Rename * Add explicit call to save the store * Don't register service backup.create in HassOS installations (home-assistant#132932) * Revert changes to action service backup.create (home-assistant#132938) * Fix logic for cleaning up temporary backup file (home-assistant#132934) * Fix logic for cleaning up temporary backup file * Reduce scope of patch * Fix with_strategy_settings info not sent over websocket (home-assistant#132939) * Fix with_strategy_settings info not sent over websocket * Fix kitchen sink tests * Fix cloud and hassio tests * Revert backup ci changes (home-assistant#132955) Revert changes speeding up CI * Fix revert of CI changes (home-assistant#132960) --------- Co-authored-by: Joakim Sørensen <joasoe@gmail.com> Co-authored-by: Martin Hjelmare <marhje52@gmail.com> Co-authored-by: Robert Resch <robert@resch.dev> Co-authored-by: Paul Bottein <paul.bottein@gmail.com> Co-authored-by: Krisjanis Lejejs <krisjanis.lejejs@gmail.com>
- Loading branch information