ENH: upload - DANDI_UPLOAD_SAME_MUST_EXIST for internal use for paran…

…oids

DEVELOPMENT.md

@@ -72,6 +72,9 @@ development command line options.
   new set on each run.  Set this environment variable to `0` to cause the
   containers to be destroyed at the end of the next run.
 
+- `DANDI_UPLOAD_SAME_MUST_EXIST` -- primarily for internal use with
+ `--existing=overwrite-metadata` so we do not upload some outdated file.
+
 ## Sourcegraph
 
 The [Sourcegraph](https://sourcegraph.com) browser extension can be used to

dandi/upload.py

@@ -376,6 +376,15 @@ def ensure_folder():
 
                 yield {"message": exists_msg + " - reuploading"}
 
+            # For "internal" use -- primarily for use with existing == "overwrite-metadata"
+            if os.environ.get("DANDI_UPLOAD_SAME_MUST_EXIST"):
+                if not file_recs:
+                    yield skip_file("File does not exist!")
+                    return
+                if remote_file_status != "same":
+                    yield skip_file("File is not the same!")
+                    return
+
             #
             # 4. Extract metadata - delayed since takes time, but is done
             #    before actual upload, so we could skip if this fails
@@ -688,6 +697,10 @@ def skip_file(msg):
         raise NotImplementedError(
             "No existing=overwrite-metadata for new dandi-api version (yet)"
         )
+    if os.environ.get("DANDI_UPLOAD_SAME_MUST_EXIST"):
+        raise NotImplementedError(
+            "Not DANDI_UPLOAD_SAME_MUST_EXIST in new dandi-api version (yet)"
+        )
 
     # TODO: we might want to always yield a full record so no field is not
     # provided to pyout to cause it to halt