Skip to content

Commit

Permalink
again..
Browse files Browse the repository at this point in the history
Signed-off-by: Dmitry Chigarev <dmitry.chigarev@intel.com>
  • Loading branch information
dchigarev committed Oct 12, 2023
1 parent c53f3bc commit a0c77bd
Showing 1 changed file with 1 addition and 1 deletion.
Original file line number Diff line number Diff line change
Expand Up @@ -81,7 +81,7 @@ def split_pandas_df_into_partitions(
# df.memory_usage().sum() * 3
# )
print(f"available:", psutil.virtual_memory().available / 1024 / 1024, "df size:", df.memory_usage(deep=True).sum() / 1024 / 1024)
print(subprocess.run("ray memory", shell=True, capture_output=True).stdout.splitlines()[-2])
print(subprocess.run("ray memory", shell=True, capture_output=True).stdout)
three_copies_fits_into_memory = True
distributed_splitting = (
enough_elements and all_numeric_types and three_copies_fits_into_memory
Expand Down

0 comments on commit a0c77bd

Please sign in to comment.