Skip to content

FIX-#1386: Fix read_csv for incorrect csv data #2076

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
anmyachev merged 1 commit into from
Sep 15, 2020
Merged

FIX-#1386: Fix read_csv for incorrect csv data #2076

anmyachev merged 1 commit into from
Sep 15, 2020

Conversation

@prutskov
Copy link
Contributor

@prutskov prutskov commented Sep 14, 2020 •
edited
Loading

Signed-off-by: Alexey Prutskov alexey.prutskov@intel.com

What do these changes do?

@prutskov prutskov self-assigned this Sep 14, 2020
@prutskov prutskov added this to the 0.8.1 milestone Sep 14, 2020
@codecov
Copy link

codecov bot commented Sep 14, 2020 •
edited
Loading

Codecov Report

Merging #2076 into master will decrease coverage by 0.02%.
The diff coverage is 100.00%.

Impacted file tree graph

@@            Coverage Diff             @@
##           master    #2076      +/-   ##
==========================================
- Coverage   82.01%   81.98%   -0.03%     
==========================================
  Files          80       84       +4     
  Lines        9611     9801     +190     
==========================================
+ Hits         7882     8035     +153     
- Misses       1729     1766      +37
Impacted Files Coverage Δ
modin/engines/base/io/text/csv_reader.py 99.11% <100.00%> (ø)
modin/pandas/__init__.py 71.15% <0.00%> (ø)
modin/__init__.py 50.00% <0.00%> (ø)
modin/pandas/utils.py 89.47% <0.00%> (ø)
modin/utils.py 97.67% <0.00%> (ø)
modin/backends/pandas/query_compiler.py 96.67% <0.00%> (+0.10%) ⬆️
modin/experimental/cloud/meta_magic.py 85.45% <0.00%> (+1.81%) ⬆️
modin/_version.py 49.63% <0.00%> (+6.20%) ⬆️

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update df725d2...6c8d1b5. Read the comment docs.

@modin-bot
Copy link

modin-bot commented Sep 14, 2020 •
edited
Loading

TeamCity Dask test results bot

Tests PASSed

Tests Logs 
============================= test session starts ==============================
platform linux -- Python 3.8.5, pytest-6.0.2, py-1.9.0, pluggy-0.13.1
rootdir: /modin, configfile: setup.cfg
plugins: cov-2.10.1, forked-1.2.0, xdist-2.1.0
collected 114 items

modin/pandas/test/test_io.py .................sx..........s............. [ 37%]
.....................................s..s.X.....s..................ss..  [100%]

----------- coverage: platform linux, python 3.8.5-final-0 -----------
Coverage XML written to file coverage.xml


= 105 passed, 7 skipped, 1 xfailed, 1 xpassed, 108 warnings in 76.36s (0:01:16) =
Closing remaining open files:test_write_pandas.hdf...donetest_write_modin.hdf...done
============================= test session starts ==============================
platform linux -- Python 3.8.5, pytest-6.0.2, py-1.9.0, pluggy-0.13.1
rootdir: /modin, configfile: setup.cfg
plugins: cov-2.10.1, forked-1.2.0, xdist-2.1.0
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I / gw8 I / gw9 I / gw10 I / gw11 I / gw12 I / gw13 I / gw14 I / gw15 I / gw16 I / gw17 I / gw18 I / gw19 I / gw20 I / gw21 I / gw22 I / gw23 I / gw24 I / gw25 I / gw26 I / gw27 I / gw28 I / gw29 I / gw30 I / gw31 I / gw32 I / gw33 I / gw34 I / gw35 I / gw36 I / gw37 I / gw38 I / gw39 I / gw40 I / gw41 I / gw42 I / gw43 I / gw44 I / gw45 I / gw46 I / gw47 I
gw0 [5399] / gw1 [5399] / gw2 [5399] / gw3 [5399] / gw4 [5399] / gw5 [5399] / gw6 [5399] / gw7 [5399] / gw8 [5399] / gw9 [5399] / gw10 [5399] / gw11 [5399] / gw12 [5399] / gw13 [5399] / gw14 [5399] / gw15 [5399] / gw16 [5399] / gw17 [5399] / gw18 [5399] / gw19 [5399] / gw20 [5399] / gw21 [5399] / gw22 [5399] / gw23 [5399] / gw24 [5399] / gw25 [5399] / gw26 [5399] / gw27 [5399] / gw28 [5399] / gw29 [5399] / gw30 [5399] / gw31 [5399] / gw32 [5399] / gw33 [5399] / gw34 [5399] / gw35 [5399] / gw36 [5399] / gw37 [5399] / gw38 [5399] / gw39 [5399] / gw40 [5399] / gw41 [5399] / gw42 [5399] / gw43 [5399] / gw44 [5399] / gw45 [5399] / gw46 [5399] / gw47 [5399]

......................................................................... [  1%]
........................................................................ [  2%]
........................................................................ [  4%]
........................................................................ [  5%]
........................................................................ [  6%]
........................................................................ [  8%]
................s.....................x.................................. [  9%]
............x.................x.....................x...............x..x [ 10%]
....................x.........................................x........x [ 12%]
..X...x......s.........................................xx............... [ 13%]
.........x.x...x.x..x.x..................x........................x..... [ 14%]
...........X.......x............x....................................... [ 16%]
........sxx........x..........x...................................x..... [ 17%]
......................................................................... [ 18%]
....x.x................x.x..................X.................x......... [ 20%]
.................x.....................x...x...x...............X.....X.. [ 21%]
......X..x.X.........................x.........X...X....X....X.....X.... [ 22%]
.........X..........X.......X........................................... [ 24%]
..X...........x.......X....x.......X............X.....X......x..X....... [ 25%]
....................................x...........................x....... [ 26%]
...........x........x.......................x.....x...................x. [ 28%]
.......................x............................x...X......x........ [ 29%]
..x.....X............x....X........X....................X...........X... [ 30%]
...X.....x.............x.....x.....................................x.... [ 32%]
..x...x...................X...................X......X.................. [ 33%]
x..xX....x....................X.......X..X...................XX........X [ 34%]
.X...X..........X....x........X.........................X....X........... [ 36%]
x...................x..x..........x....x...................X.....x....X. [ 37%]
.........x...x..........................x..x......x..................... [ 38%]
.x.xx......X...x........x..................................x...........x [ 40%]
......x..........................x......x...x......X........xxX.X.....X.. [ 41%]
..X....X.X......x.X...X....X..X.X.....X....X.......X....X........X...... [ 42%]
...X........X....ss..s..s.s..ss.sxss..sss................xx............. [ 44%]
........x............x......Xx............................s....ss.s.ss.x [ 45%]
ssss...s..X.........................x.................X.......x........... [ 46%]
X.........X...sss..sss.s.ss..s..s.s..................................... [ 48%]
...x.........................x......x.....................x............. [ 49%]
..........................x...x....s.....X..........X................... [ 50%]
x...............................x.....................x.........x....... [ 52%]
..................X.............X....X..x...X....X.....x..X......X....X.. [ 53%]
.....X................................................................... [ 54%]
................................................................x....... [ 56%]
...............x.........................X..........X..........x......... [ 57%]
..x........X............X........x.........x...........ssx.............. [ 58%]
.................x....................x...........x..............Xx..... [ 60%]
...........x...............x.........x..X....X..X.....X....X...X........ [ 61%]
........................................................................ [ 62%]
...............................x.........................x...........X... [ 64%]
............X........................................................... [ 65%]
.....................................................................x.. [ 66%]
.......................................s................................ [ 68%]
........................................................................ [ 69%]
........................................................................ [ 70%]
......................s................................................. [ 72%]
....X....................s............................................... [ 73%]
.x....................................................................... [ 74%]
.....................................X.s................................ [ 76%]
.s.....................x......s...s......x...............s.s...x...X.... [ 77%]
.s.s.....................s..s..........s.....s.......xs..x.......s...... [ 78%]
.x......s..s.......x..s.....s...........................x.......x......s [ 80%]
........x.....s........s.x......X.................s....X.....s......XX.. [ 81%]
.X........X.......X..X....s......XX.X.X.X...X.XX.X.X........XxX.XX....X. [ 82%]
.....X........X..XX...X.....xXX.......XX........X...X.XX....x........... [ 84%]
X.....X.........x......X............X.Xx...X............................ [ 85%]
......................................................X.X..X............ [ 86%]
X.................................................X.......x............. [ 88%]
....................x.....................................X.........xx.. [ 89%]
.......x...x.X...........x.X........X....X.......xx...........x....x...x [ 90%]
.........X...x................................xX........x............... [ 92%]
..............x......................................................... [ 93%]
.........................................x.....x.........x....x.......... [ 94%]
.x.x.......................x..x..xx...........x..............x.....xx... [ 96%]
x....x.......................x.......................................... [ 97%]
........................................................................ [ 98%]
.........................................................                [100%]

----------- coverage: platform linux, python 3.8.5-final-0 -----------
Coverage XML written to file coverage.xml

= 5002 passed, 69 skipped, 176 xfailed, 152 xpassed, 9505 warnings in 119.19s (0:01:59) =
============================= test session starts ==============================
platform linux -- Python 3.8.5, pytest-6.0.2, py-1.9.0, pluggy-0.13.1
rootdir: /modin, configfile: setup.cfg
plugins: cov-2.10.1, forked-1.2.0, xdist-2.1.0
collected 114 items

modin/pandas/test/test_io.py .................sx..........s............. [ 37%]
.....................................s..s.X.....s..................ss..  [100%]

----------- coverage: platform linux, python 3.8.5-final-0 -----------
Coverage XML written to file coverage.xml


= 105 passed, 7 skipped, 1 xfailed, 1 xpassed, 108 warnings in 76.36s (0:01:16) =
Closing remaining open files:test_write_pandas.hdf...donetest_write_modin.hdf...done
============================= test session starts ==============================
platform linux -- Python 3.8.5, pytest-6.0.2, py-1.9.0, pluggy-0.13.1
rootdir: /modin, configfile: setup.cfg
plugins: cov-2.10.1, forked-1.2.0, xdist-2.1.0
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I / gw8 I / gw9 I / gw10 I / gw11 I / gw12 I / gw13 I / gw14 I / gw15 I / gw16 I / gw17 I / gw18 I / gw19 I / gw20 I / gw21 I / gw22 I / gw23 I / gw24 I / gw25 I / gw26 I / gw27 I / gw28 I / gw29 I / gw30 I / gw31 I / gw32 I / gw33 I / gw34 I / gw35 I / gw36 I / gw37 I / gw38 I / gw39 I / gw40 I / gw41 I / gw42 I / gw43 I / gw44 I / gw45 I / gw46 I / gw47 I
gw0 [5399] / gw1 [5399] / gw2 [5399] / gw3 [5399] / gw4 [5399] / gw5 [5399] / gw6 [5399] / gw7 [5399] / gw8 [5399] / gw9 [5399] / gw10 [5399] / gw11 [5399] / gw12 [5399] / gw13 [5399] / gw14 [5399] / gw15 [5399] / gw16 [5399] / gw17 [5399] / gw18 [5399] / gw19 [5399] / gw20 [5399] / gw21 [5399] / gw22 [5399] / gw23 [5399] / gw24 [5399] / gw25 [5399] / gw26 [5399] / gw27 [5399] / gw28 [5399] / gw29 [5399] / gw30 [5399] / gw31 [5399] / gw32 [5399] / gw33 [5399] / gw34 [5399] / gw35 [5399] / gw36 [5399] / gw37 [5399] / gw38 [5399] / gw39 [5399] / gw40 [5399] / gw41 [5399] / gw42 [5399] / gw43 [5399] / gw44 [5399] / gw45 [5399] / gw46 [5399] / gw47 [5399]

......................................................................... [  1%]
........................................................................ [  2%]
........................................................................ [  4%]
........................................................................ [  5%]
........................................................................ [  6%]
........................................................................ [  8%]
................s.....................x.................................. [  9%]
............x.................x.....................x...............x..x [ 10%]
....................x.........................................x........x [ 12%]
..X...x......s.........................................xx............... [ 13%]
.........x.x...x.x..x.x..................x........................x..... [ 14%]
...........X.......x............x....................................... [ 16%]
........sxx........x..........x...................................x..... [ 17%]
......................................................................... [ 18%]
....x.x................x.x..................X.................x......... [ 20%]
.................x.....................x...x...x...............X.....X.. [ 21%]
......X..x.X.........................x.........X...X....X....X.....X.... [ 22%]
.........X..........X.......X........................................... [ 24%]
..X...........x.......X....x.......X............X.....X......x..X....... [ 25%]
....................................x...........................x....... [ 26%]
...........x........x.......................x.....x...................x. [ 28%]
.......................x............................x...X......x........ [ 29%]
..x.....X............x....X........X....................X...........X... [ 30%]
...X.....x.............x.....x.....................................x.... [ 32%]
..x...x...................X...................X......X.................. [ 33%]
x..xX....x....................X.......X..X...................XX........X [ 34%]
.X...X..........X....x........X.........................X....X........... [ 36%]
x...................x..x..........x....x...................X.....x....X. [ 37%]
.........x...x..........................x..x......x..................... [ 38%]
.x.xx......X...x........x..................................x...........x [ 40%]
......x..........................x......x...x......X........xxX.X.....X.. [ 41%]
..X....X.X......x.X...X....X..X.X.....X....X.......X....X........X...... [ 42%]
...X........X....ss..s..s.s..ss.sxss..sss................xx............. [ 44%]
........x............x......Xx............................s....ss.s.ss.x [ 45%]
ssss...s..X.........................x.................X.......x........... [ 46%]
X.........X...sss..sss.s.ss..s..s.s..................................... [ 48%]
...x.........................x......x.....................x............. [ 49%]
..........................x...x....s.....X..........X................... [ 50%]
x...............................x.....................x.........x....... [ 52%]
..................X.............X....X..x...X....X.....x..X......X....X.. [ 53%]
.....X................................................................... [ 54%]
................................................................x....... [ 56%]
...............x.........................X..........X..........x......... [ 57%]
..x........X............X........x.........x...........ssx.............. [ 58%]
.................x....................x...........x..............Xx..... [ 60%]
...........x...............x.........x..X....X..X.....X....X...X........ [ 61%]
........................................................................ [ 62%]
...............................x.........................x...........X... [ 64%]
............X........................................................... [ 65%]
.....................................................................x.. [ 66%]
.......................................s................................ [ 68%]
........................................................................ [ 69%]
........................................................................ [ 70%]
......................s................................................. [ 72%]
....X....................s............................................... [ 73%]
.x....................................................................... [ 74%]
.....................................X.s................................ [ 76%]
.s.....................x......s...s......x...............s.s...x...X.... [ 77%]
.s.s.....................s..s..........s.....s.......xs..x.......s...... [ 78%]
.x......s..s.......x..s.....s...........................x.......x......s [ 80%]
........x.....s........s.x......X.................s....X.....s......XX.. [ 81%]
.X........X.......X..X....s......XX.X.X.X...X.XX.X.X........XxX.XX....X. [ 82%]
.....X........X..XX...X.....xXX.......XX........X...X.XX....x........... [ 84%]
X.....X.........x......X............X.Xx...X............................ [ 85%]
......................................................X.X..X............ [ 86%]
X.................................................X.......x............. [ 88%]
....................x.....................................X.........xx.. [ 89%]
.......x...x.X...........x.X........X....X.......xx...........x....x...x [ 90%]
.........X...x................................xX........x............... [ 92%]
..............x......................................................... [ 93%]
.........................................x.....x.........x....x.......... [ 94%]
.x.x.......................x..x..xx...........x..............x.....xx... [ 96%]
x....x.......................x.......................................... [ 97%]
........................................................................ [ 98%]
.........................................................                [100%]

----------- coverage: platform linux, python 3.8.5-final-0 -----------
Coverage XML written to file coverage.xml

= 5002 passed, 69 skipped, 176 xfailed, 152 xpassed, 9505 warnings in 119.19s (0:01:59) =

@modin-bot
Copy link

modin-bot commented Sep 14, 2020 •
edited
Loading

TeamCity Python test results bot

Tests FAILed

Tests Logs 
============================= test session starts ==============================
platform linux -- Python 3.8.5, pytest-6.0.2, py-1.9.0, pluggy-0.13.1
rootdir: /modin, configfile: setup.cfg
plugins: cov-2.10.1, forked-1.2.0, xdist-2.1.0
collected 114 items

modin/pandas/test/test_io.py .................sX..........s............. [ 37%]
........s............................s..s.X.....s..................ss..  [100%]

----------- coverage: platform linux, python 3.8.5-final-0 -----------
Coverage XML written to file coverage.xml


=========== 104 passed, 8 skipped, 2 xpassed, 128 warnings in 39.83s ===========
Closing remaining open files:test_write_modin.hdf...donetest_write_pandas.hdf...done
============================= test session starts ==============================
platform linux -- Python 3.8.5, pytest-6.0.2, py-1.9.0, pluggy-0.13.1
rootdir: /modin, configfile: setup.cfg
plugins: cov-2.10.1, forked-1.2.0, xdist-2.1.0
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I / gw8 I / gw9 I / gw10 I / gw11 I / gw12 I / gw13 I / gw14 I / gw15 I / gw16 I / gw17 I / gw18 I / gw19 I / gw20 I / gw21 I / gw22 I / gw23 I / gw24 I / gw25 I / gw26 I / gw27 I / gw28 I / gw29 I / gw30 I / gw31 I / gw32 I / gw33 I / gw34 I / gw35 I / gw36 I / gw37 I / gw38 I / gw39 I / gw40 I / gw41 I / gw42 I / gw43 I / gw44 I / gw45 I / gw46 I / gw47 I
gw0 [5399] / gw1 [5399] / gw2 [5399] / gw3 [5399] / gw4 [5399] / gw5 [5399] / gw6 [5399] / gw7 [5399] / gw8 [5399] / gw9 [5399] / gw10 [5399] / gw11 [5399] / gw12 [5399] / gw13 [5399] / gw14 [5399] / gw15 [5399] / gw16 [5399] / gw17 [5399] / gw18 [5399] / gw19 [5399] / gw20 [5399] / gw21 [5399] / gw22 [5399] / gw23 [5399] / gw24 [5399] / gw25 [5399] / gw26 [5399] / gw27 [5399] / gw28 [5399] / gw29 [5399] / gw30 [5399] / gw31 [5399] / gw32 [5399] / gw33 [5399] / gw34 [5399] / gw35 [5399] / gw36 [5399] / gw37 [5399] / gw38 [5399] / gw39 [5399] / gw40 [5399] / gw41 [5399] / gw42 [5399] / gw43 [5399] / gw44 [5399] / gw45 [5399] / gw46 [5399] / gw47 [5399]

........................................................................ [  1%]
................................................................................ [  2%]
........................................................................ [  3%]
......................................................................... [  5%]
.......................................................................... [  6%]
...............................................................x......... [  8%]
........................................................................ [  9%]
....................................................X...........xs...... [ 10%]
............................x..........s.....x.......x.x...............x. [ 12%]
.........x...x......x...x.....x.......x................xx.........x..... [ 13%]
.............................................x...............x.x....x..... [ 14%]
.....xx...x........X.....xx.x...............x......x.....x.............. [ 16%]
.........xX...........X...............................X......X...xx....X [ 17%]
....XX........xX.X.XX.....X...X..X..................x......x....X...xX.. [ 18%]
.X......X..x...........x.....xX...........x.xxX............X...XX.....X. [ 20%]
..X..x.....XX......X.........XXxx.....x.xx...............xx..xX.Xx...... [ 21%]
.xx...x..........x......xX.......x.....x....x.XXX.xxXX....xX..X...xx.... [ 22%]
..xxxx...xx..Xxxx....x............................x.x............X..X..X [ 24%]
.....x............................X........x.X.............X............ [ 25%]
.X......x.........X.....................x......X.x.....X................ [ 26%]
.X....................X................x...........................s.... [ 28%]
...........X.......X.......x............................................ [ 29%]
..........................x............x......X............X..x......... [ 30%]
..............x............x............................................ [ 32%]
.........x.....................................................s........ [ 33%]
.........x.............................................................. [ 34%]
......X...............x.....x...........................x.....x......... [ 36%]
........................................................................ [ 37%]
.........................................X.............................. [ 38%]
...........................................X............................ [ 40%]
....................X.......................s........................... [ 41%]
........................................................................ [ 42%]
.................................x.................................x.... [ 44%]
...........................................................X............ [ 45%]
.........................x.........x.............xsssssssssssssssssss... [ 46%]
............x.......................................................xx.. [ 48%]
............xx..x.....................x.............x.....xx.....X...... [ 49%]
............s..........................xs........x.....sssssssssss.s.... [ 50%]
X............................................X......................x... [ 52%]
...............x...................X..............................x..... [ 53%]
..................................................x.........X........... [ 54%]
.............................................X.......X.................. [ 56%]
..X................X.......X.....................X...................... [ 57%]
.............X.................Xssss.........X.......................... [ 58%]
X....................X.................X.................X............X. [ 60%]
.....................x.........X.......X................................ [ 61%]
...........X....s....................................X.X......ss........ [ 62%]
.................................................x...................... [ 64%]
......Xx.........................x.................x...................x [ 65%]
....................x.....................xx.............................. [ 66%]
.....X......X...........X.X.....X..X.................................... [ 68%]
........................................................................ [ 69%]
........................................................................ [ 70%]
.....................................................F.................. [ 72%]
....................................................x................... [ 73%]
........................................................................ [ 74%]
.....................F......................................s........... [ 76%]
....s.....s.................x.....s...s........s..x..........Xs.sx....... [ 77%]
.s.s.......s...s..s...s.....s....s............x.......s.....s....x..s.... [ 79%]
.....s......s..s..........x....x................sxx...................x.. [ 80%]
...x...........................XXX......X.X......X..X.X......XXX....X.x. [ 81%]
.X.X......s.X.X.X.....XX....X.X...X.....X............x.................. [ 83%]
..............X.....X...X..xx..X...XX..X..............X....X........X... [ 84%]
..........................................X......X.................x.... [ 85%]
....X.............X......X................X............................. [ 87%]
.........X.....X......XX..........X...................................X. [ 88%]
X....X........x.X.....................X....................x.........X.X [ 89%]
...x..........x..X.x..X.....XxXxXx.x........xx........................x. [ 91%]
x...x.x.....x........................................................... [ 92%]
......................x.................................................. [ 93%]
..............xx..x.xx.x.............x..............xx......x..........x [ 95%]
.x..x.......................x.x....x..................................... [ 96%]
..........x............................................................. [ 97%]
........................................................................ [ 99%]
.................................................                        [100%]
=================================== FAILURES ===================================
___________________________ test_dot[float_nan_data] ___________________________
[gw5] linux -- Python 3.8.5 /opt/conda/envs/modin/bin/python
Traceback (most recent call last):
  File "/modin/modin/pandas/test/dataframe/test_default.py", line 256, in test_dot
    df_equals(modin_result, pandas_result)
  File "/modin/modin/pandas/test/utils.py", line 499, in df_equals
    assert_frame_equal(
  File "/opt/conda/envs/modin/lib/python3.8/site-packages/pandas/_testing.py", line 1372, in assert_frame_equal
    assert_series_equal(
  File "/opt/conda/envs/modin/lib/python3.8/site-packages/pandas/_testing.py", line 1166, in assert_series_equal
    assert_numpy_array_equal(
  File "/opt/conda/envs/modin/lib/python3.8/site-packages/pandas/_testing.py", line 988, in assert_numpy_array_equal
    _raise(left, right, err_msg)
  File "/opt/conda/envs/modin/lib/python3.8/site-packages/pandas/_testing.py", line 982, in _raise
    raise_assert_detail(obj, msg, left, right)
  File "/opt/conda/envs/modin/lib/python3.8/site-packages/pandas/_testing.py", line 915, in raise_assert_detail
    raise AssertionError(msg)
AssertionError: numpy array are different

numpy array values are different (14.0625 %)
[left]:  [nan, nan, nan, nan, nan, nan, nan, nan, nan, nan, nan, nan, nan, nan, nan, nan, nan, nan, nan, nan, nan, nan, nan, nan, nan, nan, nan, nan, nan, nan, nan, nan, nan, nan, nan, nan, 208522.99333004752, nan, nan, nan, 169925.49188354774, nan, nan, nan, 174915.36390615976, nan, nan, nan, nan, nan, nan, nan, 161308.85326789052, nan, nan, nan, 181923.07513736383, nan, nan, nan, 154073.23239069094, nan, nan, nan, nan, nan, nan, nan, 174013.7570578492, nan, nan, nan, 155110.9947310862, nan, nan, nan, 144217.41057075313, nan, nan, nan, nan, nan, nan, nan, 153804.73508983105, nan, nan, nan, 164128.9495456427, nan, nan, nan, 168986.39047641007, nan, nan, nan, nan, nan, nan, nan, ...]
[right]: [nan, nan, nan, nan, nan, nan, nan, nan, nan, nan, nan, nan, nan, nan, nan, nan, nan, nan, nan, nan, nan, nan, nan, nan, nan, nan, nan, nan, nan, nan, nan, nan, nan, nan, nan, nan, 208522.99333004744, nan, nan, nan, 169925.49188354774, nan, nan, nan, 174915.3639061598, nan, nan, nan, nan, nan, nan, nan, 161308.8532678905, nan, nan, nan, 181923.07513736378, nan, nan, nan, 154073.2323906909, nan, nan, nan, nan, nan, nan, nan, 174013.7570578493, nan, nan, nan, 155110.9947310862, nan, nan, nan, 144217.4105707531, nan, nan, nan, nan, nan, nan, nan, 153804.73508983103, nan, nan, nan, 164128.9495456428, nan, nan, nan, 168986.39047641004, nan, nan, nan, nan, nan, nan, nan, ...]
_________________________ test_matmul[float_nan_data] __________________________
[gw5] linux -- Python 3.8.5 /opt/conda/envs/modin/bin/python
Traceback (most recent call last):
  File "/modin/modin/pandas/test/dataframe/test_default.py", line 307, in test_matmul
    df_equals(modin_result, pandas_result)
  File "/modin/modin/pandas/test/utils.py", line 499, in df_equals
    assert_frame_equal(
  File "/opt/conda/envs/modin/lib/python3.8/site-packages/pandas/_testing.py", line 1372, in assert_frame_equal
    assert_series_equal(
  File "/opt/conda/envs/modin/lib/python3.8/site-packages/pandas/_testing.py", line 1166, in assert_series_equal
    assert_numpy_array_equal(
  File "/opt/conda/envs/modin/lib/python3.8/site-packages/pandas/_testing.py", line 988, in assert_numpy_array_equal
    _raise(left, right, err_msg)
  File "/opt/conda/envs/modin/lib/python3.8/site-packages/pandas/_testing.py", line 982, in _raise
    raise_assert_detail(obj, msg, left, right)
  File "/opt/conda/envs/modin/lib/python3.8/site-packages/pandas/_testing.py", line 915, in raise_assert_detail
    raise AssertionError(msg)
AssertionError: numpy array are different

numpy array values are different (14.0625 %)
[left]:  [nan, nan, nan, nan, nan, nan, nan, nan, nan, nan, nan, nan, nan, nan, nan, nan, nan, nan, nan, nan, nan, nan, nan, nan, nan, nan, nan, nan, nan, nan, nan, nan, nan, nan, nan, nan, 208522.99333004752, nan, nan, nan, 169925.49188354774, nan, nan, nan, 174915.36390615976, nan, nan, nan, nan, nan, nan, nan, 161308.85326789052, nan, nan, nan, 181923.07513736383, nan, nan, nan, 154073.23239069094, nan, nan, nan, nan, nan, nan, nan, 174013.7570578492, nan, nan, nan, 155110.9947310862, nan, nan, nan, 144217.41057075313, nan, nan, nan, nan, nan, nan, nan, 153804.73508983105, nan, nan, nan, 164128.9495456427, nan, nan, nan, 168986.39047641007, nan, nan, nan, nan, nan, nan, nan, ...]
[right]: [nan, nan, nan, nan, nan, nan, nan, nan, nan, nan, nan, nan, nan, nan, nan, nan, nan, nan, nan, nan, nan, nan, nan, nan, nan, nan, nan, nan, nan, nan, nan, nan, nan, nan, nan, nan, 208522.99333004744, nan, nan, nan, 169925.49188354774, nan, nan, nan, 174915.3639061598, nan, nan, nan, nan, nan, nan, nan, 161308.8532678905, nan, nan, nan, 181923.07513736378, nan, nan, nan, 154073.2323906909, nan, nan, nan, nan, nan, nan, nan, 174013.7570578493, nan, nan, nan, 155110.9947310862, nan, nan, nan, 144217.4105707531, nan, nan, nan, nan, nan, nan, nan, 153804.73508983103, nan, nan, nan, 164128.9495456428, nan, nan, nan, 168986.39047641004, nan, nan, nan, nan, nan, nan, nan, ...]

----------- coverage: platform linux, python 3.8.5-final-0 -----------
Coverage XML written to file coverage.xml

=========================== short test summary info ============================
FAILED modin/pandas/test/dataframe/test_default.py::test_dot[float_nan_data]
FAILED modin/pandas/test/dataframe/test_default.py::test_matmul[float_nan_data]
= 2 failed, 5000 passed, 69 skipped, 176 xfailed, 152 xpassed, 9494 warnings in 66.57s (0:01:06) =
============================= test session starts ==============================
platform linux -- Python 3.8.5, pytest-6.0.2, py-1.9.0, pluggy-0.13.1
rootdir: /modin, configfile: setup.cfg
plugins: cov-2.10.1, forked-1.2.0, xdist-2.1.0
collected 114 items

modin/pandas/test/test_io.py .................sX..........s............. [ 37%]
........s............................s..s.X.....s..................ss..  [100%]

----------- coverage: platform linux, python 3.8.5-final-0 -----------
Coverage XML written to file coverage.xml


=========== 104 passed, 8 skipped, 2 xpassed, 128 warnings in 39.83s ===========
Closing remaining open files:test_write_modin.hdf...donetest_write_pandas.hdf...done
============================= test session starts ==============================
platform linux -- Python 3.8.5, pytest-6.0.2, py-1.9.0, pluggy-0.13.1
rootdir: /modin, configfile: setup.cfg
plugins: cov-2.10.1, forked-1.2.0, xdist-2.1.0
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I / gw8 I / gw9 I / gw10 I / gw11 I / gw12 I / gw13 I / gw14 I / gw15 I / gw16 I / gw17 I / gw18 I / gw19 I / gw20 I / gw21 I / gw22 I / gw23 I / gw24 I / gw25 I / gw26 I / gw27 I / gw28 I / gw29 I / gw30 I / gw31 I / gw32 I / gw33 I / gw34 I / gw35 I / gw36 I / gw37 I / gw38 I / gw39 I / gw40 I / gw41 I / gw42 I / gw43 I / gw44 I / gw45 I / gw46 I / gw47 I
gw0 [5399] / gw1 [5399] / gw2 [5399] / gw3 [5399] / gw4 [5399] / gw5 [5399] / gw6 [5399] / gw7 [5399] / gw8 [5399] / gw9 [5399] / gw10 [5399] / gw11 [5399] / gw12 [5399] / gw13 [5399] / gw14 [5399] / gw15 [5399] / gw16 [5399] / gw17 [5399] / gw18 [5399] / gw19 [5399] / gw20 [5399] / gw21 [5399] / gw22 [5399] / gw23 [5399] / gw24 [5399] / gw25 [5399] / gw26 [5399] / gw27 [5399] / gw28 [5399] / gw29 [5399] / gw30 [5399] / gw31 [5399] / gw32 [5399] / gw33 [5399] / gw34 [5399] / gw35 [5399] / gw36 [5399] / gw37 [5399] / gw38 [5399] / gw39 [5399] / gw40 [5399] / gw41 [5399] / gw42 [5399] / gw43 [5399] / gw44 [5399] / gw45 [5399] / gw46 [5399] / gw47 [5399]

........................................................................ [  1%]
................................................................................ [  2%]
........................................................................ [  3%]
......................................................................... [  5%]
.......................................................................... [  6%]
...............................................................x......... [  8%]
........................................................................ [  9%]
....................................................X...........xs...... [ 10%]
............................x..........s.....x.......x.x...............x. [ 12%]
.........x...x......x...x.....x.......x................xx.........x..... [ 13%]
.............................................x...............x.x....x..... [ 14%]
.....xx...x........X.....xx.x...............x......x.....x.............. [ 16%]
.........xX...........X...............................X......X...xx....X [ 17%]
....XX........xX.X.XX.....X...X..X..................x......x....X...xX.. [ 18%]
.X......X..x...........x.....xX...........x.xxX............X...XX.....X. [ 20%]
..X..x.....XX......X.........XXxx.....x.xx...............xx..xX.Xx...... [ 21%]
.xx...x..........x......xX.......x.....x....x.XXX.xxXX....xX..X...xx.... [ 22%]
..xxxx...xx..Xxxx....x............................x.x............X..X..X [ 24%]
.....x............................X........x.X.............X............ [ 25%]
.X......x.........X.....................x......X.x.....X................ [ 26%]
.X....................X................x...........................s.... [ 28%]
...........X.......X.......x............................................ [ 29%]
..........................x............x......X............X..x......... [ 30%]
..............x............x............................................ [ 32%]
.........x.....................................................s........ [ 33%]
.........x.............................................................. [ 34%]
......X...............x.....x...........................x.....x......... [ 36%]
........................................................................ [ 37%]
.........................................X.............................. [ 38%]
...........................................X............................ [ 40%]
....................X.......................s........................... [ 41%]
........................................................................ [ 42%]
.................................x.................................x.... [ 44%]
...........................................................X............ [ 45%]
.........................x.........x.............xsssssssssssssssssss... [ 46%]
............x.......................................................xx.. [ 48%]
............xx..x.....................x.............x.....xx.....X...... [ 49%]
............s..........................xs........x.....sssssssssss.s.... [ 50%]
X............................................X......................x... [ 52%]
...............x...................X..............................x..... [ 53%]
..................................................x.........X........... [ 54%]
.............................................X.......X.................. [ 56%]
..X................X.......X.....................X...................... [ 57%]
.............X.................Xssss.........X.......................... [ 58%]
X....................X.................X.................X............X. [ 60%]
.....................x.........X.......X................................ [ 61%]
...........X....s....................................X.X......ss........ [ 62%]
.................................................x...................... [ 64%]
......Xx.........................x.................x...................x [ 65%]
....................x.....................xx.............................. [ 66%]
.....X......X...........X.X.....X..X.................................... [ 68%]
........................................................................ [ 69%]
........................................................................ [ 70%]
.....................................................F.................. [ 72%]
....................................................x................... [ 73%]
........................................................................ [ 74%]
.....................F......................................s........... [ 76%]
....s.....s.................x.....s...s........s..x..........Xs.sx....... [ 77%]
.s.s.......s...s..s...s.....s....s............x.......s.....s....x..s.... [ 79%]
.....s......s..s..........x....x................sxx...................x.. [ 80%]
...x...........................XXX......X.X......X..X.X......XXX....X.x. [ 81%]
.X.X......s.X.X.X.....XX....X.X...X.....X............x.................. [ 83%]
..............X.....X...X..xx..X...XX..X..............X....X........X... [ 84%]
..........................................X......X.................x.... [ 85%]
....X.............X......X................X............................. [ 87%]
.........X.....X......XX..........X...................................X. [ 88%]
X....X........x.X.....................X....................x.........X.X [ 89%]
...x..........x..X.x..X.....XxXxXx.x........xx........................x. [ 91%]
x...x.x.....x........................................................... [ 92%]
......................x.................................................. [ 93%]
..............xx..x.xx.x.............x..............xx......x..........x [ 95%]
.x..x.......................x.x....x..................................... [ 96%]
..........x............................................................. [ 97%]
........................................................................ [ 99%]
.................................................                        [100%]
=================================== FAILURES ===================================
___________________________ test_dot[float_nan_data] ___________________________
[gw5] linux -- Python 3.8.5 /opt/conda/envs/modin/bin/python
Traceback (most recent call last):
  File "/modin/modin/pandas/test/dataframe/test_default.py", line 256, in test_dot
    df_equals(modin_result, pandas_result)
  File "/modin/modin/pandas/test/utils.py", line 499, in df_equals
    assert_frame_equal(
  File "/opt/conda/envs/modin/lib/python3.8/site-packages/pandas/_testing.py", line 1372, in assert_frame_equal
    assert_series_equal(
  File "/opt/conda/envs/modin/lib/python3.8/site-packages/pandas/_testing.py", line 1166, in assert_series_equal
    assert_numpy_array_equal(
  File "/opt/conda/envs/modin/lib/python3.8/site-packages/pandas/_testing.py", line 988, in assert_numpy_array_equal
    _raise(left, right, err_msg)
  File "/opt/conda/envs/modin/lib/python3.8/site-packages/pandas/_testing.py", line 982, in _raise
    raise_assert_detail(obj, msg, left, right)
  File "/opt/conda/envs/modin/lib/python3.8/site-packages/pandas/_testing.py", line 915, in raise_assert_detail
    raise AssertionError(msg)
AssertionError: numpy array are different

numpy array values are different (14.0625 %)
[left]:  [nan, nan, nan, nan, nan, nan, nan, nan, nan, nan, nan, nan, nan, nan, nan, nan, nan, nan, nan, nan, nan, nan, nan, nan, nan, nan, nan, nan, nan, nan, nan, nan, nan, nan, nan, nan, 208522.99333004752, nan, nan, nan, 169925.49188354774, nan, nan, nan, 174915.36390615976, nan, nan, nan, nan, nan, nan, nan, 161308.85326789052, nan, nan, nan, 181923.07513736383, nan, nan, nan, 154073.23239069094, nan, nan, nan, nan, nan, nan, nan, 174013.7570578492, nan, nan, nan, 155110.9947310862, nan, nan, nan, 144217.41057075313, nan, nan, nan, nan, nan, nan, nan, 153804.73508983105, nan, nan, nan, 164128.9495456427, nan, nan, nan, 168986.39047641007, nan, nan, nan, nan, nan, nan, nan, ...]
[right]: [nan, nan, nan, nan, nan, nan, nan, nan, nan, nan, nan, nan, nan, nan, nan, nan, nan, nan, nan, nan, nan, nan, nan, nan, nan, nan, nan, nan, nan, nan, nan, nan, nan, nan, nan, nan, 208522.99333004744, nan, nan, nan, 169925.49188354774, nan, nan, nan, 174915.3639061598, nan, nan, nan, nan, nan, nan, nan, 161308.8532678905, nan, nan, nan, 181923.07513736378, nan, nan, nan, 154073.2323906909, nan, nan, nan, nan, nan, nan, nan, 174013.7570578493, nan, nan, nan, 155110.9947310862, nan, nan, nan, 144217.4105707531, nan, nan, nan, nan, nan, nan, nan, 153804.73508983103, nan, nan, nan, 164128.9495456428, nan, nan, nan, 168986.39047641004, nan, nan, nan, nan, nan, nan, nan, ...]
_________________________ test_matmul[float_nan_data] __________________________
[gw5] linux -- Python 3.8.5 /opt/conda/envs/modin/bin/python
Traceback (most recent call last):
  File "/modin/modin/pandas/test/dataframe/test_default.py", line 307, in test_matmul
    df_equals(modin_result, pandas_result)
  File "/modin/modin/pandas/test/utils.py", line 499, in df_equals
    assert_frame_equal(
  File "/opt/conda/envs/modin/lib/python3.8/site-packages/pandas/_testing.py", line 1372, in assert_frame_equal
    assert_series_equal(
  File "/opt/conda/envs/modin/lib/python3.8/site-packages/pandas/_testing.py", line 1166, in assert_series_equal
    assert_numpy_array_equal(
  File "/opt/conda/envs/modin/lib/python3.8/site-packages/pandas/_testing.py", line 988, in assert_numpy_array_equal
    _raise(left, right, err_msg)
  File "/opt/conda/envs/modin/lib/python3.8/site-packages/pandas/_testing.py", line 982, in _raise
    raise_assert_detail(obj, msg, left, right)
  File "/opt/conda/envs/modin/lib/python3.8/site-packages/pandas/_testing.py", line 915, in raise_assert_detail
    raise AssertionError(msg)
AssertionError: numpy array are different

numpy array values are different (14.0625 %)
[left]:  [nan, nan, nan, nan, nan, nan, nan, nan, nan, nan, nan, nan, nan, nan, nan, nan, nan, nan, nan, nan, nan, nan, nan, nan, nan, nan, nan, nan, nan, nan, nan, nan, nan, nan, nan, nan, 208522.99333004752, nan, nan, nan, 169925.49188354774, nan, nan, nan, 174915.36390615976, nan, nan, nan, nan, nan, nan, nan, 161308.85326789052, nan, nan, nan, 181923.07513736383, nan, nan, nan, 154073.23239069094, nan, nan, nan, nan, nan, nan, nan, 174013.7570578492, nan, nan, nan, 155110.9947310862, nan, nan, nan, 144217.41057075313, nan, nan, nan, nan, nan, nan, nan, 153804.73508983105, nan, nan, nan, 164128.9495456427, nan, nan, nan, 168986.39047641007, nan, nan, nan, nan, nan, nan, nan, ...]
[right]: [nan, nan, nan, nan, nan, nan, nan, nan, nan, nan, nan, nan, nan, nan, nan, nan, nan, nan, nan, nan, nan, nan, nan, nan, nan, nan, nan, nan, nan, nan, nan, nan, nan, nan, nan, nan, 208522.99333004744, nan, nan, nan, 169925.49188354774, nan, nan, nan, 174915.3639061598, nan, nan, nan, nan, nan, nan, nan, 161308.8532678905, nan, nan, nan, 181923.07513736378, nan, nan, nan, 154073.2323906909, nan, nan, nan, nan, nan, nan, nan, 174013.7570578493, nan, nan, nan, 155110.9947310862, nan, nan, nan, 144217.4105707531, nan, nan, nan, nan, nan, nan, nan, 153804.73508983103, nan, nan, nan, 164128.9495456428, nan, nan, nan, 168986.39047641004, nan, nan, nan, nan, nan, nan, nan, ...]

----------- coverage: platform linux, python 3.8.5-final-0 -----------
Coverage XML written to file coverage.xml

=========================== short test summary info ============================
FAILED modin/pandas/test/dataframe/test_default.py::test_dot[float_nan_data]
FAILED modin/pandas/test/dataframe/test_default.py::test_matmul[float_nan_data]
= 2 failed, 5000 passed, 69 skipped, 176 xfailed, 152 xpassed, 9494 warnings in 66.57s (0:01:06) =

@modin-bot
Copy link

modin-bot commented Sep 14, 2020 •
edited
Loading

TeamCity Ray test results bot

Tests PASSed

Tests Logs 
============================= test session starts ==============================
platform linux -- Python 3.8.5, pytest-6.0.2, py-1.9.0, pluggy-0.13.1
rootdir: /modin, configfile: setup.cfg
plugins: cov-2.10.1, forked-1.2.0, xdist-2.1.0
collected 114 items

modin/pandas/test/test_io.py .................sx..........s............. [ 37%]
.....................................s..s.X.....s..................ss..  [100%]

----------- coverage: platform linux, python 3.8.5-final-0 -----------
Coverage XML written to file coverage.xml


= 105 passed, 7 skipped, 1 xfailed, 1 xpassed, 96 warnings in 77.87s (0:01:17) =
Closing remaining open files:test_write_modin.hdf...donetest_write_pandas.hdf...done
============================= test session starts ==============================
platform linux -- Python 3.8.5, pytest-6.0.2, py-1.9.0, pluggy-0.13.1
rootdir: /modin, configfile: setup.cfg
plugins: cov-2.10.1, forked-1.2.0, xdist-2.1.0
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I / gw8 I / gw9 I / gw10 I / gw11 I / gw12 I / gw13 I / gw14 I / gw15 I / gw16 I / gw17 I / gw18 I / gw19 I / gw20 I / gw21 I / gw22 I / gw23 I / gw24 I / gw25 I / gw26 I / gw27 I / gw28 I / gw29 I / gw30 I / gw31 I / gw32 I / gw33 I / gw34 I / gw35 I / gw36 I / gw37 I / gw38 I / gw39 I / gw40 I / gw41 I / gw42 I / gw43 I / gw44 I / gw45 I / gw46 I / gw47 I
gw0 [5399] / gw1 [5399] / gw2 [5399] / gw3 [5399] / gw4 [5399] / gw5 [5399] / gw6 [5399] / gw7 [5399] / gw8 [5399] / gw9 [5399] / gw10 [5399] / gw11 [5399] / gw12 [5399] / gw13 [5399] / gw14 [5399] / gw15 [5399] / gw16 [5399] / gw17 [5399] / gw18 [5399] / gw19 [5399] / gw20 [5399] / gw21 [5399] / gw22 [5399] / gw23 [5399] / gw24 [5399] / gw25 [5399] / gw26 [5399] / gw27 [5399] / gw28 [5399] / gw29 [5399] / gw30 [5399] / gw31 [5399] / gw32 [5399] / gw33 [5399] / gw34 [5399] / gw35 [5399] / gw36 [5399] / gw37 [5399] / gw38 [5399] / gw39 [5399] / gw40 [5399] / gw41 [5399] / gw42 [5399] / gw43 [5399] / gw44 [5399] / gw45 [5399] / gw46 [5399] / gw47 [5399]

........................................................................ [  1%]
........................................................................ [  2%]
........................................................................ [  4%]
........................................................................ [  5%]
........................................................................ [  6%]
.............................................................x...x...... [  8%]
...........x..........................x............s.................... [  9%]
...........x...x.................................x...................... [ 10%]
....x.......X........................................s......xx.......x.. [ 12%]
......................x.........x..............x........................ [ 13%]
..............x..x...................x..X........x..xx...xx.X........... [ 14%]
..X..........X.............x....x.........x...x.......................x. [ 16%]
.x...............xx...xx........x...x....Xx....X..X...X..X...X....x..... [ 17%]
.........x.....x....x........x..xx...X..X..�[2m�[36m(pid=9920)�[0m error: object directory /localdisk/tc_agent/system/git/git-CE4319E5.git/objects does not exist; check .git/objects/info/alternates.
�[2m�[36m(pid=9920)�[0m fatal: bad object HEAD
..X....Xx.XX......X...X....... [ 18%]
.X......X.....X.............x......x.....................x..x.X......... [ 20%]
x.........x....�[2m�[36m(pid=7140)�[0m RuntimeWarning: overflow encountered in reduce
.......................x..........X.....X....X.........X. [ 21%]
....X....X...................................................x.......... [ 22%]
........................................................................ [ 23%]
........................................................................ [ 25%]
................X........................................X.............X [ 26%]
.............................................x.......................... [ 28%]
...........X....................................X......XXX............x. [ 29%]
..............................................................x......... [ 30%]
.....................x..............................x.................... [ 32%]
..........................x.....................................x....... [ 33%]
...................X....X...............X................XXXx........... [ 34%]
.......x...........................................xX................... [ 36%]
..............................x...................................x..... [ 37%]
..............xx....X.........................Xx........................ [ 38%]
......x......x..............X.....................X.......Xx.....X.X.... [ 40%]
...................xx........................................X.....X.... [ 41%]
.......x...................................ssss.sss..ssssX.............. [ 42%]
X......................X..x...............X.............................. [ 44%]
.....x..xx.....s..X...................................x................x [ 45%]
x...................X...........x.........................s.......ssssss [ 46%]
sssss..s.....X........X...............................................X. [ 48%]
......................X..............................................XX. [ 49%]
...................................X........X...........x............... [ 50%]
.......X........x...............x.........x.................x.....x..... [ 52%]
...............s.............x..x.....................x....x.......x..... [ 53%]
.........sss..ssssssss....sss.....X....x...................X..........x. [ 54%]
............X....X.................X.............X.......X.............. [ 56%]
....X...............x........x.........x..x..........x...........x...... [ 57%]
....x.X..X...X.X.........x.......x........X.........X.X..........x....x. [ 58%]
........................................................................ [ 60%]
.....................x..........................x..................x.... [ 61%]
..x...................x..............x....x..X.X.X...................... [ 62%]
.............................X..............X........................... [ 64%]
......x.x............................................................... [ 65%]
..........................x........x...x......x.........x...x....X..X.Xx [ 66%]
........................................................................ [ 68%]
........................................................................ [ 69%]
.X.........................�[2m�[36m(pid=10508)�[0m error: object directory /localdisk/tc_agent/system/git/git-CE4319E5.git/objects does not exist; check .git/objects/info/alternates.
�[2m�[36m(pid=10508)�[0m fatal: bad object HEAD
............................................. [ 70%]
............................................................s..........�[2m�[36m(pid=10579)�[0m error: object directory /localdisk/tc_agent/system/git/git-CE4319E5.git/objects does not exist; check .git/objects/info/alternates.
�[2m�[36m(pid=10579)�[0m fatal: bad object HEAD
. [ 72%]
...........x.....................s...................................... [ 73%]
..................................X..................................... [ 74%]
.......................................s..........s..................... [ 76%]
s....s.X...........s.............x...........s....s......s.....s......x. [ 77%]
..............s.s.......s...s..s....................s.x.....s.........s. [ 78%]
.s...s..x.....x....x...............x.....s...sxx.........sx.....x...Xx.X [ 80%]
..XxX..........s.....s............x....X....X.....XX..s......x..XX.....X [ 81%]
..X......................X...X....xX..X.X......X.....X..X...X...X.X.X.... [ 82%]
.X..X.....XX......x.........X.X.X..X.............XX...XX.x........X...... [ 84%]
..x...x.X.............X.................X..x............................ [ 85%]
..................�[2m�[36m(pid=10979)�[0m error: object directory /localdisk/tc_agent/system/git/git-CE4319E5.git/objects does not exist; check .git/objects/info/alternates.
�[2m�[36m(pid=10979)�[0m fatal: bad object HEAD
X..................................................... [ 86%]
......X..............................x....X........X..................... [ 88%]
................................X..............................x..X..... [ 89%]
....x..x..x...X..xx..xx.X.X...X.....x........xXX.X....x.......X.....x.XX [ 90%]
..X.................X...............x.........x.......................... [ 92%]
........................................................................ [ 93%]
......................x.....x...xx.x............................xxx..... [ 94%]
.........x...........x..............x..............xx....x...x.......... [ 96%]
...........x.............x......................................x....... [ 97%]
........................................................................ [ 98%]
....................................................x..........          [100%]

----------- coverage: platform linux, python 3.8.5-final-0 -----------
Coverage XML written to file coverage.xml

= 5002 passed, 69 skipped, 176 xfailed, 152 xpassed, 9470 warnings in 77.39s (0:01:17) =
============================= test session starts ==============================
platform linux -- Python 3.8.5, pytest-6.0.2, py-1.9.0, pluggy-0.13.1
rootdir: /modin, configfile: setup.cfg
plugins: cov-2.10.1, forked-1.2.0, xdist-2.1.0
collected 114 items

modin/pandas/test/test_io.py .................sx..........s............. [ 37%]
.....................................s..s.X.....s..................ss..  [100%]

----------- coverage: platform linux, python 3.8.5-final-0 -----------
Coverage XML written to file coverage.xml


= 105 passed, 7 skipped, 1 xfailed, 1 xpassed, 96 warnings in 77.87s (0:01:17) =
Closing remaining open files:test_write_modin.hdf...donetest_write_pandas.hdf...done
============================= test session starts ==============================
platform linux -- Python 3.8.5, pytest-6.0.2, py-1.9.0, pluggy-0.13.1
rootdir: /modin, configfile: setup.cfg
plugins: cov-2.10.1, forked-1.2.0, xdist-2.1.0
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I / gw6 I / gw7 I / gw8 I / gw9 I / gw10 I / gw11 I / gw12 I / gw13 I / gw14 I / gw15 I / gw16 I / gw17 I / gw18 I / gw19 I / gw20 I / gw21 I / gw22 I / gw23 I / gw24 I / gw25 I / gw26 I / gw27 I / gw28 I / gw29 I / gw30 I / gw31 I / gw32 I / gw33 I / gw34 I / gw35 I / gw36 I / gw37 I / gw38 I / gw39 I / gw40 I / gw41 I / gw42 I / gw43 I / gw44 I / gw45 I / gw46 I / gw47 I
gw0 [5399] / gw1 [5399] / gw2 [5399] / gw3 [5399] / gw4 [5399] / gw5 [5399] / gw6 [5399] / gw7 [5399] / gw8 [5399] / gw9 [5399] / gw10 [5399] / gw11 [5399] / gw12 [5399] / gw13 [5399] / gw14 [5399] / gw15 [5399] / gw16 [5399] / gw17 [5399] / gw18 [5399] / gw19 [5399] / gw20 [5399] / gw21 [5399] / gw22 [5399] / gw23 [5399] / gw24 [5399] / gw25 [5399] / gw26 [5399] / gw27 [5399] / gw28 [5399] / gw29 [5399] / gw30 [5399] / gw31 [5399] / gw32 [5399] / gw33 [5399] / gw34 [5399] / gw35 [5399] / gw36 [5399] / gw37 [5399] / gw38 [5399] / gw39 [5399] / gw40 [5399] / gw41 [5399] / gw42 [5399] / gw43 [5399] / gw44 [5399] / gw45 [5399] / gw46 [5399] / gw47 [5399]

........................................................................ [  1%]
........................................................................ [  2%]
........................................................................ [  4%]
........................................................................ [  5%]
........................................................................ [  6%]
.............................................................x...x...... [  8%]
...........x..........................x............s.................... [  9%]
...........x...x.................................x...................... [ 10%]
....x.......X........................................s......xx.......x.. [ 12%]
......................x.........x..............x........................ [ 13%]
..............x..x...................x..X........x..xx...xx.X........... [ 14%]
..X..........X.............x....x.........x...x.......................x. [ 16%]
.x...............xx...xx........x...x....Xx....X..X...X..X...X....x..... [ 17%]
.........x.....x....x........x..xx...X..X..�[2m�[36m(pid=9920)�[0m error: object directory /localdisk/tc_agent/system/git/git-CE4319E5.git/objects does not exist; check .git/objects/info/alternates.
�[2m�[36m(pid=9920)�[0m fatal: bad object HEAD
..X....Xx.XX......X...X....... [ 18%]
.X......X.....X.............x......x.....................x..x.X......... [ 20%]
x.........x....�[2m�[36m(pid=7140)�[0m RuntimeWarning: overflow encountered in reduce
.......................x..........X.....X....X.........X. [ 21%]
....X....X...................................................x.......... [ 22%]
........................................................................ [ 23%]
........................................................................ [ 25%]
................X........................................X.............X [ 26%]
.............................................x.......................... [ 28%]
...........X....................................X......XXX............x. [ 29%]
..............................................................x......... [ 30%]
.....................x..............................x.................... [ 32%]
..........................x.....................................x....... [ 33%]
...................X....X...............X................XXXx........... [ 34%]
.......x...........................................xX................... [ 36%]
..............................x...................................x..... [ 37%]
..............xx....X.........................Xx........................ [ 38%]
......x......x..............X.....................X.......Xx.....X.X.... [ 40%]
...................xx........................................X.....X.... [ 41%]
.......x...................................ssss.sss..ssssX.............. [ 42%]
X......................X..x...............X.............................. [ 44%]
.....x..xx.....s..X...................................x................x [ 45%]
x...................X...........x.........................s.......ssssss [ 46%]
sssss..s.....X........X...............................................X. [ 48%]
......................X..............................................XX. [ 49%]
...................................X........X...........x............... [ 50%]
.......X........x...............x.........x.................x.....x..... [ 52%]
...............s.............x..x.....................x....x.......x..... [ 53%]
.........sss..ssssssss....sss.....X....x...................X..........x. [ 54%]
............X....X.................X.............X.......X.............. [ 56%]
....X...............x........x.........x..x..........x...........x...... [ 57%]
....x.X..X...X.X.........x.......x........X.........X.X..........x....x. [ 58%]
........................................................................ [ 60%]
.....................x..........................x..................x.... [ 61%]
..x...................x..............x....x..X.X.X...................... [ 62%]
.............................X..............X........................... [ 64%]
......x.x............................................................... [ 65%]
..........................x........x...x......x.........x...x....X..X.Xx [ 66%]
........................................................................ [ 68%]
........................................................................ [ 69%]
.X.........................�[2m�[36m(pid=10508)�[0m error: object directory /localdisk/tc_agent/system/git/git-CE4319E5.git/objects does not exist; check .git/objects/info/alternates.
�[2m�[36m(pid=10508)�[0m fatal: bad object HEAD
............................................. [ 70%]
............................................................s..........�[2m�[36m(pid=10579)�[0m error: object directory /localdisk/tc_agent/system/git/git-CE4319E5.git/objects does not exist; check .git/objects/info/alternates.
�[2m�[36m(pid=10579)�[0m fatal: bad object HEAD
. [ 72%]
...........x.....................s...................................... [ 73%]
..................................X..................................... [ 74%]
.......................................s..........s..................... [ 76%]
s....s.X...........s.............x...........s....s......s.....s......x. [ 77%]
..............s.s.......s...s..s....................s.x.....s.........s. [ 78%]
.s...s..x.....x....x...............x.....s...sxx.........sx.....x...Xx.X [ 80%]
..XxX..........s.....s............x....X....X.....XX..s......x..XX.....X [ 81%]
..X......................X...X....xX..X.X......X.....X..X...X...X.X.X.... [ 82%]
.X..X.....XX......x.........X.X.X..X.............XX...XX.x........X...... [ 84%]
..x...x.X.............X.................X..x............................ [ 85%]
..................�[2m�[36m(pid=10979)�[0m error: object directory /localdisk/tc_agent/system/git/git-CE4319E5.git/objects does not exist; check .git/objects/info/alternates.
�[2m�[36m(pid=10979)�[0m fatal: bad object HEAD
X..................................................... [ 86%]
......X..............................x....X........X..................... [ 88%]
................................X..............................x..X..... [ 89%]
....x..x..x...X..xx..xx.X.X...X.....x........xXX.X....x.......X.....x.XX [ 90%]
..X.................X...............x.........x.......................... [ 92%]
........................................................................ [ 93%]
......................x.....x...xx.x............................xxx..... [ 94%]
.........x...........x..............x..............xx....x...x.......... [ 96%]
...........x.............x......................................x....... [ 97%]
........................................................................ [ 98%]
....................................................x..........          [100%]

----------- coverage: platform linux, python 3.8.5-final-0 -----------
Coverage XML written to file coverage.xml

= 5002 passed, 69 skipped, 176 xfailed, 152 xpassed, 9470 warnings in 77.39s (0:01:17) =

anmyachev
anmyachev requested changes Sep 14, 2020
View reviewed changes
@prutskov prutskov force-pushed the prutskov/read_csv-json branch 3 times, most recently from f4f8c6d to f11a364 Compare September 15, 2020 08:18
@prutskov
FIX-modin-project#1386: Fix read_csv for incorrect csv data
6c8d1b5 
Signed-off-by: Alexey Prutskov <alexey.prutskov@intel.com>
@prutskov prutskov force-pushed the prutskov/read_csv-json branch from f11a364 to 6c8d1b5 Compare September 15, 2020 08:19
@prutskov prutskov requested a review from anmyachev September 15, 2020 08:20
anmyachev
anmyachev approved these changes Sep 15, 2020
View reviewed changes
Copy link
Collaborator

@anmyachev anmyachev left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM!

@anmyachev anmyachev merged commit d308c58 into modin-project:master Sep 15, 2020
aregm pushed a commit to aregm/modin that referenced this pull request Sep 16, 2020
@prutskov @aregm
FIX-modin-project#1386: Fix read_csv for incorrect csv data (modin-…
872da76 
…project#2076)

Signed-off-by: Alexey Prutskov <alexey.prutskov@intel.com>
@prutskov prutskov deleted the prutskov/read_csv-json branch April 8, 2021 06:32
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@anmyachev anmyachev anmyachev approved these changes

Assignees

@prutskov prutskov

Labels

Ready for review

Projects

None yet

Milestone

0.8.1

Development

Successfully merging this pull request may close these issues.

When read_csv is called on a json file modin rises an exception

3 participants

@prutskov @modin-bot @anmyachev