Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Distributed] don't sidestep require logic #26813

Merged
merged 1 commit into from
Aug 2, 2018
Merged

Conversation

vchuravy
Copy link
Member

We were trying to be clever, but there is logic in require that we shouldn't sidestep.

fixes: #26805

@vchuravy vchuravy requested a review from amitmurthy April 15, 2018 00:34
@ararslan ararslan added the parallelism Parallel or distributed computation label Apr 15, 2018
@ararslan
Copy link
Member

Can you add a test to ensure that the behavior noted in the linked issue doesn't regress in the future?

@ararslan ararslan added the needs tests Unit tests are required for this change label Apr 15, 2018
@vchuravy
Copy link
Member Author

vchuravy commented May 6, 2018

@StefanKarpinski is there an easy way to generate a fresh environment with a stub package for testing, without replicating most of test/loading.jl?

@StefanKarpinski
Copy link
Member

You could just reuse test/project if you want. It doesn't currently have any top-level source but you could turn it into a package that you can load for this test, which would have the side effect of making sure that all the package resolution stuff works in the distributed case as well.

@vchuravy vchuravy force-pushed the vc/distributed_require branch from f349bd2 to 5184c67 Compare May 9, 2018 14:36
@vchuravy
Copy link
Member Author

vchuravy commented May 9, 2018

I don't have time right now to do that kind of work, so I propose either waiting for another week or merging as is and I will come back to add tests.

@StefanKarpinski
Copy link
Member

I'm fine with either. This is a bug-fix so doesn't block the alpha release.

@JeffBezanson
Copy link
Member

Merge?

@ararslan
Copy link
Member

ararslan commented Aug 1, 2018

Would be good to have a test.

@ararslan ararslan mentioned this pull request Aug 1, 2018
7 tasks
@StefanKarpinski
Copy link
Member

Insisting on a test has blocked merging this for three months already.

@ararslan
Copy link
Member

ararslan commented Aug 1, 2018

Why would we merge it now without tests if we weren't going to merge it before without tests?

@StefanKarpinski
Copy link
Member

StefanKarpinski commented Aug 1, 2018

So let me get this clear: you'd rather leave this broken than have it fixed but untested? That's really putting the process cart before the horse of quality. Please, feel free to write a test by all means, but I mainly want the bug fixed.

@KristofferC
Copy link
Member

If the choice is between no test but works and no test and doesn't work, seems like the former is better?

@ararslan
Copy link
Member

ararslan commented Aug 1, 2018

I'm not saying we absolutely need to add a test here. I'm saying we should, since a bugfix should have verification that it fixes a bug. I'm just confused as to why there seems to be little interest in testing this.

@StefanKarpinski
Copy link
Member

There's not a lack of interest in testing, but this seems like a serious pain to test, no one has written tests and we're running out of time.

@vchuravy
Copy link
Member Author

vchuravy commented Aug 1, 2018

I have a test incoming, apologies for the delay, JuliaCon took up a lot of time in the last months.

@vchuravy vchuravy force-pushed the vc/distributed_require branch from 5184c67 to d165927 Compare August 1, 2018 21:20
@vchuravy vchuravy removed the needs tests Unit tests are required for this change label Aug 1, 2018
@vchuravy
Copy link
Member Author

vchuravy commented Aug 1, 2018

Added a test that was developed against master where it fails with:

make -C test Distributed
make: Entering directory '/home/vchuravy/src/julia/test'
    JULIA test/Distributed
Test    (Worker) | Time (s) | GC (s) | GC % | Alloc (MB) | RSS (MB)
┌ Warning: Replacing module `TestPkg`
└ @ Base loading.jl:872
┌ Warning: Replacing module `TestPkg`
└ @ Base loading.jl:872
┌ Warning: Replacing module `TestPkg`
└ @ Base loading.jl:872
      From worker 3:	WARNING: using TestPkg.TestPkg in module Main conflicts with an existing identifier.
      From worker 4:	WARNING: using TestPkg.TestPkg in module Main conflicts with an existing identifier.
      From worker 2:	WARNING: using TestPkg.TestPkg in module Main conflicts with an existing identifier.
ERROR: LoadError: On worker 2:
importing TestPkg into Main conflicts with an existing identifier

@ararslan ararslan merged commit 3b50b2d into master Aug 2, 2018
@ararslan ararslan deleted the vc/distributed_require branch August 2, 2018 01:50
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
parallelism Parallel or distributed computation
Projects
None yet
Development

Successfully merging this pull request may close these issues.

@everywhere using Module is failing
5 participants