-
Notifications
You must be signed in to change notification settings - Fork 266
Split the scalding platform out into packages #434
Conversation
This reverts commit 8158cd7.
Add in remaining type aliases
@@ -27,12 +28,12 @@ import Conversion.asMethod | |||
/** Services and Stores are very similar, but not exact. | |||
* This shares the logic for them. | |||
*/ | |||
class BatchedOperations(batcher: Batcher) { | |||
private[scalding] class BatchedOperations(batcher: Batcher) { |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
why? These look pretty useful for Tsar or others doing operations with batches?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I couldn't see any uses outside of the scalding platform for it currently. I'd rather be defensive about whats public and not so we know what's safe to change and not? If spark uses it then it might move again, so we don't need more type aliases?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
If you want to keep it public i'll add the type alias in scalding and remove it ?
If we remove the private, I mentioned above, and this goes green, I think it is good to merge. |
…form Split the scalding platform out into packages
Moments returns NaN when count is too low for higher order statistics
Make it easier to iterate on the scalding platform by separating more dense files the single folder out into its components to see what should live where