-
Notifications
You must be signed in to change notification settings - Fork 96
Feature/scala code/ch02 biman #8
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Merged
bimanmandal
merged 43 commits into
feature/scala-code/ch02
from
feature/scala-code/ch02-Biman
Jan 7, 2022
Merged
Feature/scala code/ch02 biman #8
bimanmandal
merged 43 commits into
feature/scala-code/ch02
from
feature/scala-code/ch02-Biman
Jan 7, 2022
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
* Scala Code for data algorithms with spark-ch01 * Refactored the package name * With spark contextclose * Feature/scala code/ch01 biman (#3) * fold by key * added comments for fold by key * added Average by Group By Key * added Average by ReduceByKey * dataframe action describe * dataframe add column * dataframe drop column * dataframe filter rows * dataframe join * dataframe join inner * dataframe join left * dataframe join right * dataframe sql * rdd map transformations * rdd filter transformations * rdd flatMap transformations * rdd transformations groupByKey * rdd transformations Join * rdd transformations Cartesian * rdd transformations Combine By Key * rdd transformations MapPartitions * rdd transformations Sort By * rdd action take ordered * Feature/scala code/ch01 deepak (#4) * fold by key * added comments for fold by key * added Average by Group By Key * added Average by ReduceByKey * dataframe action describe * dataframe add column * dataframe drop column * dataframe filter rows * dataframe join * dataframe join inner * dataframe join left * Refactroed code + RDD Transformation * INDENTATION CORRECT * ReduceByKey * ReduceByKey1 Co-authored-by: bimanmandal <biman29@gmail.com> * added gradle shorthands * Feature/generate sh files (#6) * added gradle shorthands * added the shell script * added the shell script * updated the shell commands Co-authored-by: Biman Mandal <43241698+bimanmandal@users.noreply.github.com> Co-authored-by: bimanmandal <biman29@gmail.com>
* gradle wrapper fix * gradle wrapper fix * gradle wrapper fix * gradle wrapper fix
deepakmca05
added a commit
that referenced
this pull request
Jan 7, 2022
* added kmers for FASTA and FASTQ formats * DNA Based count in scala * Indentation fix * improved documentation * ch02 * Feature/scala code/ch01 (#5) * Scala Code for data algorithms with spark-ch01 * Refactored the package name * With spark contextclose * Feature/scala code/ch01 biman (#3) * fold by key * added comments for fold by key * added Average by Group By Key * added Average by ReduceByKey * dataframe action describe * dataframe add column * dataframe drop column * dataframe filter rows * dataframe join * dataframe join inner * dataframe join left * dataframe join right * dataframe sql * rdd map transformations * rdd filter transformations * rdd flatMap transformations * rdd transformations groupByKey * rdd transformations Join * rdd transformations Cartesian * rdd transformations Combine By Key * rdd transformations MapPartitions * rdd transformations Sort By * rdd action take ordered * Feature/scala code/ch01 deepak (#4) * fold by key * added comments for fold by key * added Average by Group By Key * added Average by ReduceByKey * dataframe action describe * dataframe add column * dataframe drop column * dataframe filter rows * dataframe join * dataframe join inner * dataframe join left * Refactroed code + RDD Transformation * INDENTATION CORRECT * ReduceByKey * ReduceByKey1 Co-authored-by: bimanmandal <biman29@gmail.com> * added gradle shorthands * Feature/generate sh files (#6) * added gradle shorthands * added the shell script * added the shell script * updated the shell commands Co-authored-by: Biman Mandal <43241698+bimanmandal@users.noreply.github.com> Co-authored-by: bimanmandal <biman29@gmail.com> * updated README.md * updated README.md * ch02-changes * ch02-changes * Feature/scala code/ch01 missing class gradle (#7) * gradle wrapper fix * gradle wrapper fix * gradle wrapper fix * gradle wrapper fix * added bonus chapter correlation * added bonus chapter correlation * updated docs * updated docs * updated docs * updated docs * updated docs * updated docs * updated docs * updated docs * updated docs * updated docs * improved documentation * improved documentation * improved documentation * improved documentation * improved documentation * improved documentation * improved documentation * improved documentation * improved documentation * improved documentation * improved documentation * improved documentation * improved documentation * improved documentation * DNABaseCountFastq * added the code changes for chapter 2 * added the run_spark_applications_scripts * added the conditions for 1GB data * added the readme file Co-authored-by: Mahmoud Parsian <mahmoud.parsian@yahoo.com> Co-authored-by: deepakmca05 <deepakmca05@gmail.com> Co-authored-by: Biman Mandal <43241698+bimanmandal@users.noreply.github.com> Co-authored-by: Mahmoud Parsian <mahmoud.parsian@yahoo.com>
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
No description provided.