Feature/scala code/ch02 biman (#8) #9
Merged
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
* added kmers for FASTA and FASTQ formats * DNA Based count in scala * Indentation fix * improved documentation * ch02 * Feature/scala code/ch01 (#5) * Scala Code for data algorithms with spark-ch01 * Refactored the package name * With spark contextclose * Feature/scala code/ch01 biman (#3) * fold by key * added comments for fold by key * added Average by Group By Key * added Average by ReduceByKey * dataframe action describe * dataframe add column * dataframe drop column * dataframe filter rows * dataframe join * dataframe join inner * dataframe join left * dataframe join right * dataframe sql * rdd map transformations * rdd filter transformations * rdd flatMap transformations * rdd transformations groupByKey * rdd transformations Join * rdd transformations Cartesian * rdd transformations Combine By Key * rdd transformations MapPartitions * rdd transformations Sort By * rdd action take ordered * Feature/scala code/ch01 deepak (#4) * fold by key * added comments for fold by key * added Average by Group By Key * added Average by ReduceByKey * dataframe action describe * dataframe add column * dataframe drop column * dataframe filter rows * dataframe join * dataframe join inner * dataframe join left * Refactroed code + RDD Transformation * INDENTATION CORRECT * ReduceByKey * ReduceByKey1 Co-authored-by: bimanmandal <biman29@gmail.com> * added gradle shorthands * Feature/generate sh files (#6) * added gradle shorthands * added the shell script * added the shell script * updated the shell commands Co-authored-by: Biman Mandal <43241698+bimanmandal@users.noreply.github.com> Co-authored-by: bimanmandal <biman29@gmail.com> * updated README.md * updated README.md * ch02-changes * ch02-changes * Feature/scala code/ch01 missing class gradle (#7) * gradle wrapper fix * gradle wrapper fix * gradle wrapper fix * gradle wrapper fix * added bonus chapter correlation * added bonus chapter correlation * updated docs * updated docs * updated docs * updated docs * updated docs * updated docs * updated docs * updated docs * updated docs * updated docs * improved documentation * improved documentation * improved documentation * improved documentation * improved documentation * improved documentation * improved documentation * improved documentation * improved documentation * improved documentation * improved documentation * improved documentation * improved documentation * improved documentation * DNABaseCountFastq * added the code changes for chapter 2 * added the run_spark_applications_scripts * added the conditions for 1GB data * added the readme file Co-authored-by: Mahmoud Parsian <mahmoud.parsian@yahoo.com> Co-authored-by: deepakmca05 <deepakmca05@gmail.com>
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
added kmers for FASTA and FASTQ formats
DNA Based count in scala
Indentation fix
improved documentation
ch02
Feature/scala code/ch01 (Feature/scala code/ch01 #5)
Scala Code for data algorithms with spark-ch01
Refactored the package name
With spark contextclose
Feature/scala code/ch01 biman (Feature/scala code/ch01 biman #3)
fold by key
added comments for fold by key
added Average by Group By Key
added Average by ReduceByKey
dataframe action describe
dataframe add column
dataframe drop column
dataframe filter rows
dataframe join
dataframe join inner
dataframe join left
dataframe join right
dataframe sql
rdd map transformations
rdd filter transformations
rdd flatMap transformations
rdd transformations groupByKey
rdd transformations Join
rdd transformations Cartesian
rdd transformations Combine By Key
rdd transformations MapPartitions
rdd transformations Sort By
rdd action take ordered
Feature/scala code/ch01 deepak (Feature/scala code/ch01 deepak #4)
fold by key
added comments for fold by key
added Average by Group By Key
added Average by ReduceByKey
dataframe action describe
dataframe add column
dataframe drop column
dataframe filter rows
dataframe join
dataframe join inner
dataframe join left
Refactroed code + RDD Transformation
INDENTATION CORRECT
ReduceByKey
ReduceByKey1
Co-authored-by: bimanmandal biman29@gmail.com
added gradle shorthands
Feature/generate sh files (Feature/generate sh files #6)
added gradle shorthands
added the shell script
added the shell script
updated the shell commands
Co-authored-by: Biman Mandal 43241698+bimanmandal@users.noreply.github.com
Co-authored-by: bimanmandal biman29@gmail.com
updated README.md
updated README.md
ch02-changes
ch02-changes
Feature/scala code/ch01 missing class gradle (Feature/scala code/ch01 missing class gradle #7)
gradle wrapper fix
gradle wrapper fix
gradle wrapper fix
gradle wrapper fix
added bonus chapter correlation
added bonus chapter correlation
updated docs
updated docs
updated docs
updated docs
updated docs
updated docs
updated docs
updated docs
updated docs
updated docs
improved documentation
improved documentation
improved documentation
improved documentation
improved documentation
improved documentation
improved documentation
improved documentation
improved documentation
improved documentation
improved documentation
improved documentation
improved documentation
improved documentation
DNABaseCountFastq
added the code changes for chapter 2
added the run_spark_applications_scripts
added the conditions for 1GB data
added the readme file
Co-authored-by: Mahmoud Parsian mahmoud.parsian@yahoo.com
Co-authored-by: deepakmca05 deepakmca05@gmail.com