Skip to content

Conversation

@goodwillpunning
Copy link
Contributor

This commit updates the demo notebook with simple examples to slowly introduce Rule Engine concepts, as well as examples of the latest features added to the Rules Engine.

@goodwillpunning goodwillpunning changed the base branch from master to enable_streaming August 13, 2021 18:15
@GeekSheikh
Copy link
Contributor

added Example.scala to reflect the new notebook.

@GeekSheikh GeekSheikh merged commit d6851f5 into enable_streaming Aug 15, 2021
@GeekSheikh GeekSheikh deleted the update_demo_notebook branch August 15, 2021 22:26
GeekSheikh added a commit that referenced this pull request Aug 15, 2021
* enable streaming

* scaffolding for simpleExpr validation

* completed refactor -- tests outstanding

* refactor and enablement complete

* updated readme

* added implicit boolean

* added filter for summary report

* Update ValidatorTestSuite (#19)

* Update Validator tests with API changes.

* Add tests for implicit and explicit expression rules.

* imported outstanding spark sql functions

* Add test suite for Rules class.

* Add tests for RuleSet class.

* Add test for complex expressions on aggregates.

* Fix isGrouped bug when groupBys array is empty by default or explicitly set.

* Fix overloaded add function that merges 2 RuleSets.

* Add ignoreCase and invertMatch to ValidateStrings and ValidateNumerics rule types.

* Update documentation with latest features in categorical Rules.

Co-authored-by: Daniel Tomes [GeekSheikh] <10840635+geeksheikh@users.noreply.github.com>

* Update sbt (#23)

* simple update to build sbt

* Add scoverage.

Co-authored-by: Will Girten <will.girten@databricks.com>

* removed unused imports

* Accept expanded sequence of Rules to RuleSet Class.

* cleaning up (#30)

* cleaning up

* removed dependencies from assembly

* Fix whitespaces and special characters in Rule Names (#25)

* Parse white spaces and special characters in failure report.

* Update variable name with more meaningful name.

* Add  method to remove whitespace and special characters from Rule names.

* Simplify ruleName public accessor.

* Change special character replacement to underscores.

* Update warning messages and assign private ruleName only once.

* Update demo notebook (#33)

* Update demo notebook with examples of latest features added.

* added scala demo example

Co-authored-by: Daniel Tomes [GeekSheikh] <10840635+geeksheikh@users.noreply.github.com>

* implemented new inclusive boundaries option (#32)

* implemented new inclusive boundaries option

* enhanced logic for upper and lower inclusivity

* readme updated

* Update validation logic for Bounds class. Add test case for inclusive boundary rules. (#35)

Co-authored-by: Will Girten <47335283+goodwillpunning@users.noreply.github.com>

Co-authored-by: Will Girten <47335283+goodwillpunning@users.noreply.github.com>
Co-authored-by: Will Girten <will.girten@databricks.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants