Code

Feat/data quality#60

Code

Open

neylsoncrepalde wants to merge 30 commits intomainA3Data/rony:mainfrom feat/data-qualityA3Data/rony:feat/data-qualityCopy head branch name to clipboard

+1,309-46

Commits

Commits on Aug 20, 2021

• bugfix: Fixed diff-2-module

  RodrigoATorres

  committed
  c57eccb

• Merge pull request #52 from RodrigoATorres/bugfix/diff-2-module

  Show description for d5d4edf
  RodrigoATorres

  authored
  d5d4edf

Commits on Aug 23, 2021

• feat:added workspace & acc number to crawler path

  

  massao Mitsunaga

  committed
  5535884

• Merge branch 'main' of github.com:MassaoMitsunaga/rony into dev

  

  massao Mitsunaga

  committed
  ac05806

• Merge branch 'dev' of github.com:MassaoMitsunaga/rony into dev

  

  massao Mitsunaga

  committed
  60424ae

• feat:added kinesis stream module

  

  massao Mitsunaga

  committed
  c541f5b

Commits on Aug 24, 2021

• feat:quickstart updated

  

  massao Mitsunaga

  committed
  b756d13

Commits on Aug 30, 2021

• add: initial framework for creating Spark processing classes and structuring spark applications. File with custom udfs and methods.

  pltoledo

  committed
  a965a1e

• add: module template config file for spark module

  pltoledo

  committed
  6e33e8e

Commits on Sep 2, 2021

• fix: structure module and add dependencie in module .json

  pltoledo

  committed
  8b37858

• fix: structure module and add dependencie in module .json

  pltoledo

  committed
  4984fef

Commits on Oct 23, 2021

• Merge pull request #53 from MassaoMitsunaga/dev

  Show description for b3a9eb5
  RodrigoATorres

  authored
  b3a9eb5

• Merge pull request #55 from pltoledo/main

  Show description for a7b42a3
  RodrigoATorres

  authored
  a7b42a3

• Update ChangeLog.md

  RodrigoATorres

  authored
  5c9ac38

Commits on Nov 17, 2021

• feat/data-quality - first commit

  

  Neylson Crepalde

  committed
  29d9533

Commits on Nov 23, 2021

• first DataQuality abstract Class

  

  Neylson Crepalde

  committed
  0c3bb42

• insert run abstractmethod in DataQuality class

  

  Neylson Crepalde

  committed
  4cb32da

• constroi DataQuality como um módulo da biblioteca Rony, não como gerador de código

  

  Neylson Crepalde

  committed
  f318f10

Commits on Nov 24, 2021

• improve DataQuality abstract class

  

  Neylson Crepalde

  committed
  c2cb7f4

• hard coded initial Analyzer run

  

  Neylson Crepalde

  committed
  73207d4

• WIP analyzer hard coded example is working

  

  Neylson Crepalde

  committed
  aec41bc

• separate DataQuality and DQ AbsClass. Create default SparkSession

  

  Neylson Crepalde

  committed
  b0c1cc5

• change version to dev .1000

  

  Neylson Crepalde

  committed
  78042a1

• update class diagram

  

  Neylson Crepalde

  committed
  0250a8e

Commits on Nov 25, 2021

• Analyzer with config file or string expression working. Only one column methods yet

  

  Neylson Crepalde

  committed
  2840cb6

Commits on Dec 6, 2021

• doc(dq) correct parameters on write_file

  

  Neylson Crepalde

  committed
  85f5e95

Commits on Mar 31, 2022

• change json to yaml

  

  Neylson Crepalde

  committed
  97ff295

• refactor yaml to deal with metrics with 2+ columns

  

  Neylson Crepalde

  committed
  0b76951

Commits on Jul 7, 2022

• feat/complete analyzer jobs with all PyDeequ Analyzer methods

  

  Neylson Crepalde

  committed
  538cb70

• doc/rony analyzer example

  

  Neylson Crepalde

  committed
  1ea8286