Commits

Branch selector

 master

User selector

All users

Datepicker

All time

Commit History

Commits on Oct 3, 2023

• fix: fixed query to use subquery in where clausule

  dantonbertuol

  committed
  6136a9c

  Copy full SHA for 6136a9c

• fix: added feature to use token in api request

  dantonbertuol

  committed
  d1a658c

  Copy full SHA for d1a658c

Commits on Sep 26, 2023

• fix: closed mysql connection on end of function

  dantonbertuol

  committed
  2027f9f

  Copy full SHA for 2027f9f

• refactor: separada classe de extração da classe do pipeline and added logs info

  dantonbertuol

  committed
  2862d38

  Copy full SHA for 2862d38

• fix: changed size of recomendation field

  dantonbertuol

  committed
  870a1fd

  Copy full SHA for 870a1fd

• feat: added function to truncate table

  dantonbertuol

  committed
  956bdd2

  Copy full SHA for 956bdd2

• fix: changed query to join last record in quotes

  dantonbertuol

  committed
  c46a7c5

  Copy full SHA for c46a7c5

Commits on Sep 22, 2023

• feat: added new gold tables

  dantonbertuol

  committed
  b5ea6ba

  Copy full SHA for b5ea6ba

• fix: changed file type to deltatable in gold tables

  dantonbertuol

  committed
  00133c3

  Copy full SHA for 00133c3

• feat: added new file type delta, without saveastable

  dantonbertuol

  committed
  1a4f3f1

  Copy full SHA for 1a4f3f1

• feat: added new enrich tables dividends and indicators

  dantonbertuol

  committed
  3c20395

  Copy full SHA for 3c20395

• feat: created class to gold tables

  dantonbertuol

  committed
  012c4c7

  Copy full SHA for 012c4c7

• fix: ignore ticker when all indicators are blank

  dantonbertuol

  committed
  b7c93f4

  Copy full SHA for b7c93f4

Commits on Sep 20, 2023

• perf: ignore F stocks

  dantonbertuol

  committed
  38ff96a

  Copy full SHA for 38ff96a

• fix: only get dividends if exists

  dantonbertuol

  committed
  d39038a

  Copy full SHA for d39038a

• fix: added try except to ignore stocks error

  dantonbertuol

  committed
  4e081d2

  Copy full SHA for 4e081d2

Commits on Sep 19, 2023

• build: added yfinance in requirements

  dantonbertuol

  committed
  15e2953

  Copy full SHA for 15e2953

• refactor: changed pipeline to dict concepts in load views. added static variables bucket names

  dantonbertuol

  committed
  9179025

  Copy full SHA for 9179025

• refactor: changed datalake to unique layer, removed step of clean data and refactored code to work in the new structure. Also added new tables in convertion to delta step

  dantonbertuol

  committed
  a1ec5e4

  Copy full SHA for a1ec5e4

• feat: created functions to load and drop tem views

  dantonbertuol

  committed
  55220bf

  Copy full SHA for 55220bf

Commits on Sep 15, 2023

• feat: created step and class to get indicators and dividends of stocks in yfinance.

  dantonbertuol

  committed
  96c0b9b

  Copy full SHA for 96c0b9b

Commits on Sep 14, 2023

• refactor: changed format of create tables struct for clean code

  dantonbertuol

  committed
  113209e

  Copy full SHA for 113209e

Commits on Sep 6, 2023

• Merge branch 'master' of https://github.com/dantonbertuol/open-datalakehouse-stack

  dantonbertuol

  committed
  c7afbd1

  Copy full SHA for c7afbd1

• build: added docker compose from dremio container

  dantonbertuol

  committed
  8e167e9

  Copy full SHA for 8e167e9

Commits on Sep 2, 2023

• fix: limited get in 200 rows (api limit)

  dantonbertuol

  committed
  d18ca82

  Copy full SHA for d18ca82

• build: add package version in requirements

  dantonbertuol

  committed
  afd6f8c

  Copy full SHA for afd6f8c

Commits on Aug 30, 2023

• fix: fixed fstring in query

  dantonbertuol

  committed
  b589efc

  Copy full SHA for b589efc

Commits on Aug 29, 2023

• refactor: changed form of exception return

  dantonbertuol

  committed
  1a3b9da

  Copy full SHA for 1a3b9da

Commits on Aug 28, 2023

• doc: changed and added docs

  dantonbertuol

  committed
  a333bd1

  Copy full SHA for a333bd1

• feat: added steps of convert and enrich delta tables.

  dantonbertuol

  committed
  3d95d2a

  Copy full SHA for 3d95d2a

• feat: folder to sql files used in delta tables

  dantonbertuol

  committed
  f85b503

  Copy full SHA for f85b503

• feat: created class to enrich delta tables

  dantonbertuol

  committed
  2ce8730

  Copy full SHA for 2ce8730

• feat: created class to convert parquet file in delta tables - datalakehouse

  dantonbertuol

  committed
  2c72b8d

  Copy full SHA for 2c72b8d

• feat: added function to read parquet, delta and sql from s3 and insert delta tables

  dantonbertuol

  committed
  6251f9f

  Copy full SHA for 6251f9f

Commits on Aug 24, 2023

• feat: added step in pipeline to clean data from landing to processing

  dantonbertuol

  committed
  4a3750a

  Copy full SHA for 4a3750a

Pagination

Previous

Next