Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update TimeSeries stage to also work with Production DFP #1121

Merged
merged 17 commits into from
Aug 30, 2023
Merged

Update TimeSeries stage to also work with Production DFP #1121

Changes from 1 commit
Commits
Show all changes
17 commits
Select commit Hold shift + click to select a range
44eeaa4
remove timeseries stage
efajardo-nv Aug 4, 2023
a08e741
remove unused import
efajardo-nv Aug 4, 2023
4a2f842
update timeseries stage for prod dfp
efajardo-nv Aug 8, 2023
8391990
remove debug lines
efajardo-nv Aug 8, 2023
03f3b1b
remove timeseries from dfp kafka unit test
efajardo-nv Aug 8, 2023
15078fb
remove timeseries from cli
efajardo-nv Aug 9, 2023
a5d0286
pylint fixes
efajardo-nv Aug 9, 2023
1ab7fb9
change timeseries accepted type to multimessage
efajardo-nv Aug 10, 2023
758bab2
revert validation data changes
efajardo-nv Aug 10, 2023
5df5246
revert removal of timeseries from cli
efajardo-nv Aug 10, 2023
a8a660e
set config ts column for test_dfp_kafka
efajardo-nv Aug 10, 2023
3c54568
Merge branch 'branch-23.11' into update-ae-benchmark
efajardo-nv Aug 17, 2023
ca24e22
Merge branch 'branch-23.11' of https://github.com/nv-morpheus/Morpheu…
efajardo-nv Aug 25, 2023
79db3c2
Merge branch 'branch-23.11' of https://github.com/nv-morpheus/Morpheu…
efajardo-nv Aug 29, 2023
f11eaff
remove excess debug messages
efajardo-nv Aug 29, 2023
529bd2d
Merge branch 'branch-23.11' into update-ae-benchmark
efajardo-nv Aug 30, 2023
50ad6bf
Merge branch 'branch-23.11' into update-ae-benchmark
efajardo-nv Aug 30, 2023
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
set config ts column for test_dfp_kafka
  • Loading branch information
@efajardo-nv
efajardo-nv committed Aug 10, 2023
commit a8a660ed5cc3da6592c5c602972d230393436c44
2 changes: 2 additions & 0 deletions tests/test_dfp_kafka.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -89,6 +89,7 @@ def test_dfp_roleg(mock_ae: mock.MagicMock,
config.ae.userid_column_name = "userIdentitysessionContextsessionIssueruserName"
config.ae.userid_filter = "role-g"
config.ae.feature_columns = load_labels_file(os.path.join(TEST_DIRS.data_dir, 'columns_ae_cloudtrail.txt'))
config.ae.timestamp_column_name = "event_dt"

input_glob = os.path.join(TEST_DIRS.validation_data_dir, "dfp-cloudtrail-*-input.csv")
train_data_glob = os.path.join(TEST_DIRS.validation_data_dir, "dfp-cloudtrail-*-input.csv")
Expand Down Expand Up @@ -189,6 +190,7 @@ def test_dfp_user123(mock_ae: mock.MagicMock,
config.ae.userid_column_name = "userIdentitysessionContextsessionIssueruserName"
config.ae.userid_filter = "user123"
config.ae.feature_columns = load_labels_file(os.path.join(TEST_DIRS.data_dir, 'columns_ae_cloudtrail.txt'))
config.ae.timestamp_column_name = "event_dt"

input_glob = os.path.join(TEST_DIRS.validation_data_dir, "dfp-cloudtrail-*-input.csv")
train_data_glob = os.path.join(TEST_DIRS.validation_data_dir, "dfp-cloudtrail-*-input.csv")
Expand Down