Skip to content

Host to fall back on its own indexing if worker denies #7980

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 15 commits into from
Jan 13, 2022

Conversation

surgupta-msft
Copy link
Contributor

Issue describing the changes in this PR

resolves #7916

Documentation

Pull request checklist

  • Taken changes from Protobuf repo needed for this change. PR merged.
  • Made WorkerFunctionMetadataProvider as AggregateFunctionMetadataProvider which first uses worker indexing and if worker denies then it falls back to host indexing by calling HostFunctionMetadataProvider
  • Worker has the ability to deny indexing by setting flag functionMetadataResponse.UseDefaultMetadataIndexing to True.

@satvu satvu requested a review from vrdmr December 13, 2021 21:50
@ghost ghost added the no-recent-activity label Dec 29, 2021
@ghost
Copy link

ghost commented Dec 29, 2021

This pull request has been automatically marked as stale because it has been marked as requiring author feedback but has not had any activity for 7 days. It will be closed if no further activity occurs within 7 days of this comment.

@fabiocav fabiocav requested review from liliankasem and kshyju January 5, 2022 21:06
liliankasem
liliankasem previously approved these changes Jan 5, 2022
@surgupta-msft surgupta-msft merged commit e9407db into dev Jan 13, 2022
@surgupta-msft surgupta-msft deleted the surgupta/host-fallback branch January 13, 2022 19:38
surgupta-msft added a commit that referenced this pull request Jul 22, 2022
* Added host fall back if worker denies indexing

* Added Env in CanWorkerIndex

* Calling host if flag useDefaultWorkerIndexing is set to true

* Renaming workerFunctionMetadataProvider to AggregateFunctionMetadataProvider

* Code cleanup and test fixing

* code cleanup and resolving PR comments

* Tests

* Added tests

* Fixing test failures

* Code restructuring in AggregateFunctionMetadatProvider

* Improved logging and exception

* Added method to determine if worker denied indexing

* corrected environment variable
@surgupta-msft
Copy link
Contributor Author

/backport to v3.x

@github-actions
Copy link
Contributor

@github-actions
Copy link
Contributor

@surgupta-msft an error occurred while backporting to v3.x, please check the run log for details!

Error: @surgupta-msft is not a repo collaborator, backporting is not allowed.

surgupta-msft added a commit that referenced this pull request Jul 22, 2022
* Added host fall back if worker denies indexing

* Added Env in CanWorkerIndex

* Calling host if flag useDefaultWorkerIndexing is set to true

* Renaming workerFunctionMetadataProvider to AggregateFunctionMetadataProvider

* Code cleanup and test fixing

* code cleanup and resolving PR comments

* Tests

* Added tests

* Fixing test failures

* Code restructuring in AggregateFunctionMetadatProvider

* Improved logging and exception

* Added method to determine if worker denied indexing

* corrected environment variable
surgupta-msft added a commit that referenced this pull request Jul 25, 2022
* Host to fall back on its own indexing if worker denies (#7980)

* Added host fall back if worker denies indexing

* Added Env in CanWorkerIndex

* Calling host if flag useDefaultWorkerIndexing is set to true

* Renaming workerFunctionMetadataProvider to AggregateFunctionMetadataProvider

* Code cleanup and test fixing

* code cleanup and resolving PR comments

* Tests

* Added tests

* Fixing test failures

* Code restructuring in AggregateFunctionMetadatProvider

* Improved logging and exception

* Added method to determine if worker denied indexing

* corrected environment variable

* Remvoing retry options and config source from proto file in host (#8070)

* Sending single load request in case of multiple functions (#8054)

* Sending single load request in case of multiple functions. Advertised via capabilities

* Adding comment to explain disabled function flow (#8099)

* Host to send load request correctly after fallback is requested by the worker (#8200)

* fix for hostfallback bug

* Added tests

* Sending load request

* Code refactoring

* Added tests

* Python sample app update for worker indexing

* Refactoring  in tests

* Worker indexing tests refactoring

* variable naming fix

* Worker Indexing - Adding log to inform about mixed function app (#8201)

* Adding logic to detect mixed app and log it

* Added tests

* Test logger string

* added tests

* Tests

* Tests refactoring

* passing scripthostoptions

* Taking scriptpath from scriptJobHostoptions

* Added list of legacy functions

* Project stein - Adding additional logs and exception handling (#8231)

* Added logs and exception handling

* minox fixes

* Minor improvements in CanWorkerIndex

* Mixed app Loglevel setting based on Environment name

* Added helper method and its test and link to document

* Checking IsCoreTools for logging

* Removing customer IsDev method

* Adding ability to allow worker to send Function load responses in batch (#8363)

* Adding FunctionLoadResponses to send single load response in case of multiple functions

* Subscribed to LoadResponseCollection

* Updated subtree from https://github.com/azure/azure-functions-language-worker-protobuf. Tag: v1.5.4-protofile. Commit: 576c9de

* Removing redundant line

* Added failure testcase for LoadRepsonseCollection

* Moving event subscription under if else block

* Send function outside else block

* Tests

* Renaming variable

* Adding timeout

* Cleaning up if-else

* Updating protobuf to latest v1.5.8

* Updating logs

* Protobuf update

* Updating logs in tests
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Worker Indexing - Host to fall back on its indexing if worker denies by checking legacy payload
6 participants