Skip to content

[BUG]: OpenAI HttpService Python Bindings Example Broken #1244

Open
@rmccorm4

Description

@rmccorm4

Describe the Bug

This commit removed runtime.primary_token and runtime.child_token from DistributedRuntime Python bindings: 466b8e5

This line in OpenAI HttpService python bindings example depends on it:

shutdown_signal = service.run(runtime.child_token())

service.run(token) currently requires the token argument - but maybe can be refactored not to if we don't want to expose the tokens at binding level.

Steps to Reproduce

cd lib/bindings/python/examples/openai_service
python3 server.py

Expected Behavior

Working example

Actual Behavior

    shutdown_signal = service.run(runtime.child_token())
AttributeError: 'builtins.DistributedRuntime' object has no attribute 'child_token'

Environment

ai-dynamo==0.2.1
ai-dynamo-runtime==0.2.1

Additional Context

No response

Screenshots

No response

Metadata

Metadata

Assignees

Labels

bugSomething isn't workinglanguage::pythonIssues/PRs that reference Python code

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions