Skip to content

Benchmark gpt-tfjs integration #657

@JulienVig

Description

@JulienVig

Benchmark and report some information on what to expect and the row for improvement:

  • number of training iterations needed on an example dataset, expected loss/perplexity, example of text generation after training
  • number of tokens/sec
  • model sizes
  • memory requirements
  • compare numbers with ONNX

#656 should be addressed first

Metadata

Metadata

Assignees

Labels

discojsRelated to Disco.jsdocumentationImprovements or additions to documentation

Type

No type

Projects

No projects

Milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions