[Discussion] Use of embeddings with Codex.

[PriNova]

Hi Dave,

I follow you since the raven project and read one of your online book about AGI. Great and inspiring writing.

I'm testing codex for a while and wonder if this wiki-approach would work with embeddings and a code base too?
Codex is cut-off in 2021, so I would like to "update" the model with a current code base and asks questions or generating methods, classes, functions etc and codex considers the provided code base.

Could this be achieved with embeddings?
Would I need to generate the embeddings word-wise, line-wise or class-wise or maybe file-wise?

If you have an idea, I'm eager to hear from you.

[daveshap]

This Issue name is not good, and the description does not clarify what you're asking. Can you please update the issue name and clarify the description?

[PriNova]

Sorry, if my description confuses. English is not my native language.
I want to know, if it is possible to use embeddings with the Codex model and what have to be considered?

For example, I want to write code or refactoring code with the help of the codex model, but codex knowledge is cutted-off at the year 2021. So for this issue my idea would be to transform the library in use into embeddings.

My question now is, wether it is possible and if yes, how this can be done? Is the use of embeddings a got idea or is there a better technical way?

[daveshap]

The purpose would be to add more coding capabilities?