JIT compilation

[tontinton]

Wondering if there are plans to compile into machine code.

[pront]

Hi @tontinton,

We currently have a REPL implementation at https://github.com/vectordotdev/vrl/blob/main/src/cli/repl.rs.

Would you mind sharing what use cases you're thinking about? This would help us understand if you're envisioning something different.

For context, you might find these resources helpful:

• https://vector.dev/docs/reference/vrl/#goals
• https://vector.dev/docs/reference/vrl/#vector-rust-native

[tontinton]

I want to run VRL on lots and lots of logs (Terabytes) for implementing a project similar to Trino but for semi-structured logs.

I am concerned about the performance of VRL as an interpreted language. LuaJIT and CRuby for example implement JIT compilation, and wondered whether this is something VRL should also have?

[pront]

Gotcha, there is no plan at the moment to do this. We will update this ticket if this changes in the future.

Out of curiosity, did you run any benchmarks? You can write a very simple Rust crate which uses VRL as a library. You can see here how Vector's remap transform does it.

[tontinton]

No benchmarks yet, but planning to.