Standalone Compiler

[CompeyDev]

This PR aims to enable the long-awaited standalone compilation feature, which allows for building luau source files to OS-native executables. It should be noted, however, that this PR only implements an initial interface for the above, and future PRs much implement more advanced features such as requires in such standalone environments.

TODO:

• Binary compilation
  • Maintain a standard binary format
  • Parse binary format and execute at runtime
    • Create a documented struct for META Chunk (de)serialization
  • Make system highly performant
    • Swap out GLOBAL alloc for Jemalloc^
    • Multithread building & bytecode discovery process
      • Parallel Iterators
• Tests & QA? (How do I exactly add tests for standalone compilation?)

^ Jemalloc is performant in multithreaded scenarios with multiple simultaneous reads across threads.

Closes #8.

[filiptibell]

Thank you for the PR, this is really cool and a great start for this feature! I left some comments to resolve.

[CompeyDev]

BTW, can we please fix the failing lint tests? Those have nothing to do with this PR, but it's a bit a annoying seeing an ❌ on the checks!

[filiptibell]

BTW, can we please fix the failing lint tests? Those have nothing to do with this PR, but it's a bit a annoying seeing an ❌ on the checks!

Fixed in 5040ded

[CompeyDev]

@filiptibell Do note that the bytecode discovery is currently broken, due to the bytecode offset integer being inaccurately recovered at runtime, even though the value is somewhat close to the actual offset. The bytecode size seems to not be affected, however.

Since I'll not be able to work on this much over the next few days, I will allow you write access so that you can finalize and merge this as discussed on Discord.

[filiptibell]

Thank you for implementing this!

[CompeyDev]

LGTM!