-
Notifications
You must be signed in to change notification settings - Fork 42
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Can't compile and run on Macpro M1 ? #4
Comments
Note that Sneller relies on AVX-512 instructions and the M1 doesn't emulate these when running in Rosetta 2. So even if you're able to compile it, you won't be able to run it. |
I think it would be super useful for development to have |
There are several reasons why we don't support Apple Silicon:
We are planning to provide an environment where users can test-drive Sneller. It will allow to ingest data into our cloud-based solution and you will be able to query it for some time. Data will be purged automatically after some days. The most difficult part of this is to prevent abuse of this test-environment. |
I really wanted to try this out too. Bummer that the SIMD for other CPU ISA is not happening. @ramondeklein @philhofer The golang team have an issue for portable SIMD: golang/go#58610 |
Certainly! The bulk of the porting that needs to happen is translation of about 36,000 lines of x86 assembly in the bytecode engine. |
I should also mention we're busing working on launching a "playground" interface that would let you upload data and run queries against our cloud infra for free in order to get a sense of our capabilities; hopefully I can tell you guys more in a few days! |
That sounds awesome . Thanks for the heads-ups |
Would it be possible to run locally without any SIMD acceleration then ? So I can easily test without the playground |
Regarding ARM support, the graviton3 servers on AWS now offer ARM SVE (Scalable Vector Extention) support which is pretty similar architecturally to AVX512, but a complete different syntax (and with varying capabilities). A longer term target would be to support this as well, but with over 300 primitives right now, that is a significant effort (although we can probably perform part of the "translation" automatically). |
You read my mind .. I was wondering about that too . still would be cool to just run without any acceleration for testing and contributing |
Yeah, a portable golang (non-assembly) implementation would be nice to have -- it would run at much lower speeds of course which would be tolerable for GB-sized workloads but unbearable for TB-sized workloads. |
It’s just for testing / contributions. So perf can be sucky. I can do perf testing in the playground. Idea.. make easy for a developer to test locally and then test via the playground. Maybe a CLI with a Context argument that is passed in. Would then be nice on ramp for devs maybe |
Maybe even force to pass a flag locally to convey to developers they are not getting any acceleration |
Good idea. So it’s clearly intentional |
This time you read our minds ... 😄 as a quick preview checkout the following for a (revamped) local demo on some sample JSON data (but this does require local AVX512 support, eg. an c6i instance on AWS): https://asciinema.org/a/eOjVUwlA7ZYXTGtC6PpsupR2O Also, as mentioned by @philhofer we are close to launching a playground where you can, amongst others, create a table in no time from a set of presigned S3 URLs on some existing objects in S3 -- stay tuned for that ! |
hey @frank-sneller zion is Ion :) Will def try it out and feedback. really great stuff !! |
Correct, under the hood it is all standard ion stuff (and our SQL dialect is based on PartiQL, which is a nice fit with ion). |
Hi all, Just a (belated) follow up to this issue: you can try out sneller for free in your browser on our playground. |
a large number of interfaces are not implemented:
The text was updated successfully, but these errors were encountered: