Skip to content

feat(xla): run dense matmul numeric probe - #940

Merged
inureyes merged 1 commit into
mainfrom
feature/issue-932-dense-matmul-probe
Jul 27, 2026
Merged

inureyes merged 1 commit into
mainfrom
feature/issue-932-dense-matmul-probe

Conversation

@inureyes

Copy link
Copy Markdown
Member

Summary

  • emit a semantically narrow f32 dense-matmul probe with explicit input, accumulator, result, and rounding boundaries
  • bind the VMFB cache to the v3 operator numeric contract, compiler identity, MLIR digest, and linked IREE runtime archive SHA-256
  • load resident weights and execute the emitted graph through the native auxiliary IREE ABI
  • compare identical operands against a row-major sequential Rust decomposition with exact-bit reporting
  • add a root example so real-runtime validation receives the established static IREE link recipe

Qualification semantics

This probe is intentionally reported as canonical-decomposition, not production-mlx. The selected IREE CPU contraction kernel remains explicitly unobserved, so a passing report is always production_qualified=false. No model family or capability predicate is activated.

Validation

  • cargo-fmt fmt --all -- --check
  • cargo check -p mlxcel-xla
  • cargo check -p mlxcel-xla --features micro-oracle
  • cargo test -p mlxcel-xla --features micro-oracle numeric_ -- --nocapture (21 passed)
  • cargo-clippy clippy -p mlxcel-xla --features micro-oracle --tests --no-deps (existing warnings only)
  • cargo run --features xla-micro-oracle --example xla_numeric_probe -- local-task repeated successfully through real compile/load/invoke

Observed local-task evidence:

  • comparison: exact bits, 4 elements, 0 failures, first divergence null
  • operator contract SHA-256: ea04d277cbca9b0d32679ea8dd6cb55b05bbd5503ed1dc99be7a19425c20eea9
  • IREE runtime archive SHA-256: 3ab0d811d9ce1f359e7e1f37ecfad7285499cfed5e3c6335265767cfbc7cdf44
  • artifact fingerprint: b4461b40278903ca
  • transfers: 24 B resident weight, 24 B invocation input, 16 B output
  • reported candidate invocation: approximately 2 ms

Compile-time and peak-memory fields are not yet part of the v1 report schema and remain follow-up instrumentation; this slice does not claim to complete #932.

Refs #932

Emit a contract-explicit f32 dense matmul, bind its VMFB to the v3 operator manifest and exact compiler/runtime fingerprints, and execute it through the native auxiliary IREE ABI against the canonical oracle harness.

Keep the report classified as canonical decomposition with an unobserved IREE kernel, so the exact-bit CPU pass cannot qualify a production family.

Refs #932
@inureyes inureyes added area:architecture Architecture and code structure changes area:core mlxcel-core: MLX FFI, primitives, KV cache, layers area:inference Generation, sampling, decoding (incl. speculative, DRY) priority:high High priority status:review Under review type:enhancement New features, capabilities, or significant additions labels Jul 27, 2026
@inureyes
inureyes merged commit 971a557 into main Jul 27, 2026
5 checks passed
@inureyes inureyes added the status:done Completed label Jul 27, 2026
@inureyes
inureyes deleted the feature/issue-932-dense-matmul-probe branch July 27, 2026 01:08
@inureyes inureyes removed the status:review Under review label Jul 27, 2026
@inureyes inureyes self-assigned this Aug 31, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

area:architecture Architecture and code structure changes area:core mlxcel-core: MLX FFI, primitives, KV cache, layers area:inference Generation, sampling, decoding (incl. speculative, DRY) priority:high High priority status:done Completed type:enhancement New features, capabilities, or significant additions

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant