Kumi::Parser

Text parser for Kumi schemas. Direct tokenizer → AST construction with ~4ms parse time.

Installation

gem 'kumi-parser'

Usage

require 'kumi/parser'

schema = <<~KUMI
  schema do
    input do
      float :income
      string :status
    end
    
    trait :adult, input.age >= 18
    value :tax, fn(:calculate_tax, input.income)
  end
KUMI

# Parse to AST
ast = Kumi::Parser::TextParser.parse(schema)

# Validate
Kumi::Parser::TextParser.valid?(schema) # => true

API

• parse(text) → AST
• valid?(text) → Boolean
• validate(text) → Array of error hashes

Syntax

schema do
  input do
    <type> :<name>[, domain: <spec>]
  end
  
  trait :<name>, <expression>
  
  value :<name>, <expression>
  value :<name> do
    on <condition>, <result>
    base <result>
  end
end

Function calls: fn(:name, arg1, arg2, ...)
Operators: + - * ** `` / `%` `>` `<` `>=` `<=` `==` `!=` `&` `|`
References: `input.field`, `value_name`, `array[index]`
Strings: Both `"double"` and `'single'` quotes supported
Element syntax: `element :type, :name` for array element specifications

Ruby DSL Differences

String concatenation: Ruby DSL evaluates "Hello" + "World" → Literal("HelloWorld"), text parser → CallExpression(:add, [...]).

Semantically equivalent - both should execute identically.

Architecture

• smart_tokenizer.rb - Context-aware tokenization with embedded metadata
• direct_ast_parser.rb - Recursive descent parser, direct AST construction
• token_metadata.rb - Token types, precedence, and semantic hints

License

MIT