Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Tests: Added integration tests for GBNF parser #6472

Merged
merged 6 commits into from
Apr 6, 2024
Merged

Tests: Added integration tests for GBNF parser #6472

Changes from 1 commit
Commits
Show all changes
6 commits
Select commit Hold shift + click to select a range
345eae3
Added integration tests for GBNF parser to validate correctness of pa…
HanClinto Apr 4, 2024
b7264d6
Fixing whitespace errors and cleaning error message alert to be clearer.
HanClinto Apr 4, 2024
b930945
Removing hacky include to llama.cpp from grammar integration test now…
HanClinto Apr 4, 2024
0bf5704
Comment cleanup.
HanClinto Apr 4, 2024
d24dabc
Reorganizing tests for readability.
HanClinto Apr 4, 2024
4b54e71
Cleaning up debug message to make a bit more sense.
HanClinto Apr 4, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
Fixing whitespace errors and cleaning error message alert to be clearer.
  • Loading branch information
@HanClinto
HanClinto committed Apr 4, 2024
commit b7264d6efd3ff4ace549e78fe9e9d4fc896387b7
10 changes: 6 additions & 4 deletions tests/test-grammar-integration.cpp
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -30,12 +30,14 @@ expr ::= term ("+" term)*
term ::= numero
number ::= [0-9]+)""";

fprintf(stderr, "NOTE: Error message (\"error parsing grammar\") expected on following line during successful test:\n");

grammar_parser::parse_state parsed_grammar = grammar_parser::parse(grammar_str.c_str());

// Ensure we did NOT parsed correctly
assert(parsed_grammar.rules.empty());

fprintf(stderr, "^ If previous line displays an error, then this test passed.\n");
fprintf(stderr, "End of expected error message. Test successful.\n");
}

static void test_simple_grammar() {
Expand Down Expand Up @@ -80,7 +82,7 @@ number ::= [0-9]+)""";

assert(completed_grammar);

// Clean up allocated memory
// Clean up allocated memory
llama_grammar_free(grammar);
}

Expand Down Expand Up @@ -222,7 +224,7 @@ ws ::= [ \t\n\r]?)""";
grammar->stacks = original_stacks;
}

// Clean up allocated memory
// Clean up allocated memory
llama_grammar_free(grammar);
}

Expand All @@ -233,4 +235,4 @@ int main() {
test_failure_missing_reference();
// Add more test cases as needed
return 0;
}
}