feat: data generation for ctx distillation and rule to code

[ganler]

No description provided.

[Copilot]

Pull Request Overview

This PR adds data generation infrastructure for context distillation and rule-to-code conversion. The implementation includes pipelines for generating training data from vulnerability databases and creating context-aware distilled responses using AI models.

• Implements CWE-to-code data generation with XML parsing and OpenAI integration
• Adds context distillation pipeline with safety analysis and reward-based verification
• Creates placeholder files for additional rule-to-code conversion modules

Reviewed Changes

Copilot reviewed 7 out of 7 changed files in this pull request and generated 6 comments.

Show a summary per file

File	Description
datagen/rule2code/cwe2code.py	Complete implementation for converting CWE vulnerability data to code examples using AI
datagen/ctxdistill/ctxdistill.py	Core context distillation logic with safety analysis and multi-turn conversation handling
datagen/ctxdistill/post.py	Post-processing pipeline for filtering and formatting distilled conversations
datagen/ctxdistill/main.py	Main entry point defining dataset configurations for distillation
datagen/rule2code/*.py	Placeholder files with TODO comments for future implementation