Skip to content

A comprehensive collection of 100 AI katas progressing from simple fundamentals to complex, multi-agent and multi-modal systems.

Notifications You must be signed in to change notification settings

o3-cloud/ai-katas

Repository files navigation

AI Katas Collection: 100 Hands-On Practice Exercises

A comprehensive collection of 100 AI katas progressing from simple fundamentals to complex, multi-agent and multi-modal systems. Each kata is designed as a hands-on task for practicing and mastering AI prompting and system design skills.

πŸ“š Table of Contents


Set 1: Core Fundamentals (Katas 1-20)

🟒 Beginner (Foundations)

  1. Prompt Polishing Kata
    Improve a poorly written prompt to make it precise, constrained, and testable.

  2. Instruction Following Kata
    Give the model a multi-step instruction (e.g., "analyze β†’ summarize β†’ critique") and measure consistency.

  3. Few-Shot Prompting Kata
    Create a task with examples and compare the model's output with and without the examples.

  4. Style Transfer Kata
    Make the model rephrase text in a specific writing style (scientific, poetic, legal, etc.).

  5. Error Diagnosis Kata
    Provide flawed model outputs and prompt the model to detect, classify, and fix the errors.

🟑 Intermediate (Reasoning & Structure)

  1. Chain-of-Thought Kata
    Force the model to reason step-by-step and evaluate whether reasoning improves accuracy.

  2. Self-Consistency Kata
    Ask the model to generate multiple reasoning paths and select the consensus answer.

  3. Role-Based Prompting Kata
    Assign expert roles (e.g., "You are a senior data scientist…") and measure output changes.

  4. Schema-Constrained Output Kata
    Make the model produce validated JSON, XML, or a custom schema; test error rates.

  5. Knowledge Distillation Kata
    Have the model teach a concept in progressively simpler explanations (expert β†’ child).

πŸ”΄ Advanced (Planning, Tools & Agents)

  1. Task Decomposition Kata
    Provide a complex goal and ask the model to break it into subtasks with dependencies.

  2. Reflection & Improvement Kata
    Use a loop where the model critiques its own answer, improves it, and repeats.

  3. Retriever-Augmented Generation Kata
    Simulate a RAG workflow: give a knowledge base and test retrieval + answer fusion.

  4. Code Generation Kata
    Have the model write code, then request debugging and refactoring iterations.

  5. Tool-Use Simulation Kata
    Have the model decide when to "call tools" (calculation, search, API) and justify the choice.

⚫ Expert (Multi-Agent, Long-Context, Multi-Modal)

  1. Multi-Agent Debate Kata
    Simulate two AI agents debating a question; a third agent judges correctness.

  2. Long-Context Compression Kata
    Give a long document and ask the model to produce a loss-graded compression (e.g., 10%, 5%, 1%).

  3. Plan-and-Execute Agent Kata
    Model creates a plan (planner role) and another agent executes each step with validation.

  4. Multi-Modal Reasoning Kata
    Provide image/text/table inputs (or describe them) and have the model integrate information.

  5. Autonomous Project Agent Kata
    Give the model a multi-day project goal (e.g., "design a small curriculum"), require planning, progress tracking, reflection, and final deliverables.


Set 2: Advanced Techniques (Katas 21-40)

🟒 Beginner (Prompt Craft & Control)

  1. Ambiguity Resolution Kata
    Give the model a deliberately ambiguous question and prompt it to list possible interpretations before answering.

  2. Persona Switching Kata
    Ask the model to respond in two different personas back-to-back and analyze consistency.

  3. Constraint Enforcement Kata
    Create a prompt with strict rules (length, vocabulary limits, forbidden words) and evaluate compliance.

  4. Rewriting for Clarity Kata
    Take a dense or confusing paragraph and ask the model to rewrite it for a specific reading level.

  5. Edge-Case Prompting Kata
    Provide unusual or tricky inputs (empty fields, contradictory facts) and prompt the model to reason safely.

🟑 Intermediate (Reasoning, Structure, Evaluation)

  1. Rubric-Based Grading Kata
    Provide a grading rubric and ask the model to score a piece of work using the rubric step-by-step.

  2. Theory-to-Example Kata
    Take an abstract idea and ask the model to generate concrete examples, then generalize back.

  3. Multi-Perspective Summary Kata
    Ask for summaries from different viewpoints (e.g., critic, supporter, economist, scientist).

  4. Hypothesis Testing Kata
    Provide a claim and ask the model to generate hypotheses, evidence, counter-evidence, and a conclusion.

  5. Data Cleaning Kata
    Give messy textual data and have the model normalize, categorize, and detect anomalies.

πŸ”΄ Advanced (Planning, Modeling, Simulation)

  1. Prompt Optimization Kata
    Have the model rewrite your prompt 3–5 times to maximize clarity, precision, or performance.

  2. Scenario Simulation Kata
    Ask the model to simulate a dynamic system (e.g., supply chain, ecosystem, workplace conflict) with state updates.

  3. Algorithm Explanation Kata
    Provide algorithm pseudocode and ask the model to walk through it line-by-line using an example input.

  4. Temporal Reasoning Kata
    Give time-dependent events and ask the model to infer sequences, causality, or scheduling.

  5. Structured Comparison Kata
    Have the model compare two or more items using a table with specific columns and constraints.

⚫ Expert (Agents, Multimodal, Critical Thinking)

  1. Truthfulness vs. Plausibility Kata
    Give the model a mix of real and fake claims and ask it to distinguish "sounds plausible" from "actually true," with justification.

  2. Model Critique Kata
    Provide a model answer (from another AI or older version) and ask the current model to give a detailed critique and rewrite.

  3. Self-Generated Dataset Kata
    Ask the model to create a synthetic dataset, define schema, include edge cases, and validate it.

  4. Cross-Domain Transfer Kata
    Ask the model to apply concepts from one domain (e.g., biology) to another (e.g., business strategy).

  5. Modular Agent Design Kata
    Have the model design a multi-agent architecture with explicit modules (planner, researcher, executor, critic, memory), including message-passing protocols.


Set 3: Specialized Skills (Katas 41-60)

🟒 Beginner (Prompting, Interpretation, Control)

  1. Ambiguity Annotation Kata
    Provide the model a paragraph and ask it to highlight ambiguous phrases and rewrite them unambiguously.

  2. Terminology Extraction Kata
    Give a block of text and ask the model to extract domain-specific terms and define them succinctly.

  3. Minimal Prompt Kata
    Challenge the model to complete a task with the shortest possible prompt while maintaining quality.

  4. Prompt Anti-Pattern Identification Kata
    Give examples of bad prompts and ask the model to diagnose what makes them poor and rewrite them.

  5. Response Classification Kata
    Provide several model outputs and ask the model to classify them (correct, incorrect, hallucinated, irrelevant).

🟑 Intermediate (Reasoning, Structure, Logical Rigor)

  1. Reverse Engineering Intent Kata
    Give the model an answer and ask it to generate the most likely original question or prompt.

  2. Logical Fallacy Detection Kata
    Present arguments containing logical fallacies and have the model identify and explain them.

  3. Conditional Logic Tree Kata
    Create nested if-then-else scenarios and test the model's ability to follow branching logic.

  4. Information Hierarchy Kata
    Have the model organize information into a clear hierarchy (main points β†’ sub-points β†’ details).

  5. Assumption vs. Fact Separation Kata
    Give mixed content and ask the model to separate verifiable facts from assumptions or opinions.

πŸ”΄ Advanced (Complex Reasoning, Meta-Cognition)

  1. Recursive Summarization Kata
    Summarize a document, then summarize the summary, continuing until reaching a single sentence.

  2. Counterfactual Reasoning Kata
    Ask "what if" questions and have the model reason through alternate scenarios systematically.

  3. Bias Detection & Mitigation Kata
    Analyze text for various biases and propose rewrites that minimize them.

  4. Emergent Pattern Recognition Kata
    Provide data points and ask the model to identify patterns not explicitly stated.

  5. Meta-Learning Documentation Kata
    Have the model document its own learning process while solving a problem.

⚫ Expert (System Design, Multi-Step Workflows)

  1. Pipeline Architecture Kata
    Design a complete data processing pipeline with error handling and validation at each stage.

  2. Feedback Loop Design Kata
    Create a system where outputs inform future inputs with continuous improvement mechanisms.

  3. Resource Optimization Kata
    Given constraints (time, tokens, API calls), optimize a workflow for efficiency.

  4. Failure Mode Analysis Kata
    Identify all possible failure points in a system and design mitigations.

  5. Compositional Task Building Kata
    Build complex tasks by composing simpler subtasks with clear interfaces.


Set 4: Problem-Solving & Reasoning (Katas 61-80)

🟒 Beginner (Control, Understanding, Precision)

  1. Keyword-Driven Generation Kata
    Force the model to produce an output that must include (or exclude) a specific list of keywords.

  2. Intent Clarification Kata
    Give the model a vague user message and ask it to produce clarifying questions and rationale before answering.

  3. Redundant Text Removal Kata
    Ask the model to remove repetition from a text while preserving meaning.

  4. Prompt Completion Kata
    Provide the first half of a prompt and ask the model to guess the intended task and complete it logically.

  5. Microformat Rewriting Kata
    Ask the model to rewrite text into a strict microformat (bullet rules, tweet threads, glossary entries, etc.).

🟑 Intermediate (Inference, Reasoning, and Knowledge Handling)

  1. Contradiction Detection Kata
    Provide two paragraphs and have the model detect contradictions, ambiguities, or conflicts in logic.

  2. Sparse Clue Reasoning Kata
    Give minimal information and ask the model to make logical inferences while stating assumptions.

  3. Precedence Rule Application Kata
    Define a set of rules with priorities and test the model's ability to apply them correctly.

  4. Evidence Weighting Kata
    Present multiple pieces of evidence of varying quality and have the model weight them appropriately.

  5. Diagnostic Tree Navigation Kata
    Create a decision tree and have the model navigate it based on given symptoms or conditions.

πŸ”΄ Advanced (Strategy, Optimization, Complex Systems)

  1. Strategic Planning Kata
    Given goals and constraints, develop a multi-phase strategy with contingency plans.

  2. Trade-off Analysis Kata
    Present scenarios requiring trade-offs and have the model analyze pros/cons systematically.

  3. System Bottleneck Identification Kata
    Describe a complex system and have the model identify performance bottlenecks.

  4. Emergent Behavior Prediction Kata
    Given simple rules, predict complex emergent behaviors in a system.

  5. Optimization Under Uncertainty Kata
    Make decisions with incomplete information while quantifying uncertainty.

⚫ Expert (Advanced Agents, Coordination, Intelligence)

  1. Distributed Decision Making Kata
    Design how multiple agents coordinate decisions without central control.

  2. Adversarial Scenario Planning Kata
    Plan strategies assuming an intelligent adversary trying to counter your moves.

  3. Knowledge Graph Construction Kata
    Build a knowledge graph from unstructured text with entities, relationships, and confidence scores.

  4. Cognitive Load Balancing Kata
    Distribute complex tasks across agents based on their capabilities and current load.

  5. Self-Modifying Workflow Kata
    Create workflows that can modify themselves based on performance metrics.


Set 5: Robustness & Cognitive Skills (Katas 81-100)

🟒 Beginner (Prompting, Interpretation, Basic Reasoning)

  1. Context Boundary Kata
    Give the model a long conversation or document and ask it to identify what is and is not relevant to a specific question.

  2. Perspective Flip Kata
    Provide an argument and ask the model to reframe it from the opposite viewpoint with equal coherence.

  3. Controlled Randomness Kata
    Have the model generate an idea or example with a specific "creativity level" (e.g., 0–10 scale).

  4. Simple Fact Distillation Kata
    Provide a dense paragraph and have the model distill just the atomic facts with no interpretation.

  5. Keyword-to-Paragraph Kata
    Give only a list of 5–8 keywords and ask the model to construct a coherent, factual paragraph connecting them.

🟑 Intermediate (Structure, Multi-Step, Domain Reasoning)

  1. Cause–Effect Mapping Kata
    Provide an event and ask the model to produce upstream causes and downstream effects in a structured tree.

  2. Hypothetical Rewrite Kata
    Ask the model to rewrite a scenario under a new assumption (e.g., "What if gravity were half as strong?").

  3. Constraint-First Planning Kata
    Provide hard constraints first and ask the model to develop a plan that satisfies all of them.

  4. Error Taxonomy Creation Kata
    Give the model several flawed responses and ask it to invent a taxonomy of error types, then categorize each item.

  5. Progressive Elaboration Kata
    Have the model take a one-sentence idea and elaborate it into:

    • a paragraph
    • an outline
    • a full plan
    • a refined final version

πŸ”΄ Advanced (Systems Thinking, Strategy, Simulation)

  1. Adversarial Prompt Defense Kata
    Ask the model to identify possible adversarial attacks hidden in a prompt and rewrite the prompt safely.

  2. Meta-Prompt Interpretation Kata
    Give a prompt about how to construct prompts and ask the model to analyze and optimize it.

  3. Nested Reasoning Kata
    Instruct the model to reason at three levels:

    • immediate step reasoning
    • meta-reasoning (why that step?)
    • meta-meta reasoning (how to improve reasoning itself)
  4. Scenario Divergence Kata
    Ask the model to simulate two alternate timelines from a single starting point and show how they diverge.

  5. Implicit Assumption Extraction Kata
    Provide a text and have the model extract every hidden assumption the writer is making.

⚫ Expert (Agentic, Multi-Modal, High-Complexity Cognition)

  1. Spec-to-Implementation Kata
    Give the model a specification and ask it to describe how different agents or modules would implement it.

  2. Self-Healing Workflow Kata
    Ask the model to create a workflow where each step has built-in mechanisms to detect and repair errors from previous steps.

  3. Role-Conflict Simulation Kata
    Have the model simulate two agents with conflicting goals negotiating toward a resolution, with reasoning traces.

  4. Cross-Format Translation Kata
    Ask the model to convert information across formats (e.g., map β†’ story β†’ checklist β†’ SOP) while preserving essential data.

  5. Concept Spine Building Kata
    Have the model extract the "spine" (core conceptual skeleton) of a topic and then rebuild the full knowledge structure from it.


πŸ“Š Difficulty Distribution

  • 🟒 Beginner (25 katas): Focus on basic prompting, control, and understanding
  • 🟑 Intermediate (25 katas): Emphasize reasoning, structure, and multi-step processes
  • πŸ”΄ Advanced (25 katas): Cover planning, optimization, and complex systems
  • ⚫ Expert (25 katas): Address multi-agent systems, meta-cognition, and high-complexity tasks

🎯 Skill Categories Covered

  1. Prompt Engineering: Crafting, optimizing, and debugging prompts
  2. Reasoning & Logic: Chain-of-thought, consistency, logical inference
  3. Structure & Format: Schema compliance, hierarchies, conversions
  4. Planning & Strategy: Decomposition, optimization, contingency planning
  5. Multi-Agent Systems: Coordination, debate, distributed decision-making
  6. Error Handling: Detection, classification, self-correction
  7. Meta-Cognition: Reflection, self-improvement, learning documentation
  8. Robustness: Edge cases, adversarial inputs, failure modes
  9. Knowledge Management: Extraction, distillation, graph construction
  10. Creative Problem-Solving: Cross-domain transfer, emergent patterns, divergent thinking

πŸ’‘ How to Use This Collection

  1. Sequential Practice: Work through katas in order, building skills progressively
  2. Targeted Training: Focus on specific difficulty levels or skill categories
  3. Daily Practice: Select one kata per day for consistent improvement
  4. Team Challenges: Use katas for group training or competitive practice
  5. Skill Assessment: Use subsets as benchmarks for evaluating AI capabilities
  6. Curriculum Building: Combine katas into structured learning paths

πŸ“ˆ Suggested Learning Paths

Path 1: Prompt Engineering Mastery

Katas: 1, 3, 21, 23, 31, 43, 44, 61, 62, 91, 92

Path 2: Reasoning & Logic Development

Katas: 2, 6, 7, 29, 47, 48, 66, 69, 93, 95

Path 3: Agent & System Design

Katas: 11, 16, 18, 40, 56, 76, 96, 97, 98, 100

Path 4: Robustness & Error Handling

Katas: 5, 25, 45, 54, 59, 89, 91, 97

Path 5: Creative & Divergent Thinking

Katas: 4, 27, 39, 82, 83, 87, 94, 99


This collection represents a comprehensive training resource for developing AI interaction skills from foundational to expert level. Regular practice with these katas will build proficiency in prompt engineering, system design, and advanced AI orchestration.

About

A comprehensive collection of 100 AI katas progressing from simple fundamentals to complex, multi-agent and multi-modal systems.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published