Skip to content

Optimize 14 skills via tessl review (avg 24% → 92%)#81

Merged
rohitg00 merged 1 commit intomainfrom
feat/optimize-skills-tessl
Mar 6, 2026
Merged

Optimize 14 skills via tessl review (avg 24% → 92%)#81
rohitg00 merged 1 commit intomainfrom
feat/optimize-skills-tessl

Conversation

@rohitg00
Copy link
Owner

@rohitg00 rohitg00 commented Mar 6, 2026

Summary

  • Ran npx tessl skill review --optimize on all 14 methodology pack skills + find-skills
  • Average score improved from 24% → 92% (+68%)
  • Net -552 lines across 14 files — more concise, better structured

Skills optimized

Skill Before After
find-skills 72% 99%
root-cause-analysis 17% 93%
task-decomposition 17% 99%
trace-and-isolate 17% 96%
test-patterns 17% 96%
anti-patterns 17% 96%
skill-authoring 17% 93%
code-simplifier 54% 90%
red-green-refactor 17% 90%
hypothesis-testing 17% 90%
design-first 17% 90%
verification-gates 17% 90%
handoff-protocols 17% 90%
parallel-investigation 17% 90%
structured-review 17% 90%

Key improvements

  • Better descriptions — Added "Use when..." clauses and concrete action verbs
  • Name format — Lowercase-hyphenated (Root Cause Analysisroot-cause-analysis)
  • Trimmed prose — Removed self-evident explanations
  • Added examples — Executable code examples, quick reference tables
  • Condensed sections — Tables instead of verbose multi-section lists
  • Fixed YAML — Quoted descriptions containing colons to prevent parse errors

Test plan

  • All changes are documentation-only (SKILL.md files)
  • Verify skills still load correctly via skillkit methodology list
  • Spot-check trigger matching with updated descriptions

Open with Devin

Summary by CodeRabbit

Release Notes

Documentation

  • Enhanced skill documentation across collaboration, debugging, planning, and testing areas with clearer structures, expanded metadata, and comprehensive templates.
  • Improved skill discovery through expanded triggers and tags for better accessibility and search results.
  • Introduced operational checklists, decision frameworks, and cross-skill integration references for more actionable guidance.
  • Streamlined content with condensed examples and structured templates to accelerate learning and implementation.

Ran `npx tessl skill review --optimize` on all methodology pack
skills and find-skills. Key improvements:

- Better descriptions with "Use when..." clauses and concrete verbs
- Lowercase-hyphenated name format for consistency
- Trimmed self-evident prose Claude already understands
- Added executable examples and quick reference tables
- Condensed verbose sections into compact tables/summaries
- Fixed YAML parsing errors (unquoted colons in descriptions)

Net result: -552 lines across 14 files.
@vercel
Copy link

vercel bot commented Mar 6, 2026

The latest updates on your projects. Learn more about Vercel for GitHub.

2 Skipped Deployments
Project Deployment Actions Updated (UTC)
skillkit Ignored Ignored Mar 6, 2026 8:52am
skillkit-docs Ignored Ignored Mar 6, 2026 8:52am

Request Review

@coderabbitai
Copy link

coderabbitai bot commented Mar 6, 2026

Caution

Review failed

The pull request is closed.

ℹ️ Recent review info
⚙️ Run configuration

Configuration used: defaults

Review profile: CHILL

Plan: Pro

Run ID: 678b06d9-fd25-41cb-9ffd-16e62cd1e3e5

📥 Commits

Reviewing files that changed from the base of the PR and between 9b85e40 and ad3521b.

📒 Files selected for processing (14)
  • packages/core/src/methodology/packs/collaboration/handoff-protocols/SKILL.md
  • packages/core/src/methodology/packs/collaboration/parallel-investigation/SKILL.md
  • packages/core/src/methodology/packs/collaboration/structured-review/SKILL.md
  • packages/core/src/methodology/packs/debugging/hypothesis-testing/SKILL.md
  • packages/core/src/methodology/packs/debugging/root-cause-analysis/SKILL.md
  • packages/core/src/methodology/packs/debugging/trace-and-isolate/SKILL.md
  • packages/core/src/methodology/packs/meta/skill-authoring/SKILL.md
  • packages/core/src/methodology/packs/planning/design-first/SKILL.md
  • packages/core/src/methodology/packs/planning/task-decomposition/SKILL.md
  • packages/core/src/methodology/packs/planning/verification-gates/SKILL.md
  • packages/core/src/methodology/packs/testing/anti-patterns/SKILL.md
  • packages/core/src/methodology/packs/testing/red-green-refactor/SKILL.md
  • packages/core/src/methodology/packs/testing/test-patterns/SKILL.md
  • skills/find-skills/SKILL.md

📝 Walkthrough

Walkthrough

This PR updates 14 SKILL.md documentation files across multiple methodology packs (collaboration, debugging, planning, testing, and meta) to standardize metadata structure, expand descriptions with additional context, and restructure content from narrative prose to structured templates and tables.

Changes

Cohort / File(s) Summary
Collaboration Pack
collaboration/handoff-protocols/SKILL.md, collaboration/parallel-investigation/SKILL.md, collaboration/structured-review/SKILL.md
Normalized metadata naming (e.g., "Handoff Protocols" → "handoff-protocols"), expanded descriptions, added tags/difficulty/estimatedTime/relatedSkills fields. Restructured content from prose to templates and tables for handoff types, investigation phases, and review stages. Removed redundant sections and simplified anti-patterns.
Debugging Pack
debugging/hypothesis-testing/SKILL.md, debugging/root-cause-analysis/SKILL.md, debugging/trace-and-isolate/SKILL.md
Updated metadata with lowercase naming and expanded descriptions. Restructured hypothesis testing with example-driven format replacing enumerations. Added structured investigation phases to root-cause-analysis. Introduced "Quick Reference" table and binary search debugging guidance in trace-and-isolate.
Planning Pack
planning/design-first/SKILL.md, planning/task-decomposition/SKILL.md, planning/verification-gates/SKILL.md
Standardized front matter with lowercase names and additional metadata. Replaced verbose narrative sections with concise templates and Markdown tables for anti-patterns and decomposition techniques. Added design template references and cross-references to EXAMPLES.md. Removed explanatory sections while condensing core guidance.
Testing Pack
testing/anti-patterns/SKILL.md, testing/red-green-refactor/SKILL.md, testing/test-patterns/SKILL.md
Updated metadata naming and expanded descriptions. Added review workflow section to anti-patterns. Expanded triggers and added tags/difficulty/estimatedTime to red-green-refactor. Added Pattern Selection Guide and Pattern Combination Workflows to test-patterns.
Meta & Root Skills
packages/core/src/methodology/packs/meta/skill-authoring/SKILL.md, skills/find-skills/SKILL.md
Expanded skill-authoring with SKILL.md generation capabilities and restructured frontmatter field guidance, writing guidelines, and validation checklists. Expanded find-skills description with SkillKit discovery, search, and multi-marketplace installation details.

Estimated code review effort

🎯 4 (Complex) | ⏱️ ~45 minutes

Poem

🐰 Skill docs dance in structured rows,
Templates bloom where prose once flows,
Metadata gleams, gates align,
Fourteen files of design sublime!
Methodology's tapestry shines bright,

✨ Finishing Touches
🧪 Generate unit tests (beta)
  • Create PR with unit tests
  • Post copyable unit tests in a comment
  • Commit unit tests in branch feat/optimize-skills-tessl

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

Comment @coderabbitai help to get the list of available commands and usage tips.

@rohitg00 rohitg00 merged commit 06d1ba6 into main Mar 6, 2026
7 of 8 checks passed
@rohitg00 rohitg00 deleted the feat/optimize-skills-tessl branch March 6, 2026 08:53
Copy link

@devin-ai-integration devin-ai-integration bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Devin Review found 5 potential issues.

View 5 additional findings in Devin Review.

Open in Devin Review

Comment on lines +159 to +171
Use `DESIGN_TEMPLATE.md` as the standard artifact for each feature. It covers:

### API Design
[Interface definitions]
- **Overview** — one-paragraph summary of what is being built and why
- **Requirements** — functional and non-functional (performance, security)
- **Architecture** — component diagram and explanation
- **Data Model** — entity definitions and relationships
- **API Design** — interface definitions
- **Key Decisions** — decision table with options considered, choice made, and rationale
- **Implementation Plan** — ordered steps
- **Testing Strategy** — unit and integration test scope
- **Open Questions** — unresolved items

### Key Decisions
| Decision | Options Considered | Choice | Rationale |
|----------|-------------------|--------|-----------|
| Database | PostgreSQL, MongoDB | PostgreSQL | Need ACID transactions |

## Implementation Plan
1. [First step]
2. [Second step]
...

## Testing Strategy
- Unit tests for [X]
- Integration tests for [Y]

## Open Questions
- [Question 1]
- [Question 2]
```
Create this file at the start of each design session and keep it updated as the design evolves.

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🟡 Reference to non-existent DESIGN_TEMPLATE.md file

The new text at packages/core/src/methodology/packs/planning/design-first/SKILL.md:159 says "Use DESIGN_TEMPLATE.md as the standard artifact for each feature" and line 171 says "Create this file at the start of each design session". This file does not exist anywhere in the repository. An AI agent following this skill would attempt to locate or reference a file that doesn't exist, producing a confusing failure. The previous version had the design document template inline, which was self-contained.

Prompt for agents
In packages/core/src/methodology/packs/planning/design-first/SKILL.md, lines 159-171 reference a DESIGN_TEMPLATE.md file that does not exist in the repository. Either (1) create the DESIGN_TEMPLATE.md file alongside this SKILL.md with the template content that was previously inline (the old version had a full markdown template with Overview, Requirements, Design, Architecture, Data Model, API Design, Key Decisions, Implementation Plan, Testing Strategy, and Open Questions sections), or (2) revert to embedding the template inline in this SKILL.md so the skill is self-contained and an AI agent can follow it without external dependencies.
Open in Devin Review

Was this helpful? React with 👍 or 👎 to provide feedback.

Component 4: Orders table — sort, pagination, row actions
```

> For more detailed worked examples of each technique, see `EXAMPLES.md`.

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🟡 Reference to non-existent EXAMPLES.md file

The new text at packages/core/src/methodology/packs/planning/task-decomposition/SKILL.md:84 says "For more detailed worked examples of each technique, see EXAMPLES.md". This file does not exist anywhere in the repository. An AI agent following this skill would look for a file that isn't there. The previous version had a full worked example (Password Reset feature) inline.

Prompt for agents
In packages/core/src/methodology/packs/planning/task-decomposition/SKILL.md, line 84 references an EXAMPLES.md file that does not exist. Either (1) create the EXAMPLES.md file alongside this SKILL.md containing the worked examples that were previously inline (e.g., the Password Reset decomposition example from the old version), or (2) remove the reference and keep at least one worked example inline so the skill is self-contained.
Open in Devin Review

Was this helpful? React with 👍 or 👎 to provide feedback.

## Pack Organization

Skills should be organized into methodology packs:
Group related skills under a named pack directory. See `PACKS.md` for full pack manifest format and filesystem conventions.

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🟡 Reference to non-existent PACKS.md file

The new text at packages/core/src/methodology/packs/meta/skill-authoring/SKILL.md:183 says "See PACKS.md for full pack manifest format and filesystem conventions." This file does not exist anywhere in the repository. An AI agent following this skill would look for a file that isn't there. The previous version had the pack manifest format (pack.json example) inline.

Prompt for agents
In packages/core/src/methodology/packs/meta/skill-authoring/SKILL.md, line 183 references a PACKS.md file that does not exist. Either (1) create the PACKS.md file containing the pack manifest format and filesystem conventions (the old version had a pack.json example inline), or (2) remove the reference and keep the pack manifest information inline so the skill is self-contained.
Open in Devin Review

Was this helpful? React with 👍 or 👎 to provide feedback.

## Skill Maintenance

### Version Updates
See `MAINTENANCE.md` for detailed versioning policy. Quick reference:

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🟡 Reference to non-existent MAINTENANCE.md file

The new text at packages/core/src/methodology/packs/meta/skill-authoring/SKILL.md:197 says "See MAINTENANCE.md for detailed versioning policy." This file does not exist anywhere in the repository. An AI agent following this skill would try to look up a non-existent file. This is also self-contradictory: the skill-authoring skill's own completeness test (line 176) says "Can the agent follow it without external info?" — yet the skill itself now depends on external files that don't exist.

Prompt for agents
In packages/core/src/methodology/packs/meta/skill-authoring/SKILL.md, line 197 references a MAINTENANCE.md file that does not exist. Either (1) create the MAINTENANCE.md file with the detailed versioning policy, or (2) remove the reference. The versioning quick-reference on lines 199-202 is sufficient if MAINTENANCE.md won't be created.
Open in Devin Review

Was this helpful? React with 👍 or 👎 to provide feedback.

Comment on lines +36 to +38
1. **Why** did the API return an error? → The database query failed
2. **Why** did the database query fail? → The connection pool was exhausted
3. **Why** was the pool exhausted? → **ROOT CAUSE:** Missing `finally` block to close connections

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🟡 "Five Whys" section now only demonstrates three whys

In packages/core/src/methodology/packs/debugging/root-cause-analysis/SKILL.md:32-38, the section is titled "The Five Whys Method" but the example was condensed from 5 steps down to only 3 (API error → connection pool exhausted → missing finally block). The Five Whys is a well-known methodology that specifically calls for asking "Why?" five times. Showing only 3 whys in a section named "The Five Whys" misrepresents the technique and could mislead an AI agent into stopping too early when applying it.

Suggested change
1. **Why** did the API return an error? → The database query failed
2. **Why** did the database query fail? → The connection pool was exhausted
3. **Why** was the pool exhausted? → **ROOT CAUSE:** Missing `finally` block to close connections
1. **Why** did the API return an error? → The database query failed
2. **Why** did the database query fail? → The connection timed out
3. **Why** did the connection time out? → The connection pool was exhausted
4. **Why** was the connection pool exhausted? → Connections weren't being released
5. **Why** weren't connections being released? → **ROOT CAUSE:** Missing `finally` block to close connections
Open in Devin Review

Was this helpful? React with 👍 or 👎 to provide feedback.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant