feat(yaml workflow): yaml workflow representation + doc embeddings

[Sg312]

Description

Available changes:

• This pr adds a new yaml-based workflow representation. It adds workflow import/export functionality with yaml, and allows users to create new workflows from yaml files.
• Adds docs embeddings and table migrations for internal docs

Changes behind ff:

• Adds copilot, which is an in-workflow assistant
• Internal doc search tool, which copilot can call to understand sim studio workflows
• Internal get user workflow tool, which copilot can call to understand the user's workflow
• Workflow yaml editor

Type of change

• New feature (non-breaking change which adds functionality)

How Has This Been Tested?

Please describe the tests that you ran to verify your changes. Provide instructions so we can reproduce. Please also list any relevant details for your test configuration.

Checklist:

• My code follows the style guidelines of this project
• I have performed a self-review of my own code
• I have commented my code, particularly in hard-to-understand areas
• I have added tests that prove my fix is effective or that my feature works
• All tests pass locally and in CI (bun run test)
• My changes generate no new warnings
• Any dependent changes have been merged and published in downstream modules
• I have updated version numbers as needed (if needed)
• I confirm that I have read and agree to the terms outlined in the Contributor License Agreement (CLA)

Security Considerations:

• My changes do not introduce any new security vulnerabilities
• I have considered the security implications of my changes

Additional Information:

Any additional information, configuration or data that might be necessary to reproduce the issue or use the feature.

[vercel]

The latest updates on your projects. Learn more about Vercel for Git ↗︎

Name	Status	Preview	Comments	Updated (UTC)
sim	✅ Ready (Inspect)	Visit Preview	💬 Add feedback	Jul 9, 2025 7:57pm

1 Skipped Deployment

Name	Status	Preview	Comments	Updated (UTC)
docs	⬜️ Skipped (Inspect)			Jul 9, 2025 7:57pm

[delve-auditor]

✅ No security or compliance issues detected. Reviewed everything up to 3c61bc1.

Security Overview

• 🔎 Scanned files: 49 changed file(s)

Detected Code Changes

The diff is too large to display a summary of code changes.

Reply to this PR with @delve-auditor followed by a description of what change you want and we'll auto-submit a change to this PR to implement it.

[greptile-apps]

PR Summary

Major implementation of YAML-based workflow system and documentation assistant functionality, featuring vector embeddings for semantic search and a new copilot feature.

• Added robust YAML workflow support in apps/sim/lib/workflows/yaml-generator.ts with import/export capabilities and block relationship handling
• Implemented vector-based documentation search through new docs_embeddings table and chunking system in apps/sim/lib/documents/docs-chunker.ts
• Created copilot chat interface with documentation assistance in apps/sim/app/workspace/[workspaceId]/w/[workflowId]/components/panel/components/copilot/copilot.tsx
• Added workflow text editor with YAML/JSON switching in apps/sim/app/workspace/[workspaceId]/w/[workflowId]/components/workflow-text-editor/workflow-text-editor.tsx
• Implemented migration structure for copilot_chats table with proper indexing and foreign key relationships in apps/sim/db/migrations/0052_fluffy_shinobi_shaw.sql

_{46 files reviewed, 70 comments
Edit PR Review Bot Settings | Greptile}

[icecrasher321]

is this actually being triggered correctly?

[Sg312]

i'll address later