Skip to content

Commit

Permalink
Add daemon to index, overview diagram (#2)
Browse files Browse the repository at this point in the history
  • Loading branch information
sridhar-daxa authored Jan 29, 2024
1 parent 42d0395 commit 1b607f0
Show file tree
Hide file tree
Showing 4 changed files with 22 additions and 9 deletions.
Binary file added assets/img/pebblo-overview.jpg
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
3 changes: 1 addition & 2 deletions docs/gh_pages/daemon.md
Original file line number Diff line number Diff line change
@@ -1,11 +1,10 @@
# Pebblo Daemon

## Overview

Pebblo has two components.

1. Pebblo Daemon
2. Pebblo Langchain SafeLoader
1. Pebblo Safe DocumentLoader for Langchain

This document describes how to `Pebblo Daemon` works to enable any Langchain Gen-AI application with deep data visibility on the types of Topics and Entities ingested through Document Loaders. For more details on how Pebblo enabled your Langchain RAG application see this [Pebblo SafeLoader](/pebblo-docs/rag.html) document.

Expand Down
18 changes: 17 additions & 1 deletion docs/gh_pages/index.md
Original file line number Diff line number Diff line change
@@ -1,6 +1,22 @@
# Contents

# Overview

Pebblo enables developers to safely load data and promote their Gen AI app to deployment without worrying about the organization’s compliance and security requirements. The project identifies semantic topics and entities found in the loaded data and summarizes them on the UI or a PDF report.

![Pebblo Overview](/pebblo-docs/assets/img/pebblo-overview.jpg)

# Benefits

1. Identify semantic topics and entities in your data loaded in RAG applications
1. Accelerate time-to-production by effortlessly meeting your organization’s data compliance requirements
1. Mitigate security risks arising from data poisoning and emerging threats.
1. Comply with regulations such as the EU AI Act with custom reports and data records
1. Support for a wide range of Gen AI development frameworks and data loaders

# Documentation

- [Installation](/pebblo-docs/installation.html)
- [Development Environment](/pebblo-docs/development.html)
- [Pebblo Daemon](/pebblo-docs/daemon.html)
- [Pebblo SafeLoader for Langchain RAG](/pebblo-docs/rag.html)
- [Reports](/pebblo-docs/reporting.html)
10 changes: 4 additions & 6 deletions docs/gh_pages/rag.md
Original file line number Diff line number Diff line change
@@ -1,15 +1,13 @@
# Pebblo SafeLoader for Langchain

## Overview
# Safe DocumentLoader for Langchain

Pebblo has two components.

1. Pebblo Daemon
2. Pebblo Langchain DocumentLoader
1. Pebblo Safe DocumentLoader for Langchain

This document describes how to augment your existing Langchain DocumentLoader with Pebblo SafeLoader to get deep data visibility on the types of Topics and Entities ingested into the Gen-AI Langchain application. For details on `Pebblo Daemon` see this [pebblo daemon](/pebblo-docs/daemon.html) document.
This document describes how to augment your existing Langchain DocumentLoader with Pebblo Safe DocumentLoader to get deep data visibility on the types of Topics and Entities ingested into the Gen-AI Langchain application. For details on `Pebblo Daemon` see this [pebblo daemon](/pebblo-docs/daemon.html) document.

Pebblo Safeloader enables safe data ingestion for _any_ Langchain `DocumentLoader`. This is done by wrapping the document loader call with `PebbloSafeLoader`.
Pebblo Safeloader enables safe data ingestion for _any_ Langchain `DocumentLoader`. This is done by wrapping the document loader call with `Pebblo Safe DocumentLoader`.

## How to Pebblo enable Document Loading?

Expand Down

0 comments on commit 1b607f0

Please sign in to comment.