Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Deep Lake mini upgrades #3375

Merged
merged 49 commits into from
Apr 24, 2023
Merged
Changes from 1 commit
Commits
Show all changes
49 commits
Select commit Hold shift + click to select a range
97be64f
Merge pull request #1 from hwchase17/master
davidbuniat Apr 5, 2023
7ec34e1
deeplake vector store advances
Apr 5, 2023
987c377
merge
Apr 5, 2023
a2cc2ec
Merge branch 'master' of https://github.com/activeloopai/langchain
Apr 5, 2023
b9ab944
remove comments
Apr 5, 2023
a969c7a
demo update
Apr 5, 2023
f151697
Merge branch 'master' of https://github.com/hwchase17/langchain
Apr 5, 2023
313a620
typo fix
Apr 5, 2023
78c99c8
mypy fixes
Apr 5, 2023
1e1271b
filter fix on delete
Apr 5, 2023
99379be
formatting update
Apr 5, 2023
be0bafb
unused imports
Apr 5, 2023
a8816ca
ruff fix
Apr 5, 2023
4986056
fix comments
Apr 5, 2023
894d5bd
refmormat
Apr 5, 2023
c81bb90
Merge branch 'hwchase17:master' into master
davidbuniat Apr 7, 2023
236002f
deeplake vectro store improved
Apr 8, 2023
93acd8e
deeplake faster and custom filters
Apr 8, 2023
28f89ab
dretriever example added
Apr 8, 2023
5641667
Merge branch 'hwchase17:master' into master
davidbuniat Apr 8, 2023
fbf8110
typo
Apr 8, 2023
7f0b925
Merge branch 'master' of https://github.com/activeloopai/langchain
Apr 8, 2023
374491e
minor updates
Apr 8, 2023
b346833
ruf fix
Apr 8, 2023
166a2d6
added use case
Apr 8, 2023
ed21551
added code
Apr 8, 2023
e516ae8
added retriever pointer in the docs
Apr 8, 2023
598332e
Merge branch 'hwchase17:master' into master
davidbuniat Apr 8, 2023
0a34694
merge
Apr 10, 2023
40d170a
Merge branch 'hwchase17:master' into master
davidbuniat Apr 15, 2023
a4e4a4d
improve token auth and tests mode on
Apr 15, 2023
ecd6ea8
remove few flags
Apr 15, 2023
0d42983
tests update
Apr 15, 2023
c80a7d3
remove modules notebook
Apr 15, 2023
781fdc4
reemove semi-sensitive data
Apr 15, 2023
3f89c5e
Merge branch 'hwchase17:master' into master
davidbuniat Apr 21, 2023
0357e60
Merge branch 'hwchase17:master' into master
davidbuniat Apr 22, 2023
e1ee292
upgrade deeplake version and twitter notebook
Apr 23, 2023
629988d
Merge branch 'hwchase17:master' into master
davidbuniat Apr 23, 2023
061d60b
upgraded notebookss, moved to local storage instead of in-memory, set…
Apr 23, 2023
1841305
Merge branch 'master' of https://github.com/activeloopai/langchain
Apr 23, 2023
6b7c3b2
doc update
Apr 23, 2023
4eeb26d
Merge branch 'hwchase17:master' into master
davidbuniat Apr 23, 2023
07fd0c2
reformat
Apr 23, 2023
d270d59
fixed typo and added assert
Apr 23, 2023
396b6ee
reeformatting
Apr 23, 2023
619f6e5
Merge branch 'hwchase17:master' into master
davidbuniat Apr 23, 2023
8c7ecc3
added disallowed_special=() to bypass utf-8 encoding issue in example
Apr 23, 2023
4294a60
creds fix for exists
Apr 24, 2023
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
minor updates
  • Loading branch information
Davit Buniatyan committed Apr 8, 2023
commit 374491e6dbd24ba2a743e48f802e4d2c337a9ea0
Original file line number Diff line number Diff line change
Expand Up @@ -6,7 +6,9 @@
"metadata": {},
"source": [
"# Analysis of Twitter the-algorithm source code with LangChain, GPT4 and Deep Lake\n",
"In this tutorial, we are going to use Langchain + Deep Lake with GPT4 to analyze the code base of the twitter algorithm."
"In this tutorial, we are going to use Langchain + Deep Lake with GPT4 to analyze the code base of the twitter algorithm. \n",
"\n",
"For full documentation of Deep Lake please follow https://docs.activeloop.ai/ and API reference https://docs.deeplake.ai/en/latest/"
]
},
{
Expand Down Expand Up @@ -45,8 +47,7 @@
"cell_type": "markdown",
"metadata": {},
"source": [
"### 1. Index the code base (optional)\n",
"You can directly skip this part and directly jump into using already indexed dataset. To begin with, first we will clone the repository, then parse and chunk the code base and use OpenAI indexing."
"Authenticate into Deep Lake if you want to create your own dataset and publish it. You can get an API key from the platform at https://app.activeloop.ai"
]
},
{
Expand All @@ -63,7 +64,8 @@
"cell_type": "markdown",
"metadata": {},
"source": [
"Authenticate into Deep Lake if you want to create your own dataset and publish it. You can get an API key at https://app.activeloop.ai"
"### 1. Index the code base (optional)\n",
"You can directly skip this part and directly jump into using already indexed dataset. To begin with, first we will clone the repository, then parse and chunk the code base and use OpenAI indexing."
]
},
{
Expand Down Expand Up @@ -204,6 +206,14 @@
"retriever.search_kwargs['k'] = 20"
]
},
{
"attachments": {},
"cell_type": "markdown",
"metadata": {},
"source": [
"You can also specify user defined functions using [Deep Lake filters](https://docs.deeplake.ai/en/latest/deeplake.core.dataset.html#deeplake.core.dataset.Dataset.filter)"
]
},
{
"cell_type": "code",
"execution_count": 16,
Expand Down