STAGING to main

[praveshkumar1988]

• Integration_qa test (Integration_qa test #375)

• Test IntegrationQA added

• update test cases

• update test

• update node count assertions

• test changes

• update changes

• modification test

• Code refatctor test cases

• Handle allowedlist issue in test

• test changes

• update test

• test case execution

• test chatbot updates

• test case update file

• added file

---

• recent merges

• pdf deletion due to out of diskspace

• fixed status blank issue

• Rendering the file name instead of link for gcs and s3 sources in the info modal

• Convert is_cancelled value from string to bool

• added the default page size

• Issue fixed Processed chunked as 0 when file re-process again

• Youtube timestamps (Youtube timestamps #386)

• Wikipedia source to accept all valid urls

• wikipedia url to support multiple languages

• integrated wiki langauge param for extract api

• Youtube video timestamps

---

• groq llm integration backend (groq llm integration backend #286)

• groq llm integration backend

• groq and description in node properties

• added groq in options

---

• offset in chunks (offset in chunks #389)

• page number in gcs loader (page number in gcs loader #393)

• added youtube timestamps (added youtube timestamps #392)

• chat pop up button (chat pop up button #387)

• expand

• minimize-icon

• css changes

• chat history

• chatbot wider Side Nav

• expand icon

• chatbot UI

• Delete

• merge fixes

• code suggestions

---

• chunks create before extraction using is_pre_process variable (chunks create before extraction using is_pre_process variable #383)

• chunks create before extraction using is_pre_process variable

• Return total pages for Model

• update requirement.txt

• total pages on uplaod API

• added the Confirmation Dialog

• added the selected files into the confirmation modal

• format and lint fixes

• added the stop watch image

• fileselection on alert dialog

• Add timeout in docker for gunicorn workers

• Add cancel icon to info popup (Add cancel icon to info popup #384)

• Info Modal Changes

• css changes

• recent merges

• Integration_qa test (Integration_qa test #375)

• Test IntegrationQA added

• update test cases

• update test

• update node count assertions

• test changes

• update changes

• modification test

• Code refatctor test cases

• Handle allowedlist issue in test

• test changes

• update test

• test case execution

• test chatbot updates

• test case update file

• added file

---

• fixed status blank issue

• Rendering the file name instead of link for gcs and s3 sources in the info modal

• added the default page size

• Convert is_cancelled value from string to bool

• Issue fixed Processed chunked as 0 when file re-process again

• Youtube timestamps (Youtube timestamps #386)

• Wikipedia source to accept all valid urls

• wikipedia url to support multiple languages

• integrated wiki langauge param for extract api

• Youtube video timestamps

---

• groq llm integration backend (groq llm integration backend #286)

• groq llm integration backend

• groq and description in node properties

• added groq in options

---

• Save Total Pages in DB

• Added total Pages

• file selection when we didn't select anything from Main table

• added the danger icon only for large files

• added the overflow for more files and file selection for all new files

• moved the interface to types

• added the icon accoroding to the source

• set total page for wiki and youtube

• h3 heading

• merge

• updated the alert on basis if total pages

• deleted chunks

• polling based on total pages

• isNan check

• large file based on file size for s3 and gcs

• file source in server side event

• time calculation based on chunks for gcs and s3

---

• fixed the layout issue

• Populate graph schema (Populate graph schema #399)

• crreate new endpoint populate_graph_schema and update the query for getting lables from DB

• Added main.py changes

• conditionally-including-the-gcs-login-flow-in-gcs-as-source (conditionally-including-the-gcs-login-flow-in-gcs-as-source #396)

• added the condtion

• removed llms

• Fixed issue : Remove extra unused param

• get emb only if used (Relationship emb refactor #278)

• Chatbot chunks (Chatbot chunks #402)

• Added file name to the content sent to LLM

• added chunk text in the response

• increased the docs parts sent to llm

• Modified graph query

• mardown rendering

• youtube starttime

• icons

• offset changes

• removed the files due to codespace space issue

---

• Settings modal to support generating the labels from the llm by using text given by user (Settings modal to support generating the labels from the llm by using text given by user #405)

• added the json

• added schema from text dialog

• integrated the schemaAPI

• added the alert

• resize fixes

• fixed css issue

• fixed status blank issue

• Modified response when no docs is retrived (Modified response when no docs is retrived #413)

• Fixed env/docker-compose for local deployments + README doc (Fixed env/docker-compose for local deployments + README doc #410)

• Fixed env/docker-compose for local deployments + README doc

• wrong place for ENV in README

• by default, removed langsmith + fixed knn score string to float

• by default, removed langsmith + fixed knn score string to float

• Fixed strings in docker-compose env

• Added requirements (neo4j 5.15 or later, APOC, and instructions for Neo4j Desktop)

• Missed the TIME_PER_PAGE env, was causing NaN issue in the approx time processing notification. fixed that

• Support for all unstructured files (Support for all unstructured files #401)

• all unstructured files

• responsiveness

• added file type

• added the extensions

• spell mistake

• ppt file changes

---

• Settings modal to support generating the labels from the llm by using text given by user with checkbox (Settings modal to support generating the labels from the llm by using text given by user with checkbox #415)

• added the json

• added schema from text dialog

• integrated the schemaAPI

• added the alert

• resize fixes

• Extract schema using direct ChatOpenAI API and Chain

• integrated the checkbox for schema to text dialog

• Update SettingModal.tsx

---

• gcs file content read via storage client (gcs file content read via storage client #417)

• gcs file content read via storage client

• added the access token the file state

---

• pypdf2 to read files from gcs (pypdf2 to read files from gcs #420)

• 407 remove driver from frontend (407 remove driver from frontend #416)

• removed driver

• removed API

• connecting to database on page refresh

---

• Css handling of info modal and Tooltips (Css handling of info modal and Tooltips #418)

• css change

• toolTips

• Sidebar Tooltips

• copy to clip

• css change

• added image types

• added gcs

• type fix

• docker changes

• speech

• added the toolip for dropzone sources

---

• Fixed retrival bugs (Fixed retrival bugs #421)

• yarn format fixes

• changed the delete message

• added the cancel button

• changed the message on tooltip

• added space

• UI fixes

• tooltip for setting

• updated req

• wikipedia URL input (wikipedia URL input #424)

• accept only wikipedia links

• added wikipedia link

• added wikilink regex

• wikipedia single url only

• changed the alert message

• wording change

• pushed validation state persist error

---

• speech and copy (speech and copy #422)

• speech and copy

• startTime

• added chunk properties

• tooltips

---

• Fixed issue for out of range in KNN API

• solved conflicts

• conflict solved

• Remove logging info from update KNN API

• tooltip changes

• format and lint fixes

• responsiveness changes

• Fixed issue for total pages GCS, S3

• UI polishing (UI polishing #428)

• button and tooltip changes

• checking validation on change

• settings module populate fix

• format fixes

• opening the modal after auth success

• removed the limit

• added the scrobar for dropdowns

• speech state (speech state #426)

• speech state

• Button Details changes

• delete wording change

• Total pages in buckets (Total pages in buckets #431)

• page number NA for buckets

• added N/A for gcs and s3 pages

• total pages for gcs

• remove unwanted logger

---

• removed the max width

• Update FileTable.tsx

• Update the docker file

• Modified prompt (Modified prompt #438)

• Update Dockerfile

• Update Dockerfile

• Update Dockerfile

• rendering Fix

• Local file upload gcs (Local file upload gcs #442)

• Uplaod file to GCS

• GCS local upload fixed issue and delete file from GCS after processing and failed or cancelled

• Add life cycle rule on uploaded bucket

• pdf upload local and gcs bucket check

• delete files when processed and extract changes

---

• Modified chat length and entities used (Modified chat length and entities used #443)

• metadata for unstructured files (metadata for unstructured files #446)

• Unstructured file metadata (Unstructured file metadata #447)

• metadata for unstructured files

• sleep in gcs upload

• updated

• icons added to chunks (icons added to chunks #435)

• icons added to chunks

• info modal icons

---