Skip to content

johnykoudsi/information_retrival

 
 

Repository files navigation

Information Retrieval System

An Information Retrieval System designed to efficiently store, retrieve, and manage information from large datasets.

Table of Contents

Features

  • User Query Suggestions
  • Model Trainning
  • Word Embeddings
  • Pre Processing
  • Indexing
  • Query Processing
  • Matching & Ranking
  • UI/UX
  • SOA

Usage

  • Run main_vsm_build.ipynb to add create the tfidf vectorizer for each dataset
  • Run suggestions_build_tables.ipynb to store the offline suggestions
  • Run embedding_build.ipynb to train the model and to store the offline models
  • Run main_antique_evaluation.ipynb to get antique evaluations with embeddings and without
  • Run main_wiki_evaluation.ipynb to get wikiR evaluations
  • Run uvicorn main:app --port 8700 --reload to run the Templates

Installation

$ python3 -m venv env/python
$ source env/python/bin/activate
$ python3 -m pip install -r requirements.txt

About

No description, website, or topics provided.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

 
 
 

Contributors

Languages

  • Python 43.4%
  • Jupyter Notebook 39.1%
  • HTML 17.5%