dataprocessing

Creating an Inverted Index of words occurring in a large set of documents extracted from web pages using Hadoop MapReduce and Google Dataproc

Versatile API that consolidates multiple data providers into one unified interface

Java library of multi-way algorithms.

Data Engineering pipeline.

A Transformation Script for converting from the WINGS Framework to OPMW and PROV frameworks. The Transformation Script utilizes the Jena Framework in Java. Multiple aspects of the WINGS Workflow System are captured in the script including the Expanded Template. Further, it includes several tests for its validity and consistency.

StarThrive Business Manager is a Java-based application designed to manage a portfolio of companies, focusing on financial metrics, profitability, and customer capacity, with an intuitive user interface following object-oriented programming principles

A Java program for analyzing stop-and-frisk data from the NYPD. Features data import, organization, and statistical analysis to compare occurrences during and after policy implementation.

Processes and analyzes near real-time weather data using the Kappa architecture,Apache Kafka,Spark,Cassandra,docker,AWS EC2,spring boot API

Advance IT Test for Summit Institute of Development

(Work in Progress) Real time data from reddit and then apply sentimental analysis. Store the data in Hadoop as well.

Explore essential MapReduce design patterns for big data processing! This repository includes practical implementations of patterns from the "MapReduce Design Patterns" book, complete with examples across summarization, filtering, organization, joins, and more.

Determination of which words occur in a dataset of textbooks along with each word's occurrence count identification with the help of Google Cloud Platform based Dataproc cluster formation.