Skip to content

Riduidel/tech-lab-ingester

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Welcome to tech-lab-ingester 👋

Version Documentation Maintenance License: MIT

A Java project loosely spawned aadarchi which aims to detect notable technologies in a variety of languages

Prerequisites

Usage

Accessing to generated metrics

Metrics can only be accessed as BigQuery dataset. They may appear one day as HuggingFace dataset ...

🤝 Contributing

Building the JAR

Since we mainly use Camel Quarkus, the whole application can be built the usual maven way: mvn install

Data access

Data is stored in a Zenika (the company I'm working in) Google Drive folder.

Developping new features

This project is a "simple" Camel Quarkus project. But it also uses various API credentials (at least GitHub API and Libraries.io API).

So you first need to create in your maven settings a tech-lab-ingester profile grouping these settings:

		<profile>
			<id>settings-tech-lab-ingester</id>
			<properties>
				<tech-lab-ingester.libraries.io.token><!-- Replace with your own Libraries.io token --></tech-lab-ingester.libraries.io.token>
				<tech-lab-ingester.github.token><!-- Replace with your own GitHub API token --></tech-lab-ingester.github.token>
			</properties>
		</profile>

Once this profile is created, developing is as easy as

  1. Load project in your preferred IDE
  2. Run mvn quarkus:dev -Psettings-tech-lab-ingester
  3. Profit (you can even remote debug the application on port 5005)

Do not develop features without having discussed first with the team

We do want to have new features. But we want to have these features discussed first. So if you want to develop a new feature, check first if there is an associated issue (and believe us, it's easy to add new issues on this project). Once the issue exists, you can create your PR and we will try to review it as fast as possible.

Validating data

Most of the data we aggregate here can be seen on other websites. Since we currently focus on git community metrics (stars, forks, and so on), it's a good idea to compare the values we have with the ones available in sites like OSSInsights or daily-stars-explorer

Author

👤 Riduidel & Helielzel

Show your support

Give a ⭐️ if this project helped you!

📝 License

Copyright © 2023 Riduidel & Helielzel.
This project is MIT licensed.


This README was generated with ❤️ by readme-md-generator

About

A helper script for aadarchi allowing us to fetch interesting technologies

Topics

Resources

Stars

Watchers

Forks

Contributors 6