Skip to content

Commit

Permalink
Merge branch 'main' of https://github.com/hykilpikonna/CLAP
Browse files Browse the repository at this point in the history
  • Loading branch information
hykilpikonna committed Oct 14, 2023
2 parents f3d8c31 + 29bf721 commit 8e6c8e6
Show file tree
Hide file tree
Showing 2 changed files with 2 additions and 4 deletions.
6 changes: 2 additions & 4 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -4,7 +4,7 @@

CLAP (Contrastive Language-Audio Pretraining) is a model that learns acoustic concepts from natural language supervision and enables “Zero-Shot” inference. The model has been extensively evaluated in 26 audio downstream tasks achieving SoTA in several of them including classification, retrieval, and captioning.

<img width="832" alt="clap_diagrams" src="https://raw.githubusercontent.com/hykilpikonna/CLAP/main/docs/diagram.png">
<img width="832" alt="clap_diagrams" src="docs/clap2_diagram.png">

## Setup

Expand All @@ -20,8 +20,6 @@ pip install git+https://github.com/microsoft/CLAP.git

## Usage

In `CLAP\src\`:

- Zero-Shot Classification and Retrieval
```python
from msclap import CLAP
Expand Down Expand Up @@ -57,7 +55,7 @@ Take a look at [examples](./examples/) for usage examples.
To run Zero-Shot Classification on the ESC50 dataset try the following:

```bash
> cd src && python zero_shot_classification.py
> cd examples && python zero_shot_classification.py
```
Output (version 2023)
```bash
Expand Down
Binary file added docs/clap2_diagram.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.

0 comments on commit 8e6c8e6

Please sign in to comment.