[PRE REVIEW]: CCS-Lib: A Python package to elicit latent knowledge from LLMs

[editorialbot]

Submitting author: @lauritowal (Walter Laurito)
Repository: https://github.com/EleutherAI/ccs
Branch with paper.md (empty if default branch): joss-paper
Version: 0.1.1
Editor: @mooniean
Reviewers: @praneethd7, @isdanni
Managing EiC: Arfon Smith

Status

Status badge code:

HTML: <a href="https://joss.theoj.org/papers/185369445fa61332ccc687783e11d290"><img src="https://joss.theoj.org/papers/185369445fa61332ccc687783e11d290/status.svg"></a>
Markdown: [![status](https://joss.theoj.org/papers/185369445fa61332ccc687783e11d290/status.svg)](https://joss.theoj.org/papers/185369445fa61332ccc687783e11d290)

Author instructions

Thanks for submitting your paper to JOSS @lauritowal. Currently, there isn't a JOSS editor assigned to your paper.

@lauritowal if you have any suggestions for potential reviewers then please mention them here in this thread (without tagging them with an @). You can search the list of people that have already agreed to review and may be suitable for this submission.

Editor instructions

The JOSS submission bot @editorialbot is here to help you find and assign reviewers and start the main review. To find out what @editorialbot can do for you type:

@editorialbot commands

[editorialbot]

Hello human, I'm @editorialbot, a robot that can help you with some common editorial tasks.

For a list of things I can do to help you, just type:

@editorialbot commands

For example, to regenerate the paper pdf after making changes in the paper's md or bib files, type:

@editorialbot generate pdf

[editorialbot]

Software report:

github.com/AlDanial/cloc v 1.88  T=0.24 s (1563.3 files/s, 232799.8 lines/s)
-------------------------------------------------------------------------------
Language                     files          blank        comment           code
-------------------------------------------------------------------------------
YAML                           304           6840            102          41693
Python                          54           1034           1020           3334
JSON                             4              0              0            408
Markdown                         3             47              0            174
TOML                             1              9             19             55
Dockerfile                       1             10             10             31
TeX                              1              3              0             13
-------------------------------------------------------------------------------
SUM:                           368           7943           1151          45708
-------------------------------------------------------------------------------


gitinspector failed to run statistical information for the repository

[editorialbot]

Wordcount for paper.md is 532

[editorialbot]

Reference check summary (note 'MISSING' DOIs are suggestions that need verification):

OK DOIs

- None

MISSING DOIs

- None

INVALID DOIs

- None

[editorialbot]

👉📄 Download article proof 📄 View article proof on GitHub 📄 👈

[editorialbot]

Five most similar historical JOSS papers:

ELDAM: A Python software for Life Cycle Inventory data management
Submitting author: @GustaveCoste
Handling editor: @sjpfenninger (Retired)
Reviewers: @konstantinstadler, @romainsacchi
Similarity score: 0.7891

PyEI: A Python package for ecological inference
Submitting author: @karink520
Handling editor: @drvinceknight (Active)
Reviewers: @matt-graham, @pmyteh
Similarity score: 0.7871

UralicNLP: An NLP Library for Uralic Languages
Submitting author: @mikahama
Handling editor: @gkthiruvathukal (Active)
Reviewers: @gweissman
Similarity score: 0.7870

elapid: Species distribution modeling tools for Python
Submitting author: @earth-chris
Handling editor: @graciellehigino (Active)
Reviewers: @chrisborges, @gabrieldansereau
Similarity score: 0.7856

pyndl: Naïve Discriminative Learning in Python
Submitting author: @derNarr
Handling editor: @osorensen (Active)
Reviewers: @frankier, @jinhangjiang, @VenkteshV
Similarity score: 0.7848

⚠️ Note to editors: If these papers look like they might be a good match, click through to the review issue for that paper and invite one or more of the authors before considering asking the reviewers of these papers to review again for JOSS.

[arfon]

@lauritowal - thanks for your submission to JOSS. We're currently managing a large backlog of submissions and the editor most appropriate for your area is already rather busy.

For now, we will need to waitlist this paper and process it as the queue reduces. Thanks for your patience!

[lauritowal]

Hi @arfon - thanks. Is it possible to change the repository URL to: https://github.com/EleutherAI/ccs and the title to CCS-Lib: A Python package to elicit latent knowledge from LLMs
Everything else stays the same. Thanks!

[arfon]

@editorialbot set https://github.com/EleutherAI/ccs as repository

[editorialbot]

Done! repository is now https://github.com/EleutherAI/ccs

[arfon]

@editorialbot invite @mooniean as editor

👋 @mooniean – would you be willing to edit this submission for JOSS?

[editorialbot]

Invitation to edit this submission sent!

[mooniean]

@editorialbot assign me as editor

[editorialbot]

Assigned! @mooniean is now the editor

[mooniean]

Hi @lauritowal!

The project repository changed, as well as the name of the package - could you update the paper with these new nomenclatures please? I can only find versions with the previous name!

[lauritowal]

Oh sure - I'll update it and notify you later.
Thanks a lot.
@mooniean

[lauritowal]

@mooniean okay, done now

[mooniean]

@editorialbot generate pdf

[editorialbot]

👉📄 Download article proof 📄 View article proof on GitHub 📄 👈

[editorialbot]

Five most similar historical JOSS papers:

PyEI: A Python package for ecological inference
Submitting author: @karink520
Handling editor: @drvinceknight (Active)
Reviewers: @matt-graham, @pmyteh
Similarity score: 0.7957

ELDAM: A Python software for Life Cycle Inventory data management
Submitting author: @GustaveCoste
Handling editor: @sjpfenninger (Retired)
Reviewers: @konstantinstadler, @romainsacchi
Similarity score: 0.7945

CiteLang: Modeling the Research Software Ecosystem
Submitting author: @vsoch
Handling editor: @faroit (Active)
Reviewers: @gflofst, @rmmilewi
Similarity score: 0.7926

Efficiently Learning Relative Similarity Embeddings with Crowdsourcing
Submitting author: @stsievert
Handling editor: @ajstewartlang (Active)
Reviewers: @hoechenberger, @stain, @jorgedch
Similarity score: 0.7843

Lerche: Generating data file processors in Julia from EBNF grammars
Submitting author: @jamesrhester
Handling editor: @sbenthall (Active)
Reviewers: @ziotom78, @eschnett
Similarity score: 0.7842

⚠️ Note to editors: If these papers look like they might be a good match, click through to the review issue for that paper and invite one or more of the authors before considering asking the reviewers of these papers to review again for JOSS.

[mooniean]

@lauritowal thank you for changing! The name of the paper still doesn't match the one requested here (CCS-Lib: A Python package to elicit later knowledge from LLMs) - fixing that should be ok!

The references are not formatted properly (see here), if you could re-arrange that then all is ok!

Is there any reviewers you'd like to suggest?

[mooniean]

@lauritowal hello! Did you have a chance to fix the minor details I mentioned?

[lauritowal]

Will do it today, sorry about that.

[lauritowal]

@mooniean done :)
I'll post a reviewer suggestion in the next days

[mooniean]

@editorialbot generate pdf

[editorialbot]

👉📄 Download article proof 📄 View article proof on GitHub 📄 👈

[editorialbot]

Five most similar historical JOSS papers:

CiteLang: Modeling the Research Software Ecosystem
Submitting author: @vsoch
Handling editor: @faroit (Active)
Reviewers: @gflofst, @rmmilewi
Similarity score: 0.7901

CCA-Zoo: A collection of Regularized, Deep Learning based, Kernel, and Probabilistic CCA methods in a scikit-learn style framework
Submitting author: @jameschapman19
Handling editor: @emdupre (Active)
Reviewers: @robbisg, @hugorichard, @ejolly
Similarity score: 0.7899

Efficiently Learning Relative Similarity Embeddings with Crowdsourcing
Submitting author: @stsievert
Handling editor: @ajstewartlang (Active)
Reviewers: @hoechenberger, @stain, @jorgedch
Similarity score: 0.7842

Lexedata: A toolbox to edit CLDF lexical datasets
Submitting author: @Anaphory
Handling editor: @Bisaloo (Active)
Reviewers: @xrotwang, @peterdekker
Similarity score: 0.7832

PyEI: A Python package for ecological inference
Submitting author: @karink520
Handling editor: @drvinceknight (Active)
Reviewers: @matt-graham, @pmyteh
Similarity score: 0.7822

⚠️ Note to editors: If these papers look like they might be a good match, click through to the review issue for that paper and invite one or more of the authors before considering asking the reviewers of these papers to review again for JOSS.

[mooniean]

@lauritowal thanks for the changes! Are you happy for me to ask some reviewers in the reviewers list or would you like to suggest some people?

[lauritowal]

@mooniean
patrickraoulphilipp

[mooniean]

Hi 👋 @patrickraoulphilipp @guanqun-yang @jhagerer - would you be available and interested in reviewing this submission for the Journal of Open Source Software?

CCS-Lib: A Python package to elicit latent knowledge from LLMs #6135

Thanks in advance!

[mooniean]

Seems like we didn't get any answers - lets try a different set!

[mooniean]

Hi @harishsiravuri @praneethd7 would you be available and interested in reviewing this submission for the Journal of Open Source Software?

CCS-Lib: A Python package to elicit latent knowledge from LLMs #6135

Thanks in advance!

[mooniean]

Oops I think I didn't tag them and instead put a link. Re-retrial:

Hi @harishsiravuri @praneethd7 would you be available and interested in reviewing this submission for the Journal of Open Source Software?

CCS-Lib: A Python package to elicit latent knowledge from LLMs #6135

Thanks in advance!

[praneethd7]

@mooniean I would be happy to review this work! It looks interesting!

[mooniean]

Excellent, let me see if I find a second reviewer to start the process!

[mooniean]

Hi @isdanni @Saran-nns ! Would you be available and interested in reviewing this submission for the Journal of Open Source Software?

CCS-Lib: A Python package to elicit latent knowledge from LLMs #6135

Thanks in advance!

[isdanni]

Hi @isdanni @Saran-nns ! Would you be available and interested in reviewing this submission for the Journal of Open Source Software?

CCS-Lib: A Python package to elicit latent knowledge from LLMs #6135

Thanks in advance!

Thanks for the invite! I would love to review this

[mooniean]

@editorialbot add @praneethd7 as reviewer

[editorialbot]

@praneethd7 added to the reviewers list!

[mooniean]

@editorialbot add @isdanni as reviewer

[editorialbot]

@isdanni added to the reviewers list!

[mooniean]

@editorialbot start review

[editorialbot]

OK, I've started the review over in #6511.