-
Notifications
You must be signed in to change notification settings - Fork 26
Comparing changes
Open a pull request
base repository: instructlab/eval
base: v0.4.2
head repository: instructlab/eval
compare: v0.5.0
- 17 commits
- 7 files changed
- 3 contributors
Commits on Dec 10, 2024
-
build(deps): bump pypa/gh-action-pypi-publish from 1.12.2 to 1.12.3
Bumps [pypa/gh-action-pypi-publish](https://github.com/pypa/gh-action-pypi-publish) from 1.12.2 to 1.12.3. - [Release notes](https://github.com/pypa/gh-action-pypi-publish/releases) - [Commits](pypa/gh-action-pypi-publish@15c56db...67339c7) --- updated-dependencies: - dependency-name: pypa/gh-action-pypi-publish dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <support@github.com>
Configuration menu - View commit details
-
Copy full SHA for 81ab1a9 - Browse repository at this point
Copy the full SHA 81ab1a9View commit details
Commits on Dec 16, 2024
-
build(deps): bump hynek/build-and-inspect-python-package
Bumps [hynek/build-and-inspect-python-package](https://github.com/hynek/build-and-inspect-python-package) from 2.10.0 to 2.11.0. - [Release notes](https://github.com/hynek/build-and-inspect-python-package/releases) - [Changelog](https://github.com/hynek/build-and-inspect-python-package/blob/main/CHANGELOG.md) - [Commits](hynek/build-and-inspect-python-package@f01e4d0...14c7e53) --- updated-dependencies: - dependency-name: hynek/build-and-inspect-python-package dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <support@github.com>
Configuration menu - View commit details
-
Copy full SHA for aeb500e - Browse repository at this point
Copy the full SHA aeb500eView commit details
Commits on Dec 17, 2024
-
feat: update release-strategy to include discord
In order to facilliate the addition of Discord as a new chat platform, we will be mirroring all announcements made regarding releases as currently happens on Slack to also take place on Discord. This commit updates our policy document to reflect this change Signed-off-by: Oleg S <97077423+RobotSail@users.noreply.github.com>
Configuration menu - View commit details
-
Copy full SHA for 742e05a - Browse repository at this point
Copy the full SHA 742e05aView commit details -
Merge pull request #196 from instructlab/dependabot/github_actions/py…
…pa/gh-action-pypi-publish-1.12.3 build(deps): bump pypa/gh-action-pypi-publish from 1.12.2 to 1.12.3
Configuration menu - View commit details
-
Copy full SHA for a8bd84d - Browse repository at this point
Copy the full SHA a8bd84dView commit details -
Merge pull request #198 from instructlab/dependabot/github_actions/hy…
…nek/build-and-inspect-python-package-2.11.0 build(deps): bump hynek/build-and-inspect-python-package from 2.10.0 to 2.11.0
Configuration menu - View commit details
-
Copy full SHA for 1aefd04 - Browse repository at this point
Copy the full SHA 1aefd04View commit details -
Merge pull request #199 from RobotSail/add-discord
feat: update release-strategy to include discord
Configuration menu - View commit details
-
Copy full SHA for 0d44bbe - Browse repository at this point
Copy the full SHA 0d44bbeView commit details -
feat: add discord e2e status reporting
Signed-off-by: Oleg S <97077423+RobotSail@users.noreply.github.com>
Configuration menu - View commit details
-
Copy full SHA for bc497ed - Browse repository at this point
Copy the full SHA bc497edView commit details -
Merge pull request #200 from RobotSail/add-discord-e2e
feat: add discord e2e status reporting
Configuration menu - View commit details
-
Copy full SHA for 2e7e405 - Browse repository at this point
Copy the full SHA 2e7e405View commit details
Commits on Jan 8, 2025
-
Signed-off-by: Oleg S <97077423+RobotSail@users.noreply.github.com>
Configuration menu - View commit details
-
Copy full SHA for 3443ffa - Browse repository at this point
Copy the full SHA 3443ffaView commit details -
feat: add ability for ragas to read from a list
We want ragas to read from both a list as well as a list of samples Signed-off-by: Oleg S <97077423+RobotSail@users.noreply.github.com>
Configuration menu - View commit details
-
Copy full SHA for 8568b13 - Browse repository at this point
Copy the full SHA 8568b13View commit details -
feat: add ability for answers to be generated from user questions
When a dataset is provided and is missing the `response` field, we will need to generate these responses. This commit ensures that when this case happens, we will error out when a student model is not configured. Otherwise, we will always generate these responses if the student model exists, regardless if `response` is in the dataframe or not. Signed-off-by: Oleg S <97077423+RobotSail@users.noreply.github.com>
Configuration menu - View commit details
-
Copy full SHA for 58880c3 - Browse repository at this point
Copy the full SHA 58880c3View commit details -
chore: add unit tests for ragas evaluator
Signed-off-by: Oleg S <97077423+RobotSail@users.noreply.github.com>
Configuration menu - View commit details
-
Copy full SHA for 04117dd - Browse repository at this point
Copy the full SHA 04117ddView commit details -
feat: update the Ragas evaluator to have the OpenAI client as somethi…
…ng that gets passed in to __init__ Signed-off-by: Oleg S <97077423+RobotSail@users.noreply.github.com>
Configuration menu - View commit details
-
Copy full SHA for c6b5a70 - Browse repository at this point
Copy the full SHA c6b5a70View commit details -
chore: decouple tests into more atomic units
Signed-off-by: Oleg S <97077423+RobotSail@users.noreply.github.com>
Configuration menu - View commit details
-
Copy full SHA for ab3d168 - Browse repository at this point
Copy the full SHA ab3d168View commit details
Commits on Jan 9, 2025
-
Merge pull request #193 from RobotSail/add-ragas
adds basic ragas eval
Configuration menu - View commit details
-
Copy full SHA for c437ef2 - Browse repository at this point
Copy the full SHA c437ef2View commit details -
chore: update changelog for 0.5.0
Signed-off-by: Oleg S <97077423+RobotSail@users.noreply.github.com>
Configuration menu - View commit details
-
Copy full SHA for ab37b54 - Browse repository at this point
Copy the full SHA ab37b54View commit details -
Merge pull request #208 from RobotSail/update-changelog
chore: update changelog for 0.5.0
Configuration menu - View commit details
-
Copy full SHA for e31d19b - Browse repository at this point
Copy the full SHA e31d19bView commit details
This comparison is taking too long to generate.
Unfortunately it looks like we can’t render this comparison for you right now. It might be too big, or there might be something weird with your repository.
You can try running this command locally to see the comparison on your machine:
git diff v0.4.2...v0.5.0