v0.23.0

What's Changed

• Test: modify single model evaluation scores by @ashrafchowdury in #1981
• Test: upload testset as csv by @ashrafchowdury in #1979
• fix(backend): fix json evaluator description by @mmabrouk in #1990
• Test: save single model testset by @ashrafchowdury in #1980
• fix(tool): AGE-612 fix dependencies with langchain_community by @mmabrouk in #1992
• AGE 486 - SDK v3 - Configuration management with Pydantic by @mmabrouk in #1961
• feat(backend): AGE-276 and AGE-471 Improves LLM-as-a-judge reliability by @mmabrouk in #1938
• Bump versions by @github-actions in #1996

Full Changelog: v0.22.0...v0.23.0

v0.22.0

What's Changed

• [Enhancement]: Alembic migration strategy by @aybruhm in #1884
• [Feature]: Implemented Rag Faithfulness and Context Relevancy Evaluators by @aybruhm in #1924
• feat(sdk): Adding inline trace information by @jp-agenta in #1929
• [PoC-1] Display optional inline intermediate outputs in Playground by @bekossy in #1930
• refactor(sdk): Move trace processing from SDK to BE by @jp-agenta in #1934
• [FE][PoC-1]:Display optional inline intermediate outputs in Playground by @bekossy in #1937
• [PoC-1][Frontend]: UI fixes by @bekossy in #1947
• [Enhancement]: Add cloud support for alembic by @aybruhm in #1939
• Feat: add Alembic support for database migration by @aybruhm in #1856
• Rag with poetry lock from main by @aakrem in #1960
• Rag with new poetry lock by @aakrem in #1958
• fix(sdk): AGE-504 Fix Tracing with LiteLLM by @jp-agenta in #1963
• fix (workflow): replace deprecated 'docker-compose' command in test workflow by @aybruhm in #1967
• [Enhancement] Enable automatic migration for first-time users and optionally for returning users by @aybruhm in #1966
• fix: docker-compose.gh.yml by @mrunhap in #1971
• docs: add mrunhap as a contributor for bug, and infra by @allcontributors in #1973
• fix(tool): AGE-512 fix issues in postgres container by @aakrem in #1968
• Improve description Json diff eval and fix minor issue by @mmabrouk in #1941
• Fix: human evaluation tests syntax error by @ashrafchowdury in #1953
• [feature] : inline traces, internals, RAG evaluators by @jp-agenta in #1940
• Bump versions by @github-actions in #1984

New Contributors

• @mrunhap made their first contribution in #1971

Full Changelog: v0.19.9...v0.22.0

v0.19.9

What's Changed

• Minor UI improvement at human eval by @mmabrouk in #1943
• Syncing releases pyproject and git

Full Changelog: v0.19.8...v0.19.9

v0.19.8

What's Changed

• fix(sdk): AGE-480 Update litellm callbacks with new SDK by @jp-agenta in #1945
• Bump versions by @github-actions in #1946

Full Changelog: v0.19.7...v0.19.8

v0.19.7

What's Changed

• Fix: Ensure CLI catches and reports errors by @aakrem in #1928
• merge main into fix-image-deletion-in-cloud by @aakrem in #1933
• chore(deps): bump importlib-metadata from 8.0.0 to 8.2.0 in /agenta-cli by @dependabot in #1931
• Fix image deletion in cloud by @aakrem in #1932
• Bump versions by @github-actions in #1936

Full Changelog: v0.19.6...v0.19.7

v0.19.6

What's Changed

• Dependabot prs 16 07 by @aakrem in #1899
• chore(deps): bump fastapi from 0.111.0 to 0.111.1 in /agenta-cli by @dependabot in #1886
• chore(deps): bump cachetools from 5.3.3 to 5.4.0 in /agenta-cli by @dependabot in #1898
• Feat: save variant tabs position by @ashrafchowdury in #1895
• Fix/webhooks errors and docs by @jp-agenta in #1900
• [Enhancement]: Logs are not fetched in cloud by @bekossy in #1706
• Fix: outdated sentry version by @ashrafchowdury in #1903
• Refactor: TestsetTable component code has been refactored by @ashrafchowdury in #1892
• Fix: resolved the title warning issue by @ashrafchowdury in #1904
• feat(app): startweb standalone on any docker by @mmabrouk in #1912
• [Feature]: Implement JSON Diff Evaluator by @aybruhm in #1910
• [Bug Fix]: evaluation fails when using gh docker container by @aybruhm in #1917
• [Bug Fix]: age-374 by @aybruhm in #1918
• Dependabot prs 23 07 by @aakrem in #1922
• chore(deps-dev): bump pytest from 8.2.2 to 8.3.1 in /agenta-cli by @dependabot in #1919
• chore(deps-dev): bump setuptools from 70.3.0 to 71.1.0 in /agenta-cli by @dependabot in #1920
• Fixes several issues with the SDK related to observability by @jp-agenta in #1896
• Fix: warnings during build process by @ashrafchowdury in #1908
• [Feature]: Implement Semantic Similariity Match Evaluator by @aybruhm in #1921
• [Bug Fix]: resolve get_config exception: badly formed hexadecimal UUID string by @aybruhm in #1905
• [Cleanup]: remove useless env by @aakrem in #1648
• Bump versions by @github-actions in #1923

Full Changelog: v0.19.5...v0.19.6

v0.19.5

What's Changed

• [Bug] TypeError: e.localeCompare is not a function by @bekossy in #1878
• [Bug Fix]: Updating template table in cloud-dev fails by @aybruhm in #1869
• Refactor: removed duplicate StyleProps types by @ashrafchowdury in #1891
• fix(frontend): Test creation in single model eval does not work in table view by @bekossy in #1885
• Bump versions by @github-actions in #1894

Full Changelog: v0.19.4...v0.19.5

v0.19.4

What's Changed

• Dependabot prs by @aakrem in #1877
• build(deps): bump importlib-metadata from 7.2.0 to 8.0.0 in /agenta-cli by @dependabot in #1815
• build(deps): bump pymongo from 4.7.3 to 4.8.0 in /agenta-cli by @dependabot in #1819
• build(deps): bump pydantic from 2.7.4 to 2.8.0 in /agenta-cli by @dependabot in #1832
• build(deps): bump pydantic from 2.7.4 to 2.8.2 in /agenta-cli by @dependabot in #1843
• chore(deps-dev): bump setuptools from 70.2.0 to 70.3.0 in /agenta-cli by @dependabot in #1868
• Filter out evaluations with null testsets by @aakrem in #1880
• Bump versions by @github-actions in #1881

Full Changelog: v0.19.3...v0.19.4

v0.19.3

What's Changed

• docker compose cleanup from mongo post-migration by @aakrem in #1871
• [Hot fix]: ignore permission to check human evaluation access in the case object_db is None by @aybruhm in #1875
• Bump versions by @github-actions in #1876

Full Changelog: v0.19.2...v0.19.3

v0.19.2

What's Changed

• refactor(backend): remove code for deleting db and tables by @aakrem in #1864
• [Bug fix]: Human evaluation UI breaks when a variant has been deleted by @aybruhm in #1872
• Bump versions by @github-actions in #1874

Full Changelog: v0.19.1...v0.19.2