r.2024.05.20.0

Summary:

Removed koku-cji, updated base image, and made various optimizations for GCP, Azure, and AWS components.

What's Changed

• delete koku-cji by @maskarb in #5107
• chore(image): update base image by @github-actions in #5101
• [COST-5024] Avoid custom JSON parsing for GCP credits field by @samdoran in #5103
• [COST-5015] Azure disk capacity table migration by @myersCody in #5090
• [COST-5015] Retrieve azure disk capacities by @myersCody in #5089
• [COST-5044] Revert AWS HCS CCSP Price Estimate by @cgoodfred in #5114

Full Changelog: r.2024.05.16.0...r.2024.05.20.0

r.2024.05.16.0

Summary:

GCP credits as JSON, distribution of unattributed storage costs, stricter tag matching, OS disk correlation limits, and OCP infra mapping start date override.

What's Changed

• [COST-5024] GCP Return credits field as json in bigquery. by @myersCody in #5100
• [COST-4913] Add ability to distribute unattributed storage cost. by @myersCody in #5102
• [COST-5030] - use stricter tag matching strategies by @lcouzens in #5105
• [COST-5011] Limit OS disk correlation to pod data source rows by @myersCody in #5106
• [COST-5029] - Override start date for OCP infra mapping by @lcouzens in #5108

Full Changelog: r.2024.05.13.0...r.2024.05.16.0

r.2024.05.13.0

Summary:

• Model changes in support of work for node network costs and itemized cloud instance costs
• Updated OCP on Azure correlation to include OS disks costs

What's Changed

• COST-4740 Migrations for OCP Cloud table network columns by @cgoodfred in #5086
• COST-4740 Model updates for OCP on Cloud project daily summary tables by @cgoodfred in #5087
• Add start/end date to "checking infra" logs by @maskarb in #5093
• COST-4930 Migration for AWSCostEntryLineItemSummaryByEC2Compute model by @djnakabaale in #5081
• COST-4930 Add AWS EC2 Compute summary table by @djnakabaale in #5069
• COST-4915 Add unattributed distribution to cost model form by @myersCody in #5072
• Update base image by @github-actions in #5097
• COST-3761 Generate example API data for several days by @samdoran in #5085
• COST-5011 Update correlation to include OS disks. by @myersCody in #5095
• COST-5028 Guard against report_status not existing by @maskarb in #5099

Full Changelog: r.2024.05.09.0...r.2024.05.13.0

r.2024.05.09.0

Summary:

Updated ClowdApp template so that Trino migration works correctly when run from a management command.

What's Changed

• Update base image by @github-actions in #5092
• COST-5007 Add Trino host/port to management CJI by @maskarb in #5094

Full Changelog: r.2024.05.08.0...r.2024.05.09.0

r.2024.05.08.0

Summary:

• New management command for running Trino migrations
• Storing memory, OS, and storage information in support of new features that are in development

What's Changed

• COST-5009 Fix data details (cluster info) timestamps for start of new month by @lcouzens in #5079
• COST-4936 Add product_memory and product_operatingsystem columns to AWS line items tables in Trino by @djnakabaale in #5071
• COST-5007 Move trino migration to a masu management command by @maskarb in #4963
• COST-1665, COST-4866 Support new storage report columns by @maskarb in #5052
• Add inital backstage integration by @lcouzens in #5082
• Fix mkdocs.yml file location by @lcouzens in #5083
• COST-5012 Add cost models to internal sources endpoint by @maskarb in #5084
• COST-3617 Fix GCP end of month summary by @lcouzens in #5080

Full Changelog: r.2024.05.01.1...r.2024.05.08.0

r.2024.05.01.1

Summary:

• Improvements to bigquery queries to create manifests in sequential order

• The correlation logic between Microsoft Azure cloud integrations and OpenShift clusters has been updated to perform a partial match instead of an exact match. This change accommodates any additional prefixes or suffixes added to the Azure resource identifiers when matching with the names of OpenShift's persistent volumes.

  Azure	OpenShift
  az-123-volume_name1	volume_name1
  my-volume-name-OS_disk	my-volume-name

What's Changed

• [COST-4947] Migration to remove account and region from ProviderInfrastructureMap by @cgoodfred in #5077
• Add order by to bigquery queries (for manifest creation datetimes) by @lcouzens in #5074
• [COST-4967] Undo partial matching on node for ocp on azure by @myersCody in #5078

Full Changelog: r.2024.05.01.0...r.2024.05.01.1

r.2024.05.01.0

Summary:

• Development and operational enhancements
• Bug fixes around report status information for monitoring ingest process

What's Changed

• [COST-4967] Update Azure Openshift Correlation to be contains. by @myersCody in #5062
• [COST-4844] Add group by storageclass to OCP volume endpoint. by @myersCody in #5044
• [COST-4975] - Fixing GCP summary status for sources endpoint by @lcouzens in #5064
• [COST-4975] - Fix OCP infra state lookup by @lcouzens in #5070
• [COST-4759] Add all_labels to back populate for ocp on cloud. by @myersCody in #5001
• [COST-4762] Update HCS AWS Estimate pricing by @cgoodfred in #4979
• [COST-3761] API for node network costs returning example data by @samdoran in #5051
• Use multi-arch container images for development by @samdoran in #5045
• [COST-4807] Masu trino query readonly user by @cgoodfred in #5067
• [COST-4914] Update classification to include unattributed by @myersCody in #5073
• prevent running migration CI check if removal label is present by @cgoodfred in #5075
• [COST-4947] Remove account and region fields from ProviderInfrastructureMap by @cgoodfred in #5076

Full Changelog: r.2024.04.25.0...r.2024.05.01.0

r.2024.04.25.0

Summary:

Small bug fix around mid month finalization for AWS causing gaps in cost.

What's Changed

• COST-4871 mount OCI credentials as volume by @maskarb in #5048
• COST-4871 add oci env variables to subs workers by @maskarb in #5050
• COST-4947 Remove references to region and account in ProviderInfrastructureMap by @cgoodfred in #5053
• COST-861 Tokenizing error - skip bad rows when reading csv by @maskarb in #5031
• COST-4873 update ephemeral placeholder credentials by @maskarb in #5059
• COST-4974 Trino Migration to Drop Azure Line Items by @cgoodfred in #5061
• COST-4973 - Fix mid month finalization by @lcouzens in #5060
• Update view.py by @lcouzens in #5063
• update trino and hive images for local dev by @maskarb in #4717

Full Changelog: r.2024.04.18.0...r.2024.04.25.0

r.2024.04.18.0

Summary:

Small bug fix around OCP on Cloud infrastructure matching for correlating OpenShift metrics with Cloud billing costs
Updated dependencies and improving security around credentials

What's Changed

• update dependencies by @maskarb in #5035
• Bump sqlparse from 0.4.4 to 0.5.0 in the pip group across 1 directory by @dependabot in #5043
• Add dev doc about worker unallocated distribution by @myersCody in #5041
• COST-4807 mount aws credentials as volume by @maskarb in #5022
• update sqlparse and gunicorn by @maskarb in #5047
• COST-4947 Remove account and region from ProviderInfrastructureMap filter by @cgoodfred in #5049

Full Changelog: r.2024.04.16.0...r.2024.04.18.0

r.2024.04.16.0

Summary:

• COST-4372 fix inflated PVC capacity count on reports/openshift/volumes/ endpoint by aggregating the max counts
• updates in preparation for a major Trino upgrade

What's Changed

• add smoke_test shell script back by @cgoodfred in #5036
• Mark smoke_test.sh as an executable file by @cgoodfred in #5037
• rename components to trino in smoke_test.sh by @cgoodfred in #5038
• COST-4372 Use Max for volume capacity count by @djnakabaale in #5032
• Update delayed resummary logic for ocp on cloud. by @myersCody in #5027
• COST-4626 strip acct from schema in parquet converter by @maskarb in #5039
• COST-4626 bump parquet converter version by @maskarb in #5040

Full Changelog: r.2024.04.15.0...r.2024.04.16.0