r.2023.12.18.0

Summary:

• Added a new API to allowing adding/removing OpenShift projects from the Platform group
• Add Azure processing to subscription management
• Improved data types used for processing

What's Changed

• [COST-4230] - add cluster-id to basic auth log message by @maskarb in #4827
• [COST-3794] Add new API for managing custom cost groups by @samdoran in #4401
• [COST-3814] Add Azure source processing to subs flow by @cgoodfred in #4831
• [COST-3814] Add metered to the azure sources extras by @cgoodfred in #4834
• [COST-3814] Check instanceid column instead of instancename by @cgoodfred in #4835
• [COST-3814] Azure subs processing start 2 days prior to source creation by @cgoodfred in #4836
• [COST-4367] Update HCS AWS SQL by @cgoodfred in #4812
• [COST-4360] Fix default dtypes mapping for OCI by @myersCody in #4830

Full Changelog: r.2023.12.11.0...r.2023.12.18.0

r.2023.12.11.0

Summary:

This release adds improvements around data types handling in trino, logging updates and other bug fixes.

What's Changed

• Temporary disable upload of results to Report portal by @esebesto in #4814
• [COST-4334] - Adding dtypes for AWS by @lcouzens in #4816
• [COST-4360] - Adding dtypes for OCI by @lcouzens in #4819
• [COST-4230] - log warning when operator payload is set to basic auth by @maskarb in #4820
• chore(image): update base image by @github-actions in #4782
• [COST-4489] add uniqueness constraint on the ProviderInfraMap table by @maskarb in #4823
• [COST-4335] - Adding dtypes for OCP by @lcouzens in #4815
• [COST-4333] - Adding dtypes for Azure by @lcouzens in #4817
• [COST-4333] Fix OCP on Azure matching by resource-ids by @esebesto in #4824
• [COST-4481] use StringDtype(storage="pyarrow") by @maskarb in #4826

Full Changelog: r.2023.12.04.0...r.2023.12.11.0

r.2023.12.04.0

Summary:

The release contained documentation updates, package updates, model changes, and a few minor bug fixes.

What's Changed

• [COST-4444] update processing to point to new model. by @myersCody in #4801
• COST-4444: Fix regression related to startswith filter. by @myersCody in #4808
• Update openapi.json by @lcouzens in #4804
• Make ROS OCP API available in koku openapi.json by @srdeotarse in #4799
• [SWATCH-1779] - Enable result upload to Report portal for daily eph job by @esebesto in #4807
• [COST-4445] GCP delete regression by @maskarb in #4810
• Bump cryptography from 41.0.4 to 41.0.6 by @dependabot in #4809
• update dependencies by @maskarb in #4811
• [COST-4367] Add product_vcpu to aws_line_items_daily by @cgoodfred in #4774

Full Changelog: r.2023.11.27.0...r.2023.12.04.0

r.2023.11.27.0

Summary:

• Update data models for RU cost groups (feature)
• Add debug vars for ROS processing
• Remove deprecated old OCP local flow for local development
• Remove all Masu DB accessor code
• Minor Script/QE test tweaks

What's Changed

• [COST-4385] cleanup local OCP ingest by @maskarb in #4760
• [COST-4445] ReportDBAccessorBase cleanup by @maskarb in #4796
• Script to check postgres/trino data integrity by @lcouzens in #4770
• [COST-4460] remove DateAccessor in favor of DateHelper by @maskarb in #4793
• [COST-4464] Add ROS debug var to enable ROS processing in eph by @cgoodfred in #4797
• [COST-4445] delete KokuDBAccess by @maskarb in #4798
• [COST-4443] Update data model for cost groups. by @myersCody in #4800
• Update functions.sh by @lcouzens in #4802
• Update functions.sh by @lcouzens in #4803

Full Changelog: r.2023.11.21.0...r.2023.11.27.0

r.2023.11.21.0

Summary:

Summary:

• Minor OCP processor volume labels fix for enablement
• Add multi broker support for Kafka brokers
• Add support for service account token source creation and ingress payloads
• Multiple clean up prs to remove old unnecessary DB accessors
• Minor documentation around Trino migrations

What's Changed

• [COST-4442] - Pass JOB_NAME and BUILD_NUMBER to IQE CJI's by @esebesto in #4784
• fix OCP post processor volume labels by @maskarb in #4733
• [COST-3962] Add docs on Trino Migrations and validate dropped tables are external tables. by @cgoodfred in #4508
• [COST-4210] more ProviderDBAccessor removal by @maskarb in #4780
• [COST-4446] - suppress missing cluster-id alert by @maskarb in #4788
• [COST-4452] catch and log foreign key violation as warning by @maskarb in #4790
• [COST-4430] Support service account source creation and payload ingress by @chambridge in #4785
• [COST-4445] unlink ReportManifestDBAccessor from KokuDBAccess by @maskarb in #4787
• [COST-4210] remove ProviderDBAccessor by @maskarb in #4792
• [COST-4445] simplify OCPReportDBAccessor by @maskarb in #4786
• [COST-4463] MSK: multi-broker support by @maskarb in #4795

Full Changelog: r.2023.11.16.1...r.2023.11.21.0

r.2023.11.16.1

Summary:

Bugfix for special tag case sensitivity for OCP on Azure processing.

What's Changed

• [COST-4429] Add missing lower to azure tags for OCP on Azure by @cgoodfred in #4783

Full Changelog: r.2023.11.16.0...r.2023.11.16.1

r.2023.11.16.0

Summary:

Various bug fixes and preparation for service-account support.

What's Changed

• Add instrumentation to start_manifest_processing by @samdoran in #4764
• Applying string (str) data type when reading CSV (OCI) by @bacciotti in #4779
• [COST-4210] - remove ProviderDBAccessor for notifications and utils by @maskarb in #4766
• Applying string (str) data type when reading CSV (GCP) by @bacciotti in #4777
• [COST-4430] Handle service account in API identity header by @chambridge in #4776
• Revert [COST-4002] remove empty-status as requirement to create provider (#4575) by @maskarb in #4781

Full Changelog: r.2023.11.15.0...r.2023.11.16.0

r.2023.11.15.0

Summary:

Mostly bug fixes, tech-debt, and dependency updates.

What's Changed

• Bump pyarrow from 13.0.0 to 14.0.1 by @dependabot in #4769
• [COST-4429] Case insensitive special case tag matching by @cgoodfred in #4773
• add debug log level example to the .env.example by @maskarb in #4771
• [COST-4210] remove ProviderDBAccessor from Masu APIs by @maskarb in #4767
• [COST-4375] delete IngressReportDBAccessor by @maskarb in #4765
• [COST-4364] Applying string (str) data type when reading CSV (OCP) by @bacciotti in #4775
• [COST-4346] stop download attempt on CostUsageReportStatus.DoesNotExist by @maskarb in #4778

Full Changelog: r.2023.11.09.0...r.2023.11.15.0

r.2023.11.09.0

Summary:

• Support case insensitive user-access queries
• temporarily stop filtering CCSP data for AWS
• populate and use OCPPodSummaryByNodeP table for queries
• Use a datatype of string for reading CSVs so pandas doesn't infer types incorrectly

What's Changed

• [COST-4223] - Applying string (str) type when reading CSV and its tests by @bacciotti in #4757
• [COST-4363] - Applying str data type to the reading CSV to avoid leading zeros bug. by @bacciotti in #4762
• [COST-4405] - support case insensitive queries for user-access endpoints by @maskarb in #4763
• add remote attach option for celery pods and auto-reload celery by @maskarb in #4732
• [COST-4028] - data migration by @maskarb in #4768
• [COST-4366] - Remove AWS CCSP data from HCS Filter by @cgoodfred in #4751
• [COST-4028] - utilize OCPPodSummaryByNodeP in query handler by @maskarb in #4571

Full Changelog: r.2023.11.02.0...r.2023.11.09.0

r.2023.11.02.0

Summary:

• Update libraries
• Revert and change related to OCP billing and add some additional logging
• Recommend using Rancher Desktop for local development
• Other improvements for local development

What's Changed

• Bump urllib3 from 1.26.17 to 1.26.18 by @dependabot in #4743
• Deprecation documentation by @myersCody in #4752
• chore(image): update base image by @github-actions in #4723
• [COST-4378] update README to add Rancher Desktop by @maskarb in #4755
• chore(image): update base image by @github-actions in #4756
• [COST-4215] utilize kafka msg handler to ingest local OCP by @maskarb in #4700
• [COST-4377] Remove deprecated tag models. by @myersCody in #4605
• Revert #4735 by @lcouzens in #4758
• Add schema context to a couple of log messages by @lcouzens in #4759

Full Changelog: r.2023.10.31.0...r.2023.11.02.0