v0.10.0

This is the January 2025 release.

Highlights

• Instrument Processing
  • Improvements to CoDICE processing
    • Updated energy and acquisition time lookup tables for CoDICE-Lo
    • Improved consistency and added missing values for some L1A CDF attributes
    • Applied conversion factor for spin_period values in L1a processing
    • Now calculating epoch values from acq_start_(sub)seconds instead of shcoarse
  • Improvements to GLOWS processing
    • Set up basic processing for L2
    • Updates to obs day
  • Improvements to Hi processing
    • Added direct casting for IntEnums to Numpy
    • Refactored L1c pset in preparation for algorithm development
    • Now populating despun_z for L1c
    • Added hae coordinates for pset bins for L1c
    • Documented that epoch is center of time bin
  • Improvements to HIT processing
    • Added new test data for L1a
    • Added uncertainty fields to count rate dataset for L1a
    • Wrote standard rates algorithm code for L1b
  • Improvements to IDEX processing
    • Added trigger settings to L1a output CDFs
    • Added SPICE data to L1b CDFs
  • Improvements to Lo processing
    • Added decom and organization of L1a spin data
  • Improvements to SWE processing
    • Added in-flight calibration file tracking
    • Now reading in and applying in-flight calibration factors to counts using simulated data
    • Fixes to units and angles
    • Corrected flux units and updates conversion factors
  • Improvements to Ultra processing
    • Added velocity magnitude and extended spin calculations in L1b processing
    • Made velocity revisions
    • Set up extendedspin data structure
    • Set up bin arrays based on matched indices for L2 ENA maps
    • Fixed bug in spatial utils and indexing in rectangular az_el grids
    • Now allowing spacial_utils.build_az_el_grid to return non-reversed elevation values
    • Now returning az/el bin edges along with bin centers in build_az_el_grid utility function
• Infrastructure
  • Improvements to SPICE
    • Added function to transform az/el coordinates between frames
    • Epoch time is now in TDT instead of TDB
    • Fixed bug when importing spicepy as spice
  • Improvements to I-ALiRT processing
    • Reduced processing to a single running container
    • Added idle timeout settings
    • Combined tools NLB and ECS cluster
    • Updated format of dynamodb
    • Rewrote doppler calculation
• Documentation
  • Updates to ancillary file documentation
• Misc
  • Upgraded Poetry version to 2.0
  • Upgraded cdflib version to 1.3.3
  • Upgraded sammi-cdf version to 1.0
  • Created common utility function to convert spin phase to angle in degree or radian
  • Now excluding tests from build

What's Changed

• poetry version pin at 1.8.0 by @maxinelasp in #1251
• 1225 hi l1c refactor l1c pset in preperation for algorithm development by @subagonsouth in #1235
• 1148 hi l1c populate despun z by @subagonsouth in #1253
• IDEX l1b add trigger settings to output CDF by @lacoak21 in #1244
• I-ALiRT - Rewrite doppler calculation by @torimarbois in #1233
• I-ALiRT: CoDICE-Hi Decom by @laspsandoval in #1248
• Document that PSET epoch represents the center time bin in the pointing set by @subagonsouth in #1252
• Ultra l1b velocity revisions by @laspsandoval in #1242
• 1255 spice write function to transform azel coordinates between frames by @subagonsouth in #1256
• Update docstring as requested by Nat in PR by @subagonsouth in #1261
• Glows L2 Base processing by @maxinelasp in #1239
• CoDICE L1a CDF attrs improvements by @bourque in #1268
• CoDICE lo-(n)sw-angluar validation by @bourque in #1254
• Updating Ancillary Documentation by @daralynnrhode in #1269
• ENA Maps: Bin values at indices by @nkerman in #1264
• Update CoDICE-Lo energy table by @bourque in #1273
• CoDICE: conversion factor for spin period by @bourque in #1275
• HIT L1A - add new test data by @vmartinez-cu in #1278
• Ultra l1b - Extendedspin First Pass by @laspsandoval in #1265
• Upgrade dependencies - cdflib and sammi by @vmartinez-cu in #1279
• CoDICE: Calculate epoch values from acq_start_seconds instead of shcoarse by @bourque in #1262
• MNT: Add direct casting for IntEnums to Numpy by @greglucas in #1291
• SWAPI: Pipeline test by @tech3371 in #1238
• HIT L1B standard rates by @vmartinez-cu in #1302
• SWE: Adding ability to read in-flight calibration file by @tech3371 in #1267
• SWE: Flux units and conversion factor correction by @tech3371 in #1303
• HIT L1A - add uncertainty data by @vmartinez-cu in #1307
• Add SPICE data (ephemeris, attitude, and celestial coords) to IDEX l1b CDF by @lacoak21 in #1284
• 1292 bug epoch time should be tdt instead of tdb by @subagonsouth in #1295
• Replace IDEX use of j2000ns_to_j2000s with updated function name by @subagonsouth in #1310
• Ultra l1b - extendedspin data structure by @laspsandoval in #1288
• Move Spatial Utils, Fix bug in Spatial Utils with indexing of the azimuth and elevation grids by @nkerman in #1300
• MNT: Rename spice -> spiceypy by @greglucas in #1312
• Excluding tests from build by @maxinelasp in #1321
• Decom and Organize Lo L1A Spin Data by @sdhoyt in #1308
• Glows obs day updates by @maxinelasp in #1301

Full Changelog: v0.9.0...v0.10.0

v0.9.0

This is the December 2024 release.

Highlights

• Instrument Processing
  • Improvements to CoDICE processing
    • Fixed error in CoDICE-Lo product data array shapes
  • Improvements to Hi processing
    • Updates to SCI_DE packet definition and parsing
    • Updates to histogram tests
    • Updated packet definition XTCE
    • Refactored L1A histogram code
    • Refactored L1A parsing of DE_TOF binary blob
    • Added Hi-90 APIDs to processing
  • Improvements to HIT processing
    • Implemented L0 science packet decommutation
    • Refactored L1A code to use hit_utils for processing housekeeping
    • Created initial L1A count rates and pulse heights CDFs
    • Added validation for L1A count rates data
    • Added validation for L1A pulse height events
    • Added validation for L1A housekeeping data
  • Improvements to IDEX processing
    • Added support for L1B data products
    • Added more telemetry items to L1A data products
  • Improvements to Lo processing
    • Updated XTCE to fix housekeeping enum state bug
    • Updated event parsing to handle counts and passes in binary chunk
    • Implemented L1A DE processing
  • Improvements to MAG processing
    • Fixes to calibration
    • Fixed bug in L1B calibration matrix
  • Improvements to SWAPI processing
    • Updates to packet definition
  • Improvements to SWE processing
    • Fixes to phase space density units
    • Added calculation of electron flux
    • Added calculation of spin phase
  • Improvements to Ultra processing
    • Added velocity magnitudes for L1B
    • Updated species functions for L1B
    • Created rectangular grids for L2 and calculations for solid angle
• Infrastructure
  • Improvements to SPICE
    • Added function to convert MET to UTC
    • Updated instrument boresight vectors
  • Improvements to I-ALiRT processing
    • Added processing of ephemeris
    • Added static assignment of IP address containers running in AWS
    • Added query and download API
    • Added IP range for BlueNet

What's Changed

• Mag calibration fix by @maxinelasp in #1189
• Lo - Change esa_step coord name in L1A attrs by @sdhoyt in #1191
• 855 hi update packet definition xtce by @subagonsouth in #1187
• Lo - Update XTCE to fix HK enum state issue by @sdhoyt in #1201
• Bring in fixes for geometry modules by @nkerman in #1205
• 700 refactor hi l1a histogram by @subagonsouth in #1196
• Add functions to convert from met to ET and UTC by @subagonsouth in #1210
• Bring over l2_utils from large PR by @nkerman in #1206
• I-ALiRT - Process Ephemeris by @torimarbois in #1174
• Lo - Event Parsing Segmented Packets with Validation by @sdhoyt in #1212
• Add new telemetry items by @lacoak21 in #1203
• 1030 hi l1a update sci de packet definition and parsing by @subagonsouth in #1216
• SWE: Review and correct phase space density units by @tech3371 in #1223
• Add source file to header of xtce in excel_to_xtce by @subagonsouth in #1222
• Lo - Create L1A Direct Event CDFs by @sdhoyt in #1221
• Update instrument boresight vectors by @subagonsouth in #1226
• HIT L1A - add science data processing by @vmartinez-cu in #1218
• SWE: calculate flux by @tech3371 in #1227
• IDEX L1b science data processing by @lacoak21 in #1224
• SWE: spin phase by @tech3371 in #1229
• Refactor parse_direct_events to remove for loop by @subagonsouth in #1220
• MNT/TST: Update SWAPI packet definition and tests by @greglucas in #803
• I-ALiRT: CoDICE- Lo by @laspsandoval in #1215
• Ultra l1b: velocity magnitude and updated species functions by @laspsandoval in #1228
• HIT L1 - Initial validation of housekeeping data by @vmartinez-cu in #1231
• Fix data array shapes for CoDICE-Lo products by @bourque in #1234

Full Changelog: v0.8.0...v0.9.0

v0.8.0

This is the November 2024 release.

Highlights

• Instrument Processing
  • Improvements/additions to CoDICE processing
    • Added capability to process multiple APID from a single input L0 file
    • Updated input test L0 file and updated affected unit tests
  • Improvements to IDEX processing
    • Updated list of valid data levels to include new L2a, L2b, and L2c data levels
    • Updated input L0 test data and made corresponding changes to unit tests
  • Improvements to Ultra processing
    • Updates to L1c pset
    • Updates to annotated events
  • Improvements to GLOWS processing
    • Set up initial L2 processing pipeline
  • Improvements to MAG processing
    • Various cleanup for L1b CDFs
  • Improvements to Lo processing
    • Added support for segmentated packet DE fields that are spread across packets
    • Updated XTCE DE to group count and passing fields into the binary chunk
  • Improvements to Hi processing
    • Implemented support for L1b spin phase
    • Implemented support for L1b computation of nominal bin
    • Added calibration product coordinate to pset for L1c
  • Improvements to SWE processing
    • Implemented L1b science validation
  • Improvements to HIT processing
    • Implemented L1b housekeeping CDFs
    • Updated dependencies for L1b and L2
    • Implemented subcommutation for L0 sector rates
    • Implemented data decompression for L0
• Infrastructure
  • Designed how SPICE dependency is tracked and associated
  • Removed old database tables for spin and repointing
  • Updated upload API lambda to accept spin and repointing csv data
  • Added spin and repointing data extension to SPICE checks
  • Updated EFS write lambda's event rule according to new SDC-maintained spin and repoint files
  • Updated EFS write lambda to move ingested files to correct EFS path
  • Added rest of IMAP kernels to the SPICE directory mapping
  • Now grouping lambda code into its functional group
• Documentation updates
  • Updated all-contributors section of the README
  • Updated release procedure workflow documentation
  • Updated list of expected descriptors for CoDICE and IDEX
  • Updated 'Getting Started' documentation
  • Added documentation for Work Management Process
  • Updated CDF documentation
• Misc
  • Implemented cartesian to spherical function for SPICE
  • Now using the SAMMI library for CDF attribute management
  • Excel to XTCE now can handle hexadecimal state values
  • Added placeholder function for esa_step -> esa_energy_step
• Bug Fixes
  • Fixed bug in CoDICE L1a pipeline in which byte_count was not being used to determine length of data to decompress
  • Fixed bug in MAG decompression
  • Fixed Lo case 4 decompression table
  • Fixed psycopg error in pytests

What's Changed

• Add function for getting basis vectors from spice by @subagonsouth in #1080
• Small bug fix - MAG by @maxinelasp in #1114
• SWE: L1B validation data by @tech3371 in #1103
• 865 hi l1b spin phase by @subagonsouth in #1102
• HIT L1B - Create housekeeping dataset by @vmartinez-cu in #1118
• All Contributors cleanup by @bourque in #1120
• Add calculation of Hi L1B nominal_bin by @subagonsouth in #1116
• Add some more notes to the release workflow by @bourque in #1121
• Small update CoDICE and IDEX data product naming conventions by @bourque in #1123
• Updates to MAG L1B to scale based on compression flags by @maxinelasp in #1117
• update link on documentation by @lacoak21 in #1137
• Adding poetry installation steps to docs by @nkerman in #1138
• Switch to using SAMMI for CDF attribute management by @maxinelasp in #1122
• Documentation for Work Management Process by @sdhoyt in #879
• Fixing mag tests, removing temp fix by @maxinelasp in #1142
• Removed Lo DE segmented packet string commas by @sdhoyt in #1144
• Add placeholder function for converting from esa_step to esa_energy_step by @subagonsouth in #1146
• HIT L0 - subcommutate sector rates by @vmartinez-cu in #1160
• Update Lo XTCE for Segmented DE packets by @sdhoyt in #1079
• Update Lo DE Case Decoder for 4, 1 TOF2 by @sdhoyt in #1167
• Add Hexadecimal state handling to excel_to_xtce by @sdhoyt in #1159
• Process multiple CoDICE APIDs per input file by @bourque in #1162
• Glows L2 initial setup by @maxinelasp in #1156
• Mag l1b CDF cleanup by @maxinelasp in #1173
• Ultra: Updates to annotated events and create l1b cdf. by @laspsandoval in #1081
• Ultra l1c pset updates by @laspsandoval in #1059
• Use byte_count to determine size of CoDICE data arrays by @bourque in #1171
• CDF document updates by @tech3371 in #1179
• HIT L0 - data decompression by @vmartinez-cu in #1169
• HIT L1A - update hskp processing to use hit utils functions by @vmartinez-cu in #1176
• Update IDEX l1a and l0 tests to work with new l0 test data by @lacoak21 in #1181
• 1147 hi l1c add calibration product coordinate to pset by @subagonsouth in #1172

New Contributors

• @lacoak21 made their first contribution in #1137
• @nkerman made their first contribution in #1138

Full Changelog: v0.7.0...v0.8.0

v0.7.0

This is the October 2024 release.

Highlights

• Instrument Processing
  • Improvements/additions to Ultra processing
    • Added spatial and energy binning equations
    • Added exposure time and pointing frame
    • Updates to L1B Annotated products
    • Added PSET spacecraft frame and PSET helio frame exposure times
  • Improvements/additions to I-ALiRT processing
    • Added HIT algorithm lambda
  • Improvements/additions to GLOWS processing
    • Updates to L1 CDF dtypes for outputs
    • Added validation tests for L1A and L1B
  • Improvements/additions to MAG processing
    • L1a compression fixes
  • Improvements/additions to Lo processing
    • Updates to use new decompression tables
    • Refactored L1A direct event data class to function
    • Combined segmented direct event data
  • Improvements/additions to Hi processing
    • Added extract method for generating L1B direct event DataArrays
    • Populated L1A direct event CDF files with simulated data
    • Updated product definition esa_step
    • Added computation of coincidence_type and time deltas
    • Added computation of HAE lattitude and longitude
    • Added logical source parser
  • Improvements/additions to SWAPI processing
    • Updated tests and validation data
    • Updated L2 variable names
    • Updated L1 to store other housekeeping variables
  • Improvements/additions to SWE processing
    • Improvements to L1 for L2 processing
    • Added L1A CDF validation
    • Added conversion of counts to phase space density
  • Improvements/additions to HIT processing
    • Refactored L1A processing to use packet_file_to_datasets function
• Misc
  • Updated Poetry documentation
  • Added SPICE directory to the documentation build
  • Added epoch to J2000 seconds function for SPICE
  • Added calculations for instrument spin phase for SPICE
  • Upgraded cdflib version
  • Upgraded space_packet_parser version
• Bug Fixes
  • Fixed bug in I-ALiRT deployment
  • Fixed bug in Lo unpacking scheme definitions
  • Fixed bug in SPICE function get_spacecraft_spin_phase to avoid returning all nans

What's Changed

• calculate partical energy by @tech3371 in #888
• SWAPI new test and validation data by @tech3371 in #891
• 913 hi l1a update hi product definition esa step by @subagonsouth in #914
• Fixed Lo DE unpacking scheme by @sdhoyt in #901
• GLOWS L1 updates by @maxinelasp in #889
• 795 spice instrument pointing at specified time by @subagonsouth in #903
• Fixing histogram attrs missed in last PR by @maxinelasp in #919
• Add Ultra spatial and energy binning equations. by @laspsandoval in #875
• Ultra: Added exposure time for pointing frame by @laspsandoval in #967
• Updated New Lo Histogram Decompression Tables by @sdhoyt in #921
• Extract L1B DE function for better code modularization by @subagonsouth in #969
• SWE L1 Improvement to store acquisition time of each measurement by @tech3371 in #881
• Lo L1A Direct Event Refactor by @sdhoyt in #971
• MNT: Cdflib update by @tech3371 in #991
• 864 hi l1b compute coincidence type and time deltas by @subagonsouth in #995
• Add spice module to documentation by @subagonsouth in #1010
• 1020 bug get spacecraft spin phase always returns nans by @subagonsouth in #1021
• 1019 calculate instrument spin phase by @subagonsouth in #1022
• Update to poetry docs by @laspsandoval in #1027
• Add function to convert j2000ns to j2000s by @subagonsouth in #1025
• Poetry doc update by @maxinelasp in #1029
• MNT: space_packet_parser update by @tech3371 in #1007
• 867 hi l1b compute hae latitude and longitude by @subagonsouth in #1032
• swe l1a validation data by @tech3371 in #1038
• SWAPI: rename CDF variable names to match algorithm document by @tech3371 in #1042
• Lo DE Segmented Packets by @sdhoyt in #1016
• bugfix for apid by @laspsandoval in #1046
• Ultra PSET Spacecraft Frame + PSET Helio Frame Exposure Times by @laspsandoval in #1040
• Update Ultra l1b Annotated by @laspsandoval in #989
• 1026 logical source parser by @subagonsouth in #1044
• SWE: calculate phase space density by @tech3371 in #1041
• SWAPI: Add additional support data to SWAPI L1 and L2 by @tech3371 in #1043
• 1045 hi l1b modify processing workflow to use xarraydatasetupdate by @subagonsouth in #1054
• Mag l1a compression fixes by @maxinelasp in #1082

Full Changelog: v0.6.0...v0.7.0

v0.6.0

This is the September 2024 release.

Highlights

• Data Access API
  • Added query parameter for returning files acquired in the last 24 hours
  • Added query parameter for returning files acquired in the last N days
  • Improvements to query parameter validation and handling of 502 errors
• Instrument Processing
  • Improvements to CoDICE L1a processing:
    • Updated XTCE definitions
    • Implemented packet_file_to_datasets utility function, which simplifies the processing algorithm
    • Added support for variable length packet data
    • Updating CDF variable/attribute names to match expected nomenclature
    • Added CATDESC and FIELDNAM descriptions to housekeeping attributes
    • Refactored pipeline to allow more flexibility in configuring the 18 different CoDICE L1 data products
      *Improvements to Ultra L1 processing:
    • Created Ultra pset energy bins
    • Implemented Ultra L1b extended ssd and extended energy
    • Implemented Ultra particle velocity and SSD TOF
  • Improvements to Lo L1 processing:
    • Improved Lo L1a CDF YAML definitions
    • Updated Lo L1a dependency table
    • Refactoredpacket_file_to_datasets utility function for Lo
  • Improvements to HIT L1 processing:
    • Now using raw L0 file as a single L1a dependency
    • Implemented unpacing of L0 count rates data
    • Now grouping L0 science packets into science frames
    • Updated L0 dependency table
    • Updated sci deom to group packets and parse count rates
    • Implemented packet_file_to_datasets utility function, which simplifies the processing algorithm
  • Improvements to SWAPI processing:
    • Updated L1 quality flags to work with numpy v2.0+
    • Added quality flags for L2 algorithm
    • Added L3 levels to list of valid levels
    • Updated L2 dependency table
  • Improvements to SPICE:
    • Implemented SPICE frame transform function
    • Implemented some SPICE infrastructure and simple geometry function
    • Implemented spin phase query utils function, using spin start and spin rate data
    • Implemented spin phase calculation using spin data
  • IDEX L1 processing is now split into L1a and L1b processing/data products
  • Implemented packet_file_to_datasets utility function for SWE pipeline, which simplifies the processing algorithm
  • Implemented HIT CCSDS packet generation for I-ALiRT
  • Updated met_to_j200ns function
  • Updated Hi product definition to have int64 data instead of uint64
• Misc
  • Refactored AWS infrastructure to use Constructs instead of Stacks
  • Initial set of materials sent to web team for initial implementation of SDC website
  • Added AWS stack to handle website deployment
  • Added Parents attribute to CDF files that indicate parent data products used to create the CDF
  • Added wheel build to releases
  • Improvements to dependency management documentation
  • Now ignoring conftest.py modules in Codecov reporting
  • Updated EventBridge rule to match new SPICE path in data bucket
• Bug Fixes
  • Fixed bug in SPICE batch job
  • Fixed bug that was causing SPICE to fail loading metakernel
  • Fixed unique constraint for dependency table

Full Changelog

• Ultra l1b extended ssd by @laspsandoval in #789
• Docstring, variable name, formatting updates to IDEX L1 by @bourque in #799
• Implement packet_file_to_datasets function for CoDICE by @bourque in #804
• SPICE geometry enums and IMAP state function by @subagonsouth in #791
• SWAPI Quality Flag by @tech3371 in #805
• WIP/MNT: Update SWE to use packet_file_to_datasets by @greglucas in #802
• Create Ultra pset energy bins by @laspsandoval in #811
• Added new tof test data by @laspsandoval in #807
• Define spatial bins for pset by @laspsandoval in #819
• 689 spice update met to j2000ns by @subagonsouth in #818
• Ultra particle velocity and SSD TOF by @laspsandoval in #823
• Updated CoDICE XTCE files from imap_xtce tool by @bourque in #812
• Updated various CDF attributes/variable names to match expected nomenclature by @bourque in #813
• Added FIELDNAMs, LABLAXISs, and CATDESCs for housekeeping attributes by @bourque in #816
• I-ALiRT - Test decom for HIT CCSDS by @laspsandoval in #757
• Pointing frame updates by @laspsandoval in #814
• BUG - fix for time kernels not loading during imap_cli command by @tech3371 in #838
• Separate IDEX L1 into L1a and L1b by @bourque in #831
• ignore conftest.py files in codecov by @subagonsouth in #846
• Dependency documention by @maxinelasp in #844
• Test infrastructure for external spice kernels by @subagonsouth in #842
• Ultra l1b extended energy by @laspsandoval in #825
• Added SWAPI L3 levels to the list of valid levels by @tech3371 in #847
• Lo L1A Histogram packet_to_dataset() Refactor and CDF Creation by @sdhoyt in #788
• Spin data and Spin Phase function setup by @tech3371 in #824
• FIX: Update SWAPI quality flags to work with numpy 2+ by @greglucas in #848
• Mag l1a compression by @maxinelasp in #801
• HIT sci decom - group packets & parse count rates by @vmartinez-cu in #815
• Lo L1A CDF YAML Reorganization by @sdhoyt in #860
• ENH: Add "Parents" global attribute to datasets by @greglucas in #858
• MNT: Change default to use raw value in packet_file_to_datasets by @greglucas in #857
• Refactor hit_l1a.py to use packet_file_to_datasets function by @vmartinez-cu in #828
• CoDICE data product organization refactor by @bourque in #826
• Convert all hi instances of uint64 CDF variables to int64 by @subagonsouth in #872
• Spin phase calculation using spin data by @tech3371 in #852
• 859 spice frame transform function by @subagonsouth in #861
• Ultra l1b species + start to l1b Annotated by @laspsandoval in #851
• REL/CI: Add wheel build to release by @greglucas in #878

Full Changelog: v0.5.0...v0.6.0

v0.5.0

This is the release for August 2024.

Highlights

• Data Access API:
  • Improvements to documentation and help menus
  • Added demo/examples notebook
  • Added support for filename query parameter
  • Fixed output table formatting
• Instrument Processing:
  • Updated CDF attributes for GLOWS
  • Implemented proper unpacking and restructuring of data arrays for CoDICE-lo L1 data products
  • Updates to global CDF attribute metadata
  • Added Ultra Extended L1B lookup tables
  • Added support for bitflags
  • Added DynamoDB Streams for i-alirt packet ingest
  • Added Ultra pulse height calculations
  • Added SPICE pointing frame
  • Updated Lo and HIT XTCE files
  • Created module structure for SPICE functions
  • Added SPICE kernel furnishing decorator
  • Migrated HI L1a housekeeping to use CdfAttributeManager
  • Refactored epoch attributes
  • Initial implementation of SWAPI L2 alrgorithm
• Misc
  • Various updates to XTCE generator script and improved documentation
  • Enabled support for numpy v2.x
• Bug Fixes:
  • Fixed bug in --end-date query parameter in Data Access API
  • Fixed bug in mypy pre-commit check so now it covers entire code base

Full Changelog

• Refactor epoch attrs by @tech3371 in #718
• MNT/ENH: Add FLOAT and FILL options for spreadsheet dataType by @greglucas in #701
• MNT: Minimize the datatypes created from space_packet_parser by @greglucas in #723
• SWAPI l2 Implementation - counts to rate by @tech3371 in #721
• Bitflags by @laspsandoval in #694
• MNT: Change to a period separator for XTCE definitions by @greglucas in #726
• Ultra Extended L1b Lookup tables by @laspsandoval in #696
• Data access api by @anamanica in #720
• packet_file_to_datasets NOT in IDEX by @anamanica in #743
• Define the imap_processing spice structure by @subagonsouth in #733
• Mypy Update by @daralynnrhode in #731
• Glows cdf attrs update by @anamanica in #725
• MNT: Update global CDF attribute metadata by @greglucas in #747
• Ultra Extended L1b Front Coordinates by @laspsandoval in #730
• Calculate the path length for L1b Ultra by @laspsandoval in #749
• Various CoDICE L1 Updates by @bourque in #711
• 728 spice kernel furnishing decorator by @subagonsouth in #734
• Updated/Combined Lo XTCE by @sdhoyt in #754
• MNT: Enable numpy 2+ installs by @greglucas in #758
• DOC: Update XTCE generator documentation by @greglucas in #766
• Pointing frame code by @laspsandoval in #759
• Add Pulse Height Calculations by @laspsandoval in #750
• MNT: Add useful error message when packet to datasets fails by @greglucas in #763
• FIX: Avoid loss of precision when casting in packet loading (alternative) by @greglucas in #786
• CoDICE L1 decompression and unpacking data updates by @bourque in #762
• ENH: Add Enumeration states to XTCE parser by @greglucas in #783

Full Changelog: v0.4.0...v0.5.0

v0.4.0

This is the release for (most of) June and July 2024, and the latest release before the IMAP Science Team Meeting on Aug 1st and 2nd.

Highlights

• Added automated numpydoc and mypy checks to pre-commit hooks
• Added end-date parameter to CLI script
• Added unit tests for new CDF attribute management code
• All instrument pipelines now return xarray dataset objects instead of filepaths
• Added support for array-like time conversions
• Updated IDEX, HI, HIT, MAG, and SWAPI pipelines to use new yaml-based CDF attribute management code instead of dataclasses
• Updated citation info
• Updates to XTCE generator script to be instrument-agnostic
• Added generalized dataset creation code

Full Changelog

• FIX: CLI help needs to be strings not tuples by @greglucas in #646
• Add numpydoc Pre-Commit Hook Pt.1 by @daralynnrhode in #639
• Add numpydoc pre-commit For SWE Pt.2 by @daralynnrhode in #641
• Add numpydoc Pre-Commit For Ultra & Swapi Pt.3 by @daralynnrhode in #643
• Add numpydoc Pre-Commit For Mag & Lo Pt.4 by @daralynnrhode in #644
• Add numpydoc Pre-Commit For ialirt & idex Pt.5 by @daralynnrhode in #647
• Add numpydoc Pre-Commit for Hit & Hi Pt.6 by @daralynnrhode in #651
• Add numpydoc Pre-Commit For Codice & Glows Pt.7 Last One by @daralynnrhode in #652
• Updates to the CLI to include the end-date by @maxinelasp in #658
• Cdf attribute tests by @anamanica in #637
• Git workflow update by @anamanica in #650
• MNT: Pass around dataset objects rather than file objects by @greglucas in #657
• ENH/MNT: Allow array-like time conversion by @greglucas in #653
• CDF Updates by @anamanica in #660
• 662 migrate remaining hi products to use cdfattributemanager by @subagonsouth in #671
• Fix Hi L1b test marked xfail by @subagonsouth in #681
• Update Management of HIT CDF Attributes to use YAMLs by @vmartinez-cu in #679
• XTCE generator scripts by @anamanica in #680
• Update citation info by @vmartinez-cu in #685
• Add mypy Pre-commit Hook and Fix tools folder Pt.1 by @daralynnrhode in #659
• Add mypy Pre-Commit Hook for files Pt.2 by @daralynnrhode in #661
• Add mypy Pre-Commit For Ultra Pt.3 by @daralynnrhode in #663
• Add mypy Pre-Commit for swe Pt.4 by @daralynnrhode in #666
• Add mypy Pre-commit for swapi Pt.5 by @daralynnrhode in #667
• Add Pre-Commit For mag Pt.6 by @daralynnrhode in #668
• Add mypy Pre-Commit For Lo Pt.7 by @daralynnrhode in #669
• Add mypy Pre-Commit For idex Pt.8 by @daralynnrhode in #670
• Add mypy Pre-Commit For ialirt Pt.9 by @daralynnrhode in #673
• Add mypy Pre-Commit For hi & hit Pt.10 by @daralynnrhode in #674
• Add mypy Pre-Commit for glows Pt.11 by @daralynnrhode in #676
• Add mypy Pre-Commit for codice Pt.12 Last by @daralynnrhode in #678
• Improvement to correct numpy update issue for Ultra by @laspsandoval in #638
• CLI Type cleanup/standardization by @maxinelasp in #692
• Glows l1a cdf by @anamanica in #688
• Update IDEX by @anamanica in #695
• Xtce combined by @greglucas in #654
• ENH/MNT: Add a common initial dataset creation routine by @greglucas in #687
• 682 imap hi use imapcdfattributes instead of cdfattributemanager by @subagonsouth in #684
• Hi test data and fixture refactor by @subagonsouth in #709
• switched SWAPI CDF attrs to use YAML by @tech3371 in #704
• Move MAG L1A to CDF attribute manager by @maxinelasp in #693
• Cleanup CDF dataclass by @tech3371 in #714

Full Changelog: v0.3.0...v0.4.0

v0.3.0

This release includes updates to be used for the IMAP SDC Software Integration Test 3 (SIT-3). More information can be found in this galaxy page.

Highlights

• Updated L0 decommutation algorithms for Ultra
• Added unit tests for L0 decommutation for SWAPI
• Added support for L1 processing for several instruments (CoDICE, GLOWS, Hi, HIT, Lo, MAG, SWAPI, SWE, Ultra)
• Moved to YAML-based solution for defining CDF attributes
• Updated cli script for triggering processing for instruments; added support for all instruments; added functionality for downloading dependencies and uploading produced files; added support for descriptor field.
• Updated logging in L1 processing pipelines to use module-level logs
• Updated documentation, particularly for CDF attributes and file structure, file naming conventions, and git/GitHub workflow
• Added SPICE examples for Annotated Events
• Added codespell pre-commit check
• Updated version of space_packet_parser and cdflib
• Added citation information and DOI badge for citing the repository
• Added load_cdf helper function
• Added launch_time parameter to cdf.utils.calc_start_time to allow instruments to define their own launch time.
• Now defining repository version dynamically

Full Changelog

• FIX: Make sphinx-contrib an optional dependency only needed for doc builds by @greglucas in #333
• FIX: Make sure configurations are synced between packages by @greglucas in #336
• Fix IDEX and HIT tests by @bourque in #337
• Update ruff by @sdhoyt in #343
• HIT housekeeping data class by @sdhoyt in #342
• Limit bitstring usage by @greglucas in #344
• Mag cdf by @maxinelasp in #340
• Updated naming conventions for CoDICE by @bourque in #334
• CLI updates by @maxinelasp in #341
• MAG CDF updates by @maxinelasp in #349
• L0 Decom Ultra by @laspsandoval in #347
• Create l1a cdfs for auxiliary data packet by @laspsandoval in #352
• Update CoDICE CDFs to use datetime64 for EPOCH by @bourque in #354
• Swapi decom tests by @tech3371 in #355
• update to docker example that is used to build batch job image by @tech3371 in #351
• Update decom for APID 881 due to changes in packet definitions by @laspsandoval in #353
• SWE updates to be compliant with new cdflib releases by @tech3371 in #357
• Lo SciDE data class fix - multiple DEs in a packet by @sdhoyt in #339
• Updated naming and data product versioning conventions by @bourque in #358
• MNT: Cleanup extra file in repository by @greglucas in #361
• TST: Rely on temp directory for test file cleanup by @greglucas in #360
• MNT: Use module-level logger by @greglucas in #362
• Added l1a cdf generation for all apids by @laspsandoval in #356
• MNT: Update file naming convention via imap-data-access upgrade by @greglucas in #363
• Remove Warnings by @laspsandoval in #365
• MNT: Rename Epoch to epoch lowercased for variable names by @greglucas in #366
• hi direct event l1a processing by @tech3371 in #364
• Docs for calibration files by @maxinelasp in #367
• Initial CoDICE L1a algorithm for lo-sw-species data by @bourque in #300
• Update documentation variable names by @greglucas in #368
• Various fixes and improvements to CDF documentation by @bourque in #372
• Updating mag CDF generation to match new filenames by @maxinelasp in #370
• IMAP-Hi L1A DE after Discussion with Paul by @tech3371 in #369
• MNT: Change default display_type to be no_plot by @greglucas in #375
• MNT: Remove unused extra test file by @greglucas in #373
• TST: Move codice xfail into a separate test by @greglucas in #377
• MNT: Change IDEX packet definition to be formatted like others by @greglucas in #376
• MNT: Remove unused extra file by @greglucas in #381
• MNT: Add codespell and fix spelling mistakes found by @greglucas in #382
• Update IMAP-Hi DE CDF attrs by @tech3371 in #374
• Process IMAP-Hi Housekeeping data and create CDF file by @tech3371 in #371
• TST: Avoid xarray.dims deprecation by @greglucas in #380
• MNT: Remove directory option from write_cdf by @greglucas in #379
• [pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in #385
• Add vmartinez-cu to contributors by @allcontributors in #388
• docs: add subagonsouth as a contributor for review by @allcontributors in #389
• Added SPICE examples for Annotated Events by @laspsandoval in #386
• Update space_packet_parser version by @tech3371 in #387
• Add citation file by @vmartinez-cu in #392
• Mag l1a processing by @maxinelasp in #384
• CDF attrs bug fix by @tech3371 in #393
• CoDICE L1a for lo-sw-species-counts (and improvements to housekeeping) by @bourque in #391
• Small updates to the CDF documentation by @bryan-harter in #383
• Added SWAPI science data CDF attribute by @tech3371 in #394
• added SWAPI housekeeping processing and CDF attrs by @tech3371 in #398
• Science Direct Event Decompression Re-write by @sdhoyt in #397
• Initial Lo L1A Science DE CDF by @sdhoyt in #396
• Lo Star Sensor and Science Counts data classes with bit decompression by @sdhoyt in #319
• MAG L1A CDF by @maxinelasp in #395
• Remove individual IMAP-Hi packet definition xtce files by @subagonsouth in #401
• Updating CLI to fix MAG by @maxinelasp in #404
• CoDICE lo-sw-species-counts test data by @bourque in #402
• CoDICE L1a lo-nsw-species-counts by @bourque in #530
• updates to utils create_dateset function by @tech3371 in #532
• Updates based on SPDF feedback by @tech337...

v0.3.0rc2

Full Changelog

• Lo L1C CDF Creation for SIT-3 by @sdhoyt in #614
• Data version fixes for SWE and SWAPI by @tech3371 in #621
• Data_version updates to Lo L1C by @tech3371 in #625
• Glows l1b cdf by @maxinelasp in #618
• REL/CI: Add build job dependency to release process by @greglucas in #624
• Inital Codice L1b processing (for SIT-3) by @bourque in #622
• HIT Data_version fixes by @tech3371 in #626
• Mag L1B/L1C cdf by @maxinelasp in #623
• 609 imap hi l1c pointing set cdf by @subagonsouth in #627
• 630 final hi updates for sit 3 by @subagonsouth in #631
• Glows fixes for deployment by @maxinelasp in #629
• Add to SIT-3 data variables by @laspsandoval in #589
• Add Hi sensor name to imap_hi_l1b_hk products by @subagonsouth in #633
• Mag hotfix by @maxinelasp in #636
• Update for Sit 3 by @laspsandoval in #635
• MNT: Add optional descriptor field to the cli by @greglucas in #640

Full Changelog: v0.3.0rc1...v0.3.0rc2

v0.3.0rc1

Full Changelog

• v0.2.0 Release by @bourque in #332
• FIX: Make sphinx-contrib an optional dependency only needed for doc builds by @greglucas in #333
• FIX: Make sure configurations are synced between packages by @greglucas in #336
• Fix IDEX and HIT tests by @bourque in #337
• Update ruff by @sdhoyt in #343
• HIT housekeeping data class by @sdhoyt in #342
• Limit bitstring usage by @greglucas in #344
• Mag cdf by @maxinelasp in #340
• Updated naming conventions for CoDICE by @bourque in #334
• CLI updates by @maxinelasp in #341
• MAG CDF updates by @maxinelasp in #349
• L0 Decom Ultra by @laspsandoval in #347
• Create l1a cdfs for auxiliary data packet by @laspsandoval in #352
• Update CoDICE CDFs to use datetime64 for EPOCH by @bourque in #354
• Swapi decom tests by @tech3371 in #355
• update to docker example that is used to build batch job image by @tech3371 in #351
• Update decom for APID 881 due to changes in packet definitions by @laspsandoval in #353
• SWE updates to be compliant with new cdflib releases by @tech3371 in #357
• Lo SciDE data class fix - multiple DEs in a packet by @sdhoyt in #339
• Updated naming and data product versioning conventions by @bourque in #358
• MNT: Cleanup extra file in repository by @greglucas in #361
• TST: Rely on temp directory for test file cleanup by @greglucas in #360
• MNT: Use module-level logger by @greglucas in #362
• Added l1a cdf generation for all apids by @laspsandoval in #356
• MNT: Update file naming convention via imap-data-access upgrade by @greglucas in #363
• Remove Warnings by @laspsandoval in #365
• MNT: Rename Epoch to epoch lowercased for variable names by @greglucas in #366
• hi direct event l1a processing by @tech3371 in #364
• Docs for calibration files by @maxinelasp in #367
• Initial CoDICE L1a algorithm for lo-sw-species data by @bourque in #300
• Update documentation variable names by @greglucas in #368
• Various fixes and improvements to CDF documentation by @bourque in #372
• Updating mag CDF generation to match new filenames by @maxinelasp in #370
• IMAP-Hi L1A DE after Discussion with Paul by @tech3371 in #369
• MNT: Change default display_type to be no_plot by @greglucas in #375
• MNT: Remove unused extra test file by @greglucas in #373
• TST: Move codice xfail into a separate test by @greglucas in #377
• MNT: Change IDEX packet definition to be formatted like others by @greglucas in #376
• MNT: Remove unused extra file by @greglucas in #381
• MNT: Add codespell and fix spelling mistakes found by @greglucas in #382
• Update IMAP-Hi DE CDF attrs by @tech3371 in #374
• Process IMAP-Hi Housekeeping data and create CDF file by @tech3371 in #371
• TST: Avoid xarray.dims deprecation by @greglucas in #380
• MNT: Remove directory option from write_cdf by @greglucas in #379
• [pre-commit.ci] pre-commit autoupdate by @pre-commit-ci in #385
• Add vmartinez-cu to contributors by @allcontributors in #388
• docs: add subagonsouth as a contributor for review by @allcontributors in #389
• Added SPICE examples for Annotated Events by @laspsandoval in #386
• Update space_packet_parser version by @tech3371 in #387
• Add citation file by @vmartinez-cu in #392
• Mag l1a processing by @maxinelasp in #384
• CDF attrs bug fix by @tech3371 in #393
• CoDICE L1a for lo-sw-species-counts (and improvements to housekeeping) by @bourque in #391
• Small updates to the CDF documentation by @bryan-harter in #383
• Added SWAPI science data CDF attribute by @tech3371 in #394
• added SWAPI housekeeping processing and CDF attrs by @tech3371 in #398
• Science Direct Event Decompression Re-write by @sdhoyt in #397
• Initial Lo L1A Science DE CDF by @sdhoyt in #396
• Lo Star Sensor and Science Counts data classes with bit decompression by @sdhoyt in #319
• MAG L1A CDF by @maxinelasp in #395
• Remove individual IMAP-Hi packet definition xtce files by @subagonsouth in #401
• Updating CLI to fix MAG by @maxinelasp in #404
• CoDICE lo-sw-species-counts test data by @bourque in #402
• CoDICE L1a lo-nsw-species-counts by @bourque in #530
• updates to utils create_dateset function by @tech3371 in #532
• Updates based on SPDF feedback by @tech3371 in #533
• IMAP Hi Histogram L1A processing by @subagonsouth in #535
• Initial Codice L1A validation tests by @bourque in #534
• docs: add subagonsouth and vmartinez-cu as a contributor for code by @allcontributors in #539
• MNT: Remove direct bitstring dependency by @greglucas in #536
• CoDICE L1a lo-sw-priority-counts by @bourque in #540
• CoDICE L1a Lo Sunward Angular Counts by @bourque in #544
• load_cdf helper function by @bourque in #537
• Cleaning up some L1A hist CDF issues found when reviewing output file by @subagonsouth in #547
• CI: Add codecov upload token by @greglu...