Sprint 58

Due by May 26, 2022 (Review on May 26)

Sprint Goals:

Load v1.4.1 ES indices into prod ES environment and update ES Aliases (Drew) > Sprint 59

v1.4.2 updates (Will) > Sprint 59

• PSRA Canada aggregations and attach geometries

• Fix to add_data.sh remove xz repos

• cast loss period to double

• Publish FGP records (Joost) - waiting on Charles

  • Send revised data files and MXD's to FGP (Will, Phil)
    • Physical Exposure
    • Social Fabric - Will sent on Feb 11
    • PSRA - waiting on v1.4.1 > sprint 58
    • DSRA 1KM, 5KM, 25KM
  • Review revised FGP data layers (Murray, Phil, Tiegan, Joost, Will)
    • Physical Exposure
    • Social Fabric
    • PSRA
    • DSRA
  • Prep legend files (MXD's) for FGP data See issue
    • Physical Exposure
    • Social Fabric
    • PSRA
    • DSRA (Carol)
  • Update API endpoints to prod in FGP metadata - Joost
  • Update API endpoints in Downloads Repo - Damon done

• Security Documentation (Joost) > Sprint 58/59

  • FGP CSV document

• RiskProfiler QA/QC script (Drew) > Sprint 58 [x] Inquire about internal quality controllers [ ] Integrate Lighthouse check > Sprint 59 [ ] Investigate WCAG Compliance > Sprint 59 [ ] Link-checker in gh-actions > Sprint 59

• Move riskprofiler-cms code,issues,content etc. to riskprofiler (Anthony) > backlog Hard deadline before October release

• DSRA Dashboards in Kibana (Drew, Damon)

  • onboard finance Canada - waiting for prod environment - Drew
  • create index alias in Kibana Prod - Drew/Damon
  • create user accounts for Finance Canada - Arash message when emailing not to upload protected data Kibana
  • load Kibana saved objects - Arash

• Beta.Riskprofiler.ca in Prod (Anthony, Arash) Done

• Review remaining translations (Drew, Joost, Phil) > sprint 59

• GPKG generation via GitHub Actions for release assets opendrr-api (Damon, Anthony) > sprint 59

  • Blocked by diskspace limits on GitHub Actions - Stack need to be optimized for disk usage - Anthony

• Use of XZ-compressed repos XZ- or Zstd-compressed release assets to reduce Git LFS data storage and bandwidth usage (Anthony) > sprint 59

• Fully automate riskprofiler static website generation in Docker Wordpress instance (Anthony) 90% done > sprint 58

  • March 30 version - deployed on beta.riskprofiler.ca
  • May 11 version - deployed
  • Document deployment process > sprint 59

• Generate layer tiles (Joost, Damon, Anthony) - Done with SAUID, all but one CSD done, will work on hex bin layers next.

  • redo 5km shakemap as "hexgrid" replace "hexbin" webmercator & 4326 (Damon, Anthony) > sprint 58

  • add PSRA P/T aggregation levels blocked by no geometry (Damon, Anthony, Will) > sprint 59 * Create Vector/Image Tile of aggregated contents/structural/non-structural for 500yr loss for each P/T

  • Generate missing Val-des-bois tiles all zoom > 4 northern assets (Damon) > sprint 58

  • PSRA at CSD & SAUID aggregation waiting on Phil E. re:preference (Damon, Anthony) > sprint 58

  • Automate vector tiles for DSRA scenarios (Damon, Anthony) > sprint 59

  • Automate vector tile backup on github (Anthony) > sprint 59

• Create 3857 Hexgrid geometries (Will) > backlog

• Create 900913 Hexgrid geometries (Will) > sprint 59

• Document on GitHub EC2 deployment procedure for Openquake runs - AWS CLI (Anthony) > sprint 58

Demos:

GeoServer REST automation (Drew) RiskProfiler Beta Deployment - New H7 updates into github pages (Anthony) > sprint 58 Update on GPKG (Damon) > sprint 58

---

Scrum Notes:

Tuesday May 17

Damon

• vector tyling
• PSRA github action updated to match folder structure in repo - still blocked by github filesize
• investigating val-des-bois cutoff

Will

• started on new views for canada wide agg
• Conversation with Phil/Tiegan on FGP PSRA visualization - AAL metrics or EQ Risk index ranking
• Starting on 3857 hexgrids

Anthony

• Documentation - experimenting with uploading vector tiles on github - Deploying spot instances
• Looking into geopackage generation - examining add_data.sh for optimization

Joost

• Added issue to riskprofiler

Drew

• Script to create ES alias
• Generated RiskProfiler issues with Tiegan

Thursday May 19

Damon

• Continue vector tiling 1km/5km
• Found issue with hex clipping, due to scenario extents
• Suggest changing extents to CSD

Anthony

• Helping Jeremy setting up AWS spot instances
• Continue learning tiling/geoserver
• Troubleshooting inconsistencies between h7 riskprofiler and beta riskprofiler

Will

• Continue working on canada-wide agg (50,100,250,500,1000,2500 year) in new branches, will need to pull/rebase? new updates from drew's PR on opendrr-master for versioning ES index
• Continue work on psra FGP prep
• Didn't start on 3857 yet

Tuesday May 24

Anthony

• Working with Damon on GeoServer Tile generation - backend
• finished most tile sets except psra indicators
• starting new spot instance
• issue with spot instances starting on their own

Damon

• Vector tiles generation 5k 1km scenario done SAUID

Joost

• working on FGP/CCMEO
• Will start on security documentation
• Updates on H7

Will

• v1.4.2 changes - done in branch. Waiting on PR in master
• Bug in hexgrid geoms fixed
• finished mocking up PSRA layers in FGP - meeting with Phil/Tiegan - will demo
• Microzonation work
• Will start on testing 3857 grid

Drew

• Meet with Phil re:translation
• working with arash on index mapping bug
• demo to finance canada tomorrow