V2.1.7

Service Changes

Service Name	Type of Change	Old Value	New Value
ana_coastal_inundation_extent_noaa	Add Feature Service
ana_coastal_inundation_extent_hi_noaa	Add Feature Service
ana_coastal_inundation_extent_prvi_noaa	Add Feature Service
ana_high_flow_magnitude_prvi	Add Feature Service
mrf_nbm_10day_max_coastal_inundation_extent_noaa	Add Feature Service
mrf_gfs_10day_max_coastal_inundation_extent_noaa	Add Feature Service
srf_18hr_max_coastal_inundation_extent_noaa	Add Feature Service
srf_48hr_max_coastal_inundation_extent_hi_noaa	Add Feature Service
srf_48hr_max_coastal_inundation_extent_prvi_noaa	Add Feature Service
srf_48hr_max_high_flow_magnitude_prvi	Add Feature Service
static_stage_based_catfim_noaa	Layer Name Change	Stage-Based CatFIM: Major Threshold	Stage-Based CatFIM: Record Threshold

New Services

• mrf_nbm_5day_max_high_flow_magnitude
• mrf_nbm_5day_max_inundation_extent
• ana_inundation_extent_prvi
• srf_48hr_max_inundation_extent_prvi
• srf_15hr_high_water_arrival_time_alaska_noaa
• srf_15hr_max_high_flow_magnitude_alaska_noaa
• srf_15hr_rapid_onset_flooding_alaska_noaa
• mrf_gfs_10day_max_high_flow_magnitude_ak_noaa
• mrf_nbm_10day_max_high_flow_magnitude_ak_noaa
• mrf_nbm_10day_rapid_onset_flooding_ak_noaa
• mrf_gfs_10day_rapid_onset_flooding_ak_noaa
• mrf_gfs_10day_high_water_arrival_time_ak_noaa
• mrf_nbm_10day_high_water_arrival_time_ak_noaa
• srf_15hr_rate_of_change_ak_noaa
• static_ras2fim_boundaries_noaa
• static_nwm_flowlines_ak_noaa

General Updates

• Expanded public FIM services to the new 30% CONUS domain.
• Updates to Lambda Functions to support the new FIM V4.5.2.11.
• Updating RDS Bastion scripts to allow for restoring databases at the table level instead of only at the schema level, better naming schema for database dumps.
• Update Linux Image Builder Pipeline to remove the newer Rsyslog component that was failing, updated Rsyslog configs to work with the version that is built into the base AMI.
• Updated Ingest EC2 user-data to work with the new Linux AMI's Docker version.
• Increased the Cache FIM resolution to from 1ft to 0.25ft.

Full Changelog: v2.1.6.1...v2.1.7

V2.1.6.1

Service Changes

Service Name	Type of Change	Old Value	New Value
mrf_gfs_10day_water_management_noaa	Field Value (reservoir_type)	"USGS"	"RFC"
mrf_gfs_10day_water_management_noaa	Field Value (reservoir_type)	"RFC"	"USGS"
srf_18hr_water_management_noaa	Field Value (reservoir_type)	"USGS"	"RFC"
srf_18hr_water_management_noaa	Field Value (reservoir_type)	"RFC"	"USGS"
ana_past_72hr_accum_precip_hi_noaa	Description Update	N/A	N/A
ana_past_72hr_accum_precip_prvi_noaa	Description Update	N/A	N/A
srf_48hr_accum_precip_hi_noaa	Description Update	N/A	N/A
srf_48hr_accum_precip_prvi_noaa	Description Update	N/A	N/A

General Updates

• Updated EC2 Linux image builder to add logrotate configurations for the container logs. Additional configuration has also been put in for sending the same container logs to Cloudwatch via cloudwatch-agent.
• Various changes to fix the coastal service's pipeline workflows.
• Update Puerto Rico Hawaii QPE service descriptions.
• Remove high_water_threshold filter from RFC FIM processing.
• Switched the 'USGS' and 'RFC' labels in the reservoir_type attribute for the water management services.

Full Changelog: v2.1.6...v2.1.6.1

Release V2.1.6

Service Changes

Service Name	Type of Change	Old Value	New Value
rfc_max_forecast	Field Value (HEFS Link)	"https://water.weather.gov/ahps2/rfc/" + LID + ".shortrange.hefs.png"	"https://water.noaa.gov/resources/probabilistic/short_term/" + LID + ".shortrange.hefs.png"
rfc_max_forecast	Field Value (Hydrograph Link)	"https://water.weather.gov/resources/hydrographs/" + LID + "_hg.png"	"https://water.noaa.gov/resources/hydrographs/" + LID + "_hg.png"

New Services

mrf_gfs_10day_water_management_noaa:

• Depicts the source of reservoir forecasts from outputs of the operational National Water Model (NWM) medium-range forecast.
• Reservoirs can have forecasts obtained from 1 of 4 sources:

• Level Pool
• RFC Forecast
• USACE-Persistence
• USGS-Persistence

• Reservoirs that have RFC, USACE, or USGS forecasts use those in the NWM when available; otherwise, the NWM will default to using the Level Pool method.

• Updated every 6 hours

srf_18hr_water_management_noaa:

• Depicts the source of reservoir forecasts from output of the operational National Water Model (NWM) short-range forecast.
• Reservoirs can have forecasts obtained from 1 of 4 sources:

• Level Pool
• RFC Forecast
• USACE-Persistence
• USGS-Persistence

• Reservoirs that have RFC, USACE, or USGS forecasts use those in the NWM when available; otherwise, the NWM will default to using the Level Pool method.

• Updated hourly

ana_high_flow_magnitude_ak_noaa:

• Depicts the magnitude of the National Water Model (NWM) streamflow forecast where the NWM is signaling high water.

• This service is derived from the analysis and assimilation configuration of the NWM for Alaska. Shown are reaches with flow at or above high water thresholds.
• Reaches are colored by the annual exceedance probability (AEP) of their current flow.
• High water thresholds (regionally varied) and AEPs were derived using the 43-year NWM v3 reanalysis simulation.

• Updated hourly

General Updates

• FIM Caching: New method of storing previously generated FIM to be reused in future processes.

• This increases the overall efficiency and cost-savings
• FIM values being rounded up to the next foot instead of rounded up to the nearest half foot

• Updating CONUS AEP values to the latest NWM 3.0 values.

• High Water thresholds that were set to 0 are changed to 0.35 cfs or the minimum flow threshold for the NWM above 0
• Manually adjusted Cluster 9 from 1.1 to 1.0
• Manually adjusted Cluster 7 from 3.1 to 2.5
• Manually adjusted Cluster 1 from 2.9 to 2.2

• New Schism FIM workflow to increase the efficiency and cost-savings of processing the Coastal services.

• Upon completion of this build coastal services will return to service

• Updated EC2 Image Builder Pipelines for the EGIS AMIs that includes the latest patches, allows for better monitoring, and adopt the new approved "golden" base AMIs.

New Contributors

• @DrixTabligan-NOAA made their first contribution in #705
• @EdisonOrellana-NOAA made their first contribution in #702

Full Changelog: v2.1.5...v2.1.6

v2.1.5

Release V2.1.5

General Changes:

• Added GitHub Issue Template for requesting new features and feature enhancements. Commit
• Added Git Action to validate Terraform code that is updated in a given PR. Commit
• Added utility script for fulfilling schism data requests Source/Visualizations/aws_loosa/utils/schism_data_request.py. PR
• Added pagination to viz cache archiving script. PR

General Processing Pipelines:

• Converted remaining pipeline processing from Viz EC2 machine to Step/Lambda Functions. PR 1 PR 2 PR 3
• Improved monitoring and transparency for troubleshooting issues.

RFC Max Forecast Service:

• Now processed completely in viz-pipeline using DB queries against WRDS location and rfcfcst databaes (as opposed to the entry point being the viz-wrds-api-handler Lambda that pings the WRDS API). PR
• Updated to include flow-only gages.
• Field renames:
  • usgs_sitecode to usgs_site_code
  • initial_stage to initial_value
  • initial_stage_timestep to initial_value_timestep
  • min_stage to min_value
  • min_stage_timestep to min_value_timestep
  • max_stage to max_value
  • max_stage_timestep to max_value_timestep
  • record_forecast to is_record_forecast
• New fields:
  • initial_flood_value
  • initial_flood_value_timestep
  • initial_flood_status

RnR Processing:

• Now based directly on RFC Max Forecast service table (publish.rfc_max_forecast). PR
• NRLDB rating curves now used in addition to USGS rating curves to convert stage forecasts to flow.

RFC 5-Day Max Streamflow Service:

• Bugfix: Flood status at gage sites now completely in-sync with RFC Max Forecast service. PR
• New field: rating_curve_source

ANA Anomaly Service:

• Bugfix: Solved issue where processing pipelines were running out of storage space during large weather events. PR

High Water Probability Services:

• Bugfix: Fixed calculation that was suppose to be returning a percentage but was instead returning the decimal form. PR

---

Full Changelog: v2.1.4...v2.1.5

V2.1.4

What's Changed

• Removed Public Access for CONUS RFC Inundation by @CoreyKrewson-NOAA in #546
• Implements coastal fim processing by tile, not huc by @shawncrawley in #539
• Update Public Status for MRF GFS 10 Day Peak Flow Arrival Time by @CoreyKrewson-NOAA in #550
• OCONUS Feature Removal for CONUS Products by @CoreyKrewson-NOAA in #549
• Viz EC2 Services to Lambda - Part 1 - High Water Probability by @TylerSchrag-NOAA in #543
• Dynamic Service SD Creation by @CoreyKrewson-NOAA in #551
• Viz EC2 Fixes by @CoreyKrewson-NOAA in #552
• Viz Userdata Scriptblock Fix by @CoreyKrewson-NOAA in #553
• Pipeline Fixes by @CoreyKrewson-NOAA in #554
• Coastal Depth Service Metadata Tables by @CoreyKrewson-NOAA in #555
• Viz EC2 Services to Lambda - Part 1b - High Water Probability Fixes by @TylerSchrag-NOAA in #557
• Service Name and Public Status Alignment by @CoreyKrewson-NOAA in #556
• Add hour timestamp fields and refactor some old fields by @shawncrawley in #560
• Rapid Onset Flooding for Hawaii and Puerto Rico by @CoreyKrewson-NOAA in #561
• Adds time column (alongside hour) to new services by @shawncrawley in #568
• V2.1.4 Fixes #1 by @TylerSchrag-NOAA in #570
• 2.1.4 Final Tweaks by @nickchadwick-noaa in #574

Full Changelog: v2.1.3...v2.1.4

V2.1.3

What's Changed

• Changes made to take authority of water.noaa.gov by @nickchadwick-noaa in #521
• Historic Run Fixes #3 by @TylerSchrag-NOAA in #509
• Implements catfim services in the viz_pipeline by @shawncrawley in #472
• Catfim Runtime Fixes by @CoreyKrewson-NOAA in #528
• 10% FIM Service Public Access by @CoreyKrewson-NOAA in #529
• 14 Day FIM Field Fix by @CoreyKrewson-NOAA in #526
• Hawaii and Puerto Rico FIMpact Empty Rows with Reference Time by @CoreyKrewson-NOAA in #525
• added EXPERIMENTAL label to publicly available FIM layers by @KatherinePowell-NOAA in #527
• added new cloudwatch group and logging for viz pipeline by @CoreyKrewson-NOAA in #531
• RDS Bastion - pg_restore tweaks by @TylerSchrag-NOAA in #533
• Dissolved Public FIM Domain Map by @CoreyKrewson-NOAA in #532
• Additional Product Initialization Logging by @CoreyKrewson-NOAA in #535
• Rio Grande FIM Removal by @CoreyKrewson-NOAA in #534
• File Forecast Regex Bug by @CoreyKrewson-NOAA in #541
• Custom Public FIM Descriptions by @CoreyKrewson-NOAA in #544
• Final 2.1.3 Fixes by @CoreyKrewson-NOAA in #545

Full Changelog: v2.1.2...v2.1.3

V2.1.2

What's Changed

• Non-FIM HI and PRVI Empty Row Fix by @CoreyKrewson-NOAA in #504
• Updated Prod DB Instance Names by @CoreyKrewson-NOAA in #505
• Update Service Description Fix by @CoreyKrewson-NOAA in #501
• GFS Probability Services Description Update by @CoreyKrewson-NOAA in #502
• MRF NBM Coastal Inundation Services by @CoreyKrewson-NOAA in #507
• RAS2FIM Implementation by @CoreyKrewson-NOAA in #506
• Implement Replace and Route as Step Function with Lambdas by @shawncrawley in #508
• V2.1.2 Fixes by @CoreyKrewson-NOAA in #510
• Adds fixes for new target_cols ingest mechanism by @shawncrawley in #512
• Commenting out old SNS code to allow fore deployment by @nickchadwick-noaa in #513
• restores accidentally reverted code change by @shawncrawley in #514
• PR: Fixes to CatFIM and FIM Performance Map Docs by @BradfordBates-NOAA in #516
• SSM Policy States:SendTaskSuccess Permission Updates by @CoreyKrewson-NOAA in #517
• Portal Item Update Logic Fix by @CoreyKrewson-NOAA in #518
• Mapx fixes by @shawncrawley in #519
• Database Enhancements - Lock Up Fix by @TylerSchrag-NOAA in #520
• RnR Domain Generator Ref Time Query Fix by @CoreyKrewson-NOAA in #523

Full Changelog: v2.1.1...v2.1.2

V2.1.1

Description

This release's main updates were to the core networking infrastructure. This includes support for redundant production and staging environments in different AWS regions and automatic DNS failover between the multiple regions. Further refinement of AWS resource naming schemas were also put in place as well as better organization and cleanup of the repository.

NWM 3.0 Processing Capability

This version provides infrastructure and code updates to handle the National Water Model (NWM) 3.0 implementation. Once NWM 3.0 goes live, the product processing pipelines will automatically start to process NWM 3.0, including the new configurations (MRF NBM, Alaska Domain, and Total Water Level Forecasts)

Bug Fixes

Rapid Onset Flooding HUC Summaries: For the ROF HUC summary layer, we calculate the percentage of reach length flooded within the certain HUC. The value of the total possible reach length within a HUC was not correct and thus producing incorrect percentages. We have updated this value and the percentages look more reasonable now.
Short Range 48 Hour Max Inundation Extent - Puerto Rico: The SRF max inundation service for Puerto Rico was incorrectly joining flowlines to the processed data which was resulting in null stream orders. These null stream orders were causing the symbology to not work correctly and hiding all inundation.
RFC Service Status Routing Issues: We have updated our algorithm to use the RFC defined forecast points AND points where live forecasts are being issued so that actual forecast statuses are used when routing downstream.

---

What's Changed

• Implements coastal fim depth services as vrts by @shawncrawley in #486
• NWM Dynamic Data Dependency and New NWM 3.0 Services by @CoreyKrewson-NOAA in #493
• Propogates NWM_DATAFLOW_VERSION var where missed by @shawncrawley in #494
• Data request updates by @TylerSchrag-NOAA in #482
• PSURGE coastal FIM extent sublayers implemented by @shawncrawley in #487
• Remove hard-coded "para" logic by @shawncrawley in #495
• RnR Streamflow: Ensure all forecast points are included by @shawncrawley in #497
• NWM 3.0 fixes by @CoreyKrewson-NOAA in #498
• Multi region support by @nickchadwick-noaa in #500

Full Changelog: v2.1.0...v2.1.1

V2.1.0

What's Changed

• Viz product infrastructure by @CoreyKrewson-NOAA in #413
• Viz - Dependent products postprocess, add states to attribute table, peak flow arrival optimization by @TylerSchrag-NOAA in #425
• PR: Added 10. FIM Version Update Jupyter Notebook by @BradfordBates-NOAA in #426
• updated python packages by @CoreyKrewson-NOAA in #420
• Make Separate Record Sublayer in rfc_max_stage by @CoreyKrewson-NOAA in #423
• Viz dependent postprocess - minor fix by @TylerSchrag-NOAA in #428
• fixed oids on raster services by @CoreyKrewson-NOAA in #431
• Public services and new names by @CoreyKrewson-NOAA in #440
• Dynamic check dependent tables by @shawncrawley in #447
• Shared account s3 switch by @TylerSchrag-NOAA in #449
• Image Based Lambda Tagging by @CoreyKrewson-NOAA in #442
• Naming Convention PR Fixes by @CoreyKrewson-NOAA in #448
• Removed 3 and 5 day mrf files from initialize pipeline filter list. by @TylerSchrag-NOAA in #452
• Implements RnR WRF-Hydro postprocessing in AWS by @shawncrawley in #453
• Shared Account S3 Switch - Fix 2 by @TylerSchrag-NOAA in #454
• Viz EC2 Setup Access and Raster Processing Fixes by @CoreyKrewson-NOAA in #455
• Fix Missing Service Descriptions by @CoreyKrewson-NOAA in #456
• FIM Data Prep Fix for Reference Products by @CoreyKrewson-NOAA in #457
• Rnr fixes by @shawncrawley in #459
• Implements Hawaii and PR/VI schism services by @shawncrawley in #461
• PR: Fix to Stage Based CatFIM Service and FIM Version Update Script by @BradfordBates-NOAA in #462
• HAND Explode Fix/Removal by @CoreyKrewson-NOAA in #464
• EC2 S3 Fetcher Fix by @CoreyKrewson-NOAA in #465
• Fixes regex matching bug by @shawncrawley in #473
• updated DB dump names by @CoreyKrewson-NOAA in #471
• Probability Regex Fix for Shared Services by @CoreyKrewson-NOAA in #466
• PR: Fix dtype in Stage-Based CatFIM by @BradfordBates-NOAA in #463
• Rnr quickfix by @shawncrawley in #474
• Hawaii and Puerto Rico HAND and SCHISM FIM Fixes by @CoreyKrewson-NOAA in #477
• Various Small Fixes/Improvements for V2.1.0 by @CoreyKrewson-NOAA in #479
• EC2 Pipeline Services Fixes by @CoreyKrewson-NOAA in #478
• Public FIM Rendering and DB Foreign Table Fixes by @CoreyKrewson-NOAA in #480
• Location DB Host and Name Variables Swap by @CoreyKrewson-NOAA in #483
• Enables feature service on a handful of services by @shawncrawley in #488

Full Changelog: v2.0.11.2...v2.1.0

V2.0.11.2

What's Changed

• Max Flow and RFC Max Stage Update by @CoreyKrewson-NOAA in #427
• 5/9 Hot Fixes by @CoreyKrewson-NOAA in #430
• 5/4 Deployment Fixes by @nickchadwick-noaa in #432

Full Changelog: v2.0.11.1...v2.0.11.2