V2.0.4

updated postprocess sql code to match prod (#163)

Updated zip file to match current prod code with previous manual hotfixes

Co-authored-by: Corey Krewson <[email protected]>

V2.0.3

Image Service Cache fix (#161)

Updated the update service function to stop and start image services after the data is updated

Smartsheet 1: https://app.smartsheetgov.com/sheets/FwqPVjGh6Qwv9GWh8hG35rj2Rr3g7RFMF3jcj4h1?rowId=3348855992412036

Smartsheet 2: https://app.smartsheetgov.com/sheets/FwqPVjGh6Qwv9GWh8hG35rj2Rr3g7RFMF3jcj4h1?rowId=354956864710532

Co-authored-by: Corey Krewson <[email protected]>

V2.0.2

increased publish service lambda timeout to 10 minutes (#152)

Increased the viz_publish_service lambda timeout to 10 minutes

Smartsheet: https://app.smartsheetgov.com/sheets/FwqPVjGh6Qwv9GWh8hG35rj2Rr3g7RFMF3jcj4h1?rowId=7267843461932932

Co-authored-by: Corey Krewson <[email protected]>

V2.0.1

Raster Step Functions (#147)

Updated viz step functions to allow for raster processing. Includes:

Updates to viz lambda IAM role permissions and trust relationships
Updates to lambda functions
Conversion of some lambda functions from zip file based to container based
Updates to step function definition
Smartsheet: https://app.smartsheetgov.com/sheets/FwqPVjGh6Qwv9GWh8hG35rj2Rr3g7RFMF3jcj4h1?rowId=4660451830196100

Updated Lambda functions with new zip files

Smartsheet: https://app.smartsheetgov.com/sheets/FwqPVjGh6Qwv9GWh8hG35rj2Rr3g7RFMF3jcj4h1?rowId=8604151467796356

Few additional tweaks / fixes to this feature branch:

Edited readme to reflect branching from UAT when creating a new feature branch
Fix to specify the sns topic of step function failures / timeouts in viz_lambdas main.tf
Past event bug fixes to viz_initialize_pipeline lambda function
Rapid Onset Flooding and Peak Flow Arrival Time bug fixes in viz_postprocess_sql lambda function
Smartsheet cards:
https://app.smartsheetgov.com/sheets/FwqPVjGh6Qwv9GWh8hG35rj2Rr3g7RFMF3jcj4h1?rowId=8311189131290500
https://app.smartsheetgov.com/sheets/FwqPVjGh6Qwv9GWh8hG35rj2Rr3g7RFMF3jcj4h1?rowId=6821268197533572
https://app.smartsheetgov.com/sheets/FwqPVjGh6Qwv9GWh8hG35rj2Rr3g7RFMF3jcj4h1?rowId=5132418337269636
https://app.smartsheetgov.com/sheets/FwqPVjGh6Qwv9GWh8hG35rj2Rr3g7RFMF3jcj4h1?rowId=6175319074858884

Another iterative set of fixes and tweaks to the viz pipelines. Changes include:

Upgrade of viz rds instance size (CR: https://app.smartsheetgov.com/sheets/4CqJ22mJpMWmFhG37jWHrCWjmJFjX4Mj5gMrXxv1?rowId=7933713045579652) *this may be a finnicky change, like storage size, that requires a manual change?
Upgrade of viz prc db user to 1000 connection limit
Update to only cache data in db in dev and ti environments (including new env variable in function).
Change of viz_huc_processing lambda memory
Misc. viz lambda code fixes (see hydrovis-visualization pr 23)
This PR should be good to deploy to TI and UAT as soon as convenient.. but these dump files need to be copied from TI to UAT S3 before UAT deploy:

s3://hydrovis-ti-deployment-us-east-1/viz/db_pipeline/db_dumps/vizDB_admin.dump
s3://hydrovis-ti-deployment-us-east-1/viz/db_pipeline/db_dumps/vizDB_ingest.dump
s3://hydrovis-ti-deployment-us-east-1/viz/db_pipeline/db_dumps/vizDB_cache.dump
s3://hydrovis-ti-deployment-us-east-1/viz/db_pipeline/db_dumps/vizDB_publish.dump
s3://hydrovis-ti-deployment-us-east-1/viz/db_pipeline/db_dumps/vizDB_derived.dump
Thanks!

Updated RnR to use S3 bucket as a primary data source.

Fixed RnR tgz file path to match TF

Smartsheet: https://app.smartsheetgov.com/sheets/FwqPVjGh6Qwv9GWh8hG35rj2Rr3g7RFMF3jcj4h1?rowId=5133468658100100

V2.0.0

Viz filebeat UAT (#98)

Viz EC2 now uses filebeat to send logs to logstash. Also updated logstash to 8.2.3

Smartsheet: https://app.smartsheetgov.com/sheets/FwqPVjGh6Qwv9GWh8hG35rj2Rr3g7RFMF3jcj4h1?rowId=7625678595090308

Co-authored-by: Corey Krewson <[email protected]>

V1.1.10

Windows Terraform Compatibility UAT (#91)

Added `.gitattributes` file to specify LF line endings on all Terraform related files, to avoid issues with using Terraform cross-platform.

SmartSheet Card: https://app.smartsheetgov.com/sheets/FwqPVjGh6Qwv9GWh8hG35rj2Rr3g7RFMF3jcj4h1?rowId=5488799489779588

V1.1.9

Rfc max stage fix 2 UAT (#87)

This contains an updated viz_db_postprocess.zip, which has a super minor edit in the rfc_max_stage.sql file.

I have tested this change, and it's good to deploy all the way through.

Co-authored-by: tyler.schrag <[email protected]>

V1.1.8

v1.1.8

Added record status logic to RFC Max Stage sql file in db_postprocess…

V1.1.7

Fim and rfc max stage fix UAT (#84)

Updated the viz_wrds_api_handler

- Adds some missing metadata (RFC and WFO) for locations that are missing it
- smartsheet: https://app.smartsheetgov.com/sheets/FwqPVjGh6Qwv9GWh8hG35rj2Rr3g7RFMF3jcj4h1?rowId=1290094507255684

Updated viz_huc_inundation_processing

- Makes the interpolated stage equal to the rating curve max stage when the forecasted streamflow exceeds the max streamflow in the rating curve.
- smartsheet: https://app.smartsheetgov.com/sheets/FwqPVjGh6Qwv9GWh8hG35rj2Rr3g7RFMF3jcj4h1?rowId=1177472948561796

Co-authored-by: Corey Krewson <[email protected]>

V1.1.6

added Anomaly Detection to the 3 ingress S3 buckets. (#81)

Added Cloudwatch Anomaly Detection to the 3 S3 buckets that the ingress data comes from.

SmartSheet Card: https://app.smartsheetgov.com/sheets/FwqPVjGh6Qwv9GWh8hG35rj2Rr3g7RFMF3jcj4h1?rowId=2714771029026692