Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Task/raise alarm for failed canary run/cdd 2109 #1069

Open
wants to merge 61 commits into
base: main
Choose a base branch
from
Open

Task/raise alarm for failed canary run/cdd 2109 #1069

wants to merge 61 commits into from
+7,779 −18

Conversation

A-Ashiq
Copy link
Contributor

@A-Ashiq A-Ashiq commented Oct 28, 2024 •
edited
Loading

This PR does the following:

  • Sets up a canary which traverses the frontend sitemap and hits all the URLs every 10 minutes
  • Sets the canary up as a terraform module that we can eventually extract into its own package so it can be reused elsewhere

A-Ashiq added 30 commits July 30, 2024 13:11
@A-Ashiq
Bump nodejs puppeteer runtime_version
a1557f8
@A-Ashiq
Provide env vars to canary runtime from module variables
d285678
@A-Ashiq
Build zip file containing single source code file for canary script
aa38b4a
@A-Ashiq
Add timeout_in_seconds variable to cloud-watch-canary module
462b9ee
@A-Ashiq
Implement canary to traverse frontend pages c/w screenshots
252eb68
@A-Ashiq
Set retention periods for canary runs
ad227bc
@A-Ashiq
Bump aws provider from v5.58.0 to v5.60.0
6aa07c6
@A-Ashiq
Add slack_token and slack_channel_id to slack secret
aaefdd2
@A-Ashiq
Add dedicated SNS topic to cloud-watch-canary
a0cc09b
@A-Ashiq
Bump archive provider
51e9f64
@A-Ashiq
Implement required outputs from cloud-watch-canary module
ffd5b64
@A-Ashiq
Add requirement for lambda_function_notification_arn variable to tr…
9dffaf7 
…igger notification process for failed canaries
@A-Ashiq
Point script_path at broken links canary script
ad0fd5c
@A-Ashiq
Formatting
5e930d3
@A-Ashiq
Send lambda function ARN to cloud-watch-canary module so notificati…
49779f2 
…ons can be triggered from failed canaries
@A-Ashiq
Add canary script used to crawl site and take snapshots of broken pages
be6f121
@A-Ashiq
Add corresponding Cloudwatch alarm to be raised when canary run fails
f0b024e
@A-Ashiq
Delete redundant canary-front-end-screenshots canary script source …
648ef3e 
…code
@A-Ashiq
Add source code for Lambda function used to send notifications after …
213944c 
…canary run failure
@A-Ashiq
Add packaging for lambda-canary-notification
50ae722
@A-Ashiq
Remove successful canary run reports after 1 day
4880db5
@A-Ashiq
Keep failed canary reports for 2 weeks
1aaa607
@A-Ashiq
Fix issues around downloading snapshots
36c70a2
@A-Ashiq
Rename function
5809baa
@A-Ashiq
Filter for failed snapshots only
5cc4671
@A-Ashiq
Extract and return broken links as bullet point list in post to Slack
13ead0c
@A-Ashiq
Pass brokenLinks array to buildSlackPostPayload()
2985011
@A-Ashiq
Extract syntheics report and broken links report from s3
f2d5219
@A-Ashiq
Add keyToSearchFor param to docstring
23354f3
@A-Ashiq
Remove unused import
e42245b
A-Ashiq and others added 28 commits August 8, 2024 11:06
@A-Ashiq
Relaunch browser after 50 pages
077e670
@A-Ashiq
Remove unused slack/webhook dependency
f8af73b
@A-Ashiq
Add aws-sdk/client-secrets-manager to dependencies
43508f4
@A-Ashiq
Rename arg
74d9574
@A-Ashiq
Inject dependencies into all functions which depend on side-effect-he…
66534dd 
…avy functions
@A-Ashiq
Add unit tests
a07e3eb
@A-Ashiq
Remove unused functions from being exported
3c9c36d
@A-Ashiq
Revoke security group rules for cloudwatch canary module security gro…
cf9a3f3 
…up on delete
@A-Ashiq
Provide lambda context to handler()
4b38150
@A-Ashiq
Pass S3_CANARY_LOGS_BUCKET_NAME downstream into callee functions
c71580c
@A-Ashiq
Update tests to reflect capturing of env var for `S3_CANARY_LOGS_BUCK…
e09d7eb 
…ET_NAME`
@A-Ashiq
Extract script from src/ directory, output to ignored builds/ dir…
2bed52e 
…ectory
@A-Ashiq
Set analysed period of alarm to be timeout_in_seconds variable
e1b571c
@A-Ashiq
Set alarm to trigger when SuccessPercent dips below 100%
0817d3f
@A-Ashiq
Set notification lambda to consume event from eventbridge
f8dae0b
@A-Ashiq
Set notification lambda to consume event from eventbridge
ce2457d
@A-Ashiq
Trigger for failed canary runs only
37cfee4
@A-Ashiq
Add aws-sdk/client-synthetics package
2bbde92
@A-Ashiq
Allow notification lambda to call get the status of previous canary runs
f52b087
@A-Ashiq
Send notification if canary run state transitioned from PASSED -> FAI…
fc44528 
…LED compared to most recent run
@A-Ashiq
Replace with HLC2 expression
7824bdc
@A-Ashiq
Remove "cloudwatch:PutMetricData" policy for canary
b7d31f2
@A-Ashiq
Delay next page for 500ms
a726469
@A-Ashiq
Remove block to resursively find other links on page
cafa6c5
@A-Ashiq
Remove redundant grabLinks() function
6db2ff8
@A-Ashiq
Merge branch 'main' into task/raise-alarm-for-failed-canary-run/CDD-2109
f49fcfd
@A-Ashiq
Refresh lock file
f50aa0a
@A-Ashiq
Merge branch 'main' into task/raise-alarm-for-failed-canary-run/CDD-2109
7d01ff7
@A-Ashiq A-Ashiq changed the base branch from task/implement-screenshot-canary-for-frontend/CDD-2109 to main November 1, 2024 15:57
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@phill-stanley phill-stanley phill-stanley approved these changes

Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@A-Ashiq @phill-stanley