Skip to content

[rrfs-nco] WARNING and email for failback#1541

Open
lgannoaa wants to merge 4 commits into
NOAA-EMC:rrfs-ncofrom
lgannoaa:feature/three-hours-fallback-alert
Open

[rrfs-nco] WARNING and email for failback#1541
lgannoaa wants to merge 4 commits into
NOAA-EMC:rrfs-ncofrom
lgannoaa:feature/three-hours-fallback-alert

Conversation

@lgannoaa

@lgannoaa lgannoaa commented Jun 12, 2026

Copy link
Copy Markdown
Contributor

It is designed to address:

  1. print WARNING msg in the log indicating that restart files are missing and the job is proceeding with older ones.
  2. send out an email notifying NCO (and likely EMC) about the missing restart files.
    Using "gold standard" in provide WARNING message as described in PR [rrfs-nco] Adds warning for no RAVE data being available, and clarifies other warnings. #1522
    Original issue [rrfs-nco] Alert when performing a failback #1427

Requirement:
export MAILTO= must be in run.ver to identify the target email address.

ShunLiu-NOAA
ShunLiu-NOAA previously approved these changes Jun 15, 2026

@WeiWei-NCO WeiWei-NCO left a comment

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks, Lin. Do we have a test log for this change? I'm not sure but it looks like we could get multiple emails sometimes.

We would like only 1 email alert from each cycle. It's fine to get 1 for det and 1 for enkf, but not multiple from det.

@lgannoaa

Copy link
Copy Markdown
Contributor Author

We are unable to test this change due to the resource limitation on dev system. I have contacted James prior submit this PR and request his help to test. He indicated there is low risk. Hence this PR is submitted and approved by others.
The email frequency can be turned when you run the parallel.

@MatthewPyle-NOAA

Copy link
Copy Markdown
Contributor

One minor thing is I think the mail.py utility needs to be used to send e-mail - is mentioned in the standards document.

lgannoaa added 2 commits June 15, 2026 13:18
1.    print WARNING msg in the log indicating that restart files are missing and the job is proceeding with older ones.
2.    send out an email notifying NCO (and likely EMC) about the missing restart files.
Using "gold standard" in provide WARNING message as described in PR 1522
@lgannoaa lgannoaa dismissed stale reviews from ShunLiu-NOAA and BenjaminBlake-NOAA via c0ebe98 June 15, 2026 13:20
@lgannoaa lgannoaa force-pushed the feature/three-hours-fallback-alert branch from cdea64c to c0ebe98 Compare June 15, 2026 13:20
@lgannoaa

Copy link
Copy Markdown
Contributor Author

I have updated the email statement by using mail.py utility.

@JamesPolly-NCO

JamesPolly-NCO commented Jun 15, 2026

Copy link
Copy Markdown
Collaborator

@WeiWei-NCO @lgannoaa I'm happy to test this later today before we merge it.

@MatthewPyle-NOAA MatthewPyle-NOAA changed the title WARNING and email for failback [rrfs-nco] WARNING and email for failback Jun 17, 2026
@MatthewPyle-NOAA

Copy link
Copy Markdown
Contributor

@WeiWei-NCO @lgannoaa I'm happy to test this later today before we merge it.

Did you test it, or if not, do you still want to?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

6 participants