Skip to content

Set resources for dataloading, training and prediction#45

Open
SarahAlidoost wants to merge 5 commits into
mainfrom
cpu_usage
Open

Set resources for dataloading, training and prediction#45
SarahAlidoost wants to merge 5 commits into
mainfrom
cpu_usage

Conversation

@SarahAlidoost
Copy link
Copy Markdown
Member

@SarahAlidoost SarahAlidoost commented Apr 28, 2026

closes #44

This PR:

  • adds a util function to set the resources and shows how to set them in the example notebook
  • fixes a few minor things
  • adds a comparison between baseline (monthly average) and model results on residuals via plots

@CLAassistant
Copy link
Copy Markdown

CLAassistant commented May 13, 2026

CLA assistant check
All committers have signed the CLA.

@SarahAlidoost SarahAlidoost marked this pull request as ready for review June 1, 2026 11:23
@SarahAlidoost
Copy link
Copy Markdown
Member Author

@meiertgrootes and @rogerkuou when working on this PR, I found that the land mask from era5 does not mask the large water bodies, for example see the plots below, the white pixels are related to Lake Victoria in Africa. These large bodies are not available in "averaged" daily sst data. Something to be discussed in our meeting (data checkup).

climanet_landmask_1

Blue regions are water (sea, lakes, rivers,...), green are land.

climanet_landmask_2

White pixels (in land region) are nan in "averaged" daily sst data.

@SarahAlidoost
Copy link
Copy Markdown
Member Author

@meiertgrootes the notebook uses residuals as target and compares the model output with the baseline (averaged daily data).

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Investigate cpu usage in training

2 participants