Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[8pt] Add south Alaska to HAND processing #792

Closed
RobHanna-NOAA opened this issue Jan 13, 2023 · 13 comments · Fixed by #1106
Closed

[8pt] Add south Alaska to HAND processing #792

RobHanna-NOAA opened this issue Jan 13, 2023 · 13 comments · Fixed by #1106
Assignees
Labels

Comments

@RobHanna-NOAA
Copy link
Contributor

RobHanna-NOAA commented Jan 13, 2023

A list of south Alaska HUCs is coming and need to be included in our BED runs.

All inputs should be there, but this card is to prove that those HUCs will process correctly.

Even the final FIM BED results for the Alaska HUCs need to remain as EPSG:3338.

  • A separate PR, 1028, has been created to get the 3Dep DEM's via the acquire scripts. If other additional inputs are required for Alaska, those will also be covered by the other PR.
  • A separate PR, 1033: Add South Alaska to pre-clip vectors system has been added recently. Not yet sure if this can be pre-done before HAND integration but will try.

Other tasks required: (note.. key sub-tasks can be listed here if required. Big ones can likely go to their own PR depending on size and inter relationship of the tasks.

  • Update included_huc8.lst to include the selected new South Alaska HUCs.
@CarsonPruitt-NOAA
Copy link
Collaborator

We'll want to store the DEMs and vector files in EPSG:3338 (Alaska Albers). That way we can avoid distortion during the HAND processing.

@RobHanna-NOAA
Copy link
Contributor Author

Ok. no problem. Emily.. I can start getting you the DEM's and pick up where we left off

@RobHanna-NOAA
Copy link
Contributor Author

@CarsonPruitt-NOAA : We can store the raw DEM'S in 3338 if you like. When we load DEMs initially for USGS, we convert them to 5070 as we download them, then process everything at 5070. Do you want us to make a change to our program for downloading DEMs have them convert to 5070 for everything except South Alaska?

Also.... I assume we will set it up a part of the big vrt which can be expanded to add S.A. Should be an easy task for me to get her the data, then it is just a matter of figuring out which HUCs are now in play and testing them (well.. and updating a few other tidbits like the included_huc8.lst

@CarsonPruitt-NOAA
Copy link
Collaborator

Yes, we will want to store the Alaska data as 3338. Rob, I think it would be best for you to get the data set up and then Emily can work out the kinks from there.

@RobHanna-NOAA
Copy link
Contributor Author

@EmilyDeardorff : Can you figure out what HUC8's are now going to be used for Alaska? As Carson mentioned it will be the HUC 2 of 19 (HUCs starting with 19), but we don't need all of Alaska. Only the HUCs 8 that we have NWM stream data for.

@CarsonPruitt-NOAA
Copy link
Collaborator

Liliana probably also knows which HUCs are the ones we need for Alaska covered by NWM v3.

@EmilyDeardorff
Copy link
Contributor

The HUC8_Alaska_NWMv30 shapefile that Alemayehu sent us on Sept 22 contains these HUCs: 19020202, 19020301, 19020602, 19020203, 19020302, 19020800, 19020201, 19020104, 19020601, 19020401, 19020103, 19020402, 19020505, 19020503, 19020504, 19020102, 19020101, 19020502, 19020501

Does that look right?

image

@RobHanna-NOAA
Copy link
Contributor Author

oh ya. Can you compare those HUCs to the streamlines and makes sure it matches? But yes, I think that has it. I will work this week on getting you some DEMs in 3338 for those HUCs.

@CarsonPruitt-NOAA CarsonPruitt-NOAA changed the title [8pt] Add south Alaska to HAND processing [13pt] Add south Alaska to HAND processing Nov 6, 2023
@RobHanna-NOAA RobHanna-NOAA changed the title [13pt] Add south Alaska to HAND processing [8pt] Add south Alaska to HAND processing Nov 8, 2023
@EmilyDeardorff
Copy link
Contributor

'Lake' column issue (2/28/24)

The NWM streams geopackage did not have the 'Lake' attribute like it was supposed to. It turns out that data was there, just in a column titled 'NHDWaterbodyComID'. To resolve, I created a column called 'Lake' in the NWM streams Alaska geopackage (which is an input to the pre-clip processing).

Incorrect CRS for Alaska (2/28/24)

The default FIM projection is not correct to use for Alaska. To resolve, I added logic to a few scripts to assign the CRS variable depending on whether it is an Alaska HUC or not.

DEM domain geopackage not matching Alaska CRS (2/29/24)

The input DEM domain (input_DEM_domain=${inputsDir}/3dep_dems/10m_5070/HUC6_dem_domain.gpkg) was not a compatible CRS with the Alaska data (even though the polygon does include Alaska). To resolve, I added logic to a few scripts that uses the Alaska DEM domain (inputs/3dep_dems/10m_South_Alaska/23_11_07/DEM_Domain.gpkg) if the Alaska HUC is detected.

@EmilyDeardorff
Copy link
Contributor

Future Work: Need to get USGS gages for Alaska (3/4/24)

With the recent in the dev-fim-pipeline-alaska branch, the FIM pipeline has run to completion for the first time. Most of the outputs look as expected, with the exception of some USGS outputs (listed below). This is to be expected because our inputs do not currently contain the USGS gages for alaska. Eventually, we will want to add another USGS gages file that contains that data for Alaska.


FIM pipeline outputs summary:

  • HUC folder is missing:

    • usgs subset gages
    • usgs subset gages 0
    • usgs elev table
    • 3d nld subset levees burned
  • branch 0 folder is missing:

    • usgs elev table
  • branch folder is missing:

    • usgs elev table

@EmilyDeardorff
Copy link
Contributor

Branch Zero Inundation of the Matanuska River near Palmer, Alaska

  • input flow for every branch was set to 890 CMS, which is the 20% AEP flow for the Matanuska R at Palmer AK USGS gage
  • the cross-hatched area marks the boundary of HUC 19020402
  • mosaic or branch inundation is not included in this image

Branch zero inundation near the Matanuska River at Palmer AK - USGS gage 15284000
image

@EmilyDeardorff
Copy link
Contributor

High stream density leading to too many branches in HUC 19020402

Running the FIM pipeline on HUC 19020402 (Matanuska River near Palmer, Alaska) resulted in 867 branches being generated. The expected number of branches for a HUC is more like 20-40 branches. This unexpected behavior can be attributed to an overly dense network of streams being fed into the model. The figures below shows that the intensity of this issue varies between HUC.

image

image

@EmilyDeardorff
Copy link
Contributor

50% AEP Alaska inundation after mitigating stream density issue
These results are using preliminary AEP flow data.

matanuska_river_palmer_50AEP
Matanuska River near Palmer, AK

eagleriver_50AEP
Eagle River, AK

anchorage2_50AEP
Anchorage, AK

anchorage_50AEP
Anchorage, AK

trapper_creek_50AEP
Trapper Creek, AK

rude_river_50AEP
Rude River, AK

@EmilyDeardorff EmilyDeardorff linked a pull request Apr 3, 2024 that will close this issue
16 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging a pull request may close this issue.

3 participants