Skip to content

Commit 6b28f40

Browse files
author
adrianom-gh
committed
Added some retry/exponential backoff code. Started an NDVI run of US and it will now start on the last successful tile. Set concurrency in open_dataset, which fixes my concurrency error but it is very slow now. Trying to write exponential backoff code that can catch this error and contnue to retry (or poke) Google. Problem is the my exponential backoff function is wrapped around to_dataframe() which in theory is supposed to be where the Earth Engine call happens but it's not working.
1 parent 04c69fa commit 6b28f40

5 files changed

Lines changed: 177 additions & 39 deletions

File tree

.gitignore

Lines changed: 11 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -52,3 +52,14 @@ geometry/US.shp
5252
geometry/US.prj
5353
geometry/US.dbf
5454
geometry/US.cpg
55+
demos/US_NDVI_Tiles_30m_40MIL
56+
57+
src/robustraster/__pycache__/ee_grid_tiles.cpython-310.pyc
58+
src/robustraster/__pycache__/format_time.cpython-310.pyc
59+
src/robustraster/__pycache__/hooks.cpython-310.pyc
60+
src/robustraster/__pycache__/raster_export_manager_batched.cpython-310.pyc
61+
src/robustraster/__pycache__/reports_setup.cpython-310.pyc
62+
src/robustraster/__pycache__/run_manager.cpython-310.pyc
63+
src/robustraster/__pycache__/vector_export_manager.cpython-310.pyc
64+
src/robustraster/__pycache__/vrt_export_manager.cpython-310.pyc
65+
src/robustraster/__pycache__/dask_docker_cluster_manager.cpython-310.pyc

0 commit comments

Comments
 (0)