During 2021 PO.DAAC is in the process of migrating its data archive to the Earthdata Cloud, hosted in Amazon Web Services (AWS). During this transition, some data will continue to be available from the on premise archive, while some data will also be available from and within the Earthdata Cloud.

Timeline

PO.DAAC data will be migrated to the cloud in a set of four Phases. The datasets and migration dates are below, but dates may be refined over time. For up to date information, please subscribe to the PO.DAAC mailing list. If you are having trouble finding a collection below, the transition date is also listed on each collection’s landing page.

The dates listed in the tables below are the dates when on-premise access to the collections will no longer be available. At some point before the date below, discoverability (i.e. they won’t show up on collection landing pages) of the on-premise end points will be turned off, while access to them will remain until the final date. Remember that while the endpoints to the data are changing from on-premise to cloud endpoints, download capabilities remain unaffected for the data user. Users will always be able to download data from PO.DAAC.

Phase 1 (Cloud Accessable Date:  April 15, 2021;  Cloud Only Access Date: January 31, 2022)

Cloud Accessable Date:  Phase 1 -  April 15, 2021

Phase Cloud Only Access Date  Collections

Phase 1

January 31, 2022

 

Phase 2 (Cloud Accessable Date:  October 1, 2021;  Cloud Only Access Date: March 28, 2022)

Cloud Accessable Date:  Phase 2 -  October 1, 2021

Phase Cloud Only Access Date  Collections

Phase 2

March 28, 2022

 

Phase 3 (Cloud Accessable Date:  December 23, 2021;  Cloud Only Access Date: March 28, 2022) 

Cloud Accessable Date:  Phase 3 -  December 23, 2021

Phase Cloud Only Access Date  Collections

Phase 3

March 28, 2022

 

Phase 4 (Cloud Accessable Date:  April, 2022;  Cloud Only Access Date: June 6, 2022)

Cloud Accessable Date:  Phase 4 -  April, 2022

Phase Cloud Only Access Date  Collections

Phase 4

June 6, 2022

 

What to Expect

You will notice there will be some duplicate collections available. For example, if you search for “VIIRS_N20-OSPO-L2P-v2.61” in Earthdata Search, you will see two collections. One of these is our normal, on-premise collection, while the other is the cloud hosted collection.

The PO.DAAC Web Portal will label cloud hosted datasets as  CLOUD ENABLED  in an orange rectangle. This will let you know, at a glance, which datasets are cloud-enabled from the dataset search and dataset landing pages. For now, check out the Migration FAQ “How do I know if a collection is in the cloud or not? below.

In the future, we will be removing discoverability of the “on-premise” collection and only the cloud version will be available, and you will not see duplicates. 

Tutorials
User Goal Cloud Tutorial or Tool

Find Collections

Find Granules

Browse / Download Whole Granules

Subscribe to Granules

Direct In-Region Cloud Access

Access Data in zarr Cloud Optimized Format

Bulk Download

Transform: How do I subset L2 data?

Transform: How do I use OPeNDAP in the Cloud?

  • Coming Soon...

Transform: How do I subset and aggregate L3 and L4 data?

  • Coming Soon...
Migration FAQs
Are there any collections in the cloud I can try out right now?

Public cloud collections are those that are new to PO.DAAC and went immediately into the cloud. These collections are only available through the cloud. Some examples of these are the ECCO data products. As new collections become available, you will see them show up on our Portal, CMR, and Earthdata Search. You will soon also see migrated datasets from PO.DAAC on-premise into the cloud and both will be available until on-premise access ends.

How do I know if a collection is in the cloud or not?

There are several ways to see the PO.DAAC cloud collections.

For public collections, you can use Earthdata Search and the PO.DAAC Web portal filter options.

The PO.DAAC Web Portal will also label datasets as  CLOUD ENABLED  in an orange rectangle. This will let you know, at a glance, which datasets are cloud-enabled from the dataset search and dataset landing pages.

On Earthdata Search, you can use the ‘Available from AWS Cloud’ feature, as well as searching using the key word  POCLOUD.  But for PO.DAAC Cloud collections only, we’ve built a PO.DAAC Cloud Search Portal (again, make sure you’re logged in!).

Why are there so few collections in the first phase? Why so many in other phases?

The first set of collections moving to the cloud were scoped to the most used or voluminous PO.DAAC collections*. PO.DAAC wanted to make these collections available in the cloud to our user community as soon as possible to educate and foster the migration process. Once a user understands the cloud access points, migrating to new collections will be done consistently and easily.

Because access will be consistent, PO.DAAC feels confident in migrating more and more collections over the last 3 phases.

*These collections account for nearly 75% of PO.DAAC data volume, 80% of our distribution, and 40% of our total number of files. 

Other Questions?

For more answers to frequently asked questions, please see the Cloud FAQ.

 

If your question is not here feel free to submit it to us via Forum or by emailing to podaac@podaac.jpl.nasa.gov