Frequently Asked Questions
File upload parameters
GNSS Data Upload Guidelines
Outline of the CDDIS system:
The CDDIS file upload system uses a NASA single sign-on (SSO) system (https://urs.earthdata.nasa.gov/). Users will need to create an account with that system before they can use the CDDIS file upload application.
Files are then submitted to CDDIS using an HTTP POST request. This can be done utilizing a CDDIS supplied web interface (https://depot.cddis.eosdis.nasa.gov/CDDIS_FileUpload/) or with a standard command line tool like cURL (http://curl.haxx.se/) that is available for OS X, Windows, and Linux operating systems. In addition, users can write their own application to submit HTTP POST requests. An example is given below of how a data provider can create a custom application to submit an entire directory of files using cURL.
Steps to using the CDDIS system
Initial use of the system:
- Create an Earthdata login account if you do not already have one. Go to https://urs.earthdata.nasa.gov/ and follow the instructions to create an account.
- Notify CDDIS (support-cddis@nasa.gov) with the following information:
- Earthdata login name
- IP address from which you will be uploading
- Wait for confirmation from CDDIS that your credentials have been accepted before proceeding to step 3.
- Important: the very first time you try to use the system you need to use the web interface: https://depot.cddis.eosdis.nasa.gov/CDDIS_FileUpload/, this page will redirect you to the Earthdata login page to input your username and password. After that, the system will ask you to authorize the application's access to your Earthdata profile. You must do this the first time you use the system; this step will not be required in future upload sessions.
Option 1 - Using the web interface
Go to https://depot.cddis.eosdis.nasa.gov/CDDIS_FileUpload/. When redirected to the Earthdata log in page, input your username and password. When you are returned to the application's upload page, select the type of files you are uploading (GNSS, SLR, DORIS, VLBI). You will then be presented with various options depending on your selected data type. Once you have selected a data type-specific option, click on "Browse". Navigate to the local directory containing your files, and select the files to upload. You can use shift-click to select a block of files. Click the "Upload files" button. You should then get a response similar to:
You successfully uploaded m files, out of n selected
Where:
m = the number of files you uploaded
n = the number of files you selected for upload
If m ≠ n, please contact support-cddis@nasa.gov.
Option 2 - Using the command line interface through cURL
This process has two steps like the web interface, however, unlike that process, you will not see the redirect to Earthdata login happening, and you will need to set up a .netrc file on your system with your username and password for cURL to use when the redirect occurs behind the scenes.
NOTE: If your operating system does not have cURL installed by default, you will need to install it before you can use this process.
- To create a .netrc file, you will need to create a text file with the name .netrc; this file needs to have read permissions set to only yourself, so that no one can read your file and get your username and password. The format of the file is:
machine urs.earthdata.nasa.gov login <username> password <password>
where <username> and <password> are the values you set when you created your Earthdata login account.
- To login to CDDIS Ingest, type the following on the command line:
curl -c <urs_cookie_file> -n -L https://depot.cddis.eosdis.nasa.gov/CDDIS_FileUpload/login
where:
<urs_cookie_file>
is a text file that is used to save the cookie needed. One example is to use a file named .urs_cookies in your homespace
<-n>
look for a text file in my homespace under the name .netrc with read only permission, see above for instructions on creating this.
You should receive the following response:
Welcome to CDDIS File Upload
- To upload files, type the following on the command line:
curl -X POST
-b <urs_cookie_file>
-F "fileType=<fileType>" -F "fileContentType=<fileContentType>”
-F "file[]=@file1" -F "file[]=@file2" -F "file[]=@fileN"
https://depot.cddis.eosdis.nasa.gov/CDDIS_FileUpload/upload/
where:
<urs_cookie_file>
(Required) is the same as above
<fileType>
(Required) Supported datatypes are 'GNSS', 'GNSSV2', 'GNSSV4', 'DORIS', 'SLR', 'VLBI' and 'MISC'. This variable is case insensitive, so 'gnss' will work as well.
<fileContentType>
(Required) must be set to either 'Data', 'Products', or 'Misc' (this is not needed for 'VLBI' data, and is also case insensitive)
<file1>
(Required) would be replaced with the file you are uploading (need path to file - either full or relative)
<file2>
(Optional) would be a second file, if you uploaded more than one
<fileN>
(Optional) would be the last file your enter (you may add as many as you like here)
Example #1 - DORIS data file
curl -X POST -b .urs_cookies -F "fileType=DORIS" -F "fileContentType=data"
-F "file[]=@ja2data308.001.Z" https://depot.cddis.eosdis.nasa.gov/CDDIS_FileUpload/upload/
Example #2 - GNSS RINEX version 3 data file
curl -X POST -b .urs_cookies -F "fileType=GNSS" -F "fileContentType=data"
-F "file[]=@AREG00PER_R_20220080000_01D_30S_MO.crx.gz " https://depot.cddis.eosdis.nasa.gov/CDDIS_FileUpload/upload/
Example #3 - GNSS RINEX version 2 data file
curl -X POST -b .urs_cookies -F "fileType=GNSSV2" -F "fileContentType=data"
-F "file[]=@zim2001j.15d.gz" https://depot.cddis.eosdis.nasa.gov/CDDIS_FileUpload/upload/
Example #4 – GNSS RINEX version 4 data file
curl -X POST -b .urs_cookies -F "filetype=GNSSV4" -F "fileContentType=data"
-F "file[]=@POTS00DEU_R_20220660000_01D_30S_MO.crx.gz" https://depot.cddis.eosdis.nasa.gov/CDDIS_FileUpload/upload/
For the above examples, you should receive a response similar to:
You successfully ingested m files, out of n selected
Where:
m = the number of files you uploaded
n = the number of files you selected for upload
If m ≠ n, please contact support-cddis@nasa.gov.
Option 3 - other applications
Sample Application:
Here is a sample java application to log in and submit the entire contents of a directory that match a particular file pattern:
To use this client, you will first need to compile it using a java compiler on your system.
Usage: javac CurlClient.java
Then to run the client you will need to specify:
working directory: Location where temporary files will be written
directory containing files: All files must be in a single directory for this sample code
file pattern: A string that all the file names will contain (used to filter out files your don't want to upload)
file Type: One of the approved data types (GNSS/GNSSV2/GNSSV4/SLR/DORIS/VLBI/MISC)
fileContentType: One of the approved file content types (data/products/misc)
Usage: java CurlClient <working directory> <directory containing files> <filepattern to upload> <fileType GNSS/GNSSV2/GNSSV4/SLR/DORIS/VLBI/MISC> <fileContentType data/products/misc>
Return to the CDDIS FAQ TOC