This panel searches content only in this space. To search content in all spaces, use the box at the upper right.


For overview information, see Discovery Environment on the CyVerse website.

DISCOVERY ENVIRONMENT USER MANUAL

Maintenance: Tues, 28 Jan 2020

ACCESS TO OR USAGE OF THE FOLLOWING SERVICES WILL BE UNAVAILABLE OR DISRUPTED:

Discovery Environment         8:00am to 5:00pm MST
The Discovery Environment will be unavailable while patches and updates are applied.
        ** Currently running analyses will be terminated. Please plan accordingly.

Data Store                    8:00am to 5:00pm MST
The Data Store will be unavailable during the maintenance period.
 
Data Commons                  8:00am to 5:00pm MST
The Data Commons will be unavailable during the maintenance period.
 
Atmosphere and Cloud Services 8:00am to 5:00pm MST
Marana Cloud: Atmosphere instances in the Marana Cloud will be operational; however, you will not be able to use the Data Store within your instance, and you may not be able to access the Atmosphere web interface.
 
User Portal                   8:00am to 5:00pm MST
The User Portal, http://user.cyverse.org, will be unavailable while we perform maintenance and updates.
 
Agave/Science API             8:00am to 5:00pm MST
The Agave/Science API will be unavailable during this maintenance period.
 
DNA Subway                    8:00am to 5:00pm MST
DNA Subway will be unavailable during this maintenance period.
 
The following services will NOT be affected by the maintenance: CyVerse Wiki and JIRA

Keep up to date with our maintenance schedules on the CyVerse public calendar
http://www.cyverse.org/maintenance-calendar
Check your local timezone here https://bit.ly/36iVOkX 
 
Please contact support@cyverse.org for any questions, or concerns.

 

 

 

 

 

Skip to end of metadata
Go to start of metadata

You are viewing an old version of this page. View the current version.

Compare with Current View Page History

« Previous Version 67 Next »

Uploading and importing data files and folders within the DE

This page contains:

You can upload single files, multiple files, and folders from your desktop within the DE using bulk upload or simple upload, and import single or multiple files from URL. Once uploaded or imported, you can use the files for analyses in the Discovery Environment, as well as share data files you own.

You also can import test data files from the app's documentation page and download files and folders to your computer.


Method


Description


< 1.9 GB


> 10 GB*

Single
File

Multiple
Files


Folders

Java
Required

Simple Upload from Desktop

Smaller single or multiple files of up to 1.9 GB per file

(tick)

 

(tick)

 

 

 

Bulk Upload from Desktop

Larger multiple files, folders, and subfolders of up to 50 GB and larger per item.
You also can upload larger files using iDrop desktop.

(tick) (tick) (tick) (tick) (tick) (tick)

Import From URL

Import files that are not on your system of up to 3-4 GB each.

(tick) (tick) (tick) (tick)

 

 

* Depending on network bandwidth and current load. See Storing and Accessing Your Data in the Data Store for information on larger files and allocation.

Prefer command line or have larger files to upload?

Icon

If you prefer using the command line or you have large or many files to upload, you can manage the data outside of the Discovery Environment in the iPlant Data Store, using iDROP Desktop, the iRODS web client, or iCommands. The method you use depends on the size and number of your data files, as well as your personal preferences. For a comparison of the different methods of uploading and downloading data items both within and outside the DE, see Storing and Accessing Your Data in the Data Store.

Invalid License

License is not configured.

Using Simple Upload from Desktop

Simple Upload from Desktop is useful when you have smaller files of up to 1.9 GB per file.

  1. Open the Data window.
  2. In your personal folder, open the destination folder for the upload.
  3. Click Upload and then click Simple Upload from Desktop.
  4. Verify the destination folder is correct:

    To change the destination folder, click Cancel, select the correct folder, and then click Upload and Simple Upload from Desktop again.
  5. In the Upload window, click Browse to select the first file to upload.
  6. Repeat for each file to upload.
  7. Click Upload. The files are uploaded to the destination folder.

Using Bulk Upload from Desktop

Bulk Upload from Desktop uses a Java applet to allow you to upload multiple files, folders, and subfolders. It is known to work reliably for uploads of up to 50 GB and larger. We recommend using Java version 6 (version 6 update x). If you experience difficulties using this method, you may want to see which version of Java you are running, and view the Java Help Center documentation.

Invalid License

License is not configured.

Problem in Chrome on Mac OS X

Icon

Bulk upload in the DE using the Chrome browser on Mac OS X (but not in Windows or Linux) results in Java errors and will not launch. This is due to incompatibility between Chrome and Java. To use bulk upload on Mac OS X, close Chrome and use Safari or Firefox instead.

  1. Open the Data window.
  2. In your personal folder, select the destination folder for the upload.
  3. Click Upload and then click Bulk Upload from Desktop.

    Plugin messages?

    Icon
    • If This plugin is disabled is displayed, click the link, click Enable next to the Java Applet plugin, and then restart your browser.
    • If prompted to allow or deny an applet, click Allow.
    The Upload window opens:
  4. Verify the selected destination folder is correct:
  5. To select a different destination folder, click Change Destination, select the correct folder, and then click Select.
  6. To select a different resource zone (for example, TACC), click the Resource drop-down list at the bottom of the window, and select the resource.
  7. To add a file to the list:
    1. In the Local Files section on the left, expand the Users folder and select your username.
    2. Select the file or files to upload.
    3. Click Add Selected to Queue.
      The file is now listed in the Files Queued for Import list on the right:
    4. Repeat for each file to upload to the selected destination folder.
  8. To remove a file or files from the list:
    • To remove a single file, click in the Cancel/Remove column for the file.
    • To remove all files from the list, click Clear File Queue.
  9. To begin the import, click Import Files.
  10. When the iDrop Transfer Completed message is displayed, click OK.
  11. To upload another group of files, click Clear File Queue and repeat.
  12. When done, close the window by clicking at the top right of the window, and then clicking Yes to the confirmation prompt. The files are uploaded to the destination folder.
     If the window isn't updating...

     It may take up to 30 minutes for the window to be updated. Refresh your browser window to see if the changes have taken effect.

Using Import From URL

Use Import From URL when you want to import larger files, have some files you want to upload from desktop and some you want to import from URL, or want to import a file to the DE that isn't on your system.

  1. Copy the URL for the first file to import.
  2. In your personal folder, select the destination folder for the import. (To create a new folder, see Creating a Folder.)
  3. Click Upload and then click Import From URL.
  4. Paste the URL for the file to import in the first row.
  5. Repeat for each file to import.
  6. Click the Import from URL button. The files are imported to the destination folder.

Status updates

As the import progresses, you receive several status updates in the form of popups, notifications, and emails. Once you have received notification that your file has been successfully imported, it is available in the destination folder.

 If the window isn't updating...

 It may take up to 30 minutes for the window to be updated. Refresh your browser window to see if the changes have taken effect.

Problems uploading or importing within the DE?

  • No labels