{"id":14184,"date":"2026-07-02T11:30:18","date_gmt":"2026-07-02T15:30:18","guid":{"rendered":"https:\/\/labs.icahn.mssm.edu\/minervalab\/?page_id=14184"},"modified":"2026-08-07T15:07:49","modified_gmt":"2026-08-07T19:07:49","slug":"minerva_res_data_transfer","status":"publish","type":"page","link":"https:\/\/labs.icahn.mssm.edu\/minervalab\/documentation\/minerva_res_data_transfer\/","title":{"rendered":"Minerva-Res Data Transfer"},"content":{"rendered":"

[et_pb_section fb_built=”1″ _builder_version=”4.16″ global_colors_info=”{}”][et_pb_row _builder_version=”4.27.4″ background_size=”initial” background_position=”top_left” background_repeat=”repeat” custom_padding=”||1px||false|false” global_colors_info=”{}”][et_pb_column type=”4_4″ _builder_version=”4.27.4″ _module_preset=”default” global_colors_info=”{}”][et_pb_text _builder_version=”4.27.4″ _module_preset=”default” global_colors_info=”{}”]Scientific Computing and Data<\/a> \/ High Performance Computing<\/a> \/ Documentation<\/a> \/ Minerva-Res Data Transfer[\/et_pb_text][\/et_pb_column][\/et_pb_row][\/et_pb_section][et_pb_section fb_built=”1″ _builder_version=”4.27.4″ _module_preset=”default” global_colors_info=”{}”][et_pb_row _builder_version=”4.27.4″ _module_preset=”default” custom_padding=”||||false|false” global_colors_info=”{}”][et_pb_column type=”4_4″ _builder_version=”4.27.4″ _module_preset=”default” global_colors_info=”{}”][et_pb_text _builder_version=”4.27.4″ _module_preset=”default” hover_enabled=”0″ custom_css_free_form=”.minerva-doc{–ink-900:#212070;–ink-700:#3a3a52;–ink-500:#6f7086;–line:#e4e4ee;–line-soft:#efeff6;–bg-page:#fbfbfd;–bg-card:#ffffff;–bg-subtle:#f5f5fa;–accent-600:#dc298d;–accent-500:#dc298d;–accent-100:#fbdeee;–accent-050:#fdf0f7;–indigo-100:#e4e4f2;–indigo-050:#f2f2f9;–code-bg:#1b1b3a;–code-text:#e6e6f0;–code-line:rgba(255,255,255,0.08);–font-body:%22Open Sans%22,-apple-system,BlinkMacSystemFont,%22Segoe UI%22,Helvetica,Arial,sans-serif;–font-mono:%22SFMono-Regular%22,%22JetBrains Mono%22,Consolas,Menlo,monospace;–radius-lg:14px;–radius-md:8px;–in-color:#212070;–out-color:#a8206e;–restricted-color:#c0392b;–cms-color:#6a2f8c;width:100%;padding:0 8px;background:var(–bg-page);color:var(–ink-700);font-family:var(–font-body);font-size:16px;line-height:1.65;-webkit-font-smoothing:antialiased;}||.minerva-doc *,.minerva-doc *::before,.minerva-doc *::after{box-sizing:border-box;}||.minerva-doc p br,.minerva-doc li br,.minerva-doc .note br,.minerva-doc .callout br{display:none;}||.minerva-doc .site-header{padding:40px 0 8px;}||.minerva-doc .brand-tag{display:inline-flex;align-items:center;font-size:12.5px;font-weight:600;color:#212070;background:var(–indigo-100);padding:5px 12px;border-radius:999px;letter-spacing:0.2px;margin-bottom:14px;}||.minerva-doc .brand-title{margin:0;color:var(–ink-900);font-size:32px;font-weight:700;letter-spacing:-0.6px;line-height:1.2;}||.minerva-doc .intro{padding:14px 0 30px;border-bottom:1px solid var(–line);}||.minerva-doc .doc-section{border-bottom:1px solid var(–line);}||.minerva-doc .doc-section:last-of-type{border-bottom:none;}||.minerva-doc .doc-section summary{list-style:none;cursor:pointer;padding:22px 0;display:flex;align-items:baseline;gap:8px;font-size:26px;font-weight:700;color:var(–ink-900);position:relative;}||.minerva-doc .doc-section summary::-webkit-details-marker{display:none;}||.minerva-doc .doc-section summary::after{content:%22%22;margin-left:auto;align-self:center;width:10px;height:10px;border-right:2px solid var(–ink-500);border-bottom:2px solid var(–ink-500);transform:rotate(45deg);transition:transform 0.2s ease;flex:none;}||.minerva-doc .doc-section%91open%93 summary::after{transform:rotate(-135deg);border-color:var(–accent-600);}||.minerva-doc .doc-section summary:hover{color:var(–accent-600);}||.minerva-doc .section-body{padding:0 0 28px;}||.minerva-doc .eyebrow{display:inline-block;font-family:var(–font-body);font-size:26px;font-weight:700;color:var(–ink-900);letter-spacing:0;}||.minerva-doc .intro-eyebrow{display:block;font-family:var(–font-body);font-size:26px;font-weight:700;color:var(–ink-900);letter-spacing:0;margin-bottom:10px;}||.minerva-doc h3{color:var(–ink-900);font-size:15px;font-weight:600;margin:24px 0 10px;line-height:1.3;}||.minerva-doc p{margin:0 0 16px;color:var(–ink-700);}||.minerva-doc .section-body>p:last-child{margin-bottom:0;}||.minerva-doc a{color:var(–accent-600);text-decoration:none;background-image:linear-gradient(var(–accent-500),var(–accent-500));background-repeat:no-repeat;background-size:100% 1px;background-position:0 100%;}||.minerva-doc a:hover{color:var(–ink-900);background-image:linear-gradient(#212070,#212070);}||.minerva-doc strong{font-weight:600;color:var(–ink-900);}||.minerva-doc ul,.minerva-doc ol{margin:0 0 16px;padding-left:22px;}||.minerva-doc li{margin-bottom:9px;}||.minerva-doc li ul,.minerva-doc li ol{margin-top:9px;margin-bottom:0;}||.minerva-doc ul>li::marker{color:var(–accent-500);}||.minerva-doc ol>li::marker{color:var(–accent-500);font-weight:600;}||.minerva-doc .callout{margin:20px 0 4px;padding:18px 22px;border-radius:var(–radius-md);}||.minerva-doc .callout p:last-child{margin-bottom:0;}||.minerva-doc .callout-accent{background:var(–indigo-050);border:1px solid var(–indigo-100);border-left:3px solid var(–accent-500);}||.minerva-doc .callout-accent strong{color:var(–ink-900);}||.minerva-doc .callout-restricted{background:#fdf0ef;border:1px solid #f5d6d3;border-left:3px solid var(–restricted-color);}||.minerva-doc .callout-restricted strong{color:var(–restricted-color);}||.minerva-doc .note{background:var(–bg-subtle);border:1px solid var(–line);border-left:3px solid #212070;padding:14px 18px;margin:0 0 16px;border-radius:0 var(–radius-md) var(–radius-md) 0;color:var(–ink-700);}||.minerva-doc code{font-family:var(–font-mono);background:var(–bg-subtle);color:#b81f77;padding:2px 6px;border-radius:4px;font-size:0.87em;border:1px solid var(–line);}||.minerva-doc .code-block{background:var(–code-bg);border-radius:var(–radius-md);margin:14px 0 22px;overflow:hidden;box-shadow:0 8px 24px rgba(33,32,112,0.18);}||.minerva-doc .code-block pre{margin:0;padding:14px 18px;font-family:var(–font-mono);font-size:13.5px;line-height:1.7;color:var(–code-text);white-space:pre-wrap;word-break:break-word;overflow-x:auto;}||.minerva-doc .code-block pre code{background:none;border:none;padding:0;color:inherit;}||.minerva-doc .table-wrap{overflow-x:auto;margin:14px 0 4px;border-radius:var(–radius-md);border:1px solid var(–line);}||.minerva-doc table{width:100%;border-collapse:collapse;font-size:14px;}||.minerva-doc th{background:var(–indigo-050);color:var(–ink-900);font-weight:600;text-align:left;padding:12px 16px;font-size:12px;text-transform:uppercase;letter-spacing:0.5px;border-bottom:1px solid var(–indigo-100);}||.minerva-doc td{padding:12px 16px;border-top:1px solid var(–line-soft);vertical-align:top;color:var(–ink-700);}||.minerva-doc tbody tr:hover{background:var(–bg-subtle);}||.minerva-doc .doc-footer{padding:24px 0 8px;text-align:center;color:var(–ink-500);font-size:13px;}||.minerva-doc .small{display:block;font-weight:400;color:var(–ink-500);font-size:12.5px;margin-top:2px;}||.minerva-doc .badge{display:inline-block;font-size:10.5px;font-weight:700;letter-spacing:0.05em;text-transform:uppercase;padding:3px 10px;border-radius:999px;color:#fff;white-space:nowrap;}||.minerva-doc .badge-in{background:var(–in-color);}||.minerva-doc .badge-out{background:var(–out-color);}||.minerva-doc .badge-restricted{background:var(–restricted-color);}||.minerva-doc .badge-cms{background:var(–cms-color);}||.minerva-doc .part-label{display:flex;align-items:center;gap:10px;width:fit-content;max-width:100%;margin:36px 0 4px;padding:10px 20px;font-size:13px;font-weight:700;letter-spacing:0.1em;text-transform:uppercase;color:#fff;background:linear-gradient(90deg,var(–ink-900),var(–accent-600));border-radius:999px;box-shadow:0 6px 16px rgba(33,32,112,0.22);}||@media (max-width:520px){.minerva-doc .part-label{font-size:11.5px;padding:9px 16px;}}||.minerva-doc .flow-block{border:1px solid var(–line);border-left:4px solid var(–accent-500);border-radius:var(–radius-md);padding:18px 20px;margin:20px 0;background:var(–bg-card);}||.minerva-doc .flow-in{border-left-color:var(–in-color);}||.minerva-doc .flow-out{border-left-color:var(–out-color);}||.minerva-doc .flow-restricted{border-left-color:var(–restricted-color);background:#fffafa;}||.minerva-doc .flow-cms{border-left-color:var(–cms-color);}||.minerva-doc .flow-header{display:flex;align-items:center;gap:10px;margin-bottom:12px;flex-wrap:wrap;}||.minerva-doc .flow-title{font-size:15px;font-weight:700;margin:0;}||.minerva-doc .flow-in .flow-title{color:var(–in-color);}||.minerva-doc .flow-out .flow-title{color:var(–out-color);}||.minerva-doc .flow-restricted .flow-title{color:var(–restricted-color);}||.minerva-doc .flow-cms .flow-title{color:var(–cms-color);}||.minerva-doc .steps{list-style:none;padding:0;margin:14px 0;counter-reset:step;}||.minerva-doc .steps>li{counter-increment:step;display:flex;gap:12px;margin-bottom:12px;padding-bottom:12px;border-bottom:1px dashed var(–line-soft);}||.minerva-doc .steps>li:last-child{border-bottom:none;padding-bottom:0;margin-bottom:0;}||.minerva-doc .steps>li::before{content:counter(step);flex-shrink:0;width:26px;height:26px;border-radius:50%;background:var(–accent-500);color:#fff;display:flex;align-items:center;justify-content:center;font-size:12px;font-weight:700;margin-top:1px;}||.minerva-doc .flow-in .steps>li::before{background:var(–in-color);}||.minerva-doc .flow-out .steps>li::before{background:var(–out-color);}||.minerva-doc .flow-cms .steps>li::before{background:var(–cms-color);}||.minerva-doc .step-content{flex:1;font-size:14px;line-height:1.65;}||.minerva-doc .step-content .code-block{margin:6px 0 4px;}||.minerva-doc .substeps{margin:8px 0 4px;padding-left:20px;font-size:14px;line-height:1.65;}||.minerva-doc .substeps li{margin-bottom:8px;}||.minerva-doc .responsibility-box{background:var(–bg-subtle);border:1px solid var(–line);border-top:3px solid var(–accent-500);border-radius:var(–radius-md);padding:14px 18px;margin:18px 0 4px;font-size:14px;}||.minerva-doc .responsibility-box h4{font-size:14px;font-weight:700;color:var(–ink-900);margin:0 0 8px;}||.minerva-doc .responsibility-box ul{margin:0;padding-left:20px;line-height:1.65;}||.minerva-doc .responsibility-box ul li{margin-bottom:6px;}||.minerva-doc .responsibility-box ul li:last-child{margin-bottom:0;}||.minerva-doc table td a,.minerva-doc table th a{font-weight:600;}||.minerva-doc .jump-links{font-size:12.5px;color:var(–ink-500);margin-top:4px;}||.minerva-doc .jump-links a{font-weight:600;}||.minerva-doc details.doc-section:target>.section-body{display:block !important;}||@media (max-width:520px){.minerva-doc .brand-title{font-size:24px;}.minerva-doc .doc-section summary{font-size:21px;}.minerva-doc .eyebrow,.minerva-doc .intro-eyebrow{font-size:21px;}}||body{margin:0;background:#fbfbfd;}” global_colors_info=”{}” sticky_enabled=”0″]<\/p>\n

\n
\n

HPC Documentation<\/span><\/p>\n

Data Transfer Guide for Minerva-Res<\/h1>\n<\/div>\n
\n

Overview<\/span>Data may only be transferred to and from Minerva-Res using an approved method as described below. All transfers of any type will be logged, and users remain responsible for following the restrictions that apply to their data according to the DUA.<\/p>\n

\n

By default:<\/strong> (1) standard SFTP and SSH file transfers are disabled. (2) All internet access is blocked, with only certain approved remote sites whitelisted via proxy settings for a defined period.<\/p>\n

You must not copy, export, transfer, or expose data to unapproved environments by any means \u2014 including copy\/paste, downloads, screenshots, or screen recordings.<\/p>\n

All approved data transfers must use cryptographic tools during transit.<\/p>\n<\/div>\n

Data Derivatives<\/h3>\n

All data derivatives** must be treated with the same level of protection unless explicitly approved for release by the PI as non-controlled data, following the restrictions that apply to their data according to the DUA.<\/p>\n

\n

**Data derived from controlled-access datasets obtained from NIH-designated data repositories. Examples of derived data include imputed datasets and single nucleotide polymorphisms, or any data explicitly designated as Data Derivatives by NIH. For additional information, see the NIH Data Access Certification Agreement<\/a>.<\/p>\n<\/div>\n

Data Transfer Summary<\/h3>\n

Click any row to jump straight to that section’s instructions.<\/p>\n

\n\n\n\n\n\n\n\n\n
Data Classification<\/th>\nTransfer Route<\/th>\nRequired Action & Approvals<\/th>\n<\/tr>\n<\/thead>\n
Non-Controlled Data<\/strong>Standard & CMS<\/span><\/td>\nData In<\/span> (Ingress)<\/td>\nHPC approval required. See Section 1<\/a> (Standard) or Section 3<\/a> (CMS).<\/td>\n<\/tr>\n
Data Out<\/span> (Egress)<\/td>\nPI approval required. See Section 1<\/a> (Standard) or Section 3<\/a> (CMS).<\/td>\n<\/tr>\n
Controlled Data<\/strong>Standard & CMS<\/span><\/td>\nData In<\/span> (Ingress)<\/td>\nCASE 1:<\/strong> Complete the External Connectivity Form for direct data download from a remote server. CASE 2:<\/strong> Otherwise, submit an HPC ticket for guidance. See Section 2<\/a> (Standard) or Section 4<\/a> (CMS).<\/td>\n<\/tr>\n
Controlled Data<\/strong>Standard & CMS<\/span><\/td>\nData Out<\/span> (Egress)<\/td>\nStrictly Prohibited.<\/strong> Requires DUA amendment & institutional review. Contact hpchelp@hpc.mssm.edu<\/a>. See Section 2<\/a> (Standard) or Section 4<\/a> (CMS).<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<\/div>\n<\/div>\n

Part A: Standard (Non-CMS) Data<\/span><\/p>\n

\n1\u00a0 Non-Controlled Data (Non-CMS)<\/summary>\n
\n

Non-Controlled Data here refers to: data that has been reviewed by the Principal Investigator and determined not to contain NIH controlled-access data, CMS controlled-access data, participant-level genomic data, or other information subject to access restrictions under the applicable Data Use Agreement, NIH policy, CMS policy, or institutional requirements.<\/p>\n

\n
\n

Data In<\/span><\/p>\n

Upload to Minerva-Res<\/h3>\n<\/div>\n

Non-controlled data may be transferred from Minerva Arion to Minerva-Res with HPC approval.<\/p>\n

    \n
  1. \n
    \n

    Place your files in the designated group-specific staging directory:<\/p>\n

    \n
    \/sc\/arion\/projects\/<project>\/from-arion-to-arionencrypt<\/pre>\n<\/div>\n