{"id":1421,"date":"2020-09-25T09:03:48","date_gmt":"2020-09-25T13:03:48","guid":{"rendered":"https:\/\/labs.icahn.mssm.edu\/minervalab\/?p=1421"},"modified":"2021-07-01T12:18:31","modified_gmt":"2021-07-01T16:18:31","slug":"minerva-expansion-more-storage-high-memory-nodes-and-a100-gpu-nodes","status":"publish","type":"post","link":"https:\/\/labs.icahn.mssm.edu\/minervalab\/minerva-expansion-more-storage-high-memory-nodes-and-a100-gpu-nodes\/","title":{"rendered":"Minerva expansion: more storage, high memory nodes, and A100 GPU nodes"},"content":{"rendered":"<div><span style=\"font-family: Calibri,Helvetica,sans-serif,serif,EmojiFont;font-size: medium\">Thanks to a donor, we\u2019re happy to announce that we will be expanding Minerva with new high memory nodes, A100 GPU nodes, and high-speed storage.\u00a0\u00a0<\/span><span style=\"color: black;font-family: Calibri,Helvetica,sans-serif,serif,EmojiFont;font-size: medium\">After the installation, we will have a total of<\/span><b> <\/b><span style=\"color: black;font-family: Calibri,Helvetica,sans-serif,serif,EmojiFont;font-size: medium\"><b>434 nodes for a total of 20,832<\/b><\/span><span style=\"color: black;font-family: Calibri,Helvetica,sans-serif,serif,EmojiFont;font-size: medium\"><b> cores, and <\/b><\/span><span style=\"color: black;font-family: Calibri,Helvetica,sans-serif,serif,EmojiFont;font-size: medium\"><b>21<\/b><\/span><span style=\"color: black;font-family: Calibri,Helvetica,sans-serif,serif,EmojiFont;font-size: medium\"><b>\u00a0petabytes of usable storage.<\/b><\/span><span style=\"font-family: Calibri,Helvetica,sans-serif,serif,EmojiFont;font-size: medium\"><br \/>\n<\/span><\/div>\n<div><span style=\"font-family: Arial,sans-serif,serif,EmojiFont;font-size: small\">\u00a0<\/span><\/div>\n<div><span style=\"color: black;font-family: Calibri,Helvetica,sans-serif,serif,EmojiFont;font-size: medium\">The expansion will consist of:<\/span><\/div>\n<div><span style=\"color: black;font-family: Calibri,Helvetica,sans-serif,serif,EmojiFont;font-size: medium\"><b>30<\/b><\/span><span style=\"color: black;font-family: Calibri,Helvetica,sans-serif,serif,EmojiFont;font-size: medium\"><b>\u00a0<\/b><\/span><span style=\"color: black;font-family: Calibri,Helvetica,sans-serif,serif,EmojiFont;font-size: medium\"><b>high memory nodes<\/b><\/span><span style=\"color: black;font-family: Calibri,Helvetica,sans-serif,serif,EmojiFont;font-size: medium\">\u00a0(<\/span><span style=\"color: black;font-family: Calibri,Helvetica,sans-serif,serif,EmojiFont;font-size: medium\">1.5 TB of memory per node<\/span><span style=\"color: black;font-family: Calibri,Helvetica,sans-serif,serif,EmojiFont;font-size: medium\">)<\/span><\/div>\n<ul>\n<li><span style=\"font-family: Calibri,Helvetica,sans-serif,serif,EmojiFont;font-size: small\"><span style=\"font-family: Calibri,Helvetica,sans-serif,serif,EmojiFont;font-size: medium\">48 Intel Xeon Platinum<\/span> <span style=\"color: black;font-family: Calibri,Helvetica,sans-serif,serif,EmojiFont;font-size: medium\">8<\/span><span style=\"color: black;font-family: Calibri,Helvetica,sans-serif,serif,EmojiFont;font-size: medium\">268<\/span> <span style=\"font-family: Calibri,Helvetica,sans-serif,serif,EmojiFont;font-size: medium\">2.9 GHz Processors per node, for a total of\u00a0<\/span><span style=\"font-family: Calibri,Helvetica,sans-serif,serif,EmojiFont;font-size: medium\">1,440<\/span><span style=\"font-family: Calibri,Helvetica,sans-serif,serif,EmojiFont;font-size: medium\">\u00a0cores<\/span><span style=\"font-family: Calibri,Helvetica,sans-serif,serif,EmojiFont;font-size: medium\"><br \/>\n<\/span><span style=\"font-family: Calibri,Helvetica,sans-serif,serif,EmojiFont;font-size: medium\"><br \/>\n<\/span><\/span><\/li>\n<\/ul>\n<div><span style=\"color: black;font-family: Calibri,Helvetica,sans-serif,serif,EmojiFont;font-size: medium\"><b>32\u00a0<\/b><\/span><span style=\"color: black;font-family: Calibri,Helvetica,sans-serif,serif,EmojiFont;font-size: medium\"><b>A100 GPUs<\/b><\/span><span style=\"color: black;font-family: Calibri,Helvetica,sans-serif,serif,EmojiFont;font-size: medium\">\u00a0in 8 nodes\u00a0<\/span><span style=\"color: black;font-family: Arial,sans-serif,serif,EmojiFont;font-size: medium\"><br \/>\n<\/span><\/div>\n<ul>\n<li><span style=\"font-family: Calibri,Helvetica,sans-serif,serif,EmojiFont;font-size: small\"><span style=\"color: black;font-family: Calibri,Helvetica,sans-serif,serif,EmojiFont;font-size: medium\">48<\/span><span style=\"font-family: Calibri,Helvetica,sans-serif,serif,EmojiFont;font-size: medium\">\u00a0<\/span><span style=\"font-family: Calibri,Helvetica,sans-serif,serif,EmojiFont;font-size: medium\">Intel Xeon Platinum 8268 2.9 GHz Processors per node,<\/span><span style=\"font-family: Arial,sans-serif,serif,EmojiFont;font-size: medium\"><span id=\"x_x_docs-internal-guid-22dd755f-7fff-c62d-11da-69ed2717c328\"><span style=\"font-family: Calibri,Helvetica,sans-serif,serif,EmojiFont;font-size: medium\">\u00a0384 GB memory per node, <\/span><span style=\"color: black;font-family: Calibri,Helvetica,sans-serif,serif,EmojiFont;font-size: medium\"><span id=\"divtagdefaultwrapper\"><span style=\"color: black;font-family: Calibri,Helvetica,sans-serif,EmojiFont,Apple Color Emoji,Segoe UI Emoji,NotoColorEmoji,Segoe UI Symbol,Android Emoji,EmojiSymbols;font-size: medium\">1.92\u00a0TB SSD per node, <\/span><\/span><\/span><span style=\"font-family: Calibri,Helvetica,sans-serif,serif,EmojiFont;font-size: medium\">4\u00a0A100 GPUs per node, 40 GB of memory on GPU, <\/span><span id=\"divtagdefaultwrapper\"><\/span><span style=\"font-family: Calibri,Helvetica,sans-serif,serif,EmojiFont;font-size: medium\">for a total of 384 cores, 32 A100 GPUs <\/span><span style=\"font-family: Calibri,Helvetica,sans-serif,serif,EmojiFont;font-size: medium\"><br \/>\n<\/span><\/span><\/span><\/span><\/li>\n<\/ul>\n<div><span style=\"color: black;font-family: Calibri,Helvetica,sans-serif,serif,EmojiFont;font-size: medium\"><b>11.6 petabytes<\/b><\/span><span style=\"color: black;font-family: Calibri,Helvetica,sans-serif,serif,EmojiFont;font-size: medium\">\u00a0of usable storage (16 PB raw)<\/span><\/div>\n<ul>\n<li><span style=\"font-family: Calibri,Helvetica,sans-serif,serif,EmojiFont;font-size: small\"><span style=\"font-family: Calibri,Helvetica,sans-serif,serif,EmojiFont;font-size: medium\">Will be integrated into Arion file system, for a total of 21.2 PB of usable storage in Arion<\/span><span style=\"font-family: Calibri,Helvetica,sans-serif,serif,EmojiFont;font-size: medium\"><br \/>\n<\/span><span style=\"font-family: Calibri,Helvetica,sans-serif,serif,EmojiFont;font-size: medium\"><br \/>\n<\/span><\/span><\/li>\n<\/ul>\n<div>\n<div><span style=\"font-family: Calibri,Helvetica,sans-serif,serif,EmojiFont;font-size: small\"><span style=\"font-family: Calibri,serif,EmojiFont;font-size: medium\">The storage and the high\u00a0memory nodes will be delivered\u00a0in late September, while the GPUs will be delivered in Oct. The installation will be planned afterward. \u00a0We expect the storage and the high memory nodes to be in\u00a0production in mid-November.<\/span><\/span><\/div>\n<div><span style=\"font-family: Calibri,Helvetica,sans-serif,serif,EmojiFont;font-size: small\"><span style=\"font-family: Calibri,serif,EmojiFont;font-size: medium\">\u00a0<\/span><\/span><\/div>\n<div><span style=\"font-family: Calibri,Helvetica,sans-serif,serif,EmojiFont;font-size: small\"><span style=\"font-family: Calibri,serif,EmojiFont;font-size: medium\">A couple of PMs may need to scheduled for the integration of these new nodes. We will minimize and\u00a0schedule the outages on weekends as best as\u00a0we can.\u00a0<\/span><span style=\"font-family: Calibri,serif,EmojiFont;font-size: medium\">We appreciate your patience and understanding during this upgrade. Please stay tuned for later updates.<\/span><\/span><\/div>\n<div><span style=\"font-family: Calibri,Helvetica,sans-serif,serif,EmojiFont;font-size: small\"><span style=\"font-family: Calibri,serif,EmojiFont;font-size: medium\">\u00a0<\/span><\/span><\/div>\n<div><span style=\"font-family: Calibri,Helvetica,sans-serif,serif,EmojiFont;font-size: small\"><span style=\"font-family: Calibri,serif,EmojiFont;font-size: medium\">Please let us know if you have any questions at\u00a0<\/span><a href=\"mailto:hpchelp@hpc.mssm.edu\" target=\"_blank\" rel=\"noopener noreferrer\"><span style=\"font-family: Calibri,serif,EmojiFont;font-size: medium\">hpchelp@hpc.mssm.edu<\/span><\/a><span style=\"font-family: Calibri,serif,EmojiFont;font-size: medium\">.<\/span><\/span><\/div>\n<\/div>\n<p>&nbsp;<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Thanks to a donor, we\u2019re happy to announce that we will be expanding Minerva with new high memory nodes, A100 GPU nodes, and high-speed storage.\u00a0\u00a0After the installation, we will have a total of 434 nodes for a total of 20,832 cores, and 21\u00a0petabytes of usable storage. \u00a0 The expansion will consist of: 30\u00a0high memory nodes\u00a0(1.5 [&hellip;]<\/p>\n","protected":false},"author":396,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_et_pb_use_builder":"","_et_pb_old_content":"","_et_gb_content_width":"","footnotes":""},"categories":[1],"tags":[],"class_list":["post-1421","post","type-post","status-publish","format-standard","hentry","category-research-services"],"aioseo_notices":[],"_links":{"self":[{"href":"https:\/\/labs.icahn.mssm.edu\/minervalab\/wp-json\/wp\/v2\/posts\/1421","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/labs.icahn.mssm.edu\/minervalab\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/labs.icahn.mssm.edu\/minervalab\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/labs.icahn.mssm.edu\/minervalab\/wp-json\/wp\/v2\/users\/396"}],"replies":[{"embeddable":true,"href":"https:\/\/labs.icahn.mssm.edu\/minervalab\/wp-json\/wp\/v2\/comments?post=1421"}],"version-history":[{"count":1,"href":"https:\/\/labs.icahn.mssm.edu\/minervalab\/wp-json\/wp\/v2\/posts\/1421\/revisions"}],"predecessor-version":[{"id":1422,"href":"https:\/\/labs.icahn.mssm.edu\/minervalab\/wp-json\/wp\/v2\/posts\/1421\/revisions\/1422"}],"wp:attachment":[{"href":"https:\/\/labs.icahn.mssm.edu\/minervalab\/wp-json\/wp\/v2\/media?parent=1421"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/labs.icahn.mssm.edu\/minervalab\/wp-json\/wp\/v2\/categories?post=1421"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/labs.icahn.mssm.edu\/minervalab\/wp-json\/wp\/v2\/tags?post=1421"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}