{"id":1694,"date":"2015-11-05T16:57:17","date_gmt":"2015-11-05T16:57:17","guid":{"rendered":"http:\/\/amlight.net\/?p=1694"},"modified":"2023-07-21T12:59:44","modified_gmt":"2023-07-21T16:59:44","slug":"supercomputing-2015-high-speed-scientific-data-transfers-using-software-defined-networking","status":"publish","type":"post","link":"https:\/\/www.amlight.net\/?p=1694","title":{"rendered":"SuperComputing 2015 High Speed Scientific Data Transfers using Software Defined Networking"},"content":{"rendered":"<p align=\"justify\"><b><a href=\"http:\/\/sc15.supercomputing.org\/conference-program\/research-scinet\/nre-demos-2015\"><img decoding=\"async\" class=\"alignleft wp-image-1707 \" src=\"http:\/\/amlight.net\/wp-content\/uploads\/2015\/11\/SC15-logo.png\" alt=\"SC15-logo\" width=\"237\" height=\"157\" srcset=\"https:\/\/www.amlight.net\/wp-content\/uploads\/2015\/11\/SC15-logo-300x199.png 300w, https:\/\/www.amlight.net\/wp-content\/uploads\/2015\/11\/SC15-logo.png 340w\" sizes=\"(max-width: 237px) 100vw, 237px\" \/><\/a>Austin, Texas &#8211; <\/b>During the SuperComputing 2015 (SC15) conference November 16-20, an International team of high energy physicists, computer scientists, and network engineers led by the California Institute of Technology (Caltech), <a href=\"http:\/\/www.sprace.org.br\/\">SPRACE Sao Paulo<\/a> and <a href=\"http:\/\/www.aglt2.org\/supercomputing.php\">University of Michigan<\/a>, together with teams from FIU, Vanderbilt and support from vendors including Dell, Mellanox, QLogic, SGI and Spirent are working together to demonstrate large data flow transfers across an highly intelligent SDN network. This work is being supported by SCinet Network Research Exhibition <a href=\"http:\/\/sc15.supercomputing.org\/conference-program\/research-scinet\/nre\">(NRE)<\/a> and also presented in the <a href=\"https:\/\/scinet.supercomputing.org\/workshop\/node\/8\">INDIS<\/a> workshop and submitted to IEEE ACM for the publication. <a href=\"http:\/\/supercomputing.caltech.edu\/docs\/INDIS_Workshop_Paper_Oct2015_Final.pdf\">Click<\/a> here to read the paper submitted to IEEE.<\/p>\n<p><strong>SDN Demonstrations<\/strong><\/p>\n<p>SDN demonstration revolves around an OpenFlow ring connecting 7 different booths and two WAN connections. Some of the WAN connections are built using the NSI and then stitched using the custom SDN application. This helps creating an intelligent design where large flows traverse across various paths based on either the shortest or the fastest routes availability. Remote NSI paths are shown in the picture below. An interesting aspect is that all the remote switches will be controlled by a single ODL controller in the Caltech booth at the show floor.<\/p>\n<p>The group has just released first working library to control the SDN controller OpenDaylight (Lithium). The library is written in Python and is available at github:<a href=\"https:\/\/pypi.python.org\/pypi\/python-odl\/\">https:\/\/pypi.python.org\/pypi\/python-odl\/<\/a><\/p>\n<table border=\"0\" width=\"600\" cellspacing=\"4\" cellpadding=\"4\">\n<tbody>\n<tr>\n<td><a href=\"http:\/\/amlight.net\/wp-content\/uploads\/2015\/11\/DemonstrationRoutes.png\" rel=\"prettyPhoto\"><img decoding=\"async\" class=\"aligncenter wp-image-1695 size-medium\" src=\"http:\/\/amlight.net\/wp-content\/uploads\/2015\/11\/DemonstrationRoutes-300x239.png\" alt=\"SuperComputing 2015\" width=\"300\" height=\"239\" srcset=\"https:\/\/www.amlight.net\/wp-content\/uploads\/2015\/11\/DemonstrationRoutes-147x118.png 147w, https:\/\/www.amlight.net\/wp-content\/uploads\/2015\/11\/DemonstrationRoutes-177x142.png 177w, https:\/\/www.amlight.net\/wp-content\/uploads\/2015\/11\/DemonstrationRoutes-300x239.png 300w, https:\/\/www.amlight.net\/wp-content\/uploads\/2015\/11\/DemonstrationRoutes.png 930w\" sizes=\"(max-width: 300px) 100vw, 300px\" \/><\/a><\/td>\n<td><a href=\"http:\/\/amlight.net\/wp-content\/uploads\/2015\/11\/SDN-Ring.png\" rel=\"prettyPhoto\"><img decoding=\"async\" class=\"aligncenter wp-image-1698 size-medium\" src=\"http:\/\/amlight.net\/wp-content\/uploads\/2015\/11\/SDN-Ring-300x199.png\" alt=\"SDN-Ring\" width=\"300\" height=\"199\" srcset=\"https:\/\/www.amlight.net\/wp-content\/uploads\/2015\/11\/SDN-Ring-300x199.png 300w, https:\/\/www.amlight.net\/wp-content\/uploads\/2015\/11\/SDN-Ring.png 894w\" sizes=\"(max-width: 300px) 100vw, 300px\" \/><\/a><\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<p>&nbsp;<\/p>\n<p><strong>High Speed DTN demonstrations at 100GE<\/strong><\/p>\n<p>With the recent scientific innovations and continuous outcomes in the major fields like LHC, Genomis, Astronomy, Oceanlogy, the data volumes are increasing and requires efficient protocols and mechanisms to transport across the globe. The group will present such technologies and demonstrate data transfers at 100GE from disk to disk.<\/p>\n<p>A separate demonstration will show the future challenges on the systems design for the 400GE and beyond between a pair of systems.<\/p>\n<p><strong>Named Data Networking (NDN)<\/strong><\/p>\n<p>NDN project aims to develop a new Internet architecture that can capitalize on strengths \u2014 and address weaknesses \u2014 of the Internet\u2019s current host-based, point-to-point communication architecture in order to naturally accommodate emerging patterns of communication. By naming data instead of their locations, NDN transforms data into a first-class entity. At SC15, a separate NDN node will be announcing LHC data objects while the visualization software from the NDN group will show case data flows to the shortest routes.<\/p>\n<p>This work is made possible by the strong support of\u00a0the <b>US Department of Energy Office of Science\u00a0<\/b>and the <b>National Science Foundation<\/b>.<\/p>\n<p>CIARA presentations at SC15:<\/p>\n<p><strong>Title:<\/strong> &#8220;<a href=\"http:\/\/amlight.net\/wp-content\/uploads\/2015\/03\/SC15_openWave_ibarra_v2.pdf\" target=\"_blank\" rel=\"noopener noreferrer\">OpenWave: U.S.-Brazil 100G Experimental Alien Wave<\/a>&#8221;<br \/>\n<strong>Time:<\/strong> 10:00am-10:20am, Nov 17\u00a0at Caltech booth<br \/>\n<strong>Presenters:<\/strong> Julio Ibarra, Heidi Morgan, Donald Cox, and Louis Fox<\/p>\n<p><strong>Title:<\/strong> &#8220;<a href=\"http:\/\/amlight.net\/wp-content\/uploads\/2015\/11\/LSSTProjectUpdate_SC15-HM.pdf\" target=\"_blank\" rel=\"noopener noreferrer\">LSST Project Update<\/a>&#8220;, <a href=\"https:\/\/www.youtube.com\/watch?v=c16h1yyS-78\" target=\"_blank\" rel=\"noopener noreferrer\">Click here to watch video about LSST<\/a><br \/>\n<strong>Time:<\/strong> 10:00am-10:20am, Nov 19 at Caltech booth<br \/>\n<strong>Presenters:<\/strong>\u00a0Heidi Morgan<\/p>\n<p><strong>Title:<\/strong> &#8220;<a href=\"http:\/\/amlight.net\/wp-content\/uploads\/2015\/11\/20150814-data-transfer-sdn-sciencedmz-sc15.pdf\" target=\"_blank\" rel=\"noopener noreferrer\">Data Transfer in a Science DMZ using SDN with Applications for Precision Medicine in Cloud and High-performance Computing<\/a>&#8221;<br \/>\n<strong>Time:<\/strong> 8:40am &#8211; 9:00am, Nov 20th<br \/>\n<strong>Presenters:<\/strong> Nam Pho, Dino Magri, Fernando Redigolo, Byoung-Do Kim, Timothy Feeney, Heidi Morgan, Chirag Patel, Chris Botka and Tereza Carvalho<\/p>\n<p><strong>Title:<\/strong> &#8220;<a href=\"http:\/\/amlight.net\/wp-content\/uploads\/2015\/11\/SC15-AtlanticWave-SDX-slides.pdf\" target=\"_blank\" rel=\"noopener noreferrer\">AtlanticWave-SDX: An International SDX to Support Science Data Applications<\/a>&#8221;<br \/>\n<strong>Time:<\/strong> 9:20am &#8211; 9:40am, Nov 20th<br \/>\n<strong>Presenters:<\/strong> Joaqu\u00edn Chung, Jacob Cox, Julio Ibarra, Jeronimo Bezerra, Heidi Morgan, Russell Clark and Henry Owen<\/p>\n<p>For original article click <a href=\"http:\/\/supercomputing.caltech.edu\/\" target=\"_blank\" rel=\"noopener noreferrer\">here<\/a>.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Austin, Texas &#8211; During the SuperComputing 2015 (SC15) conference November 16-20, an International team of high energy physicists, computer scientists, and network engineers led by [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":1695,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[18],"tags":[],"_links":{"self":[{"href":"https:\/\/www.amlight.net\/index.php?rest_route=\/wp\/v2\/posts\/1694"}],"collection":[{"href":"https:\/\/www.amlight.net\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.amlight.net\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.amlight.net\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.amlight.net\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=1694"}],"version-history":[{"count":10,"href":"https:\/\/www.amlight.net\/index.php?rest_route=\/wp\/v2\/posts\/1694\/revisions"}],"predecessor-version":[{"id":5416,"href":"https:\/\/www.amlight.net\/index.php?rest_route=\/wp\/v2\/posts\/1694\/revisions\/5416"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.amlight.net\/index.php?rest_route=\/wp\/v2\/media\/1695"}],"wp:attachment":[{"href":"https:\/\/www.amlight.net\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=1694"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.amlight.net\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=1694"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.amlight.net\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=1694"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}