SSUG::Digital: 013 – Event driven data management and security using Spectrum Scale Clustered Watch Folder and File Audit Logging (Held in conjunction with CIUK)

Spectrum Scale provides various methods for automated data management: The Policy Engine enables rule-based data placement and data management. File Audit Logging  enables you to audit file accesses for compliance reasons. The Clustered Watch folder feature enables you to watch and respond to file system activity.  This session starts with a customer talk by DESY about their use of the policy engine to automate data-intensive workflows. Then IBM provides an overview of File Audit Logging and Clustered Watch along with use cases and recent architectural enhancements with examples.

Download slides here

 

Speaker NamePhotoBio
Jürgen Hannappel (DESY)Jürgen Hannappel works in the scientific computing group of the DESY IT department on data management for EuXFEL and Petra III. With a background in particle physics his interests shifted towards computing over time as his place of work moved from CERN and Bonn University to DESY
John Olson (IBM)John OlsonJohn Olson is a senior software engineer and the Spectrum Scale Security Architect. He has been with IBM for 21 years and has been working on Spectrum Scale since 2014. Previously, John worked on SoNAS, virtual tape servers and tape controller RAS. John was the lead developer of file audit logging in 5.0.0 and continues to architect the new solutions.
Jake Tick (IBM)Jake TickJake is a development manager for Spectrum Scale. In his almost 6 years at IBM, he has been on the Spectrum Scale system test team, FVT test team, and has now moved into management to help lead the file audit logging and watch folder team.
Luis Teran (IBM)Luis TeranLuis, who has been with IBM for about 4 years, is the lead developer for clustered watch folder and file audit logging. Luis started his work with system test on Spectrum Scale then shortly after moved into a development role. Luis now owns development for the file audit logging and cluster watch components.

The last 2020 SSUG::Digital event will take place on December 4th and is being held in conjunction with Computing Insight UK 2020. The main CIUK conference will take place on 3rd December with the user group event on 4th December.

Held in association with CIUK:

SSUG::Digital: 011 – What is new in Spectrum Scale 5.1?

Spectrum Scale is a highly scalable, high-performance storage solution for file and object storage. IBM continues to enhance Spectrum Scale performance, in response to recent hardware advancements and evolving workloads. This talk will discuss key enhancements delivered with Spectrum Scale 5.1 including Fileset QoS, AFM to object storage, NFSv4.1 support, IPv6 for Cluster Export Services (CES), and integration with ESS 3000 and ESS 5000.

Download slides here

Related material

User Group Host: Kristy Kallback-Rose

Speaker

Speaker NamePhotoBioSocial connections
Chris MaestasChris MaestasChris is an Executive Architect for IBM File and Object Storage Solutions with over 25 years of experience deploying and designing IT systems for clients in various spaces. He has experience scaling performance and availability with a variety of file systems technologies. He has developed benchmark frameworks to test out systems for reliability and validate research performance data. He also has led global enablement sessions online and face to face where discussing how best to position mature technologies like Spectrum Scale with emerging technologies in Cloud, Object, Container or AI spaces.Twitter: @cdmaestas
LinkedIn: https://www.linkedin.com/in/cdmaestas
Ismael Solis MorenoIsmael Solis MorenoIsmael works in the Spectrum Scale development team in Guadalajara Mexico as a data scientist and performance analyst. He is responsible for evaluating Spectrum Scale's new features and releases performance. Part of his role is to analyze datasets to identify points of performance improvement providing insights to the development teams.LinkedIn: https://www.linkedin.com/in/ismaelsm

 

 

SSUG::Digital: 010 – Data Accelerator for Analytics and AI (DAAA)

This talk focuses on the need of data orchestration in enterprise data pipelines. It provides details about data orchestration and how to address typical challenges that customers face when dealing with large and ever-growing amounts of data for data analytics. While the amount of data increases steadily, AI workloads need to speed up in order to be able to deliver insights and business value in a timely manner. IBM addresses these requirements with the Data Accelerator for AI and Analytics (DAAA), an expertly engineered solution based on new features delivered with Spectrum Scale 5.1. The session will include a demo of a complex proof-of-concept and present the key learnings and results.

 

Download slides here

Related material

User Group Host: Bill Anderson

Speakers

Speaker NamePhotoBio
Simon LorenzSimon Lorenz is an IT Architect at IBM Research and Development in Frankfurt, Germany. He joined IBM Germany in 1993 and has held various positions within IBM and IBM Research and Development. During international assignments, he helped to improve fully automated chip factories in Asia and US. Simon joined the IBM Spectrum Scale development team in 2014 and since then worked on: Openstack Swift integration, designing and building System Health and Proactive Services solutions. Since March 2019 he is the world wide leader of the IBM Spectrum Scale Big Data and Analytics team. His role includes designing and building solutions in the area of AI such as the Data Accelerator for AI and Analytics.
Gero SchmidtGero Schmidt is a Software Engineer at IBM Germany Research and Development GmbH in the IBM Spectrum Scale development group.
He joined IBM in 2001 working at the European Storage Competence Center in Mainz, Germany, providing technical presales support for a broad range of IBM storage products with a primary focus on enterprise storage solutions, system performance, and IBM POWER systems. He participated in the product rollout of the IBM System Storage DS6000/DS8000 series, co-authored several IBM Redbooks and has been a frequent speaker at IBM international conferences. In 2015 he joined the storage research group at the IBM Almaden Research Center in California, USA, where he worked on IBM Spectrum Scale, compression of genomic data in next generation sequencing pipelines, and the development of a cloud-native backup solution for containerized applications in Kubernetes/Red Hat OpenShift. In 2018 Gero joined the Big Data & Analytics team in the IBM Spectrum Scale development group.

SSUG::Digital: 009 – Deep Thought: An AI Project for Autonomous Driving Development

Continental, a tier-1 automotive supplier, runs a new high-performance cluster based on NVIDIA DGX, IBM Spectrum Scale and IBM ESS to boost autonomous driving development performance. Continental uses this system for deep learning, simulation, virtual data generation and related workloads. The new cluster reduces development time from weeks to hours. Speakers from Continental and the business partner SVA will present business requirements and derived workloads, the Spectrum and ESS implementation, and first operational experience.

 

Download slides here

Q&A

Did Continental ever look at Spectrum Discover for tagging? Any feedback on pros/cons for its usefulness at Continental?
We did not have a chance to look into Spectrum Discover.

Related material

User Group Host: Bill Anderson

Speaker

Speaker NamePhotoBio
David EnenkelDavid Enenkel is the Head of IT Operations at Continental - ADC GmbH. He has over 20 years of IT-Infrastructure experience and moved into the area of ADAS 2,5 years ago. He and his team are supporting the ADC engineers to find and establish feasible IT solutions/services for the specific ADAS demands as well as operating the platforms and data centers. He led the Supercomputer project as the IT project manager and is happy to give an insight into all ups and downs building up such an environment.
Viktor PálViktor Pál is working as a Deep Learning Infrastructure Architect at Continental and is currently also acting as Technical Team Lead. He has more than 14 years of IT Infrastructure experience and started working at Continental two years ago. Viktor and his team are supporting AI development by designing, implementing and operating the environment that enables Deep Learning at Continental. He contributed to the Supercomputer project as a Solution Architect and he will talk about the challenges of AI Infrastructure as Code.
Jochen ZellerJochen is IT Architect at www.sva.de. He has more than 20 years of IT experience, is part of the SVA IT Architects team and technical leader of the Spectrum Scale team. His Spectrum Scale and infrastructure projects span various industries and fields, such as HPC, health care, autonomous driving, banking, insurance, etc. When he is not working with his customers, he sits in his glider and flies away - at least in summer.

SSUG::Digital: 008 – Scalable multi-node training for AI workloads on NVIDIA DGX, Red Hat OpenShift and IBM Spectrum Scale

Nvidia and IBM did a complex proof-of-concept to demonstrate the scaling of AI workload using Nvidia DGX, Red Hat OpenShift and IBM Spectrum Scale at the example of ResNet-50 and the segmentation of images using the Audi A2D2 dataset. The project team published an IBM Redpaper with all the technical details and will present the key learnings and results.

 

Download slides here

Related material

User group host: Bob Oesterlin

Speakers:

Speaker NamePhotoBio
Thomas SchoenemeyerThomas Schoenemeyer is a Senior Solution Architect and works for the NVIDIA EMEA Automotive Enterprise Team in Munich since March 2019. His area of expertise covers defining the computing architecture and infrastructure for the development of autonomous vehicles. He is helping customers to solve their technical challenges by integrating NVIDIA datacenter products such as the DGX family, the DriveSim/Constellation and NVIDIA Mellanox Networking solutions.
Gero SchmidtGero Schmidt is a Software Engineer at IBM Germany Research and Development GmbH in the IBM Spectrum Scale development group.
He joined IBM in 2001 working at the European Storage Competence Center in Mainz, Germany, providing technical presales support for a broad range of IBM storage products with a primary focus on enterprise storage solutions, system performance, and IBM POWER systems. He participated in the product rollout of the IBM System Storage DS6000/DS8000 series, co-authored several IBM Redbooks and has been a frequent speaker at IBM international conferences. In 2015 he joined the storage research group at the IBM Almaden Research Center in California, USA, where he worked on IBM Spectrum Scale, compression of genomic data in next generation sequencing pipelines, and the development of a cloud-native backup solution for containerized applications in Kubernetes/Red Hat OpenShift. In 2018 Gero joined the Big Data & Analytics team in the IBM Spectrum Scale development group.
Simon LorenzSimon Lorenz is an IT Architect at IBM Research and Development in Frankfurt, Germany. He joined IBM Germany in 1993 and has held various positions within IBM and IBM Research and Development. During international assignments, he helped to improve fully automated chip factories in Asia and US. Simon joined the IBM Spectrum Scale development team in 2014 and since then worked on: Openstack Swift integration, designing and building System Health and Proactive Services solutions. Since March 2019 he is the world wide leader of the IBM Spectrum Scale Big Data and Analytics team. His role includes designing and building solutions in the area of AI such as the Data Accelerator for AI and Analytics.