Zowe™ Overview and IBM Z Workload Scheduler Zowe extensions · 2020. 11. 2. · JobStream Joblog Dependency (successor, predecessor, resource, not completed predecessor) Resource

Zowe™ Overview and IBM Z Workload Scheduler Zowe extensions

Domenico D’Alterio

Z Automation Offering Manager – IBM

Federica Gari

Senior Tech Sales - HCL Software

November 2020

Session 4AC

email [email protected]

Linkedin: ddalteri

email: [email protected]

Linkedin: federicagari

November 2020

Session 4AC

https://twitter.com/gseukchttps://www.linkedin.com/groups/1741877https://www.facebook.com/pages/Guide-Share-Europe-UK-Region/174907039241415mailto:[email protected]://www.linkedin.com/in/ddalteri/mailto:[email protected]://www.linkedin.com/in/federicagari

Agenda

• Zowe introduction

• IBM Z Workload Scheduler Zowe extensions

• Demo: Zowe Workload Automation CLI add-on in action

• Additional enhancements recently delivered on IBM Z Workload Scheduler

Zowe introductionAn open source platform for the mainframe

https://www.zowe.org/

The Linux Foundation and the

projects we support form the

most ambitious and successful

investment in the creation of

shared technology

www.zowe.org/

https://www.zowe.org/

Why Zowe ?

Information Technology is undergoing a revolution of changing architectures

Co-Existence With Other Cloud Models

Protecting Current and Future Investments

Simple and Familiar

Zowe Vision Statement

• Attract new people✓ Demystify the Z platform

✓ Enhance integration and consumability

✓ Promote Open community and practice

• Reduce learning curve✓ Improve productivity

✓ Modern, platform-neutral interfaces

✓ Cloud-like experience

• Simplify architecture✓ Reduce operational overhead

✓ Improve co-existence

✓ Enable rich ecosystem of free and commercial solutions

Zowe accelerates digital transformation through API-enabled services Browser-based Virtual Desktop

Swagger-defined REST APIs

Node.js-based Cmd Line Interface

• Dataset API• Job API• USS API• System API

• MVS Explorer• USS Explorer• JES Explorer• TN3270• Workflow editor

CLI

Web UI

APIs

TSO

ISPF

Product Interfaces

Rexx

JCL

USS

Development and Operations Teams

(Internal/IT Facing)

API Mediation Layer

z/OSMF

• Any z/OS based REST APIs

• zos-files• zos-console• zos-jobs• zos-tso• zos-workflow• Plug-ins for z/OS

based REST APIs

REST Services:API economy for deep integration

Industry standard REST interfaces to z/OS resources that are language and platform neutral, stateless and scalable

Foundational building blocks for system services

Dataset APIs

• Create, read, update, delete, and list data sets

JES APIs

• View the information and files of jobs, and submit and cancel job

USS APIs

• Create, read, update, and delete USS files

System APIs

• View information about PARMLIB, SYSPLEX, and USER

Enables a single point of access to mainframe APIs with high-availability, scalability, dynamic API

discovery, consistent security, “one-time” sign-on experience and unified standard API documentation

(OpenAPI / Swagger)

• API Catalog

UI Catalog of available APIs with their Swagger doc

and service status

• Gateway

Single secure point of entry to an ecosystem of API

services. Hides complexity. Highly available. Based on

Netflix Zuul.

• Discovery Service

Discover APIs across many applications. Repository of

active API services. Based on Netflix Eureka.

API Mediation Layer: Gateway to mainframe APIs

Enables app developer and DevOps engineers to interact with the mainframe easily through a CLI from any terminal on Windows, MacOS, Linux

• Interact with mainframe filesCreate, edit, download, and upload mainframe files (data sets) directly

• Submit jobsSubmit JCL from data sets or local storage, monitor status, view and download output

automatically

• Issue TSO and z/OS console commandsIssue TSO and console commands to the mainframe directly

• Integrate z/OS actions into scriptsBuild local scripts that accomplish both mainframe and local tasks

• Produce responses as JSON documentsReturn data in JSON format on request for consumption in other programming languages

• CLI Plug-Ins Access to CICS and DB2

CLI: Enables cloud-like access to mainframe

Build | Test | Deploy

Easily integrates with IDEs, shell commands, bash scripts, and build tools; installs using NPM

The Zowe Web UI is a virtual desktop system that offers a rich and open platform for a web-based

mainframe user experience.

Mainframe Virtual Desktop

A web-based window manager that provides full screen interactive experience

Zowe Node Server

Runs zLUX; uses Express.js as web service framework for communication between applications and z/OS services and components, pre-reqs Node.js for z/OS

ZSS Server

Provides secured REST API services

Application plug-in

Dataservices, Configuration dataservice, URI broker, app-to-app communication, Error reporting UI, Logging utility

Explorers

JES, MVS, USS explorers

Basic editing support for REXX and JCL

Web Desktop: An app container in a browser

▪Visit the Open Mainframe Project

▪Visit Zowe.org

▪Connect with us on Slack or via email list

▪Zowe on zTrial (under IT Operations)

▪ Interskill Basics for Zowe badge Zowe Basics

▪Zowe Github

▪Download Zowe

▪Review documentation

▪Troubleshooting

▪Reach out to us on Slack or via email list

▪Review the extenders guide

▪Zowe Tutorials and Samples

▪Provide feedback, problems or recommendations to us on Slack or via email list

▪Submit Git Issues

▪Review the community backlogand contribute code

▪Earn your committer status through meritocracy

Learn ContributeConsume Extend

Zowe is building more than just technology, we are building a community

How to get involved in Zowe

https://www.openmainframeproject.org/projects/zowehttps://zowe.org/home/https://slack.openmainframeproject.org/https://lists.openmainframeproject.org/g/zowe-devhttps://www.ibm.com/it-infrastructure/z/resources/trialhttps://www.interskill.com/course-catalog/Zowe-Basics.htmlhttps://github.com/zowehttps://www.zowe.org/#downloadhttps://www.zowe.org/#documentationhttps://docs.zowe.org/stable/troubleshoot/troubleshooting.htmlhttps://slack.openmainframeproject.org/https://lists.openmainframeproject.org/g/zowe-devhttps://docs.zowe.org/stable/extend/extend-apiml/api-mediation-onboard-overview.html#overview-of-apishttps://developer.ibm.com/tutorials/zowe-step-by-step-tutorial/https://github.com/zowe/zowe-cli-sample-pluginhttps://slack.openmainframeproject.org/https://lists.openmainframeproject.org/g/zowe-devhttps://github.com/zowehttps://github.com/zowe

IBM Offerings Leverage Zowe as infrastructure Open for 3rd Party Use

An open source framework providing cloud-native ready

interfaces for z/OS

APIs• Discoverable• Scalable, Highly Available and

secure• Single Sign-On

CLI• Standard CLI access to z/OS

resources• Scriptable• Easy to use text interface

with inline help

Web Desktop• Desktop and WebUI

framework• Inter-app communication• 3270 emulator

Solution Extending Zowe

▪ Consistent management and administrative interfaces – appealing for NextGen IT staff

▪ Break down historical silos of various tools: allow task-oriented use and not product specific

▪ Facilitate participation in enterprise CI/CD Pipelines

▪ Infrastructure to allow Bring Your Own IDE

▪ Catalog of standard interfaces

IBM Z Software enhances DevOps and IT Operations using Zowe

IBM Z Open EditorModern editing experience and DevOps support for enterprise application development (COBOL, PL/1).

Client-side command line interfaces for managing CICS, IMS, Db2, MQ, z/OS Connect

EE and Workload Scheduler resources

Industry standard RESTful APIs for interacting with automation and network resources

Enhanced dashboarding for mainframe operation, problem analysis and storage

data management

IBM Z Open EditorIBM DB2 DevOps Experience

Zowe CLI Plugin for IBM CICS Zowe CLI Plugin for IBM Db2Zowe CLI Plugin for IBM IMSZowe CLI Plugin for IBM MQZowe CLI Plugin for IBM z/OS Connect EEZowe CLI Plugin for IBM Z Workload Scheduler

IBM Z NetViewIBM IMS Operation API IBM z/OS Connect EE (Admin API) IBM Z Development & Test (REST API) IBM Z Workload Scheduler

IBM Service Management UniteIBM OMEGAMON for Storage for z/OSIBM Advanced Storage Management SuiteIBM Z Service Management SuiteIBM Z Service Automation SuiteIBM Z Monitoring SuiteIBM Performance Management Suite for z/OSIBM Z System Management Explorer Beta (WebTEP)

15

Making Zowe open source available through a ”trusted” IBM channel

Providing entitled support for the IBM products using Zowe

Offering IBM Support on Zowe for customers that want to extend Zowe 15

Available since

March 6, 2020

IBM Z Distribution for Zowe

IBM Z Workload SchedulerZowe extensions

IBM Z Workload Scheduler V9.5.0

• Get the Best out of Containers: manage workload in containerized applications

• Workload optimization: Optimize the submission of jobs that are urgent or belong to a critical path

• Analytics on Batch log: Learn and optimize your scheduling with analytics engines like Splunk and ElasticSearch

IZWSController

Additional time specifications: to trigger automatic actions

End-to-End Batch Automation in a multi-cloud

environment with a modernized Dashboard UI.

Dynamic Workload Console: • Reduced SW stack• Improved user experience

Docker Eng.

Bin/libs

App A

WA Agent

Docker Eng.

Bin/libs

App D

Docker Eng.

Bin/libs

App E

kubectl run

Host OS

Server

IBM Z Workload Scheduler V9.5.0.2

• Workload Automation API in Zowe API ML & add-on for Zowe CLI

• Automatic deployment for integration plugins

• Alerts sent via e-mailfor job ending with unexpected conditions

Batch optimization: Force within JES the execution of a JOB on a specific LPAR and on a predefined class.

Extensibility and Integration point for Workload Automation

Dynamic Workload Console:

• Liberty on z/OS support for DWC

• DB2 for z/OS support for DWC on every platform

• Open Shift support

https://www.yourautomationhub.io/


ZoweTM workload automation extensions

CLI

Web UI

APIs

Controller--------------------------- LIST OF GENERATED DATES ---------------------------

Command ===> Scroll ===> CSR

Goto Year ===>

Rule : BASEDAYS

Calendar : DEFAULT Work day end time: 00.00

Interval : 13/01/01 - 16/12/31 Free day rule: E

July 2013 August 2013 September 2013

Mo Tu We Th Fr Sa Su Mo Tu We Th Fr Sa Su Mo Tu We Th Fr Sa Su

01 02 03 04 05 06 07 01 02 03 04 01

08 09 10 11 12 13 14 05 06 07 08 09 10 11 02 03 04 05 06 07 08

15 16 17 18 19 20 21 12 13 14 15 16 17 18 09 10 11 12 13 14 15

22 23 24 25 26 27 28 19 20 21 22 23 24 25 16 17 18 19 20 21 22

29 30 31 26 27 28 29 30 31 23 24 25 26 27 28 29

30

October 2013 November 2013 December 2013


01 02 03 04 05 06 01 02 03 01

07 08 09 10 11 12 13 04 05 06 07 08 09 10 02 03 04 05 06 07 08

14 15 16 17 18 19 20 11 12 13 14 15 16 17 09 10 11 12 13 14 15

21 22 23 24 25 26 27 18 19 20 21 22 23 24 16 17 18 19 20 21 22

28 29 30 31 25 26 27 28 29 30 23 24 25 26 27 28 29

30 31

Workload automation CLI

Workload automation API

Workload automation REST API documentationFull set of workload automation

REST API available for modelling,

monitoring and administration

Full set of workload automation REST API available for modelling,

monitoring and administration

Learn more in Session 3AF

REST API for modelling REST API allows to run multiple actions on the DB resources • Add • Modify• Delete• Query list of resources• Fetch a resource

Use Action HTTP Body/Filter Response

Create a new resource

Add POST Resource name to be created + some attributes

Resource ID

Update an existing resource

Update PUT Resource ID + attributes to be updated

Resource ID orNo content (for example releasing a job)

Delete a resource

Delete DELETE Resource ID

Retrieve a list of resources

Query POST Can be filtered with attributes

List of resources (ID & name)

Fetch a resource with all attributes

Fetch GET Resource ID Resource with all the attributes

DB Resources

JobStream

Job

Workstation

Calendar

Period

Resource

Variable Table

Run Cycle Group

Event Triggering

Operator Instruction


REST API for plan

REST API allows to run multiple actions on the Plan resources • Add • Modify• Retrieve list of resources• Fetch a resource

Plan Resources

Critical Job (list, info about risk level and list of predecessors on the critical network)

Job (list, submit, update properties, HOLD, NPO, release, set dependencies)

JobStream

Joblog

Dependency (successor, predecessor, resource, not completed predecessor)

Resource

Workstation

Use Action HTTP Body/Filter Response

Create a new resource

Add POST Resource name to be created + some attributes

Resource ID

Update an existing resource

Update PUT Resource ID + attributes to be updated

Resource ID orNo content (for example releasing a job)

Retrieve a list of resources

Query POST Can be filtered with attributes

List of resources (ID & name)

Fetch a resourcewith all attributes

Fetch GET Resource ID Resource with all the attributes


Workload Automation add-on to Zowe CLI

• get

• Get resources from scheduling plan

• list | ls

• List jobs, jobstreams and resources in scheduling plan, list jobstreams in model (database)

• submit | sub

• Submit a jobstream into the plan

• update

• Update resources in plan

• execute | exec

• Execute WAPL commands

Workload Automation new set of commands

DemoZowe workload automation add-on in action !

Automated Ticket management

Business Challenge

Benefits

• Automate the resolution of a Request

• reducing skil on scheduling environment

• reducing workload on scheduling team

• Improve efficency• Avoid delay• Reduce cost and time in business processes

management

IZWS solution in Zowe

An IZWS job takes in input the properties of the submitted requests and can

• run a recovery procedure

• rerun application with additional properties provided within the ticket

• submit an application which execution is triggered by time dependencies or other external conditions

Action A

Action B

Action C

An automatic job managesthe process in background

A ticket is submitted because of a failed job

Additional enhancementsDelivered on IBM Z Workload Scheduler in April 2020

Deployment options for “distributed” components

Docker® and OpenShiftTM

support for zCentric

Agent and Dynamic

Workload Console



Goto Year ===>

Rule : BASEDAYS





01 02 03 04 05 06 07 01 02 03 04 01

08 09 10 11 12 13 14 05 06 07 08 09 10 11 02 03 04 05 06 07 08

15 16 17 18 19 20 21 12 13 14 15 16 17 18 09 10 11 12 13 14 15

22 23 24 25 26 27 28 19 20 21 22 23 24 25 16 17 18 19 20 21 22

29 30 31 26 27 28 29 30 31 23 24 25 26 27 28 29

30



01 02 03 04 05 06 01 02 03 01

07 08 09 10 11 12 13 04 05 06 07 08 09 10 02 03 04 05 06 07 08

14 15 16 17 18 19 20 11 12 13 14 15 16 17 09 10 11 12 13 14 15

21 22 23 24 25 26 27 18 19 20 21 22 23 24 16 17 18 19 20 21 22

28 29 30 31 25 26 27 28 29 30 23 24 25 26 27 28 29

30 31

Tracker--------------------------- LIST OF GENERATED DATES ---------------------------


Goto Year ===>

Rule : BASEDAYS





01 02 03 04 05 06 07 01 02 03 04 01

08 09 10 11 12 13 14 05 06 07 08 09 10 11 02 03 04 05 06 07 08

15 16 17 18 19 20 21 12 13 14 15 16 17 18 09 10 11 12 13 14 15

22 23 24 25 26 27 28 19 20 21 22 23 24 25 16 17 18 19 20 21 22

29 30 31 26 27 28 29 30 31 23 24 25 26 27 28 29

30



01 02 03 04 05 06 01 02 03 01

07 08 09 10 11 12 13 04 05 06 07 08 09 10 02 03 04 05 06 07 08

14 15 16 17 18 19 20 11 12 13 14 15 16 17 09 10 11 12 13 14 15

21 22 23 24 25 26 27 18 19 20 21 22 23 24 16 17 18 19 20 21 22

28 29 30 31 25 26 27 28 29 30 23 24 25 26 27 28 29

30 31

Tracker--------------------------- LIST OF GENERATED DATES ---------------------------


Goto Year ===>

Rule : BASEDAYS





01 02 03 04 05 06 07 01 02 03 04 01

08 09 10 11 12 13 14 05 06 07 08 09 10 11 02 03 04 05 06 07 08

15 16 17 18 19 20 21 12 13 14 15 16 17 18 09 10 11 12 13 14 15

22 23 24 25 26 27 28 19 20 21 22 23 24 25 16 17 18 19 20 21 22

29 30 31 26 27 28 29 30 31 23 24 25 26 27 28 29

30



01 02 03 04 05 06 01 02 03 01

07 08 09 10 11 12 13 04 05 06 07 08 09 10 02 03 04 05 06 07 08

14 15 16 17 18 19 20 11 12 13 14 15 16 17 09 10 11 12 13 14 15

21 22 23 24 25 26 27 18 19 20 21 22 23 24 16 17 18 19 20 21 22

28 29 30 31 25 26 27 28 29 30 23 24 25 26 27 28 29

30 31

zCentric Agent

Dynamic Workload Console Dynamic Workload Console run

natively on z/OS

- through WebSphere® Application

Server for z/OS Liberty

In a JES environment the submission of

a job on a specific system does not guarantee the execution on the same system too

New configuration parameters available to force within JES the execution of a JOB on a specific

LPAR and on a predefined class

New global policy to identify

JES2 system that can process the job

New global policy to identify

the list of workstation for which a class is

specified for the job in the plan

Batch workload execution dynamic control

Alerts sent via e-mail to list of subscribers

As an administrator or an operator you want an alert if

a job ends with an unexpected conditions



Goto Year ===>

Rule : BASEDAYS





01 02 03 04 05 06 07 01 02 03 04 01

08 09 10 11 12 13 14 05 06 07 08 09 10 11 02 03 04 05 06 07 08

15 16 17 18 19 20 21 12 13 14 15 16 17 18 09 10 11 12 13 14 15

22 23 24 25 26 27 28 19 20 21 22 23 24 25 16 17 18 19 20 21 22

29 30 31 26 27 28 29 30 31 23 24 25 26 27 28 29

30



01 02 03 04 05 06 01 02 03 01

07 08 09 10 11 12 13 04 05 06 07 08 09 10 02 03 04 05 06 07 08

14 15 16 17 18 19 20 11 12 13 14 15 16 17 09 10 11 12 13 14 15

21 22 23 24 25 26 27 18 19 20 21 22 23 24 16 17 18 19 20 21 22

28 29 30 31 25 26 27 28 29 30 23 24 25 26 27 28 29

30 31

--------------------------- LIST OF GENERATED DATES ---------------------------


Goto Year ===>

Rule : BASEDAYS





01 02 03 04 05 06 07 01 02 03 04 01

08 09 10 11 12 13 14 05 06 07 08 09 10 11 02 03 04 05 06 07 08

15 16 17 18 19 20 21 12 13 14 15 16 17 18 09 10 11 12 13 14 15

22 23 24 25 26 27 28 19 20 21 22 23 24 25 16 17 18 19 20 21 22

29 30 31 26 27 28 29 30 31 23 24 25 26 27 28 29

30



01 02 03 04 05 06 01 02 03 01

07 08 09 10 11 12 13 04 05 06 07 08 09 10 02 03 04 05 06 07 08

14 15 16 17 18 19 20 11 12 13 14 15 16 17 09 10 11 12 13 14 15

21 22 23 24 25 26 27 18 19 20 21 22 23 24 16 17 18 19 20 21 22

28 29 30 31 25 26 27 28 29 30 23 24 25 26 27 28 29

30 31

Tracker Tracker--------------------------- LIST OF GENERATED DATES ---------------------------


Goto Year ===>

Rule : BASEDAYS





01 02 03 04 05 06 07 01 02 03 04 01

08 09 10 11 12 13 14 05 06 07 08 09 10 11 02 03 04 05 06 07 08

15 16 17 18 19 20 21 12 13 14 15 16 17 18 09 10 11 12 13 14 15

22 23 24 25 26 27 28 19 20 21 22 23 24 25 16 17 18 19 20 21 22

29 30 31 26 27 28 29 30 31 23 24 25 26 27 28 29

30



01 02 03 04 05 06 01 02 03 01

07 08 09 10 11 12 13 04 05 06 07 08 09 10 02 03 04 05 06 07 08

14 15 16 17 18 19 20 11 12 13 14 15 16 17 09 10 11 12 13 14 15

21 22 23 24 25 26 27 18 19 20 21 22 23 24 16 17 18 19 20 21 22

28 29 30 31 25 26 27 28 29 30 23 24 25 26 27 28 29

30 31 zCentric Agent

Dynamic Workload Console

IBM Z Workload Schedulerthe enterprise automation hub

Automation and orchestration needs of

DevOps, digital enterprises, hybrid cloud

architectures…covering the spectrum of

needs from IT tasks automation to business

applications

Automation Hub


Automatic deployment for integration plugins

Dynamic Workload Console

zCentricAgent

Controller

Plugin installation is now required only on the Dynamic

Worlkload Console

zCentric AgentzCentric Agent

zCentricAgent

The needed plugin will be automatically deployed on the

zCentric Agents at job submission time

--------------------------- LIST OF GENERATED DATES ---------------------------


Goto Year ===>

Rule : BASEDAYS





01 02 03 04 05 06 07 01 02 03 04 01

08 09 10 11 12 13 14 05 06 07 08 09 10 11 02 03 04 05 06 07 08

15 16 17 18 19 20 21 12 13 14 15 16 17 18 09 10 11 12 13 14 15

22 23 24 25 26 27 28 19 20 21 22 23 24 25 16 17 18 19 20 21 22

29 30 31 26 27 28 29 30 31 23 24 25 26 27 28 29

30



01 02 03 04 05 06 01 02 03 01

07 08 09 10 11 12 13 04 05 06 07 08 09 10 02 03 04 05 06 07 08

14 15 16 17 18 19 20 11 12 13 14 15 16 17 09 10 11 12 13 14 15

21 22 23 24 25 26 27 18 19 20 21 22 23 24 16 17 18 19 20 21 22

28 29 30 31 25 26 27 28 29 30 23 24 25 26 27 28 29

30 31

Please submit your session feedback!

• Do it online at http://conferences.gse.org.uk/2020/feedback/4AC

• This session is 4AC

http://conferences.gse.org.uk/2020/feedback/4AC

GSE UK Conference 2020 Charity

• The GSE UK Region team hope that you find this presentation and others that follow useful and help to expand your knowledge of z Systems.

• Please consider showing your appreciation by kindly donating a small sum to our charity this year, NHS Charities Together. Follow the link below or scan the QR Code:

http://uk.virginmoneygiving.com/GuideShareEuropeUKRegion

http://uk.virginmoneygiving.com/GuideShareEuropeUKRegion

Documents

Zowe™ Overview and IBM Z Workload Scheduler Zowe extensions · 2020. 11. 2. · JobStream Joblog Dependency (successor, predecessor, resource, not completed predecessor) Resource