Streaming IBM i to Kafka for Next-Gen Use Cases

Streaming IBM i to
Kafka for Next-Gen
Use Cases
Aisan Baird - Senior Director, Sales Engineering, Precisely
Angelo Agatino Nicolosi - Information Technology
Consultant, YanchWare

Agenda
• Introduction to Precisely
• Integrating with Next Gen Platforms
• Connect Overview
• Connect Capabilities
• Building a Data Pipeline
• Stark Customer Story

So what do you want to do with your data?
Centralized BI and
analytics
Data discovery Lower costs
associated with
legacy systems
Next-gen projects
– AI and ML

Unify your data to a
Streaming Platform

The global leader in data integrity
Trust your data. Build your possibilities.
Our data integrity software and data enrichment products
deliver accuracy and consistency to power confident
business decisions.
Brands you trust, trust us
Data leaders partner with us
of the Fortune 100
90
Customers in more than
100
2,000
employees
customers
12,000
countries
“Precisely is able to understand and
engage with enterprise customers where
they are, and assist them in their journey
to where they want to be, which sets this
company apart from its competition.”
Stewart Bond & Carl Olofson
IDC

Connect today’s
infrastructure with
tomorrow’s technology
to unlock the potential of
all your enterprise data
Integrate
Understand your data and
ensure it is accurate,
consistent and complete
for confident
business decisions
Verify
Analyze location data for
enhanced and
actionable business
insights that drive
superior outcomes
Locate
Power enhanced decision
making with expertly
curated, up-to-date
business, location, and
consumer data
Enrich
Precisely: four elements of data integrity
D A T A I N T E G R I T Y

What does
next-gen look
like for
integration?
Real-time data
streaming across
the business
Containerization
for hybrid and
multi-cloud
deployments
The requirements
Rapid adoption
of new targets
into DI
Expanding data
reach with cloud
data warehousing

Moving into next-gen
targets presents data
integration challenges
Identifying and integrating the
right data
Capturing changes in real-time
Lack of skills for integrating data
sources
Scaling with next-generation
initiatives

Connecting today’s infrastructure with tomorrow’s technology to
unlock the potential of all your enterprise data.
Extract, Transform, Load Data Replication via CDC
High-performance ETL for Apache
Spark, Cloud, Windows, Linux, Unix and
Hadoop MapReduce
Real-time database replication to
streaming platforms, Cloud, databases
and data warehouses
Connect

Connect is the best
solution for accessing
and integrating
mainframe and IBM i
data with cloud
frameworks in real time.
Quickly and efficiently integrate
ALL enterprise data – including
mainframe and IBM i
Design-once, deploy anywhere
approach to sources and targets
in real time
Reduce costs and development
time – from weeks to days
Secure and governed +
unrivaled scalability and
performance

Connect Data Replication Capabilities

Top Use Cases
DB to DB Replication
Reporting
BI/ETL Integration
Much more!
Migration
Geographical, OS Vendor, DB
Vendor, Product Version
Modernization
Streaming Platforms (Kafka,
Kinesis), Cloud DWs, DBs,
Application Vendor

Change Data Capture (CDC), At a glance,
Keep data in sync in real-time
• Without overloading networks.
• Without affecting source database
performance.
• Without coding or tuning.
Reliable transfer of data you can trust even if
connectivity fails on either side.
• Auto restart.
• No data loss.
Broad Source and Target Support
• Mainframe, IBM i – Db2, VSAM, …
• Streams – Kafka, Amazon Kinesis, …
• Relational databases – Oracle, SQL Server, …
• Cloud – MS Azure SQL, S3, …
• OLAP databases – Teradata, …
• Hadoop / Big Data – Hive, HDFS, Impala, …

Business Benefits with Connect CDC
Build Streaming Data Pipelines
• Powers business decision-making with real-time
data
Get a Consistent View
• Keep your business in sync and consistent
across the enterprise
Migrate Data
• Zero downtime for database/application
upgrades and system re-platforming
Keep Data Lakes fresh
• Ensure real-time updates on transactional systems,
including IBM i, are captured & replicate
Enable Timely Reporting
• Confidently satisfy every demanding SLAs
.
Resilient Data Delivery
• Support data governance and security requirements

Flexible Replication Options
One Way Two Way
Cascade
Bi-Directional
Distribute
Consolidate
Choose a topology
or combine them
to meet your data
sharing needs

RDBMS
EDWs
Data Streams
Sources
Sybase
Strategic Projects:
Real-time analytics, AI
and machine learning
Targets
Connect CDC is
cloud platform
enabled for
Ingest and Stream
RDBMS
Mainframe
Connect CDC
IMS
IBM i
Oracle Informix SQL Server
Other
Db2 (IBM i,
z, LUW)
SybaseOracle Informix PostgreSQL
MySQL
MS SQL Server
Flat Files
(delimited)
Db2 LUW
Db2 for IBM i
Db2 for z/OS
VSAM
Precisely Connect

Building a Modern Data Pipeline
Angelo Agatino Nicolosi | YanchWare
Streaming IBM i Data to Kafka
@

Precisely: Streaming IBM i to Kafka for Next-Gen Use Cases

YanchWare
E : aan@yanchware.com
W: https://yanchware.com
Monolith

YanchWare
ERP

YanchWare
ACL
ERP

YanchWare
ACL
Business
Platform
ERP

YanchWare
Business
Platform

YanchWare
ACL
Kafka
GKE
ZK SVCs
Connect CDC

YanchWare
Setup
Mainframe
Setup Kernel
& Workstation
1
2
Connect to
Kafka
3
4
Create &
Deploy Model
ACL
Kafka
GKE
ZK SVCs
Connect CDC

YanchWare
Connect CDC
Kafka
SVCs
Pub/Sub

YanchWare
Mar Apr May Jun Jul Aug Sep Oct Nov Dec
Proof of Concept
Vendors Selection
Architecture
Internal Sales Portal - Pilot

Streaming IBM i to Kafka for Next-Gen Use Cases

More Related Content

What's hot (20)

Similar to Streaming IBM i to Kafka for Next-Gen Use Cases (20)

More from Precisely (20)

Recently uploaded (20)

Streaming IBM i to Kafka for Next-Gen Use Cases