18
Sitecore “Data Exchange Framework”

Sitecore - sugnl.net/media/SUGNL/Meetings/SUGNL meeting... · Sitecore MVP since 2011, autodidact, thought leadership, outside-the-box thinker, father of two, multicopter builder,

  • Upload
    others

  • View
    2

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Sitecore - sugnl.net/media/SUGNL/Meetings/SUGNL meeting... · Sitecore MVP since 2011, autodidact, thought leadership, outside-the-box thinker, father of two, multicopter builder,

Sitecore“Data Exchange Framework”

Page 2: Sitecore - sugnl.net/media/SUGNL/Meetings/SUGNL meeting... · Sitecore MVP since 2011, autodidact, thought leadership, outside-the-box thinker, father of two, multicopter builder,

2

Today’s presenter:

Jeroen SpeldekampSitecore MVP since 2011, autodidact, thought leadership, outside-the-box thinker, father of two, multicopterbuilder, gadget freak, runner and one of the speakers at the very first Sitecore User Group Netherlands Conference.

@[email protected]

Page 3: Sitecore - sugnl.net/media/SUGNL/Meetings/SUGNL meeting... · Sitecore MVP since 2011, autodidact, thought leadership, outside-the-box thinker, father of two, multicopter builder,

3

Suneco “We just do what we’re good at”

What we don’t do:• be yet another full service internet partner• distinguish ourselves by flashy sales pitches• aim at the very large online projects (although we love to

co-perform in them)

Then what does Suneco do?:• We stand-out in technical knowledge, especially in

Sitecore• We love to share that knowledge and use it in favor of our

customers• We look for co-operation with business partner specialists

to be able to serve all customers in all projects• We’re always looking for long term relationships with our

customers and partners

Page 4: Sitecore - sugnl.net/media/SUGNL/Meetings/SUGNL meeting... · Sitecore MVP since 2011, autodidact, thought leadership, outside-the-box thinker, father of two, multicopter builder,

4

My Goals • Finish the presentation within 45++++ minutes.

• Show the basic principle of the DEF

• Demo of configuring a data exchange from a SQL

table into Sitecore.

• Running the pipeline(s) outside of the Sitecore

Instance.

• When connecting to a Third-party system you may

consider to use the DEF instead of programming

your own.

• If we are still within the 45+++ minutes and people

are interested we can do a quick dive in the MsSql

Provider code.

Page 5: Sitecore - sugnl.net/media/SUGNL/Meetings/SUGNL meeting... · Sitecore MVP since 2011, autodidact, thought leadership, outside-the-box thinker, father of two, multicopter builder,

5

Data Exchange Framework

Data Exchange Framework is designed to facilitate the transfer of data between

systems. It allows you to define the logic needed to read data from a source

system, transfer that data into a format that is compatible with a target system,

and write the transformed data into a target system.

Extract

reading data from a source system

Transform

converting the data that was read into a format that is

compatible with

a target system

Load

writing the data to the target system

ETL layer

Page 6: Sitecore - sugnl.net/media/SUGNL/Meetings/SUGNL meeting... · Sitecore MVP since 2011, autodidact, thought leadership, outside-the-box thinker, father of two, multicopter builder,

6

Data Exchange Framework goals

• Provide consistent model for reading/writing/mapping data (ETL)

• Maintain flexibility of current approaches

• Minimal dependency on Sitecore at runtime

• Minimal Sitecore expertise needed to develop provider

Page 7: Sitecore - sugnl.net/media/SUGNL/Meetings/SUGNL meeting... · Sitecore MVP since 2011, autodidact, thought leadership, outside-the-box thinker, father of two, multicopter builder,

7

Download the

module from

dev.sitecore.net

Page 8: Sitecore - sugnl.net/media/SUGNL/Meetings/SUGNL meeting... · Sitecore MVP since 2011, autodidact, thought leadership, outside-the-box thinker, father of two, multicopter builder,

8

Sitecore 8.1 / 8.2

Data Exchange Framework 1.1

Sitecoreprovider

Dynamics CRMprovider

Textfileprovider

MsSqlprovider

…….

Page 9: Sitecore - sugnl.net/media/SUGNL/Meetings/SUGNL meeting... · Sitecore MVP since 2011, autodidact, thought leadership, outside-the-box thinker, father of two, multicopter builder,

9

The case……

Import data from our 3rd-party system TjokWok into Sitecore

Data that must be imported

• Id

• Title

The data is stored in a MS Sql database with the name TjokWok

The table with the data is called DEMO

The credentials are username demo and password is ****

Page 10: Sitecore - sugnl.net/media/SUGNL/Meetings/SUGNL meeting... · Sitecore MVP since 2011, autodidact, thought leadership, outside-the-box thinker, father of two, multicopter builder,

10

DEF

Pipelines

Page 11: Sitecore - sugnl.net/media/SUGNL/Meetings/SUGNL meeting... · Sitecore MVP since 2011, autodidact, thought leadership, outside-the-box thinker, father of two, multicopter builder,

11

Mapping

(Transformation)

• Endpoints

• Value Accessor sets

• Value Accessors

• Value Readers

• Value Writers

Page 12: Sitecore - sugnl.net/media/SUGNL/Meetings/SUGNL meeting... · Sitecore MVP since 2011, autodidact, thought leadership, outside-the-box thinker, father of two, multicopter builder,

12

Main

pipeline

Contains two steps

• Read MsSql Pipeline Step

• Iterate Data and Run

Pipelines Pipeline Step

Page 13: Sitecore - sugnl.net/media/SUGNL/Meetings/SUGNL meeting... · Sitecore MVP since 2011, autodidact, thought leadership, outside-the-box thinker, father of two, multicopter builder,

13

Process row

pipeline

Contains three steps

• Read MsSql Pipeline

Step

• Resolve Sitecore Item

Pipeline Step

• Update Sitecore Item

Pipeline Step

Page 14: Sitecore - sugnl.net/media/SUGNL/Meetings/SUGNL meeting... · Sitecore MVP since 2011, autodidact, thought leadership, outside-the-box thinker, father of two, multicopter builder,

14

Running the

Process

In order to run the data transfer through the Data

Exchange Framework, you need to set up a Runner.

This can be done in three ways:

• Manually (Inside the Sitecore Instance)

• Scheduled (Inside the Sitecore Instance)

• via API (outside the Sitecore Instance)

Page 15: Sitecore - sugnl.net/media/SUGNL/Meetings/SUGNL meeting... · Sitecore MVP since 2011, autodidact, thought leadership, outside-the-box thinker, father of two, multicopter builder,

15

DEMO TIME

Page 16: Sitecore - sugnl.net/media/SUGNL/Meetings/SUGNL meeting... · Sitecore MVP since 2011, autodidact, thought leadership, outside-the-box thinker, father of two, multicopter builder,

16

Conclusion• It’s a framework that I want to use. Instead of trying

to program it my self.

• It’s a first version.

• Missing a lot of Sitecore functionalities to write to different

Sitecore fieldtypes. Like DropLink, Droptree, Images, etc.

• Missing Standard providers to connect third-party system. So you

can connect without programming (like MSSql provider)

• What about languages. Haven’t tried it yet.

• Missing a good speak interface for configuring and maintaining

the data exchange configurations.

• Missing some notification when a long running pipeline (batch) is

finished.

Page 17: Sitecore - sugnl.net/media/SUGNL/Meetings/SUGNL meeting... · Sitecore MVP since 2011, autodidact, thought leadership, outside-the-box thinker, father of two, multicopter builder,

17

Questions ?

Page 18: Sitecore - sugnl.net/media/SUGNL/Meetings/SUGNL meeting... · Sitecore MVP since 2011, autodidact, thought leadership, outside-the-box thinker, father of two, multicopter builder,

18

Today’s presenter:

Jeroen SpeldekampSitecore MVP since 2011, autodidact, thought leadership, outside-the-box thinker, father of two, multicopterbuilder, gadget freak, runner and one of the speakers at the very first Sitecore User Group Netherlands Conference.

@[email protected]