B2B Data Transformation 9.1.0 Release Guide (English) · PowerMart, Metadata Manager, Informatica Data Quality, Informatica Data Explorer, Informatica B2B Data Transformation, Informatica

Informatica B2B Data Transformation (Version 9.1.0)

Release Guide

Informatica B2B Data Transformation Release Guide

Version 9.1.0March 2011

Copyright (c) 2001-2011 Informatica. All rights reserved.

This software and documentation contain proprietary information of Informatica Corporation and are provided under a license agreement containing restrictions on use anddisclosure and are also protected by copyright law. Reverse engineering of the software is prohibited. No part of this document may be reproduced or transmitted in any form,by any means (electronic, photocopying, recording or otherwise) without prior consent of Informatica Corporation. This Software may be protected by U.S. and/or internationalPatents and other Patents Pending.

Use, duplication, or disclosure of the Software by the U.S. Government is subject to the restrictions set forth in the applicable software license agreement and as provided inDFARS 227.7202-1(a) and 227.7702-3(a) (1995), DFARS 252.227-7013©(1)(ii) (OCT 1988), FAR 12.212(a) (1995), FAR 52.227-19, or FAR 52.227-14 (ALT III), as applicable.

The information in this product or documentation is subject to change without notice. If you find any problems in this product or documentation, please report them to us inwriting.

Informatica, Informatica Platform, Informatica Data Services, PowerCenter, PowerCenterRT, PowerCenter Connect, PowerCenter Data Analyzer, PowerExchange,PowerMart, Metadata Manager, Informatica Data Quality, Informatica Data Explorer, Informatica B2B Data Transformation, Informatica B2B Data Exchange, Informatica OnDemand, Informatica Identity Resolution, Informatica Application Information Lifecycle Management, Informatica Complex Event Processing, Ultra Messaging and InformaticaMaster Data Management are trademarks or registered trademarks of Informatica Corporation in the United States and in jurisdictions throughout the world. All other companyand product names may be trade names or trademarks of their respective owners.

Portions of this software and/or documentation are subject to copyright held by third parties, including without limitation: Copyright DataDirect Technologies. All rightsreserved. Copyright © Sun Microsystems. All rights reserved. Copyright © RSA Security Inc. All Rights Reserved. Copyright © Ordinal Technology Corp. All rightsreserved.Copyright © Aandacht c.v. All rights reserved. Copyright Genivia, Inc. All rights reserved. Copyright 2007 Isomorphic Software. All rights reserved. Copyright © MetaIntegration Technology, Inc. All rights reserved. Copyright © Oracle. All rights reserved. Copyright © Adobe Systems Incorporated. All rights reserved. Copyright © DataArt,Inc. All rights reserved. Copyright © ComponentSource. All rights reserved. Copyright © Microsoft Corporation. All rights reserved. Copyright © Rogue Wave Software, Inc. Allrights reserved. Copyright © Teradata Corporation. All rights reserved. Copyright © Yahoo! Inc. All rights reserved. Copyright © Glyph & Cog, LLC. All rights reserved.Copyright © Thinkmap, Inc. All rights reserved. Copyright © Clearpace Software Limited. All rights reserved. Copyright © Information Builders, Inc. All rights reserved.Copyright © OSS Nokalva, Inc. All rights reserved. Copyright Edifecs, Inc. All rights reserved.

This product includes software developed by the Apache Software Foundation (http://www.apache.org/), and other software which is licensed under the Apache License,Version 2.0 (the "License"). You may obtain a copy of the License at http://www.apache.org/licenses/LICENSE-2.0. Unless required by applicable law or agreed to in writing,software distributed under the License is distributed on an "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See theLicense for the specific language governing permissions and limitations under the License.

This product includes software which was developed by Mozilla (http://www.mozilla.org/), software copyright The JBoss Group, LLC, all rights reserved; software copyright ©1999-2006 by Bruno Lowagie and Paulo Soares and other software which is licensed under the GNU Lesser General Public License Agreement, which may be found at http://www.gnu.org/licenses/lgpl.html. The materials are provided free of charge by Informatica, "as-is", without warranty of any kind, either express or implied, including but notlimited to the implied warranties of merchantability and fitness for a particular purpose.

The product includes ACE(TM) and TAO(TM) software copyrighted by Douglas C. Schmidt and his research group at Washington University, University of California, Irvine,and Vanderbilt University, Copyright (©) 1993-2006, all rights reserved.

This product includes software developed by the OpenSSL Project for use in the OpenSSL Toolkit (copyright The OpenSSL Project. All Rights Reserved) and redistribution ofthis software is subject to terms available at http://www.openssl.org.

This product includes Curl software which is Copyright 1996-2007, Daniel Stenberg, <[email protected]>. All Rights Reserved. Permissions and limitations regarding thissoftware are subject to terms available at http://curl.haxx.se/docs/copyright.html. Permission to use, copy, modify, and distribute this software for any purpose with or withoutfee is hereby granted, provided that the above copyright notice and this permission notice appear in all copies.

The product includes software copyright 2001-2005 (©) MetaStuff, Ltd. All Rights Reserved. Permissions and limitations regarding this software are subject to terms availableat http://www.dom4j.org/ license.html.

The product includes software copyright © 2004-2007, The Dojo Foundation. All Rights Reserved. Permissions and limitations regarding this software are subject to termsavailable at http:// svn.dojotoolkit.org/dojo/trunk/LICENSE.

This product includes ICU software which is copyright International Business Machines Corporation and others. All rights reserved. Permissions and limitations regarding thissoftware are subject to terms available at http://source.icu-project.org/repos/icu/icu/trunk/license.html.

This product includes software copyright © 1996-2006 Per Bothner. All rights reserved. Your right to use such materials is set forth in the license which may be found at http://www.gnu.org/software/ kawa/Software-License.html.

This product includes OSSP UUID software which is Copyright © 2002 Ralf S. Engelschall, Copyright © 2002 The OSSP Project Copyright © 2002 Cable & WirelessDeutschland. Permissions and limitations regarding this software are subject to terms available at http://www.opensource.org/licenses/mit-license.php.

This product includes software developed by Boost (http://www.boost.org/) or under the Boost software license. Permissions and limitations regarding this software are subjectto terms available at http:/ /www.boost.org/LICENSE_1_0.txt.

This product includes software copyright © 1997-2007 University of Cambridge. Permissions and limitations regarding this software are subject to terms available at http://www.pcre.org/license.txt.

This product includes software copyright © 2007 The Eclipse Foundation. All Rights Reserved. Permissions and limitations regarding this software are subject to termsavailable at http:// www.eclipse.org/org/documents/epl-v10.php.

This product includes software licensed under the terms at http://www.tcl.tk/software/tcltk/license.html, http://www.bosrup.com/web/overlib/?License, http://www.stlport.org/doc/license.html, http://www.asm.ow2.org/license.html, http://www.cryptix.org/LICENSE.TXT, http://hsqldb.org/web/hsqlLicense.html, http://httpunit.sourceforge.net/doc/license.html, http://jung.sourceforge.net/license.txt , http://www.gzip.org/zlib/zlib_license.html, http://www.openldap.org/software/release/license.html, http://www.libssh2.org,http://slf4j.org/license.html, http://www.sente.ch/software/OpenSourceLicense.html, http://fusesource.com/downloads/license-agreements/fuse-message-broker-v-5-3-license-agreement, http://antlr.org/license.html, http://aopalliance.sourceforge.net/, http://www.bouncycastle.org/licence.html, http://www.jgraph.com/jgraphdownload.html, http://www.jgraph.com/jgraphdownload.html, http://www.jcraft.com/jsch/LICENSE.txt and http://jotm.objectweb.org/bsd_license.html.

This product includes software licensed under the Academic Free License (http://www.opensource.org/licenses/afl-3.0.php), the Common Development and DistributionLicense (http://www.opensource.org/licenses/cddl1.php) the Common Public License (http://www.opensource.org/licenses/cpl1.0.php) and the BSD License (http://www.opensource.org/licenses/bsd-license.php).

This product includes software copyright © 2003-2006 Joe WaInes, 2006-2007 XStream Committers. All rights reserved. Permissions and limitations regarding this softwareare subject to terms available at http://xstream.codehaus.org/license.html. This product includes software developed by the Indiana University Extreme! Lab. For furtherinformation please visit http://www.extreme.indiana.edu/.

This Software is protected by U.S. Patent Numbers 5,794,246; 6,014,670; 6,016,501; 6,029,178; 6,032,158; 6,035,307; 6,044,374; 6,092,086; 6,208,990; 6,339,775;6,640,226; 6,789,096; 6,820,077; 6,823,373; 6,850,947; 6,895,471; 7,117,215; 7,162,643; 7,254,590; 7,281,001; 7,421,458; 7,496,588; 7,523,121; 7,584,422; 7,720,842;7,721,270; and 7,774,791, international Patents and other Patents Pending.

DISCLAIMER: Informatica Corporation provides this documentation "as is" without warranty of any kind, either express or implied, including, but not limited to, the impliedwarranties of non-infringement, merchantability, or use for a particular purpose. Informatica Corporation does not warrant that this software or documentation is error free. Theinformation provided in this software or documentation may include technical inaccuracies or typographical errors. The information in this software and documentation issubject to change at any time without notice.

NOTICES

This Informatica product (the “Software”) includes certain drivers (the “DataDirect Drivers”) from DataDirect Technologies, an operating company of Progress SoftwareCorporation (“DataDirect”) which are subject to the following terms and conditions:

1.THE DATADIRECT DRIVERS ARE PROVIDED “AS IS” WITHOUT WARRANTY OF ANY KIND, EITHER EXPRESSED OR IMPLIED, INCLUDING BUT NOTLIMITED TO, THE IMPLIED WARRANTIES OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE AND NON-INFRINGEMENT.

2. IN NO EVENT WILL DATADIRECT OR ITS THIRD PARTY SUPPLIERS BE LIABLE TO THE END-USER CUSTOMER FOR ANY DIRECT, INDIRECT,INCIDENTAL, SPECIAL, CONSEQUENTIAL OR OTHER DAMAGES ARISING OUT OF THE USE OF THE ODBC DRIVERS, WHETHER OR NOT INFORMED OFTHE POSSIBILITIES OF DAMAGES IN ADVANCE. THESE LIMITATIONS APPLY TO ALL CAUSES OF ACTION, INCLUDING, WITHOUT LIMITATION, BREACHOF CONTRACT, BREACH OF WARRANTY, NEGLIGENCE, STRICT LIABILITY, MISREPRESENTATION AND OTHER TORTS.

Part Number: DT-RLG-91000-0001

Table of Contents

Preface . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . ivInformatica Resources. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . iv

Informatica Customer Portal. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . iv

Informatica Documentation. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . iv

Informatica Web Site. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . iv

Informatica How-To Library. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . iv

Informatica Knowledge Base. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . v

Informatica Multimedia Knowledge Base. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . v

Informatica Global Customer Support. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . v

Chapter 1: Version 9.x. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1Version 9.1.0. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1

Unified Installer. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1

Libraries. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1

Version 9.0.1. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2

Transformation Capabilities. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2

Libraries. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3

Platform Support. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4

Integration Agents. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4

Behavior Changes. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4

Version 9.0. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5

Libraries. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5


Obsolete COM Features. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5

Operating System Support. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 6

Integration Agents. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 6

Behavior Changes. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 6

Chapter 2: Version 8.x. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 7Version 8.6.2 HF1. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 7

Libraries. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 7


Operating System Support. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 8

Version 8.6.2. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 8


Libraries. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 9

Running Transformations. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 9

Version 8.6.1. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 10

Table of Contents i

Transformation Capabilities. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 10

Integration with Data Transformation Accelerator . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 10

Libraries. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 10

Obsolete Components. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 11

Version 8.6.0 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 12


Operating System Support. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 12

Integration Agents . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 12

Version 8.5.0. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 13

Product Name and Version . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 13



Libraries. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 14

Integration Agents . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 14

Chapter 3: Version 4.x. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 15Version 4.x Overview. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 15

Product Names and Versions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 15

Enhanced Design and Configuration Environment. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 16

New Project Wizards. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 16

Guided Mode. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 16

Integrated XSD Editor . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 16

Embedded Help. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 16

New Transformation Components. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 17

Mappers: XML-to-XML Transformations. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 17

Mapping Action and Anchors. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 17

Streamers. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 17

Non-Sequential Access to Data. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 17

Indexing: Keyed Transformations. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 18

Lookup Tables. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 18

Revised Anchors. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 18

New and Revised Transformers. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 18

Enhanced Flexibility of Actions. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 19

New and Revised Actions. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 19

New and Revised Document Processors. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 20

External Components. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 20

Simplified Data-Holder Management. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 20

Improved Schema Support Features. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 20

Valid XML Generation. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 20

Improved XML Namespace Support. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 20

Namespace of Variables. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 21

Supported XML Schemas Features. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 21

Project Copies of XML Schemas. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 21

ii Table of Contents

Additional New Features. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 21

Upgrading Existing Projects . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 21

New Terminology. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 21


64-Bit Support and Data Transformation Server. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 22

API Language Support. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 22

Setup. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 22

Multiple Configurations. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 22

Libraries. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 22

Index. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 23

Table of Contents iii

PrefaceThe Data Transformation Release Guide is written for users of previous Data Transformation versions. Itsummarizes the new and enhanced features of the current version.

Informatica Resources

Informatica Customer PortalAs an Informatica customer, you can access the Informatica Customer Portal site at http://mysupport.informatica.com. The site contains product information, user group information, newsletters,access to the Informatica customer support case management system (ATLAS), the Informatica How-To Library,the Informatica Knowledge Base, the Informatica Multimedia Knowledge Base, Informatica ProductDocumentation, and access to the Informatica user community.

Informatica DocumentationThe Informatica Documentation team takes every effort to create accurate, usable documentation. If you havequestions, comments, or ideas about this documentation, contact the Informatica Documentation team throughemail at [email protected]. We will use your feedback to improve our documentation. Let usknow if we can contact you regarding your comments.

The Documentation team updates documentation as needed. To get the latest documentation for your product,navigate to Product Documentation from http://mysupport.informatica.com.

Informatica Web SiteYou can access the Informatica corporate web site at http://www.informatica.com. The site contains informationabout Informatica, its background, upcoming events, and sales offices. You will also find product and partnerinformation. The services area of the site includes important information about technical support, training andeducation, and implementation services.

Informatica How-To LibraryAs an Informatica customer, you can access the Informatica How-To Library at http://mysupport.informatica.com.The How-To Library is a collection of resources to help you learn more about Informatica products and features. Itincludes articles and interactive demonstrations that provide solutions to common problems, compare features andbehaviors, and guide you through performing specific real-world tasks.

iv

http://mysupport.informatica.com

mailto:[email protected]


http://www.informatica.com


Informatica Knowledge BaseAs an Informatica customer, you can access the Informatica Knowledge Base at http://mysupport.informatica.com.Use the Knowledge Base to search for documented solutions to known technical issues about Informaticaproducts. You can also find answers to frequently asked questions, technical white papers, and technical tips. Ifyou have questions, comments, or ideas about the Knowledge Base, contact the Informatica Knowledge Baseteam through email at [email protected].

Informatica Multimedia Knowledge BaseAs an Informatica customer, you can access the Informatica Multimedia Knowledge Base at http://mysupport.informatica.com. The Multimedia Knowledge Base is a collection of instructional multimedia filesthat help you learn about common concepts and guide you through performing specific tasks. If you havequestions, comments, or ideas about the Multimedia Knowledge Base, contact the Informatica Knowledge Baseteam through email at [email protected].

Informatica Global Customer SupportYou can contact a Customer Support Center by telephone or through the Online Support. Online Support requiresa user name and password. You can request a user name and password at http://mysupport.informatica.com.

Use the following telephone numbers to contact Informatica Global Customer Support:

North America / South America Europe / Middle East / Africa Asia / Australia

Toll FreeBrazil: 0800 891 0202Mexico: 001 888 209 8853North America: +1 877 463 2435 Standard RateNorth America: +1 650 653 6332

Toll FreeFrance: 00800 4632 4357Germany: 00800 4632 4357Israel: 00800 4632 4357Italy: 800 915 985Netherlands: 00800 4632 4357Portugal: 800 208 360Spain: 900 813 166Switzerland: 00800 4632 4357 or 0800 463200United Kingdom: 00800 4632 4357 or 0800023 4632 Standard RateFrance: 0805 804632Germany: 01805 702702Netherlands: 030 6022 797

Toll FreeAustralia: 1 800 151 830New Zealand: 1 800 151 830Singapore: 001 800 4632 4357 Standard RateIndia: +91 80 4112 5738

Preface v






vi

C H A P T E R 1

Version 9.xThis chapter includes the following topics:

¨ Version 9.1.0, 1

¨ Version 9.0.1, 2

¨ Version 9.0, 5

Version 9.1.0Version 9.1.0 adds a unified installer and improved library features to Data Transformation.

Unified InstallerData Transformation 9.1.0 provides a new, unified installer that allows you to install Data Transformation as astandalone tool or together with other Informatica products. There are two installers:

¨ Client installer. The new client installer is a graphic interface that runs on Windows platforms. You can installthe Data Transformation design environment, Informatica PowerCenter Client, and Informatica DeveloperClient. The Data Transformation components can be installed with a fresh copy of Eclipse 3.3, or with anexisting copy of Eclipse 3.2.2 or 3.3.

¨ Server installer. The new server installer can install the Data Transformation production environment as astandalone product or together with Informatica Services.

- On Windows platforms, the installer is a graphic interface.

- On Linux and UNIX platforms, the installer is available as a graphic interface and as a console interface.

LibrariesFor more information about the following features, see the Data Transformation Libraries Guide.

ASN.1 LibraryThe ASN.1 library enables you to process data that complies with the Abstract Syntax Notation One (ASN.1)standard. An ASN.1 protocol specification is a schema for an ASN.1 data structure. The specification is a text filethat typically has an *.asn extension.

An ASN.1 source can contain any number of messages. Each message is a data structure that conforms to theprotocol specification. Optionally, the source can contain separator strings between the messages, and there canbe a header string before the first message.

1

The AsnToXml document processor converts the data to the ASN.1 XER encoding, which is an XMLrepresentation.

To create transformations that process ASN.1 data, install the library on the design environment computer. To runthe transformations as services, install the library on each computer that runs the production environment.

HIPAA Library EnhancementsHIPAA is an industry standard for administrative and financial health-care transactions. HIPAA is based on theX12 standard. The HIPAA library includes an optional add-on component that validates input messages andgenerates acknowledgments. The HIPAA library also includes HIPAA Crosswalk mappers that transform HIPAAmessages from one version to another.

¨ HIPAA Validation. This component has been updated to support HIPAA 5010A1 errata.

¨ HIPAA Crosswalk. This component has been updated to process HIPAA 5010A1 messages.

NCPDP Library EnhancementsThe NCPDP library has been enhanced to include support for the following standards:

¨ Batch Transaction v. 1.2

¨ Telecommunication v. D.0

Version 9.0.1Version 9.0.1 adds transformation, library, and integration features to Data Transformation.

Transformation CapabilitiesFor more information about the following features, see the Data Transformation Studio User Guide.

Streamer EnhancementsThe Streamer component now has an on_end_of_input property that you can use to detect and report the end of thedata stream. The count property of the SimpleSegment component enables batch processing.

The WriteSegment component enables a streamer to copy a segment without change to an output location. Thisfeature enables you to use a streamer as a data splitter.

XML StreamersThe new XmlStreamer component enables processing very large XML documents. The component splits an XMLstream into header, footer, and body segments, and it passes each segment to a separate transformation forprocessing.

Validation Rule Language (VRL) EditorThe VRL editor enables you to edit data validation rules with minimal knowledge of the VRL syntax.

2 Chapter 1: Version 9.x

Eclipse Version 3.3The Data Transformation setup installs Eclipse 3.3. If you run an upgrade setup from a Data Transformationversion that used Eclipse 3.2, the setup installs Eclipse 3.3 alongside Eclipse 3.2. Data Transformation Studioruns only in Eclipse 3.3, but you can continue using Eclipse 3.2 for other purposes.

XML Schema EditorThe Eclipse 3.3 XML Schema Editor replaces the Data Transformation XSD Editor. As in previous versions, youcan configure Data Transformation Studio to use the built-in editor or any other XSD editor.

xs:anyType SupportAn XML schema can specify that an element can contain any type of data. In the project properties, there is a newoption to process elements that have undefined types as xs:anyType instead of xs:string.

JavaScript ExtensionsThe Data Transformation JavaScript extension functions are now fully documented. The functions are useful, forexample, to implement conditional transformation logic in components such as EnsureCondition.

Obsolete ODBC ComponentsThe ODBCLookup transformer and the ODBCAction action are no longer available.


Updated Versions of Industry StandardsThe following libraries have been updated to work with new versions of the industry messaging standards:

¨ ACORD AL3

¨ DTCC-NSCC

¨ EDIFACT

¨ EDI-X12

¨ FIX

¨ NACHA

¨ SWIFT

EDI-X12 LibraryThe EDI-X12 library has enhanced capabilities for message validation and acknowledgments. In the event of avalidation error, the library transformations do not fail. Instead, they report the error to an output port or in anacknowledgment message.

HL7 LibraryThe HL7 library now transforms messages to the standard HL7 XML schema. You can edit the HL7 librarycomponents in the Library Customization Editor.

Version 9.0.1 3

HIPAA LibraryThe HIPAA library can now generate type 999 acknowledgments.

The supplementary HIPAA Crosswalk package provides mappers that transform messages between HIPAAversion 4010 and 5010. The mappers attempt to preserve all data that exists in the source message, unless thiswould cause the target to fail HIPAA validation. The package requires Data Transformation Accelerator. For moreinformation, see the Data Transformation HIPAA 4010-5010 Crosswalk Reference Implementation Release Notes.

Platform SupportFor more information about the following features, see the Data Transformation Administrator Guide.

Operating SystemsYou can run Data Transformation on Windows, Solaris, AIX, Linux, and HP-UX operating systems. This versionadds support for Windows 2008 Server and for Windows 7.

You can now run Data Transformation Studio on Windows 32-bit and 64-bit systems.

JRE VersionsThe Data Transformation setup installs JRE version 1.5.0_11 or a platform-specific equivalent. On most platforms,Data Transformation is also certified with JRE 1.6.0_12.

Integration AgentsFor more information about the following features, see the agent manuals.

Available AgentsThis Data Transformation version restores the Microsoft BizTalk Server, webMethods, and IBM WebSphereMessage Broker integration agents that were omitted from version 9.0.

webMethods agentThe webMethods integration agent runs on Windows and Solaris platforms with webMethods version 8.0.

The outdated Itemfield version of the webMethods agent is no longer supported. Use the Informatica agentinstead.

WebSphere Message Broker AgentThe WebSphere integration agent runs on Windows or Solaris platforms with WebSphere Business IntegrationMessage Broker (WBIMB) version 7.0.

Behavior ChangesUpgrading from previous versions can result in the following changes in the behavior of existing transformations. Ifyou need to restore the previous behavior, you might need to edit the transformations.

CM-5338: Uninitialized Variable Does Not Propagate Up to Calling ParserWhen parser A calls parser B with a connection to a variable that has not been initialized, the parser fails.


Workaround: In parser A (the calling parser), initialize the variable before the call to parser B (the called parser).You can initialize the variable to an empty string.

Version 9.0Data Transformation versions 8.6.2 HF1 and 9.0 are concurrent releases. Except as noted, the two versions haveidentical features. They are certified for use with different versions of the Informatica platform:

¨ Data Transformation 8.6.2 HF1 is certified for use with Informatica PowerCenter 8.6.1.

¨ Data Transformation 9.0 is certified for use with Informatica 9.0.

The versions add library and validation features to Data Transformation 8.6.2.


HIPAA LibraryThe procedure to install the HIPAA Validation add-on has been updated. You can install the add-on on the samecomputer as Data Transformation or on an independent server.

SWIFT LibraryThe SWIFT organization has certified Data Transformation with the SWIFT library for use with SWIFT versions2008 and 2009. Data Transformation carries the SWIFT-Ready Application logo.

The library includes parsers, serializers, and schemas for all SWIFT MT messages. It includes mappers thattransform messages between the SWIFT MT and MX standards. For a large set of messages, the librarycomponents provide detailed data validation, implemented as customizable rules defined in the Validation RuleLanguage.

Library Customization ToolThe Library Customization Tool has been updated to support the features of the new SWIFT library.

Transformation CapabilitiesFor more information about the following feature, see the Data Transformation Studio User Guide.

Validation Rule LanguageThe Validation Rule Language (VRL), used with the ValidateValue action, is now fully documented and availablefor use.

Obsolete COM FeaturesData Transformation 9.0 no longer supports the following features based on the Microsoft COM technology:

¨ COM API

¨ COM customization components: ExternalCOMPreProcessor, ExternalCOMAction, and OutputCOM

Version 9.0 5

Existing applications that use these features generally continue to operate. For best performance and to takeadvantage of new Data Transformation features, upgrade COM applications to the .NET API, and upgrade COMcustomizations to the Data Transformation external components architecture. For more information, see the DataTransformation Engine Developer Guide.

Operating System SupportYou can install Data Transformation 9.0 on Windows, Solaris, AIX, and Linux operating systems. For moreinformation, see the Data Transformation Administrator Guide and the Data Transformation 9.0 Release Notes. Anupcoming Data Transformation release will restore the HP-UX support.

Integration AgentsData Transformation 9.0 temporarily does not include the integration agents for Microsoft BizTalk Server,webMethods, and IBM WebSphere Message Broker. An upcoming Data Transformation release will restore theagents.

Behavior ChangesUpgrading from previous versions can result in the following changes in the behavior of existing transformations. Ifyou need to restore the previous behavior, you might need to edit the transformations.

Upgrading from Version 4.4 to 9.xCM-2489: ExpandFrameSet Processor Inserts Product Name in its OutputThe ExpandFrameSet document processor inserts an HTML comment at the start of each frame that it opens, forexample:



The comment contains the product name, “Data Transformation”. In version 4.4, the comment contained theprevious product name, “Complex Data Exchange”. If a transformation searches for the product name to helpparse the document, edit it to search for the new product name.

CM-2433: Boolean Cells Now Appear in ExcelToDataXml OutputIn version 4.4, if an Excel workbook contained boolean data, the ExcelToDataXml document processor sometimesomitted the true/false values from its output. The behavior has now been corrected. The processor now includesthe true/false values in its output.

CM-2112: Parentheses Characters Are Not Encoded in URLsIn version 4.4 and earlier, components such as EncodeAsUrl encoded the parentheses characters ( and ) as %28and %29, respectively. The characters are no longer encoded. They appear in the output as ( and ).


C H A P T E R 2


¨ Version 8.6.2 HF1, 7

¨ Version 8.6.2, 8

¨ Version 8.6.1, 10

¨ Version 8.6.0 , 12

¨ Version 8.5.0, 13

Version 8.6.2 HF1This version adds library and validation features.


HIPAA LibraryThe procedure to install the HIPAA Validation add-on has been updated. You can install the add-on on the samecomputer as Data Transformation or on an independent server.

SWIFT LibraryThe SWIFT organization has certified Data Transformation with the SWIFT library for use with SWIFT versions2008 and 2009. Data Transformation carries the SWIFT-Ready Application logo.

The library includes parsers, serializers, and schemas for all SWIFT MT messages. It includes mappers thattransform messages between the SWIFT MT and MX standards. For a large set of messages, the librarycomponents provide detailed data validation, implemented as customizable rules defined in the Validation RuleLanguage.

Library Customization ToolThe Library Customization Tool has been updated to support the features of the new SWIFT library.

Transformation CapabilitiesFor more information about the following feature, see the Data Transformation Studio User Guide.

7

Validation Rule LanguageThe Validation Rule Language (VRL), used with the ValidateValue action, is now fully documented and availablefor use.

Operating System SupportYou can install Data Transformation 8.6.2 HF1 on Windows, Solaris, AIX, Linux, and HP-UX operating systems.For more information about the system requirements, see the Data Transformation Administrator Guide.

Version 8.6.2This version introduces many features for validating and processing structured documents.


Structured ParsingThe new StructureDefinition anchor is design for parsing complex, highly structured documents, such asdocuments conforming to industry-standard messaging protocols.

The anchor contains a format-definition property that scans the source document and extracts the constituentrecords. The anchor passes the records to a set of nested structure-analysis components that validate the recordtypes and sequence and generate the parser output.

ValidationIn Content anchors and Map actions, you can nest a set of validation subcomponents. The components check thatdata conforms with criteria of any complexity, ranging from simple length or value-type tests up to complexrelational logic. In the event of a validation failure, a transformation can use the notifications feature to insert anerror message in the output.

The new HIPAAValidator document processor implements the validation mechanism of the HIPAA library.

The new ValidateValue action validates a data holder against a set of user-defined rules. The rules are configuredin a user-defined XML file included in the transformation project. The action is used, for example, to implement theAdvanced SWIFT library validations.

NotificationsYou can use the new notifications feature for generating output messages in the event of a failure, a validationerror, or any other circumstance that occurs in the data. In locations such as validation components, Group andRepeatingGroup anchors, and the on_fail property of other components, you can insert notification subcomponents.The notifications generate XML output that you can write to the transformation results file or to other locations.

AggregationYou can use the new AggregateValues action to compute the sum, count, or concatenation of a multiple-occurrencedata holder, or to check that the multiple values are equal.


JavaScript ExpressionsThe JavaScript expression capabilities have been enhanced to enable new library features.


DTCC-NSCC LibraryThis release of the DTCC-NSCC library adds support for the NSCC versions of March 2009 and September 2009.

The library has new input validation options. You can pass a service parameter called strictMode to the DTCC-NSCC parsers to enable or disable strict validation. A new set of Restricted serializers perform strict validation onXML input.

HIPAA LibraryThis release of the HIPAA library adds support for HIPAA version 5010.

The HIPAA library is now available in a HIPAAValidation version that implements all validation andacknowledgment types defined in the HIPAA standard. From the library, you can import and deploy a single HIPAAvalidation service that processes all HIPAA message types. The service can generate HTML and XML validationreports in addition to acknowledgments. The service has configuration options to enable or disable each validationor acknowledgment type.

It is no longer necessary to deploy an independent validation project for each HIPAA message type.

NACHA LibraryThis release of the HIPAA library adds support for NACHA version 2009.

SWIFT LibraryThis release of the SWIFT library adds support for SWIFT version 2009.

Library Customization ToolYou can now use the Library Customization Tool with the DTCC-NSCC, EDIFACT, EDI-X12, HIPAA, and SWIFTlibraries.

The tool has a new PDF export feature, enabling you to generate a PDF specification of a message structure. Thespecification highlights the message elements that you have edited.

Running TransformationsFor more information about the following features, see the Data Transformation Engine Developer Guide.

CM_console Exit CodesThe CM_console command has a new -e switch. The switch causes the command to return UNIX-style exit codes,useful in batch programming.

Version 8.6.2 9

Version 8.6.1This version enhances many aspects of the transformation capabilities and provides new library customization andvalidation features. The version phases out some obsolete components.


Unicode UTF-8 SupportUnicode UTF-8 is now supported as a working encoding. This enables transformations to process documents inAsian languages such as Chinese, Japanese, and Korean, as well as in other languages and in multilingualenvironments.

For a few limitations of the UTF-8 support, see the Data Transformation Release Notes.

Output in PDF, Word, Excel, and other Document FormatsThe new XmlToDocument processor converts XML input to PDF, Word, Excel, PowerPoint, HTML, or PostScriptoutput. You can use it as a postprocessor to convert parser or mapper output to an easily readable document.

The processor activates the Business Intelligence and Reporting Tool, an add-on for Eclipse. BIRT offers a user-friendly environment where you can configure formatted text, table, and chart output.

Color Coding of Mapper Example SourceData Transformation Studio now color-codes the example source of a mapper, in the same way as for parsers.The color coding highlights the mapped elements and attributes, providing visual feedback as you configure Mapactions and mapper anchors.

XSD RedefinesThe redefine feature of XML schemas is now fully supported. You can use schemas that redefine types andgroups.

Integration with Data Transformation AcceleratorYou can use the new, optional Data Transformation Accelerator to specify mappers in a familiar, Microsoft Excelinterface. You can edit the same mapper projects in both Accelerator and in Data Transformation Studio. Thisenables you to use the most convenient tools in both environments to configure, test, and deploy mappertransformations.

For more information, see the Data Transformation Accelerator Guide.


Library Customization ToolThe new Library Customization Tool lets you edit the message definitions used in the EDIFACT, EDI-X12, andHIPAA libraries. The tool enables you to view, add, delete, or redefine elements in the messaging specification.


You can use the tool to help understand the message definitions and to diagnose and correct validation errors.The tool is an Eclipse add-on, operating in the same environment as Data Transformation Studio.

HIPAA Validation and Acknowledgment MechanismThe validation and acknowledgment mechanism implemented in the HIPAA library is greatly enhanced, enablingimproved error handling and robust, failure-proof applications.

The new message rendering service is a user-friendly visualization tool for HIPAA validation errors.

Install Individual Library VersionsA library installation zip file can contain multiple versions of the same library. The library installation wizard permitsyou to select the version to install.

Obsolete ComponentsTo ensure that transformations run on all operating systems that Data Transformation supports, severalcomponents and features are being phased out of the Data Transformation system. A few other components arebeing phased out because they have not proved useful to Data Transformation users. In all cases, the systemprovides alternative or improved approaches to achieve the same goals.

The obsolete components and features continue to be supported for compatibility with projects that were createdin earlier Data Transformation versions. Do not use them in new transformation projects.

The following is a list of the obsolete components. For more information, see the Data Transformation Studio UserGuide.

¨ Several document processors that run only on Windows platforms, that require Microsoft Office applications tobe installed, or that generate non-useful output formats. Instead, use the processors generating XML outputthat run on all platforms.

- ExcelToTxt, ExcelToHtml, ExcelToTextML- PowerpointToHtml- WordToRtf, WordToTxt, WordToHtml, WordToTextML- WordPerfectToTextML

¨ Components that depend on an external JavaScript engine running only on 32-bit platforms.

- SubmitForm, SubmitFormGet- Certain rarely-used features of EnsureCondition

¨ Components that access documents by HTTP. Instead, use API and integration capabilities to submit webdocuments to transformations.

- URL port

- HtmlForm anchor

- DownloadFile, DownloadFileToDataHolder, SubmitForm, and SubmitFormGet actions

- Rarely used HTTP posting capability of RunParser¨ COM customization interfaces.

- ExternalCOMPreProcessor, ExternalCOMAction- OutputCOM option of WriteValue

¨ The MSMQ output option of WriteValue.

Version 8.6.1 11

In addition, the Data Transformation COM API and CGI interface are being phased out, in favor of the moremodern .NET API, the Web Service API, and other APIs. For more information, see the Data TransformationEngine Developer Guide.

Version 8.6.0This version introduces new transformation features and platform support. It offers enhanced integration support.


PDF Forms ProcessingThe new PdfFormToXml_1_00 document processor converts PDF forms to XML. The processor supports formsconforming to the Adobe AcroForms standard, for example, forms created by Foxit and Open Office. The Studiohas a feature for importing a PDF form to a new mapper project, while generating a schema for the XML formrepresentation.

Support for Excel 2007 InputThe ExcelToDataXml document processor now supports input in the Excel 2007 XLSX format as well as the olderXLS format. The processor can now output both raw and formatted versions of the same data.

Operating System SupportData Transformation Engine now runs on SUSE Linux 10 on 64-bit platforms, in addition to other Linux, UNIX,and Windows platforms.

For more information, see the Data Transformation Administrator Guide.

Integration AgentsThis version introduces the following integration features.

Multiple Inputs and Outputs in webMethodsThe Data Transformation Agent for webMethods can now run transformations that receive inputs from multiplesources and generate multiple outputs. The agent supports webMethods version 6.1, in addition to earlierwebMethods versions. For more information, see Data Transformation Agent for webMethods.

Streamer Support in BizTalkThe Data Transformation Agent for BizTalk can now run streamer transformations. The streamer splits largesource streams into smaller portions that a transformation can process separately. For more information, see DataTransformation Agent for BizTalk.


WebSphere Message Broker 6.1 SupportThe Data Transformation Agent for WebSphere Business Integration Message Broker (WBIMB) now supportsWBIMB version 6.1.

Version 8.5.0This version provides new transformation features, platform support, and industry-standard libraries. It offersenhanced webMethods integration support.

Product Name and VersionWith this version, the product name has been revised from Informatica Complex Data Exchange to InformaticaData Transformation. The version number has been incremented from 4.x to 8.5.

The new name and version number better reflect the role of the product and the integration with InformaticaPowerCenter 8.5. Data Transformation 8.5 is the direct successor of Complex Data Exchange 4.4. In nearly allcases, version 4.4 transformations run in version 8.5 without modification.

Informatica Data Transformation is part of the Informatica B2B Data Exchange platform for high-performance, real-time integration applications in a business-to-business environment.


PDF Table SupportIn PDF source documents, tables can present difficult parsing problems. The new PdfToTxt_4 document processorassists the parsing by letting you define the table structure graphically, for example, by dragging the columnboundary markers.

Dynamic Lookup TableThe LookupTransformer now supports dynamic construction of lookup tables. A transformation can extract thelookup data from its input, store the resulting table in a variable, and use the table for subsequent transformationoperations.

Multiple Inputs and OutputsA transformation can now obtain its input from multiple documents, and it can generate multiple output documents.To define the inputs and outputs, use the new AdditionalnputPort and AdditionalOutputPort actions.

Strict XML ValidationSerializers and mappers use the Xerces XML processor to validate their input against an XML schema. There arenow options for either strict or partial XML validation. Previously, only the partial validation was available.

Version 8.5.0 13

XSI Type SupportXML elements having the xsi:type attribute are now supported. The attribute permits an XML document to specifythe precise element type, in situations where the schema permits multiple types. A transformation can interpret anxsi:type attribute found in the input, and it adds xsi:type attributes where necessary to the output.

User LogYou can use the new on_fail property to generate user-defined log messages if any transformation componentfails. For example, if an anchor does not find its source text, it can generate a user-defined information, warning,or error event. A custom logger can run a serializer that reports detailed event information. The custom messagesare written to a user log that supplements the standard Data Transformation event log.

Operating System SupportData Transformation now runs on Linux Red Hat EL5 on x86 platforms, in addition to Windows, UNIX, and otherLinux platforms. For more information, see the Data Transformation Administrator Guide.


Frequent Library UpdatesData Transformation offers transformation libraries supporting industry-standard protocols. The libraries are nowmade available as independent packages that you can install in Data Transformation Studio. This policy enablesmore frequent library additions and updates, not necessarily tied to a particular Data Transformation release.

New and Updated LibrariesNew libraries supporting the CREST, FIX, IATA PADIS, NACHA, and Telekurs VDF industry standards haverecently been released. In addition, several of the existing libraries such as ACORD AL3, BAI, EDIFACT, EDI-X12,and HIPAA have been updated and improved.

To obtain the new or updated libraries, contact Informatica.

Integration AgentsThis version introduces the following integration features.

Enhanced Transformation Features in webMethodsThe Data Transformation agent for webMethods has improved support for streamers, service parameters, anddynamic service names. These features enhance the flexibility and support for large input data streams whenusing Data Transformation in a webMethods environment. For more information, see Data Transformation Agentfor webMethods.


C H A P T E R 3


¨ Version 4.x Overview, 15

¨ Product Names and Versions , 15

¨ Enhanced Design and Configuration Environment, 16

¨ New Transformation Components, 17

¨ Improved Schema Support Features, 20

¨ Additional New Features, 21

Version 4.x OverviewThis chapter describes the Data Transformation features introduced in versions 4.0 to 4.4, collectively known as4.x.

Data Transformation 4.x introduced a major redesign from version 3.2. Version 4.x greatly enhanced theperformance, functionality, and convenience of transformations. Among the 4.x features are:

¨ An all-new Studio design and configuration environment

¨ Many new transformation features

¨ Enhanced schema support

¨ Enhanced application integration capabilities via industry-standard libraries, a multilingual API, agents, andoperating system support

Product Names and VersionsData Transformation versions 4.0 to 4.3 were marketed under the name ContentMaster. Version 4.4 was marketedunder the name Complex Data Exchange, which better reflected the role of product in enabling business-to-business exchange of complex data.

Following version 4.4, the next version was released as Informatica Data Transformation version 8.5. The newname and version express the integration with Informatica PowerCenter 8.5. For convenience, this chapter refersto all versions using the name Data Transformation.

15

Enhanced Design and Configuration EnvironmentData Transformation Studio, which is the design and configuration tool for transformations, is now integrated withthe Eclipse development environment.

Eclipse is a versatile platform designed to support both Java development and plug-in development tools. DataTransformation Studio works seamlessly within Eclipse, letting you develop Data Transformation projects. You canuse Data Transformation projects either in conjunction with other projects that you develop in Eclipse, orindependently of Eclipse.

The Eclipse platform is supplied with the Data Transformation software. You do not need any previous experiencewith Eclipse in order to use Data Transformation Studio.

For more information about using Data Transformation Studio within the Eclipse environment, see the DataTransformation Studio Editing Guide.

New Project WizardsData Transformation Studio offers a set of wizards to help you set up new projects quickly with the typical options.There are wizards for parsers, serializers, blank projects, and other purposes.

For example, you can use the New Parser wizard to define the XML schema, example source, formats, documentprocessors, and default transformers.

Guided ModeOptionally, you can use the new guided mode to configure the IntelliScript of a transformation. In this mode,pressing the Enter key leads you through a logical sequence of properties. The mode displays screen tips thatexplain the meaning of each property.

Integrated XSD EditorThe XSD editor, which was previously offered as an optional Data Transformation module, is now integrated intoData Transformation Studio. The editor enables you to create, modify, or import an XML schema at the same timeas you configure transformations.

Data Transformation continues to support XML schemas prepared with any XML schema editor, in addition toschemas prepared with the built-in XSD editor.

Embedded HelpA new feature of the Data Transformation Studio environment is embedded, context-sensitive help. As you work inan editor, the help window automatically scrolls to the precise component and property that you are configuring.You can read the explanation of a component or property as you work, without leaving the Studio window.

The environment provides many other user-assistance and debugging tools. For example, by right-clicking text inan example source document, you can quickly find the corresponding anchor in the IntelliScript and thecorresponding event in the event log, and vice versa.


New Transformation ComponentsData Transformation 4 offers many new components that you can use in the IntelliScript configuration of atransformation.

For more information about the components described here, see the Data Transformation Studio User Guide.

Mappers: XML-to-XML TransformationsThe introduction of the Mapper component completes the circle of format-to-format transformation capabilities. DataTransformation now supports the following top-level transformation types:

Transformation Description

Parsers Convert any data format to XML.

Serializers Convert XML to any data format.

Transformers Modify existing data formats.

Mappers Convert XML to XML.

Serializers and mappers now provide an option to select an example source document. You an use the examplesource for developing and testing a transformation in the same way as for parsers. Likewise, serializers andmappers now support document processors. For example, this feature allows serializers and mappers to processExcel or Word documents, which the processors convert to XML.

Mapping Action and AnchorsWithin a Mapper, you can nest the Map action, which was previously called CopyValue. You can nest mapperanchors, such as AlternativeMappings, GroupMapping, RepeatingGroupMapping, and EmbeddedMapper. The conceptsare analogous to the parsing and serialization anchors that are nested in Parser and Serializer components,respectively.

StreamersThe new Streamer component splits a large source document into smaller portions that the software can processindependently of each other. Streamers are useful in transformations that process very large inputs such as multi-gigabyte data streams. In addition to reducing memory requirements, a streamer enables a transformation toprocess each source segment as soon as it is available, rather than waiting until the entire source is received.

Non-Sequential Access to DataA transformation can use the new LocatorByOccurrence component to access multiple-occurrence data holders non-sequentially. The component can select occurrences in a preconfigured sequence or in a dynamically-definedsequence.

New Transformation Components 17

Indexing: Keyed TransformationsThe new Key and LocatorByKey components allow you to construct transformations that retrieve, match, and storerecords by keyed criteria. For example, you can match lists of employee records by the employee IDs. You canthen select and output employee names.

The capabilities are similar to database joins and SQL where queries, but operate on loosely-structured sourcedocuments. In previous Data Transformation versions, this type of transformation required a relatively complexconfiguration. In version 4, the transformations are easy to implement.

Lookup TablesThe new LookupTable and LookupTransformer components enable a transformation to retrieve keyed data from apredefined table. The table can be defined in the IntelliScript or in an external XML file.

Revised AnchorsThe RepeatingGroup anchor has a new property called skip_failed_iterations, which controls the behavior if aniteration fails. To preserve the behavior of existing version 3.2 projects, the default value of the property is true.

The Alternatives anchor and the AlternativeSerializers serialization anchor have a new NameSwitch option. Theoption allows a transformation to select an alternative dynamically by name.

By default, the Content anchor searches for data that matches the XSD type of its data holder. The newdisable_XSD_type_search property allows the anchor to retrieve the data regardless of type. You can then use atransformer to convert the data to the required type.

New and Revised TransformersThe following are some new transformers that are available:

Transformer Description

Base64Decode Converts the base64 MIME encoding to a binary string.

Base64Encode Converts a binary string to the base64 MIME encoding.

CDATADecode Decodes a CDATA section of an XML document.

CDATAEncode Encodes a CDATA section of an XML document.

CreateUUID Generates a UUID identifier.

DateFormatICU Formats a date.

HebrewDosToWindowsTransformer Converts Hebrew text from the MS DOS to Windows code page.

TransformationStartTime Outputs the date and/or time at which the transformation started running.

TransformByParser Runs a parser on the input text, replacing segments of the text.

TransformByProcessor Runs a document processor on the input text, converting it to a new format.

TransformByService Runs a Data Transformation service on the input text.


The following transformer has been revised:

Transformer Description

Resize You can now specify the size and padding character dynamically, by storing the values in a dataholder.

Enhanced Flexibility of ActionsThe concept of actions has been generalized and the use of actions is more flexible. You can now insert actions atany location in the Contains list of a parser, serializer, or mapper. The action property of parsers and groups nolonger exists.

The actions are executed in the main sequence of anchors. You can set the timing of each action to the initial,main, or final phase, just as you can set the timing of anchors. To simulate the action behavior of previousversions, put the actions at the end of the anchor sequence and set their phase property to final.

Certain anchors and serialization anchors have been unified and redefined as actions. For example, theSetContent and SetContentSerializer components are now unified as the SetValue action. The EnsureCondition andEnsureConditionSerializer components are now unified as the EnsureCondition anchor.

The UseActionsSerializer no longer exists. You can nest the actions directly in a GroupSerializer, instead.

New and Revised ActionsData Transformation 4 introduces the following new action components:

Action Description

DateAddICU Increments a date.

DateDiffICU Returns the difference between two dates.

EnsureCondition Evaluates a JavaScript expression. It replaces the version 3.2 EnsureCondition anchor andEnsureConditionSerializer serialization anchor.

SetValue Fills a data holder with predefined content. It replaces the version 3.2 SetContent anchor andSetContentSerializer serialization anchor.

RunMapper Runs a mapper.

Sort Sorts the occurrences of a multiple-occurrence data holder.

The following actions have been revised:

Action Description

AddEventAction The values of the severity property have been renamed. A new fatal error severity levelstops the transformation.

Map Copies information between data holders. This was previously called the CopyValue action.

WriteValue The ODBCInsert option has been removed. You can use ODBCAction to write to a database.A new option, ExternalOutputWriter, activates a custom component that writes the data.

New Transformation Components 19

Action Description

In the OutputDataHolder option, the transformers property is now empty by default. Inprevious versions, it contained the HtmlProcessor and RemoveMarginSpace transformers, whichremoved redundant whitespace from the output.

New and Revised Document ProcessorsThe ExcelToXml processor now has options to process selected worksheets and empty cells. ExcelToXml andXmlToExcel have options to support Excel validation criteria and VBA macro code. The new ExcelToDataXmlprocessor generates a compact XML representation containing only the cell data and omitting the formattinginformation.

External ComponentsExternal components, such as custom document processors and custom transformers, now support their ownproperties. The properties are displayed in the IntelliScript. A transformation can use the properties to passconfiguration options or data to the components. For more information, see the Data Transformation EngineDeveloper Guide.

Simplified Data-Holder ManagementSerializers now detect the XML elements that they must load automatically. The corresponding_schema andenforce_corresponding_schema properties of serializers no longer exist.

Similarly, the force_single_instance_of property of version 3.2 parsers is no longer needed.

To define the XML elements that a transformation loads or creates explicitly, you can use the source and targetproperties and the Locator component.

Improved Schema Support FeaturesData Transformation offers enhanced schema support, including XML validation and namespaces.

Valid XML GenerationData Transformation uses schemas for enhanced guidance of XML generation. The default project configurationensures that Data Transformation always generates valid XML, according to the schemas attached to a project.

The validation is controlled by properties of the transformation project. For more information about the projectproperties, see the Data Transformation Studio User Guide.

Improved XML Namespace SupportData Transformation 4 supports both named and unnamed XML namespaces more smoothly than previousversions.

Namespaces are assigned in the schema. In Data Transformation Studio, you can edit the namespace aliases.The Schema view displays namespaces in a convenient navigator interface.

For more information, see the Data Transformation Studio User Guide.


Namespace of VariablesThe namespace of variables has been renamed. The new name is www.Local-Project.com/Variables.

Supported XML Schemas FeaturesThe following XML schema elements and attributes, which were subject to limitations in Data Transformation 3.2,are now fully supported. For more information about the XML schema support, see the Data Transformation StudioUser Guide.

abstractsubstitutionGroupuse="prohibited"

Project Copies of XML SchemasWhen you add an XML schema to a project, Data Transformation copies the schema to the project folder. Thecopy and the original are not linked. For more information, see the Data Transformation Studio User Guide.

Additional New FeaturesIn addition to the features described above, Data Transformation 4 provides new capabilities in several areas.

Upgrading Existing ProjectsYou can import Data Transformation 3.2 projects and services to Data Transformation 4. You can use a syntaxconversion tool to upgrade projects and services to the new structure and syntax. For more information aboutupgrading projects, see the Data Transformation Administrator Guide.

New TerminologySome of the Data Transformation terminology has been revised for clarity, or to make the terms consistent withthose used in the Eclipse development environment. The most important changes are as follows:

¨ Data Transformation workspaces are now called projects.

¨ The term workspace is now used for the location where Eclipse stores a set of Data Transformation projects.

¨ Data Transformation services are now deployed, rather than published.

¨ Data Transformation services are stored in the Data Transformation repository, rather than the servicesdatabase location.

Operating System SupportThe version 4 Data Transformation Engine runs on Microsoft Windows and on UNIX-type platforms such as SunSolaris, IBM AIX, Linux, and HP-UX. Data Transformation Studio runs on Microsoft Windows.

For more information about specific platforms, see the Data Transformation Administrator Guide.

Additional New Features 21

64-Bit Support and Data Transformation ServerData Transformation 4 supports 64-bit environments on UNIX-type platforms. On some platforms, DataTransformation is available as a native 64-bit application. On other platforms, you can enable 64-bit support byusing the Data Transformation Server.

The Server allows an application to invoke Data Transformation Engine out-of-process. This can improve stabilityby improving the isolation of applications.

For more information, see the Data Transformation Administrator Guide and the Data Transformation EngineDeveloper Guide.

API Language SupportThe Data Transformation API is now supported in Java, C, C++, .NET, and COM versions. A new Web ServiceAPI supports the use of Data Transformation services over the Internet.

API applications can pass service parameters to a transformation. Variables defined within the transformation areinitialized with the external values passed in the API call.

For more information, see the Data Transformation Engine Developer Guide and the API references for eachlanguage.

SetupThe Data Transformation setup has been streamlined. A Java Runtime Environment is now installed with thesetup. On UNIX-type platforms, the environment variables have been simplified. For more information, see theData Transformation Administrator Guide.

Multiple ConfigurationsBy using the Configuration Editor, you can support multiple Data Transformation configurations on the samecomputer. For example, multiple users or applications can load Data Transformation Engine with different servicelocations, JREs, or other options. For more information, see the Data Transformation Administrator Guide.

LibrariesExpanded Data Transformation libraries are now available. The libraries cover messaging standards such asACORD, several EDI versions, HIPAA, HL7, and SWIFT. The libraries contain predefined parsers, serializers, andXML schemas that support the respective standards.

A new version of the EDI-X12 library supports rigorous validation of EDI message data according to the X12specification.

For more information, see the Data Transformation Libraries Guide.


I N D E X

AAccelerator

Studio integration with 10actions

inserting in anchor sequence 19new 19

aggregationmultiple-occurrence data holders 8

APIslanguage support 22

Asian languagesUTF-8 support 10

BB2B Data Exchange

product family 13batch transaction standard 1.2

NCPDP library 2BizTalk integration

streamer support 12

CCGI interface

obsolete 11color coding

mapper example source 10COM

obsolete features 5COM API

obsolete 11COM customization interfaces

obsolete 11Complex Data Exchange

former product name 15components

new i 17configurations

multiple 22ContentMaster

former product name 15

DData Transformation

new product name 13deploying services

publishing 21deprecated

components 11

document processorASN.1 library 1

document processorsnew features 20obsolete 11

DTCC-NSCC libraryvalidation 9version 2009 9

EEclipse

Studio in 16version 3.3 3

EDI-X12 libraryvalidation and acknowledgments 3

embedded helpauto display 16

eventscustom logger 14

example sourcemapper color coding 10

Exceltransformation output 10

exit codesUNIX-style 9

external componentswith custom properties 20

Gguided mode

IntelliScript 16

Hhelp

on components and properties 16HIPAA

installing HIPAA Validation Add-On 5, 7validation and acknowledgments 11

HIPAA Crosswalkmapper package 4

HIPAA librarytype 999 acknowledgments 4validation 9version 5010 9

HL7XML schema 3

HTTPobsolete components 11

23

Iindexing

locators and keys 18industry standards

libraries 22inputs

multiple 13

JJavaScript

expression support 9extension functions 3

JavaScript engineobsolete 11

Kkeyed transformations

indexing 18

Llibaries

updated versions 3libraries

Customization Tool 10industry-standard transformations 22installing versions 11new and updated 14update frequency 14

Library Customization EditorHL7 3

Library Customization ToolSWIFT library 5, 7

licensingand registration 22

loggercustom 14

lookup tablesdynamic 13keyed data 18

Mmapper

anchors 17mappers

color coding 10defining in Accelerator 10XML-to-XML transformations 17

MSMQ outputobsolete 11

multiple 13multiple ports

input and output 13

NNACHA library

version 2009 9

namespacevariables 21

namespacessupport 20

notificationsevent and failure handling 8

Oobsolete

components 11ODBCAction

obsolete action 3ODBCLookup

obsolete transformer 3on_fail

custom logging property 14operating systems

support 21supported

Linux 14outputs 13

PPDF

table support 13transformation output 10

PDF message specificationLibrary Customization Tool 9

processorsnew features 20obsolete 11

product namereflecting integration 13

projectsworkspaces 21

publishdeploying services 21

Rredefine

schema support 10repository

services database location 21

Sschemas

Eclipse editor 3redefine support 10

serializersnew features 20

services database locationrepository 21

sixty-four bitoperating system support 22

streamersplitting large inputs 17

streamersenhancements 2XML 2

24 Index

strict validationXML 13

structured parsingStructureDefinition anchor 8

Studionew version 4 features 16on 64-bit Windows 4

SWIFTMT and MX libraries 5, 7

SWIFT libraryversion 2009 9

Ttables

PDF support 13telecommunication standard D.0

NCPDP library 2terminology

new 21transformers

new 18types

XSI type attribute 14

UUnicode

UTF-8 support 10unified

installer 1upgrade to 5010A1

HIPAA Crosswalk 2upgrading

projects to version 4 21UTF-8

support 10

Vvalidation

data 8generated XML 20installing HIPAA add-on 5, 7

strict XML 13VRL rule language 5, 8

validation hotfix 16HIPAA 2

variablesnamespace 21

version numberreflecting integration 13

VRLeditor 2Validation Rule Language 5, 8

WWeb Service API

support 22webMethods

agent versions 4integration features 14

webMethods integrationmultiple inputs and outputs 12

WebSphereagent versions 4

wizardsnew project 16

Wordtransformation output 10

workspacesprojects 21

XXML

generating valid 20XML input

streamers 2XmlToDocument

postprocessor 10xs:anyType

data type 3XSD editor

in Studio 16XSI type

attribute 14

Index 25

Documents

B2B Data Transformation 9.1.0 Release Guide (English) · PowerMart, Metadata Manager, Informatica Data Quality, Informatica Data Explorer, Informatica B2B Data Transformation, Informatica