HP NonStop Data Transformation Engine What’s New Reference Guide Abstract This manual provides information about what’s new in the HP NonStop™ Data Transformation Engine (NonStop DTE) 6.7.1 product version. Product Version NonStop Data Transformation Engine 6.7.
Document History Part Number Product Version Published 528269-001 NonStop Data Transformation Engine 6.7.1 June 2004 528269-002 NonStop Data Transformation Engine 6.7.
Contents About This Document Related References........................................................................................... 6 Chapter 1 – Introduction Release History................................................................................................ 7 Product Name Changes ...................................................................................... 7 Chapter 2 - Version 6.7.1 New Adapters for NonStop Data Transformation Engine ..........................................
Contents Launching Database Interface Designer from IFD ...................................................... 21 Resource Registry Alias Resolution ....................................................................... 22 Initialization File Enhancements.......................................................................... 22 Relative Type Name Enhancement ....................................................................... 22 XML Type Property Enhancement...........................................
Contents Index What's New Reference Guide 5
About This Document The What's New Reference Guide contains information about differences between versions of the Mercator product suite. This document discusses new features and enhancements only. To learn about fixed bugs, refer to the Release Notes for the individual release. This document assumes that the reader knows the Windows environment, has used the Mercator Design Studio, and understands words such as mapping, type trees, and other basic Mercator terminology.
Chapter 1 – Introduction This guide describes the the changes between NonStop Data Transformation Engine 5.0.3 and 6.7.1. Changes in intermediate Mercator product versions are also included as the 6.7.1 version includes these changes as well. This guide also describes product name changes from NonStop Data Transformation Engine 1.0 and later versions. Release History The following table displays an historical list of Integration Broker Suite releases prior to this release (6.7.1).
Chapter 1 – Introduction Product Name Changes Old Name (Versions 1.x – 2.x) New Name (Versions 5.0 and later) Event Server, Launcher Event Server Launcher Monitor Enterprise Manager Mercator for EC Commerce Broker Mercator for PeopleSoft Enterprise Broker (limited-use edition available for PeopleSoft) Mercator for R/3 Enterprise Broker (limited-use edition available for SAP R/3) Mercator FS Commerce Broker Mercator FS for SWIFTAlliance SWIFTAlliance Messenger FS Manager Novera 4.
Chapter 2 - Version 6.7.1 Version 6.7.1 maintenance release (Service Pack 1 for v6.7) offers enhancements to functionality and improvements in using Mercator products. The significant changes included in v6.7.1 are described in the following sections.
Chapter 2 - Version 6.7.1 Map Designer For items with Pad properties in existing type trees from Design Studio versions earlier than 6.7.1, the default value of the Item Subclass > Pad > CountsTowardMinContent property is Yes. For new items with Pad properties, the default value of the Item Subclass > Pad > CountsTowardMinContent property will be Yes.
Chapter 2 - Version 6.7.1 Resource Registry 2 represents the two audit codes (13 or 14) for failing minimum or maximum size requirements (TooLong TooShort). Audit Log A new attribute has been added in the Log section of the MapSettings audit to reflect the SizeValidation attribute.
Chapter 2 - Version 6.7.1 Resource Registry Masked Resource Aliases in Audit and Debug Log Files Encrypted Resource Registry resource aliases are now masked when displayed in logs and trace files.
Chapter 2 - Version 6.7.1 Command Server Command Server Software Development Kit The following items are new or enhanced for the SDK v6.7.1. BEA Tuxedo Adapter Caching Maps The Tuxedo Transformation Server now caches maps based on what a user specifies in the mercserv.cfg file. See the NonStop Data Transformation Engine Services Guide for more information.
Chapter 2 - Version 6.7.1 Resource Adapters HTTP Adapter Timeout (-TIMEOUT) Adapter Command Use the new Timeout adapter command (-TIMEOUT) to set the socket timeouts to a specified number of seconds, to account for HTTP server access time. The default timeout is 300 seconds. See the HTTP Adapter Reference Guide for more information.
Chapter 3 – Version 6.7 Version 6.7 offers new enhancements and features that empower customers for B2B expansion, provide extended support for Java and other key industry standard, and extend the performance, scalability and manageability of customers' existing systems and applications.
Chapter 3 – Version 6.7 Utility Commands CORBA API This new API enables a map to be invoked as a CORBA object. The Mercator map objects are offered as CORBA services with a number of popular ORBs. The server-side CORBA objects can be developed either in C++ or Java. The CORBA API is consistent with the other language implementations of the Mercator Programming Interface. Java API Enhancements This new API enables a map to be invoked as a Java object.
Chapter 3 – Version 6.7 Importer Enhancements Multiple Attachments for E-mail adapter The -ATTACH command only supports a single attachment. If you are using Internet mail (-PROTO INET) and multiple attachments need to be sent or received, you can accomplish this by chaining the MIME adapter with the e-mail adapter, and using the -RAW option of the e-mail adapter to map the MIME header fields.
Chapter 3 – Version 6.7 Importer Enhancements ♦ modules ♦ interfaces ♦ structs ♦ operations ♦ attributes ♦ constants XML Schema Importer Type trees created by the XML Schema Importer are now simplified, smaller, easier to process, and better describe the underlying XML data. DTD Schema Importer The DTD Schema Importer now allows you to select either a type tree that was generated by using a series of maps prior to MIB v6.7, or to select a type tree that was generated in MIB v6.7 using an XML parser.
Chapter 3 – Version 6.7 Card and Map Setting Enhancements Card and Map Setting Enhancements The following sections detail new card and map settings for Version 6.7 as well as enhancements made to existing settings. Ignore Restrictions Map Setting A new option has been added to the Ignore Validation Options execution command, which specifies that restrictions be ignored for all items appearing in the input data with no warnings.
Chapter 3 – Version 6.7 RUN Map Behavior Change RUN Map Behavior Change Behavior has changed for files created by RUN maps. If the Scope card setting is set to Map with the OnFailure setting set to Rollback, the file will not be created until the top map has completed successfully.
Chapter 3 – Version 6.7 Packaged Example Enhancements Packaged Example Enhancements There is a new front-end user interface for the examples and it can be accessed through the Start menu. For example, Start > Programs > Mercator 6.7 > Design Studio. The examples included with the Design Studio, Mercator Integration Broker, and the Software Development Kit Version 6.7 have been restructured.
Chapter 3 – Version 6.7 Resource Registry Alias Resolution Resource Registry Alias Resolution Additional resources for which to create aliases are now available in the Resource Registry. These resources include: ♦ backup files ♦ audit files and locations ♦ trace files and locations ♦ work space locations ♦ external parser location (defined in the Type Designer) Initialization File Enhancements The following new settings have been added to the mercator.
Chapter 3 – Version 6.7 UNIX Time Format Enhancement UNIX Time Format Enhancement The time format in UNIX audit files has been changed to report elapsed time in milliseconds, just as it is on the Windows platform. This enhancement enables the resolution of the map elapsed time, the time difference between when a map starts and ends execution, to be expressed in the audit log file as microseconds.
Chapter 4 – Version 6.5.2 Version 6.5.2 Maintenance Release offers enhancements to functionality and improvements in using Mercator products. Significant changes introduced in Version 6.5.2 are described in the following sections. XML Schema Importer New for v6.5.2, the XML Schema Importer is a facility for automatically generating type trees by parsing an Extensible Markup Language (XML) schema.
Chapter 4 – Version 6.5.2 Unique Audit Log Filename Unique Audit Log Filename Audit log filenames will now be unique across multiple processes. For example, processes started in both the Command Server and Event Server will produce audit log filenames that are unique to both the Command Server and Event Server. Email Adapter The Email adapter has been enhanced to allow additional customization of header information by specifying content types, and to enable full mapping of the email message header.
Chapter 4 – Version 6.5.2 Adapter Polling Interval Enhancement Adapter Polling Interval Enhancement Two new settings, PollWaitTimeMin and PollWaitTimeMax, have been added to the mercator.ini file to configure the polling interval used by adapters to detect events. IBM WebSphere MQ Adapter The IBM WebSphere MQ adapter has been enhanced so that a PUT operation will use the correct context as specified using the MQOPEN Options (-MQOO) adapter command.
Chapter 5 – Version 6.5.1 Version 6.5.1 Maintenance Release offers enhancements to functionality and improvements in using Mercator products. Significant changes introduced in Version 6.5.1 are described in the following sections. IBM MQSeries Adapter Name Change The IBM MQSeries product name has changed to IBM WebSphere MQ. Therefore, throughout Mercator documentation the name has changed from IBM MQSeries adapter to IBM Websphere MQ Adapter.
Chapter 6 – Version 6.5 Version 6.5 offers new features, enhancements to functionality, resolution of discovered software problems, and improvements in using Mercator products. Significant changes introduced in Version 6.5 are described in the following sections. Large File Support The transformation engine includes an enhancement to allow for mapping to and from large data files that exceed 2 Gigabytes in size. Note Any file within a single burst is still limited to a maximum size of 4 Gigabytes.
Chapter 7 – Version 6.0 Version 6.0 offers new features, enhancements to functionality, and improvements in using Mercator products. Significant changes introduced in Version 6.0 are described in the following sections.
Chapter 7 – Version 6.0 Mercator Design Studio Enhancements New: Graphical Impact Analysis for All Designers The Source Compare feature allows you to compare two Mercator source files of the same type, to discover the differences, and to graphically navigate through the differences. The Source Compare feature provides impact analysis for different versions of Mercator data models, transformation models, and system integration models.
Chapter 7 – Version 6.0 Mercator Design Studio Enhancements New: External System Component for the Flow Designer A new palette object has been added to the Integration Flow Designer Tool Box to represent an external system object, such as an SAP R/3 system or e-business marketplace. Improved: Flow Designer Navigator Extensions The Flow Designer Navigator now shows more than just systems and their map components.
Chapter 7 – Version 6.0 Mercator Design Studio Enhancements execution audit summary of a map. This option allows a more concise view of execution statistics. Enhanced XML DTD Importer The DTD Importer has been enhanced to take advantage of the new type property extensions described below. Type Property Extensions Improve Native XML Support Type Property extensions in Version 6.0 allow XML data to be directly validated and constructed without using the XML Data adapter.
Chapter 7 – Version 6.0 Mercator Design Studio Enhancements white space can appear in the data before the first component and could appear after each component. White space component syntax includes a Build As property that allows specification of a literal to be used when builds output data objects are built. The Version 6.0 XML DTD Importer uses these white space property extensions for defining XML data. More Granularity for Item Content Restrictions In all releases through Version 5.
Chapter 7 – Version 6.0 Mercator Design Studio Enhancements Date & Time Separator Character Restriction Removed Enhancements to custom Date & Time formats now allow additional characters, such as an alphabetic separator: 2001-01-23T10:32:59-0500 in ISO 8601 format Comment Type Folded in a New Floating Component The Version 5.0 Comment Type properties have been incorporated into a more robust Floating Component property in Version 6.0.
Chapter 7 – Version 6.0 Mercator Design Studio Enhancements Content-distinguishable Types Whenever two types are required to be distinguishable because objects of those types can appear at the same point in a data stream, and those two types cannot be distinguished by an initiator, the type tree analysis tries to determine if the data content is distinguishable.
Chapter 7 – Version 6.0 Mercator Design Studio Enhancements EITHER (B, DEFAULT(B)) Returns the value for B when B exists and has content. Otherwise, returns MyDefault. New: ECHOIN A new function, ECHOIN, has been added to make the RUN function easier. Syntax ECHOIN (single-number-expression, single-text-expression) Meaning ECHOIN (card#, input-echo-source-command) Returns a text item whose value is a Mercator input echo source override command to be used in a RUN function argument.
Chapter 7 – Version 6.0 Mercator Design Studio Enhancements Returns a type object whose content matches the input type object, but whose syntax matches the output type object. For example, MyXMLPurchaseOrder = REFORMAT(MyCOBOL_PurchaseOrder) This function is useful when the same type structure may come from different type trees, such as different versions of the same EDI, or when converting legacy formats to XML.
Chapter 7 – Version 6.0 Operational Monitoring & Management SUBSTITUTE ("ABBA" , "B", "A", "A", "B") First all occurrences “B” are replaced with “A” in “ABBA” resulting in “AAAA”; then all occurrences of “A” are replaced with “B” in “AAAA” resulting in “BBBB”. “BBBB” is the final result. WORD Extended to Search Backwards The third argument for the WORD function can now be a negative number. This extends the WORD function to be able to search word lists from the back end forward.
Chapter 7 – Version 6.0 Resource Management Services and heartbeats, and remote management services to securely stop and start Mercator systems. The Management Console, which can be installed on one or more platforms, communicates with Mercator systems controlled by an Event Server. To configure the systems that can be controlled, Mercator now provides an Event Server Administration service.
Chapter 7 – Version 6.0 Resource Management Services stored in an XML format. The DTD for each file type is defined in the Resource Registry documentation. Defining Resource Names Using the Resource Registry, a resource name is associated with one or more logical virtual servers. Each logical virtual server may have a different resource property definition for a given resource name. For example, suppose Payroll is a resource name.
Chapter 7 – Version 6.0 Resource Management Services Global Transaction Management Support for distributed global transactions by interfacing with external transaction managers has been added in Version 6.0. This release adds support for Microsoft Distributed Transaction Coordinator (MS DTC) and MQSeries Transaction Manager. Database and messaging adapters are now capable of participating in a global transaction under the control of these transaction managers.
Chapter 7 – Version 6.0 Resource Management Services Database Adapter Enhancements New OLE DB and Informix Database Adapter Support New for Version 6.0, the database adapters for OLE DB data providers allow you to access and manipulate data contained in databases that can be presented as OLE DB data links. The new Informix option allows you to access and manipulate data contained in Informix databases for sources, targets, and map rules.
Chapter 7 – Version 6.0 Mercator Programming Interfaces supports ZLIB inflate/deflate compression method, commonly used as a content type in XML/HTTP publish/subscribe scenarios (see RFC 1950 and RFC 1951). Mercator COM Adapter The COM adapter allows the user to access an automation-compatible component from within a map and call one or more methods on that component. Both local servers (DLLs) and remote servers (DCOM executables) are supported.
Chapter 7 – Version 6.0 Mercator Programming Interfaces ♦ Map authors no longer need to remember complicated library and function names as they did when using the Application adapter. ♦ You can create adapters to suit your specific requirements. ♦ Third parties can create adapters with as much functionality as Mercator adapters. ♦ Customer and third-party adapters can be listed in the Map Designer and Integration Flow Designer.
Index E-mail adapter, 17, 25 environment variables, 12 European date formats, 28 Event Server and SNMP support, 39 and the HTTP Listener, 41 examples, 21 A Adapter Toolkit interface, 43 adapters. See resource adapters audit log, 10, 12, 20 B backup unique filename, 20 BEA Tuxedo Adapter enhancements for 6.7.1, 13 burst option, 31 F floating component, 34 FTP adapter, 17 secure data transfer, 41 FTP Adapter enhancements for 6.7.
Index O import/export command, 29 trace and audit windows, 31 map settings RestrictionError, 19 maps run behavior, 20 maximum threads. See global maximum threads Mercator product name changes, 7 Mercator Programming Interface enhancements for 6.7.1, 13 Mercator Programming Interfaces, 15 CORBA, 16 Java, 16 object-oriented programming, 43 stream objects, 43 mercator.
Index X and floating component, 34 and white space, 32 XML Schema Importer, 18, 24 X XML data, 22, 32 What's New Reference Guide 47
