Data Sync Functionality
The core focus of this release was to enhance DBIntegrate to take advantage of “Change Data Capture” or CDC, which is the processing of taking events in our legacy applications e.g. ISAM/COBOL, or RDBMS and applying associated actions into another database, for example SQL Server. We have termed this functionality ‘Data Synchronization’ (Data Sync).

Our Data Synchronization graphical interface for defining jobs has retained the look and feel of the DBIntegrate Data Mapper, so there will be minimal retraining to get up and running with your job if you are already familiar with product.
The use of drag ‘n’ drop functionality and easy to use interfaces makes first time use straightforward and painless:

Data Sync wasn’t the only work and improvement we carried out in this release, we are always working to refine our code and carry out code reviews on a weekly basis to help bring you the best product available. We constantly work on improving DBIntegrate in the background, but some of the other features you might notice that this release brings to you include:

Support for access to Fixed-width text files
This allows you to import your text file, select column widths and assign column headers.

Data De-duplication Results Viewer
We have created a deduplication “results” viewer, this enables users to identify which records have been matched against each other.  This audit trail allows users to view and refine the matching or merging processing steps.

NEW Processing Functions
We are also continuously identifying and adding new functions to DBIntegrate that have not only been useful for us, but we think will help you as well. The new functions enable for greater manipulation of your data without the need to code and create your own custom functions.

Here is a selection of some of our new favourite functions:

• DBI_CHECK_EMAIL_FORMAT: Identifies if e-mails are in a valid format, and returns a Boolean result.
• DBI_REMOVE_EXTRA_SPACES: Removes additional spaces within a string
• DBI_SUBSTITUTE_STRING: Lets users enter in a string they wish to switch for another
• DBI_REMOVE_PUNCTUATION: Removes any punctuation from a string
• DBI_SENDEMAIL: Send e-mails straight from the Data Sync or Data Mapper runtime

NEW DBIntegrate Variable
We have added in a new variable; s_action_err. If used during runtime this identifies if a record has failed on insert/update or delete to a target source. It can be called within IF conditions to apply further processing or user notification, such as in conjunction with DBI_SENDEMAIL to send an e-mail to a specified admin team (for example) to notify them of erroneous data.

Please find the release notice here where you can view further information on new features and issues that have been resolved since our last release.
If you would like a free-demo of DBIntegrate please visit our website for access here

Please note: the free-demo version has reduced functionality; Data De-duplication & Data Sync are not available for free use.

We’ve done a huge amount of work for this release although much of it is ‘under the covers’ providing much more flexibility, improved performance and reliability for all data access going forward.

Here are the highlights:

• Improved Data Access.
  All data is accessed directly in order to improve performance. CSV format files are accessed through a native API to provide speed and flexibility. In future releases we will build on the improvements in this area.
• Data Source Definition Wizards
  We’ve worked on the Data Source Wizards to make it as easy as possible to define a data source. In most cases it takes just a few seconds.
• Logging
  We’ve standardized the logging for all the different types of processing. This will also enable access to logging from user defined functions. Logging can be configured in the Project Designer for every project type.
• Data Merge and De-duplication
  Data Merge and De-duplication jobs can now be run in separate steps. This will really help enable an iterative and collaborative approach to data integration project development.
• Processing Functions
  We’ve added more new processing functions, including functions that make use of a built-in database. For example, we have a function that gets the ISO country code for any specified country name.

For more information, please look at the release notice.

Contact customer services for product download or go direct to our FTP site.

Plans for the next DBIntegrate release will be posted very soon.

• Changes aimed at improving performance. This includes caching the results of DBI_LOOKUP.
• Transaction processing. If there is any failure when processing a source row, all INSERTs to target tables for that row are rolled back
• Documentation automatically generated from the DBINT file.

Please check our website or contact Transoft customer services for more information: ussupport@transoft.com / uksupport@transoft.com.

The DBIntegrate Server
Provides real-time, read-write access to many different data sources including SQL Server, Oracle, Access, MySQL, COBOL, C-ISAM, BASIC, Excel spreadsheets, Progress, Sculptor and PRO-ISAM.

The DBIntegrate Runtime
Drives data mapping, re-structuring and cleansing processes. It includes a large number of in-built data processing functions and is easily extensible.

The DBIntegrate Administrator
Provides an easy to use, drag and drop, graphical user interface for defining data mapping, data restructuring and data cleansing operations.

Some of the recent enhancements are:

Extend the names of tables, columns, indices and the remotequalifier definition from 30 characters to 128 characters.
This makes it much easier to access data sources suc as SQL Server where long names may have been used. It also enables the use of spreadsheets that are stored in a folder that has a long path-name.

Columns with length greater than 4096 characters.
It is now possible to access columns that contain up to 8192 bytes of data.

Make use of parameterized queries
We have enabled parameterized queries in order to improve performance

Automatically create a DSN when a new UDD is created
It is possible to create an ODBC DSN automatically when a new UDD is created. This makes it easy to access the UDD and the data using ODBC.

It also offers Data Integration with optimized realtime, read-write access to data across all sources, plus fast, configurable Data Warehousing.

DBIntegrate v1.2 is now available for download from Transoft’s FTP site. The release includes the following components:

The DBIntegrate Server
Provides real-time, read-write access to many different data sources including SQL Server, Oracle, Access, MySQL, COBOL, C-ISAM, BASIC, Excel spreadsheets, Progress, Sculptor and PRO-ISAM.

The DBIntegrate Runtime
Drives data mapping, re-structuring and cleansing processes. It includes a large number of in-built data processing functions and is easily extensible.

The DBIntegrate Administrator
Provides an easy to use, drag and drop, graphical user interface for defining data mapping, data restructuring and data cleansing operations.

Some of the recent enhancements are:

New and improved processing functions:

• DBI_ESCAPE_SINGLE_QUOTE
• DBI_CALCULATE
• DBI_TODAY
• DBI_GET_ADDR_POSTCODE
• DBI_ISORG
• DBI_WRITELINE
• DBI_NEW_GUID
• DBI_TRUN_LEN

Data Mapping and Viewing

• Implement Source and Target View buttons to allow easy viewing of source and target data
• Auto-refresh lists of source and target tables and columns

Data Source Administration

• Graphical tool to allow the definition of views in the UDD

DBIntegrate Runtime

• Validate schema and mappings before running a migration job
• Report statistics after each migration job
• Stop the migration job if errors exceed the specified maximum
• Output the version to the log file