Ketl

From MIKE2 Methodology

This article is currently Under Construction. It is undergoing major changes as it is in the early stages of development. Users should help contribute to this article to get it to the point where is ready for a Peer Review.

KETL™, is an open source ETL tool from Kinetic Networks. The data integration platform is built with portable, java-based architecture and open, XML-based configuration and job language.

Contents 1 Relationship to MIKE2.0 1.1 SAFE Architecture 1.2 Overall Implementation Guide 1.3 Alignment with Strategic Requirements for Infrastructure Development 2 Product Review 2.1 Key Features 2.2 Pros 2.3 Cons 2.4 Desired Enhancements 2.5 User Valuation Enhancements 3 Usage 3.1 Product Access 3.2 Open Source Licensing 3.3 Comparable Open Source Products 3.4 Reference Implementations through MIKE2.0

Relationship to MIKE2.0

SAFE Architecture

• Used to deliver the ETL sub-component

Overall Implementation Guide

ETL Design and Implementation Activities of MIKE2.0, which are:

• ETL Physical Design
• Technology Backplane Development

Alignment with Strategic Requirements for Infrastructure Development

• Review against Technology Selection QuickScan

Product Review

Key Features

• Scalable, platform independent ETL engine–enables complex ETL transformations to be executed in a highly efficient manner. Supports multiple CPU’s and 64-bit servers.
• Job execution and scheduling manager–dependency-driven job execution model supports multiple job types, conditional exception handling, email notification and time-based scheduling. Job types fall into three categories, with support for additional executors via the KETL API.

1. SQL–executes pre-defined SQL statement via JDBC
2. XML–executes XML defined jobs
3. OS–executes an operating system command

• XML job definition language–allows ETL jobs to be easily defined in XML, enabling the use of widely available XML authoring tools and associated support for version control systems.
• Centralized repository–supports multiple KETL instances to leverage job and parameter definitions.
• Performance monitoring–collects historical and active job statistics in the repository, allowing comprehensive analysis of problematic jobs.
• Comprehensive data source support–supports extracting and loading of relational, flat file and XML data sources, via JDBC and proprietary database APIs.
• Scheduling engine–time-based and event-driven job execution

Pros

• Pros point 1
• Pros point 2
• Pros point 3
• Pros point 4

Cons

• Cons point 1
• Cons point 2
• Cons point 3
• Cons point 4

Desired Enhancements

Functonality that users of the MIKE2.0 Methodology would like to see added to this product are as follows:

User Valuation Enhancements

Voting scores from MIKE2.0 Contributors on the value of the asset in the context of the overall methodology

Usage

Product Access

KETL download available from product website

Open Source Licensing

• GNU Public License (GPL)

Comparable Open Source Products

• Kettle
• CloverETL
• Enhydra Octopus
• Talend Open Source Solutions

Reference Implementations through MIKE2.0