How to perform database landing with Talend ?

 What is tDBInput? 

tDBInput is a Talend component that reads data from a database and extracts, transforms, and loads data (ETL processes). 

Features: 

→  Supports multiple databases such as Microsoft SQL Server, MySQL, PostgreSQL, Oracle, IBM DB2, Vertica, and others 

→  tDBInput requires connection data such as the port, database name, user, and password 

→  SQL Query: Allows writing and executing SQL queries 

What is tDBOutput? 

tDBOutput is a Talend component used for inserting, updating, or deleting data in a table in a database. It supports various databases and can perform different types of data manipulations. 

 

In this SkillPill, you will discover step by step how to perform “database landing” with Talend

Step 1: Create the job  

Open Talend Studio and create a new job with a specific name related to the chosen topic

Step 2: Create a connection  

Create two connections to VerticaDB with schemas for source and target. (Repository -> Metadata -> DB Connection) 

Step 3: Add connection components  

Use tPreJob and tDBConnection components to establish connections to the database 

Use tPostJob and tDBClose components to close the database connection 

Step 4: Add tDBInput components  

Use two tDBInput components and name them CustomersUS and StatesUS 

→ Select the Basic settings menu, configure Database to Vertica 

→ Check Use an existing connection 

→ Choose the connection from the Component List for the source system 

→ Select Schema -> Repository and choose tables CustomersUS and StatesUS 

→ Generate the query using Guess Query 

Step 5: Add tMap and link the components 

Use a tMap component and connect the links between the components 

→ Connect CustomersUS to tMap using Row > Main 

→ Connect StatesUS to tMap using Row > Main (Lookup) 

→ tMap can have multiple input sources, but only one can be the Main row, the rest are lookups. 

→ Connect tMap to Customers_States using Row > Main 

Step 6: tMap configuration 

→ Drag StateID from the CustomersUS to StateID from StatesUS table 

→ From tMap Settings -> Join Model set Inner Join, then Apply and Ok 

Step 7: Add tDBOutput Component  

→ Use a tDBOutput component and name it Customers_States 

→ Select the Basic settings menu, set Database to Vertica 

→ Check Use an existing connection 

→ Choose the connection from the Component List for the target system 

→ Select Schema -> Repository and choose the table Customers_States 

→ Connect tMap to tDBOutput using the Main row 

Run the process and verify the result. 

 

Here is the result in Talend:

Watch the video tutorial here:

About btProvider:

We hold all possible technical and sales certifications for all products:

Talend, Tableau Desktop, Tableau Public, Tableau Server, Tableau Prep, Tableau Data Management, Vertica, Salesforce, Mulesoft, Write-Back.

With Talend – the best data management platform – you can always understand your data better. Using Talend, you will make intelligent and strategic decisions and seamlessly integrate, assure quality, and govern your data effortlessly. See other #skillpill video tutorials here:

How to create a Barcode Chart

How to create a top N Set

Using measure names in parameter actions

Are you interested in learning more about Talend – the catalyst for efficient and comprehensive data management solutions across your company.

Contact us!