Datastage Advanced – Complex Data Processing

2.88 out of 5 based on 49 customer ratings

SKU: ISXDS22. Category: .

Product Description


This course is designed to introduce you to advanced parallel job data processing techniques in DataStage v11.5. In this course you will develop data techniques for processing different types of complex data resources including relational data, unstructured data (Excel spreadsheets), and XML data. In addition, you will learn advanced techniques for processing data, including techniques for masking data and techniques for validating data using data rules. Finally, you will learn techniques for updating data in a star schema data warehouse using the DataStage SCD (Slowly Changing Dimensions) stage. Even if you are not working with all of these specific types of data, you will benefit from this course by learning advanced DataStage job design techniques, techniques that go beyond those utilized in the DataStage Essentials course.


Experienced DataStage developers seeking training in more advanced DataStage job techniques and who seek techniques for working with complex types of data resources.


DataStage Fundamentals course or equivalent.

Key topics

Unit 1: Accessing databases
Topic 1:  Connector stage overview
• Use Connector stages to read from and write to relational tables
• Working with the Connector stage properties
Topic 2:  Connector stage functionality
• Before / After SQL
• Sparse lookups
• Optimize insert/update performance
Topic 3:  Error handling in Connector stages
• Reject links
• Reject conditions
Topic 4:  Multiple input links
• Designing jobs using Connector stages with multiple input links
• Ordering records across multiple input links
Topic 5:  File Connector stage
• Read and write data to Hadoop file systems
Demonstration 1: Handling database errors
Demonstration 2:  Parallel jobs with multiple Connector input links
Demonstration 3:  Using the File Connector stage to read and write HDFS files

Unit 2: Processing unstructured data
Topic 1:  Using the Unstructured Data stage in DataStage jobs
• Extract data from an Excel spreadsheet
• Specify a data range for data extraction in an Unstructured Data stage
• Specify document properties for data extraction.
Demonstration 1:  Processing unstructured data

Unit 3: Data masking
Topic 1:  Using the Data Masking stage in DataStage jobs
• Data masking techniques
• Data masking policies
• Applying policies for masquerading context-aware data types
• Applying policies for masquerading generic data types
• Repeatable replacement
• Using reference tables
• Creating custom reference tables
Demonstration 1: Data masking

Unit 4: Using data rules
Topic 1:  Introduction to data rules
• Using the Data Rules Editor
• Selecting data rules
• Binding data rule variables
• Output link constraints
• Adding statistics and attributes to the output information
Topic 2:  Use the Data Rules stage to valid foreign key references in source data
Topic 3:  Create custom data rules
Demonstration 1:  Using data rules

Unit 5: Processing XML data
Topic 1:  Introduction to the Hierarchical stage
• Hierarchical stage Assembly editor
• Use the Schema Library Manager to import and manage XML schemas
Topic 2:  Composing XML data
• Using the HJoin step to create parent-child relationships between input lists
• Using the Composer step
Topic 3:  Writing Hierarchical data to a relational table
Topic 4:  Using the Regroup step
Topic 5:  Consuming XML data
• Using the XML Parser step
• Propagating columns
Topic 6:  Transforming XML data
• Using the Aggregate step
• Using the Sort step
• Using the Switch step
• Using the H-Pivot step
Demonstration 1:  Importing XML schemas
Demonstration 2: Compose hierarchical data
Demonstration 3: Consume hierarchical data
Demonstration 4:  Transform hierarchical data

Unit 6:  Updating a star schema database
Topic 1:  Surrogate keys
• Design a job that creates and updates a surrogate key source key file from a dimension table
Topic 2:  Slowly Changing Dimensions (SCD) stage
• Star schema databases
• SCD stage Fast Path pages
• Specifying purpose codes
• Dimension update specification
• Design a job that processes a star schema database with Type 1 and Type 2 slowly changing dimensions
Demonstration 1: Build a parallel job that updates a star schema database with two dimensions



  • Use Connector stages to read from and write to database tables
  • Handle SQL errors in Connector stages
  • Use Connector stages with multiple input links
  • Use the File Connector stage to access Hadoop HDFS data
  • Optimize jobs that write to database tables
  • Use the Unstructured Data stage to extract data from Excel spreadsheets
  • Use the Data Masking stage to mask sensitive data processed within a DataStage job
  • Use the Hierarchical stage to parse, compose, and transform XML data
  • Use the Schema Library Manager to import and manage XML schemas
  • Use the Data Rules stage to validate fields of data within a DataStage job
  • Create custom data rules for validating data
  • Design a job that processes a star schema data warehouse with Type 1 and Type 2 slowly changing dimensions

49 reviews for Datastage Advanced – Complex Data Processing

2 out of 5 :

What’S In Fake Accutane Bought Online? Almold cialis 5 mg retrourept Vibramycin Dose Rate

4 out of 5 :

photos of real viagra purchase generic viagra online viagra australia

2 out of 5 :

drugstore pharmacy rx express pharmacy

4 out of 5 :

canadian online pharmacy mail order pharmacy people’s pharmacy

1 out of 5 :

rx plus pharmacy peoples pharmacy online pharmacy

1 out of 5 :

erectile dysfunction treatment the peoples pharmacy best drugstore face wash

2 out of 5 :

nearest drugstore canadian pharmacies online canadian drug pharmacy

1 out of 5 :

pharmacy in canada erectile ed meds online

2 out of 5 :

indian pharmacy online pharmacy drugstore online pharmacy open near me

2 out of 5 :

online pharmacy without scripts erectile dysfunction pills pharmacies near me

3 out of 5 :

canadian drugstore online drugs without prescription london drugs canada

2 out of 5 :

pharmacy cost comparison pharmacy drug store best online canadian pharmacy

1 out of 5 :

cvs online pharmacy us pharmacy no prior prescription cialis super active

3 out of 5 :

prescription cost northwest pharmacy trusted overseas pharmacies

2 out of 5 :

online pharmacies of canada where can i buy viagra cheap canadian pharmacies without an rx

1 out of 5 :

walmart pharmacy price check best online pharmacy stores canadian drugs online pharmacy

3 out of 5 :

cialis prescription assistance program generic cialis tadalafil cialis without perscripiton

2 out of 5 :

boots viagra viagra. no prescription hard for 36hr like viagra

1 out of 5 :

generic viagra purchase with mastercard free viagra viagra online stores

4 out of 5 :

cheap chinese viagra paying with paypal where can i get viagra in melbourne disount viagral

4 out of 5 :

efectos de pastilla cialis cialis 5 mg ciao which one is better viagra cialis levitra

4 out of 5 :

cash loans up to 30000 payday loans in omaha nebraska we fix money com payday loan

3 out of 5 :

pluto payday loans instant cash loan reviews visa cash advance cost


Good blog! I really love how it is simple on my eyes and the data are well written. I’m wondering how I could be notified whenever a new post has been made. I have subscribed to your RSS which must do the trick! Have a great day!

2 out of 5 :

payday loans clovis nm allied cash advance tucson arizona access cash loan

3 out of 5 :

best alternative to cialis cialis side effects headache cialis sinus headache

3 out of 5 :

cash loan in az payday loans in schenectady ny should i consolidate my payday loans

2 out of 5 :

youtube viagra viagra best price viagra no prescriptin

vreyro linomit

Very fantastic visual appeal on this internet site, I’d rate it 10 10.

1 out of 5 :

female viagra pills viagra generico how expensive is viagra

4 out of 5 : – is 2 yr old doxycycline safe to take ?

4 out of 5 : – buy cialis usa

2 out of 5 :

I like this post, enjoyed this one thanks for putting up. “To the dull mind all nature is leaden. To the illumined mind the whole world sparkles with light.” by Ralph Waldo Emerson.

4 out of 5 :
кредит онлайн
5 out of 5 :

Hello I am so excited I found your site, I really found you by accident, while
I was researching on Askjeeve for something else, Anyways I am here now and would just like to
say thanks for a tremendous post and a all round thrilling blog (I also love the
theme/design), I don’t have time to look over it all at the moment but I have book-marked
it and also added in your RSS feeds, so when I have time I will be back to read a
great deal more, Please do keep up the superb job.

Here is my page кредит онлайн

4 out of 5 :
2 out of 5 :

Hi, here on the forum guys advised a cool Dating site, be sure to register – you will not REGRET it


There is noticeably a bundle to know about this. I assume you made certain nice points in features also.


Good day! This is kind of off topic but I need some advice from an established blog. Is it difficult to set up your own blog? I’m not very techincal but I can figure things out pretty fast. I’m thinking about making my own but I’m not sure where to start. Do you have any points or suggestions? With thanks

2 out of 5 :
3 out of 5 :

You are breaking the internet

Kitsap Daily News
Click here

Very informative article post.Really looking forward to read more.

diamond seks

Really informative blog article.Thanks Again. Much obliged.

jual play spotify

I think this is a real great blog.Thanks Again. Awesome.

buy weed online
5 out of 5 : 우리카지노사이트

5 out of 5 : 스타클럽카지노

5 out of 5 : 아시안카지노

5 out of 5 :
5 out of 5 :
5 out of 5 :
5 out of 5 :
5 out of 5 : 우리카지노사이트

buy tiktok followers

Very good article post.Really looking forward to read more. Awesome.

Seattle Weekly

Looking forward to reading more. Great article post.Thanks Again. Really Cool.

Juneau Empire
lingerie haul

Thank you ever so for you blog article.Really thank you! Much obliged.

anal butt plug

Great blog post. Keep writing.

rechargeable bullet vibrator

Fantastic blog article.Much thanks again. Will read on…

plus size role play costumes

Wow, great article.Really thank you! Much obliged.


Thanks-a-mundo for the article post.Much thanks again. Want more.

kai asset
Carl Scholz

Thanks for the article.Much thanks again. Really Great.

jasa view youtube live

Thanks again for the article post.Really thank you!

use any generic keyword

This is one awesome blog post.Really looking forward to read more. Really Great.

MIM parts

Thanks a lot for the post.Really thank you!

Бинарные Опционы
1 out of 5 :

Post writing is also a fun, if you know after that you
can write if not it is complicated to write.

Content Marketing Specialist

I think this is a real great article.Much thanks again. Really Great.


Really enjoyed this blog post.Thanks Again. Will read on…

RV Windshield Replacement

A big thank you for your article post.Much thanks again.

1 out of 5 :
Dentitox Pro
Бинарные Опционы
2 out of 5 :

I believe everything wrote made a lot of sense. But, think about this,
what if you were to write a killer post title?
I am not saying your content isn’t solid, however what if you added something that grabbed folk’s attention? I mean Datastage
Advanced – Complex Data Processing | ISXChange Inc is kinda vanilla.
You could glance at Yahoo’s home page and watch how
they create article titles to grab people to click. You might add
a video or a related pic or two to grab readers interested about everything’ve written. In my opinion,
it might make your posts a little livelier.

see this here

Say, you got a nice article.Thanks Again. Keep writing.

Joanne Ashmead

Very nice write-up. I certainly appreciate this website. Stick with it!

เว็บตรง pg

Say, you got a nice article post. Really Great.

Executive Coaching

Excellent blog you have got here.. Itís difficult to find excellent writing like yours nowadays. I seriously appreciate individuals like you! Take care!!

kalliasseri school
Lifestyle Coaching

There’s definately a great deal to know about this subject. I really like all of the points you have made.

Marketing Coaching

Greetings! Very useful advice in this particular article! It’s the little changes which will make the most significant changes. Thanks for sharing!

houses for sale nearby

I was pretty pleased to find this web site. I need to to thank you for ones time just for this wonderful read!! I definitely enjoyed every part of it and i also have you saved as a favorite to check out new information in your web site.

house for sale near my location
dont book with this untrusted company

Wow, great article post.Really thank you! Fantastic.

Personal Coaching

An intriguing discussion is definitely worth comment. I do think that you ought to publish more about this topic, it might not be a taboo matter but usually people do not discuss these subjects. To the next! Many thanks!!

Vip Transformation Day

I blog frequently and I truly thank you for your information. Your article has truly peaked my interest. I’m going to bookmark your site and keep checking for new details about once per week. I opted in for your RSS feed as well.

Meditation Training

An impressive share! I have just forwarded this onto a coworker who had been conducting a little research on this. And he in fact ordered me dinner simply because I discovered it for him… lol. So let me reword this…. Thank YOU for the meal!! But yeah, thanx for spending the time to talk about this issue here on your internet site.

Business Coaching

The next time I read a blog, I hope that it won’t disappoint me just as much as this one. I mean, I know it was my choice to read, nonetheless I genuinely thought you would probably have something helpful to say. All I hear is a bunch of whining about something that you can fix if you weren’t too busy looking for attention.

Mens Accountability Coaching

Hi, I do think this is an excellent web site. I stumbledupon it 😉 I will come back once again since I book marked it. Money and freedom is the best way to change, may you be rich and continue to help others.

Online Coaching Courses

Everything is very open with a clear description of the challenges. It was really informative. Your website is very helpful. Thank you for sharing!

Online Coaching Courses

I absolutely love your blog.. Excellent colors & theme. Did you make this website yourself? Please reply back as Iím trying to create my very own website and want to learn where you got this from or what the theme is named. Thanks!

Social Media Marketing Businesses

This excellent website certainly has all the info I wanted about this subject and didnít know who to ask.


Very good blog post.Thanks Again. Will read on…

Wealth Advisor

Thank you ever so for you article. Really Great.

State Planning

Really appreciate you sharing this article post.Really looking forward to read more. Much obliged.

Social Media Marketing Agency Around Me
Adam and Eve Coupon

Thanks so much for the blog post.Really looking forward to read more. Want more.


Thanks for sharing, this is a fantastic blog.Really looking forward to read more. Keep writing.

Hiding belongings
Secy Snapchat

Great post.Really looking forward to read more. Really Cool.

Rude Snapchat

Thanks so much for the blog article.Really thank you! Great.

couples sex kit

Really informative blog post.Much thanks again. Really Great.

clit vibrators

I truly appreciate this blog post.Thanks Again.

meticore negative reviews
gifts for sex wife

Im grateful for the blog. Will read on…

view website

Really appreciate you sharing this blog article.Really looking forward to read more. Cool.

best electricians near me

I value the post.Really thank you! Keep writing.

this link

I loved your post.Thanks Again. Cool.

More about the author

I really enjoy the blog article.Really looking forward to read more. Really Great.

best CBD oil UK

Thanks for sharing, this is a fantastic blog post.Thanks Again. Will read on…

Lost ways
CBD oil UK

Im thankful for the post.Thanks Again. Fantastic.

Jesse Grillo

Thank you ever so for you blog.Thanks Again. Much obliged.

Portsmouth water damage

Fantastic post.Thanks Again. Really Cool.

g spot rabbit vibrator

wow, awesome post.Really looking forward to read more. Really Great.

best masturbator for men

A round of applause for your article.Thanks Again. Really Great.

credit card processing iso

wow, awesome article.Really thank you! Much obliged.


Thanks-a-mundo for the article post.Much thanks again. Keep writing.

Бинарные Опционы
2 out of 5 :

Nice post. I learn something new and challenging
on sites I stumbleupon everyday. It’s always helpful
to read through articles from other writers and use something from their web sites.

Daftar Situs Slot Pragmatic Play Terpercaya

I value the post.Really thank you! Much obliged.


I appreciate you sharing this article post.Really looking forward to read more. Awesome.

g spot massager
big penis sleeve

Thank you for your article. Really Great.

silicone clit vibrator

Thanks-a-mundo for the blog article.Thanks Again.

Add a review