Scribd
Upload
35 views

Ds Filter

The document discusses different types of aggregation stages in data pipelines including the Aggrigator stage which can perform aggregation functions like sum, avg, max, min and count. It provides an example of aggregating employee salary data by department number and calculating total salary, maximum salary and minimum salary by department.

Uploaded by

abreddy2003
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as TXT, PDF, TXT or read online on Scribd
35 views

Ds Filter

The document discusses different types of aggregation stages in data pipelines including the Aggrigator stage which can perform aggregation functions like sum, avg, max, min and count. It provides an example of aggregating employee salary data by department number and calculating total salary, maximum salary and minimum salary by department.

Uploaded by

abreddy2003
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as TXT, PDF, TXT or read online on Scribd
You are on page 1/ 2

Aggrigator:

------------

1.Aggrigator it is a processing stage


2.it can have 1-i/p link and 1-o/p link and dosnt support reject link
3.by using aggrigator stage we can perform aggrigations
1.sum
2.avg
3.max
4.min
5.count

4.group key=deptno
column for calculation=sal

empno,ename,sal,comm,deptno,COMPNAY
100,bhaskar,1000,100,10,ibm
200,raj,2000,200,20,ibm
300,vijay,3000,300,10,ibm
400,vidhya,4000,4000,20,ibm
500,dinesh,5000,400,30,ibm

op1
deptno,totsal
10,4000
20,6000
30,5000

op2
deptno,totsal
10,3000
20,4000
30,5000

op3
deptno,totsal
10,1000
20,2000
30,5000

========================
deptno,totsal,maxsal,minsal
10,4000,3000,1000
20,6000,4000,2000
30,5000,5000,5000

================================
copy stage

1.it is a processing stage


2.this stage can give multiple copies
select deptno,sum(sal) as totsal from emp
group by deptno
=====================================================
Filter:

1.FILTER

we have three filter category stage in data stage


1.filter
2.external filter
3.switch

Filter stage:
--------------
1.a FILTER IS A processing stage
2.it can have 1-i/p link and multiple ouput links and one rejectlink
3.how mnay noof where candiions we are taking and those many no of output links
were required
4.options
output rejects=false

You might also like

pFad - Phonifier reborn

Pfad - The Proxy pFad of © 2024 Garber Painting. All rights reserved.

Note: This service is not intended for secure transactions such as banking, social media, email, or purchasing. Use at your own risk. We assume no liability whatsoever for broken pages.


Alternative Proxies:

Alternative Proxy

pFad Proxy

pFad v3 Proxy

pFad v4 Proxy