Scribd
Upload
16 views1 page

Data Engineer

Uploaded by

gamer.rnldycbln
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as DOC, PDF, TXT or read online on Scribd
16 views1 page

Data Engineer

Uploaded by

gamer.rnldycbln
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as DOC, PDF, TXT or read online on Scribd
You are on page 1/ 1

Job Title: Data Engineer

Location: Remote
Term: Permanent full time
Schedule: US Hours (Central standard time)

OVERVIEW:
This opportunity will be assisting one of our key customers in developing and maintaining their data within a data
warehouse. There will be daily monitoring of data pipeline success and troubleshooting any issues. In addition, it
will include enhancing existing data pipelines as well as building new ones. This will also include building Power BI
front applications.

KEY RESPONSIBILITIES:
 Azure Data Factory Development: Design, develop, and deploy data pipelines using Azure Data Factory to
automate data ingestion, transformation, and loading processes.
 Python Data Library Integration: Utilize Python's data libraries including NumPy, Pandas, and SciPy to
manipulate and preprocess data efficiently.
 Data Modeling: Demonstrate proficiency in designing and implementing both 3NF (Third Normal Form)
and Star Schema data models to ensure optimal performance and scalability.
 Dashboard Support: Collaborate with stakeholders to understand reporting requirements and provide
support in developing interactive dashboards using Power BI for data visualization.
 Data Quality Assurance: Implement data quality checks and validation processes to ensure accuracy,
completeness, and consistency of data across different stages of the pipeline.
 Performance Optimization: Identify and implement performance tuning techniques to enhance the
efficiency and speed of data processing workflows.
 Documentation and Best Practices: Maintain comprehensive documentation of data pipelines, workflows,
and data models. Adhere to best practices in data engineering and ensure compliance with organizational
standards.

REQUIREMENTS:
 Bachelor's degree in Computer Science, Information Technology, or related field.
 Proven experience in Azure Data Factory and pipeline development.
 Proficiency in Python programming for data manipulation tasks, with a focus on libraries like NumPy,
Pandas, and SciPy.
 Strong understanding of relational database concepts, including 3NF and Star Schema.
 Experience with Power BI or similar data visualization tools for creating interactive dashboards.
 Excellent problem-solving skills and attention to detail.
 Strong communication and collaboration abilities, with the capability to work effectively in a team
environment.
 Ability to prioritize tasks, manage workload efficiently, and meet project deadlines.

You might also like

pFad - Phonifier reborn

Pfad - The Proxy pFad of © 2024 Garber Painting. All rights reserved.

Note: This service is not intended for secure transactions such as banking, social media, email, or purchasing. Use at your own risk. We assume no liability whatsoever for broken pages.


Alternative Proxies:

Alternative Proxy

pFad Proxy

pFad v3 Proxy

pFad v4 Proxy