Data Engineer Lemon Tree
Data Engineer Lemon Tree
Responsibilities
Design, build and maintain batch or real-time data pipelines in
production.
Maintain and optimize the data infrastructure required for accurate
extraction, transformation, and loading of data from a wide variety
of data sources.
Develop ETL (extract, transform, load) processes to help extract
and manipulate data from multiple sources.
Automate data workflows such as data ingestion, aggregation, and
ETL processing.
Prepare raw data in Data Warehouses into a consumable dataset
for both technical and non-technical stakeholders.
Build, maintain, and deploy data on AWS platforms.
Ensure data accuracy, integrity, privacy, security, and compliance
through quality control procedures.
Monitor data systems performance and implement optimization
strategies.
Leverage data controls to maintain data privacy, security,
compliance, and quality for allocated areas of ownership.
Experience
Bachelor's degree in Computer Science, Information Systems, or a
related field.
Minimum Qualifications
Advanced SQL skills and experience with relational databases and
database design.
Experience working with Data Warehouse solution and Data Mart.
Working knowledge of AWS solutions.
Strong proficiency in object-oriented languages: Python,
Pyspark,Scala.
Strong proficiency in data pipeline and workflow management tools
Strong project management and organizational skills.
Excellent problem-solving, communication, and organizational
skills.
Proven ability to work independently and with a team.