Ali Bhayani
Ali Bhayani
Data Engineer
Cloud Shuttle
May 2022 to February 2023
Developed front-end code in existing Next.js applications. Deployed forms that take meetup speaker details and store
them in AWS Dynamodb.
An existing website required submitted form details to be sent to Slack channels. I used Slack webhooks in a Lambda
function that is triggered via AWS Eventbridge rules. Deployed AWS API Gateway that takes HTTP post requests from
the website forms and submits AWS Events. Wrote Confluence documentation and designed architecture diagrams to
illustrate all the elements created.
Created, managed, and published 3 python plugins for the organization to implement custom Airflow operators and
great_expectations plugins. Documented the usage of each package and used Pytests to ensure working code is
uploaded to the PyPI package index.
Completed Dbt projects to generate data modeling in Snowflake, and GCP Big Query data warehouses. Applied CI/CD
practices using Github actions for these projects. Got certified as a dbt developer.
Deployed Soda SQL testing repository integrated with Snowflake environment. Applied CI/CD practices using Github
actions to run tests on a schedule.
Deployed unit testing using Jest and end-to-end testing using Cypress in existing Next.js applications for the company
and clients. Wrote documentation to describe the steps on how to implement testing.
Worked on Terraform projects to create Snowflake data warehousing patterns separating development, testing, and
production environments. Applied CI/CD practices using Github actions for these projects. Wrote documentation to
describe warehouse and database elements along with Snowflake roles.
EDUCATION
Final Year Project: Fire Hazard Detection using OpenCV (03/2017 - 10/2017) | OpenCV, C++
A desktop application that reads in the live video feed and monitors frames to detect fire hazards. YCrCb color schemes
implemented on C++ OpenCV libraries.
TECHNICAL SKILLS
Development Python, AWS CDK, Terraform Cloud Technologies Cloud Functions, Container
services, Event Handelling, Graph
Data Warehousing Snowflake, RDS, Redshift, Databases, IAM management
DynamoDB, Big Query, Azure SQL
Cloud Storage AWS S3, Google Cloud Storage,
Data Pipelines Apache Airflow, Snowpipe, Azure Azure Blob Storage
Data Factory, GCP Cloud Fusion
and Data Proc, AWS Data Other Git VCS, DAX measures
Pipeline