Roles & Responsibility
• Design and build code
across several new and existing software projects.
• Ensure all code
developed conforms to the Software Development Life Cycle SOP and Coding
Standards.
• Ensure all code
produced is performant and tested prior to being handed for peer review.
• Implement major
features with limited guidance from leads and managers.
• Be a technical expert,
mentor junior developers and share your expertise with other software engineers
to strengthen our team.
• In addition to new
projects, be willing to add new features and refactor parts of established
projects
• Provide accurate
timing estimates on work.
Skills Required:
• 6+ years of strong
experience in Data engineering projects using Microsoft Azure platform (Min 2-3
projects)
• Strong expertise in
building data engineering solutions using Azure Data Lake, Azure Data Factory,
Azure Data Bricks, Azure ADLS Gen2, Blob storage, Azure Storage Explorer
• Proficient in creating
Data Factory pipelines for on-cloud ETL processing; copy activity, custom Azure
development etc.
• Knowledge of Azure
Data Catalog, Event Grid, Service Bus, SQL, and Synapse.
• Strong expertise in
Spark framework using Scala/Python/Java.
• Strong T-SQL
programming skills or with any other flavor of SQL.
• Experience working
with high volume data, large objects, complex data transformations.
• Experience working in
DevOps environments integrated with GIT for version control and CI/CD pipeline.
• Good understanding of
data modelling for data warehouse and data marts.
• Should have experience
on Big data components like HIVE, Sqoop, HDFS, Spark.
• Strong verbal and
written communication skills.
• Ability to learn,
contribute and grow in a fast phased environment.
Good to Have
• Expertise in Microsoft
Azure is mandatory including components like Azure Data Factory, Azure Events
Hub and Kafka.
• Experience using Jira
and ServiceNow in project environments