Title:  Lead Data Engineer

Location: Preferable Hyderabad

Working Timing : 2PM IST to 11Pm IST

Develop ingestion pipelines to consume data from various sources – structured and unstructured

Design and develop the data services and reusable data frameworks for Investment Product data to enable easy access for all the consuming platforms

Design and implementation of highly complex data solution(s) end-to-end from ingestion to curation to development of the operational & analytical areas of a data platform

Play a key role in architecting future integrated data platform solutions

Co-ordinate with other internal IT teams to release code changes and as needed to resolve system / technical issues for the team

This role will be leaned on as a subject matter-expert when it comes to all-things on the investment product data

This role will be able to balance multiple initiatives with fast iteration and coordinate with the rest of the team. Therefore, a commitment to collaborative problem solving is very important

Work closely with key stakeholders to understand use cases, design solutions and lead from inception to production

Collaborate with various user experience channels enabling enhanced data consumption experience.

Must have good experience and working knowledge with –

Data engineering on AWS Cloud platform

Databases like Oracle, MY-SQL, and importantly on Snowflake

On any ETL tools like Informatica, Streamsets, AWS Glue etc.

Programming using Python.

Building APIs (XML & JSON structures) (preferably AWS API gateway)