Responsibilities & Key Result Areas
Position
• Senior Data Engineer
• An independent contributor expected to be an expert in the technology area.
• Must be a Bachelor graduate or above
• Excellent Communication & Customer Interaction Skills with positive attitude.
Must haves –
• 4 to 5 Years Enterprise Data Warehouse (EDW) and Data Lake Platforms and solutions in E-commerce Domain
• Core Skill Needed – Data Engineering
• Expertise in Data Warehouse (DW) and Data Lake concepts, various implementation methodologies, data warehouse and data lake architecture and advance topics.
• Expertise in Data warehouse schemas (Star Schema and Snow Flake Schema)
• Involved in technical design, creating specs and documentation skills.
• Expertise in designing and implementing Data Pipelines, Data Transformation/Parsing Techniques, ETL/ELT Process using Python, SQL, PL/SQL, AWS CLi
• Expertise in Rest API integration and data extract using APIs
• ETL/ELT Implementation using Airflow and SAP BODS
• Database Programming must – PL/SQL, Stored Procedure and Functions using MS SQL Server 2018 onwards and Amazon Redshift
• Expertise in various data formats – XML, JSON, Big Data File Formats (AVRO, PARAQUET, ORC)
• Expertise in Amazon Redshift, AWS S3 and various AWS resource like RDS, EC2 instances, VPC, Subnets, Users/Roles and AWS Console
• Expertise in larger DW/BI Projects and implementation, support and sustenance etc.
• Strong Analytical, Problem solving Skills - Proactively assesses and provide/implement solution.