Data Engineer will work closely with the rest of the product team and business peers to effectively execute Data project initiatives. This person should be able to deliver in a fast-paced and deadline-driven environment. Along with development candidate will be responsible for maintenance of the data applications and would be expected to automate the processes with no or minimal human intervention.
Responsibilities :
- Development and maintenance of ELT snowflake data warehouse solutions
- Collaborate with internal and external technology and business partners to implement product changes
- Produce detail design and unit test documents as required
- Critically analyze business requirements architect and implement Data solutions
- Define develop and maintain standards and processes to ensure effective ETL solution
- Production maintenance
- Work closely with product manager to develop and execute action plans to address gaps
- Recommend innovations that enhance and / or provide a competitive advantage to the organization
- Communicate effectively with both the business and technical teams
- Mentor junior offshore developers to accomplish results
- Build and continuously improve data engineering best practices
Qualifications :
Data engineering experience using ETL / ELT technologiesETL / ELT experience working with IICS Informatica StreamSets DBT Python Data bricks Snowflake and ADF or equivalent technologiesHands on experience with SnowflakeExperience working with SSIS SSRS and Power BIHands on experience working in an Azure environment.Experience working in insurance or reinsurance industry is highly desirableHands on experience with agile methodologiesExperience with Data warehouse / data lake / data hub modelingExperience working with external data feed to enrich internal data- desiredHands on experience with data standardization / conformance / transformation processSolid understanding of MDM and reference dataHands on experience with CI / CD process especially in data engineeringExperience working in SOX and SOC-2 compliant environmentExperience with automated monitoring of data loadsSupport of production environmentStrong understanding of technologies utilized in the industry and the ability to see their impact as well as enhancement management and product lifecycle developmentKnowledge of source code version control systems such as Git including branching / merging resolving code conflicts and 3-way and baseless mergesRelevant experience working with 3rd party vendors to deliver resultsAdditional Information :
Bachelors degree in computer science MIS or related field requiredRemote Work : Yes
Employment Type : Full-time
Key Skills
Apache Hive,S3,Hadoop,Redshift,Spark,AWS,Apache Pig,NoSQL,Big Data,Data Warehouse,Kafka,Scala
Experience : years
Vacancy : 1