Job Overview :
The Cloud Data Engineer will build scalable, cloud-native data pipelines. The ideal applicants
must have a strong foundation in Python and AWS technologies.
The role follows a hybrid work arrangement, requiring regular onsite work at Quezon City.
Applicants must be willing to report onsite, work on mid-shift
and graveyard schedules, and observe U.S. holidays instead of Philippine holidays.
Key Responsibilities :
- Design, build, and maintain cloud-based data pipelines and workflows that support
analytics and operational systems.
Integrate data from various sources using APIs and cloud services.Develop clean, efficient, and test-driven code in Python for data ingestion and processing.Optimize data storage and retrieval using big data formats like Apache Parquet and ORC.Implement robust data models, including relational, dimensional, and NoSQL models.Collaborate with cross-functional teams to gather and refine requirements and deliverhigh-quality solutions.
Deploy infrastructure using Infrastructure as Code (IaC) tools such as AWSCloudFormation or CDK.
Monitor and orchestrate workflows using Apache Airflow or Dagster.Follow best practices in data governance, quality, and security.Core Expertise :
Experience : At least 3 years in a data engineering role working on data integration,processing, and transformation use cases with open-source languages (i.e. Python) and
cloud technologies.
Strong programming skills in Python specifically for API integration and data libraries,with emphasis on quality and test-driven development.
Demonstrated proficiency with big data storage formats (Apache Parquet, ORC) andpractical knowledge of pitfalls and optimization strategies.
Demonstrated proficiency with SQLExperience with data modeling :Relational modeling
Dimensional modeling
NoSQL modelingWorking knowledge of IaC on AWS (CloudFormation or CDK)Working knowledge of AWS Services :Required : Glue, IAM, Lambda, DynamoDb, Step Functions, S3,CloudFormation or CDK
Nice-to-have : Athena, Kinesis, MSK, MWAA, SQS
Experience with orchestration of data flows / pipelines : Apache Airflow or DagsterNice-to-have :
Experience with data streaming (Kinesis, Kafka)Experience with Apache SparkClient-facing experience, multi-cultural team experience, technical leadership,team leadership
Key Competencies & Abilities :
Ability to work independently and collaboratively in a team environment.High level of attention to detail and commitment to delivering quality work.Strong analytical and critical thinking skills.Effective time management and organizational skills.Strong customer focus and the ability to communicate technical concepts clearly tostakeholders.
Excellent written and verbal communication skills.Additional Information :
Must be willing to work on a hybrid setupEngagement is project-based for 6 months, with a possibility of extension.Work schedule is on a mid-shift and graveyard rotation.The role observes U.S. holidays instead of Philippine holidays.