API Developer (Databricks)

Job Summary

The API Developer (Databricks) will design, develop, and maintain APIs and data integration solutions leveraging Databricks and related technologies. This role involves building scalable data pipelines, optimizing data workflows, and ensuring seamless integration between applications and data platforms to support BDO’s digital transformation initiatives.

Key Responsibilities

API Development :

Design and implement RESTful APIs for data access and integration.

Ensure API security, scalability, and performance.

Databricks Development :

Build and optimize data pipelines and ETL processes using Databricks and Apache Spark.

Integrate Databricks with various data sources and enterprise systems.

Data Management :

Implement data quality checks and monitoring processes.

Collaborate with data engineers and analysts to support analytics and machine learning workflows.

Collaboration & Documentation :

Work closely with cross-functional teams to gather requirements and deliver solutions.

Maintain technical documentation for APIs and data workflows.

Continuous Improvement :

Stay updated with best practices in API development and Databricks technologies.

Contribute to automation and CI / CD processes for data and API deployments.

Qualifications

Education :

Bachelor’s degree in Computer Science, Information Technology, or related field.

Experience :

3+ years of experience in API development and integration.

Hands-on experience with Databricks, Apache Spark, and big data technologies.

Technical Skills :

Proficiency in Python, Scala, or Java.

Strong knowledge of REST API standards and frameworks.

Familiarity with cloud platforms (Azure preferred).

Experience with CI / CD tools and DevOps practices.

Soft Skills :

Strong problem-solving and analytical abilities.

Excellent communication and teamwork skills.

Preferred Skills

Experience with Databricks Delta Lake and MLflow.

Knowledge of data warehousing and ETL processes.

Familiarity with containerization (Docker) and Infrastructure as Code (Terraform).