Lead Data Engineer

Job Description

We’re looking for people bold enough to help us build a world that works smarter, faster, and better for everyone.

As Lead Data Engineer, you will play a pivotal role in shaping our data architecture, engineering scalable data pipelines, and leading efforts to transform raw data into actionable insights. You will mentor a growing team of engineers while working closely with cross-functional leaders to ensure data drives every critical decision at Compant and our portfolio companies.

What You’ll Do

• Architect, build, and optimize robust data pipelines and ETL processes using Azure Data Factory and Databricks
• Lead the design and implementation of enterprise-grade data warehousing solutions (e.g., Snowflake)
• Guide the adoption of best practices in data engineering, cloud infrastructure, and DevOps
• Extract and transform data from varied sources (e.g., social media platforms, analytics tools) to support advanced business intelligence efforts
• Lead the development of dynamic dashboards and data visualizations using Power BI or Tableau, driving high-impact insights
• Manage and mentor a team of data engineers, ensuring alignment with business priorities and engineering excellence
• Collaborate with Data Analysts, Product Managers, and Business Leaders to enable data-driven decision-making across the organization
• Oversee database development activities including stored procedures, views, and functions using Microsoft SQL Server and other technologies
• Continuously evaluate emerging tools and technologies to enhance data infrastructure scalability, reliability, and performance

Requirements

What You Bring

Benefits

Requirements

What You Bring Bachelor’s degree in Computer Science, Engineering, or a related technical field 5+ years of experience in data engineering, with at least 1–2 years in a leadership or senior capacity Expertise in building scalable cloud-based data pipelines and analytics infrastructure (preferably in Azure) Advanced proficiency in Python, ANSI SQL, and working knowledge of Snowflake and Microsoft SQL Server Solid understanding of data modeling (e.g., star schema, Kimball methodology) and data warehousing principles Hands-on experience with BI tools such as Power BI or Tableau Familiarity with CI / CD pipelines, DevOps, and agile development methodologies A proactive, collaborative mindset with a passion for mentoring, problem-solving, and driving innovation through data