Senior Data Engineer

We are looking for an experienced and skilled Senior Data Engineer to join our data engineering team. As a Senior Data Engineer, you will play a critical role in designing, building, and optimizing our data pipelines and infrastructure.

Your expertise in SQL, Databricks, and dbt will be essential in enabling seamless data integration, transformation, and modeling, empowering our organization to derive valuable insights and make data-driven decisions.

Responsibilities:

1. Data Pipeline Development: Design, implement, and maintain scalable and robust data pipelines using SQL, Databricks, and dbt. Ensure efficient and reliable data ingestion, integration, and transformation processes from various sources.
2. Data Modeling and Architecture: Develop and maintain data models that support business requirements and data analytics needs. Collaborate with data analysts and stakeholders to understand data requirements and implement data structures that facilitate effective reporting and analysis.
3. Performance Optimization: Continuously monitor and fine-tune data processes and queries to optimize performance and reduce processing times. Identify bottlenecks and implement improvements to enhance data pipeline efficiency.
4. Data Quality and Governance: Implement data quality checks and data governance processes to maintain data accuracy, completeness, and consistency. Identify data quality issues and collaborate with relevant teams to resolve them promptly.
5. ETL Automation: Automate data extraction, transformation, and loading processes to streamline data integration and minimize manual intervention. Implement monitoring and alerting mechanisms to ensure the reliability of automated workflows.

Requirements:

• Bachelor’s or Master’s degree in Computer Science or IT.
• 5+ years of experience in data engineering roles, with a strong focus on SQL for data querying, manipulation, and optimization.
• Strong understanding of data modeling concepts, data warehousing, and ETL processes.
• Excellent problem-solving skills and the ability to troubleshoot data-related issues.
• Strong communication and interpersonal skills to collaborate effectively with cross-functional teams.
• Experience in version control systems (e.g., Git) and CI/CD pipelines is a plus.