Data Engineer

Description

Data Engineer

We’re looking for a highly skilled Senior Data Engineer to join a rapidly growing and dynamic tech company. This role involves designing and optimizing data pipelines, and ensuring the integrity and accessibility of data infrastructure. If you have expertise in managing complex data systems and a passion for real-time data processing, we want to hear from you!

Requirements

  • Experience with data warehouse and data modeling techniques.
  • Proven ability to design, build, and maintain data pipelines using Airflow.
  • Expertise in creating scalable solutions with Snowflake or Redshift.
  • Hands-on experience with Kafka for real-time data processing.
  • Proficiency in Python and SQL, with strong data manipulation and transformation skills.

Responsibilities

  • Develop and implement data models to meet business requirements, focusing on performance and scalability.
  • Design, build, and maintain scalable data pipelines using Apache Airflow.
  • Implement and manage Kafka-based streaming data pipelines for real-time data processing and system integration.
  • Integrate third-party databases and APIs into the data ecosystem.
  • Establish and maintain monitoring, alerting, and maintenance procedures for data pipelines.
  • Collaborate with data scientists, analysts, and stakeholders to understand and address data needs.