Software Vacancy
Malta
Recently Posted
We are in search of a highly skilled Senior Data Engineer who specializes in managing, designing, and optimizing data pipelines using Apache Airflow, Snowflake, and Apache Kafka. You will play a crucial role in architecting robust, scalable, and efficient data solutions, ensuring the integrity, reliability, and accessibility of our data infrastructure.
Requirements
- Designing, building, and maintaining complex data pipelines using Airflow
- Implementing scalable data solutions using Snowflake or Redshift
- Implementing Kafka-based streaming architectures for real-time data processing
- Proficiency in programming languages such as Python, SQL, and experience with data manipulation and transformation
Responsibilities
- Developing and implementing data models to support business requirements, optimizing for performance and scalability
- Designing, building, and maintaining scalable data pipelines using Apache Airflow
- Implementing and maintaining Kafka-based streaming data pipelines for real-time data processing and integration with various systems
- Integrating third-party databases and APIs
- Establishing monitoring, alerting, and maintenance procedures to ensure the health and reliability of data pipelines
For more detailed information, please contact us.
Job Features
| Job Category | Warehousing (Data) and BI |