Senior Data Engineer (Spark/Kafka/Hadoop) - Hybrid Lisbon (3 days/week office) em Lisboa, Portugal
HumanIT Digital Consulting
HíbridoMistura de escritório e remoto
PresencialTrabalho no escritório
€1,700 a €2,300 por mês
Lisboa, Portugal
Senior Data Engineer (Spark/Kafka/Hadoop) - Hybrid Lisbon (3 days/week office)
ABOUT THE OPPORTUNITY
Join the marketing technology division of a global technology leader. Its platforms power marketing measurement, customer insights and campaign optimization for businesses worldwide. As a Senior Data Engineer, you’ll design, build and operate scalable data platforms and pipelines at enterprise scale. You’ll also influence future-state data architecture and help accelerate an ongoing cloud transformation. This is a 12-month project starting in November 2026.
PROJECT & CONTEXT
Build batch, streaming and real-time data pipelines for business-critical products in campaign measurement, reporting, customer insights and AI/ML.
Develop reusable frameworks for data ingestion, transformation, orchestration and delivery across data lake, warehouse and lakehouse environments.
Support the modernization and cloud migration of legacy platforms toward cloud-native architectures.
Strengthen data quality, observability, governance, lineage and security across the data ecosystem.
Mentor engineers, lead root-cause analysis on complex production issues and contribute to architectural decisions and technology roadmaps.
Work in close partnership with Product, Engineering, Data Science, Analytics and Business stakeholders.
The work model is hybrid, with 3 days per week on-site in Lisbon and regular working hours. The selection process includes an interview with the client.
WHAT WE’RE LOOKING FOR (Required)
Extensive experience designing and building scalable data platforms and distributed data processing solutions
Strong expertise in Apache Spark, Apache Kafka, the Hadoop ecosystem, cloud-native data services and large-scale data processing frameworks
Proficiency in one or more of the following: Python, Java, Scala or SQL
Experience developing data pipelines for analytics, reporting, machine learning and operational data products
Deep understanding of data modeling, ETL/ELT design patterns, data architecture and data lifecycle management
Experience building and supporting solutions on AWS, Azure or GCP
Knowledge of data governance, security, privacy, lineage, metadata management and regulatory compliance
Experience with CI/CD, DevOps automation, Infrastructure-as-Code and observability frameworks
Proven experience leading technical initiatives, influencing architectural decisions and mentoring engineers
Strong communication and stakeholder management skills across engineering, product, analytics and business teams
Bachelor’s degree in Computer Science, Engineering, Information Systems or a related field
Fluent English, written and spoken
NICE TO HAVE (Preferred)
Advanced degree (MSc or equivalent)
Compensation: €1700 – 2300 €/month net, depending on experience and seniority level.
Why HumanIT people stay (4.4 Glassdoor, 89% recommend)
... modernize, migrate, and maintain reliable data-platform infrastructure across cloud and enterprise environments. The mandatory requirements are 3+ years of senior-level production data-platform engineering experience, strong Python, Bash and SQL, AWS, Snowflake and Kafka/Confluent expertise, production migration and operations, ...
... the existing Data Platform (Spark-based ETL pipelines, Kafka messaging, PostgreSQL DWH) and be a key player in designing and implementing the next-generation Data Lake / event-driven Data Warehouse architecture. Align with the company's software engineering policies including SDLC, CI/CD processes, database structures, ...
... (5+ years) Type of position: Hybrid model in Lisbon. Candidates need to be already living in Portugal! The amazing you, will have: - Proven experience as a Big Data Engineer; - Strong hands-on experience with Spark, Python, Hadoop, Hive, SQL, Linux, APIs, and Kafka; - Solid experience in software development and CI/CD practices; ...
... years of experience as a Data Engineer; - Strong programming skills in Python and SQL; - Expertise in data pipelining (AirFlow); - Hands-on experience with big data and distributed processing frameworks (e.g., Spark, Databricks, Hadoop, Kafka, DBT); - Solid understanding of data modeling and databases (relational, NoSQL, ...
... platforms! Lisbon-based opportunity with hybrid work model As a Senior Middleware Operations Engineer, you will be working for our client, a leading player in the data management industry dedicated to delivering reliable and scalable solutions. You will support critical run activities for Kafka and Qlik Replicate platforms, ...
... capacity planning and change control. - Strong written and verbal communication, working with a global team. - Upper-intermediate English level. NICE TO HAVES - Kafka ecosystem depth: Kafka Connect, Schema Registry, Kafka Streams, MirrorMaker, or managed Kafka services. - Change-data-capture patterns and tooling. - Infrastructure ...
... SDKs and API contracts Fluency in Java and/or Python, with strong knowledge of software development methodologies and best practices Experience with distributed data systems such as Spark, BigQuery, Kafka, and designing and modeling both logical and physical data models, with SQL and NoSQL experience Experience with Terraform, ...
... experience in Big Data / Hadoop platform administration; - Bachelor’s degree in Computer Science or equivalent; - Strong knowledge of Hadoop, Cloudera, YARN, Kafka; - Solid expertise in Linux , JVM tuning, system-level troubleshooting, and distributed environments; - Experience with PostgreSQL / SQL databases; - Automation ...
... and autonomy, and where every challenge is an opportunity to create technology with impact. SENIOR DATA ENGINEER What We Are Looking For We are looking for a Senior Data Engineer to join a leading international banking environment and contribute to the development of innovative data solutions supporting Risk Reporting & ...
... technological advancement, consider Loka your optimal leverage point. Loka is a globally distributed tech consultancy based in Silicon Valley, and we’re seeking a Senior Data Engineer to join our growing team. In this role you will design, implement and scale data solutions from batch to streaming, dealing with the low-latency ...