Join a team where Databricks is at the heart of the engineering strategy and where your work powers largescale financial platforms used across global markets
Location Flexible Hybrid in Lisbon
Contract Fulltime, direct contract with a global technology consulting leader
Our client is a worldrenowned technology consulting company partnering with a major multinational in banking and financial services. This longterm program is part of a data and cloud modernization journey centred on Databricks, scalable architectures and highquality data products. You will join an international engineering environment dedicated to transforming complex data into reliable, governed and businesscritical assets.
Responsibilities
Build, optimize and maintain end-to-end Databricks pipelines, ensuring performance, reliability and scalability.
Apply Medallion Architecture principles to design structured, maintainable and productionready data layers.
Develop distributed processing solutions with PySpark, aligned with best engineering practices.
Design and orchestrate workflows using ADF and Airflow, improving automation and observability.
Contribute to the evolution of Databricks Lakehouse standards, performance tuning and cluster optimization.
Integrate CI/CD practices using Azure DevOps, with automated testing and version control.
Collaborate closely with data scientists, architects and business stakeholders to operationalize data products and ensure alignment with financialsector requirements.
Support governance, security and documentation across the Databricks ecosystem.
Required Skills
Strong, demonstrable experience with Databricks as the primary engineering platform.
Solid understanding of Medallion Architecture and modern lakehouse principles.
Proficiency in PySpark and distributed processing frameworks.
Experience with Azure Data Factory, Airflow and workflow orchestration.
Familiarity with Azure DevOps CI/CD, Git workflows and automated deployments.
Comfortable working in Agile, collaborative and multicultural environments.
Nice to Have
Advanced experience with Azure DevOps for pipeline automation.
Background in data testing or test framework development.
Exposure to investment banking or financial services data landscapes.
Ready to take the next step?
Apply now and join an international Databricksdriven project shaping the future of digital innovation in financial services.
... will make you succeed in this position? - Bachelor/Master in a field that emphasizes data analysis (Computer Science, Information Management, Mathematics, Engineering or Statistics). - Experience over 5 years in the field of Analytics , ideally in service/consulting companies. - Experience using Azure Databricks for data ...
... Data & AI consultancy with teams across Europe, Asia, and the Americas. As we continue to expand our presence across Europe, we are looking for a Senior Data Engineer – Databricks to join our growing team and contribute to the development of scalable data platforms for international clients. In this role, you will work closely ...
... profissionais com formação superior em Ciência de Computadores, Engenharia de Dados, Matemática Aplicada ou área semelhante e mais de 2 anos de experiência como Data Engineer, Analytics Engineer ou AI/Data Engineer. São necessários conhecimentos sólidos de SQL e Python, bem como experiência com Databricks, AWS e arquiteturas Lakehouse. ...
... análise e resolução de problemas - Ágil para continuamente compreender as necessidades de negócio - Experiência em Python e SQL, conhecimento de Airflow e Databricks é um plus - Gosto por atividade física e/ou desporto Que funções irão desempenhar - Construir estruturas que otimizem a extração, transformação, migração e ...
... maintain scalable data pipelines using Python, PySpark, and Databricks - Build efficient and reusable data processing and transformation frameworks following engineering best practices - Collaborate with Data Scientists, Data Analysts, and Software Engineers to deliver robust and scalable data solutions - Support data modeling ...
IT House is looking for a Senior Data Engineer for a direct placement with an end client in the Logistics and Transportation sector. Main Responsabilities - Design, develop and maintain scaleable data pipelines - Implement data integration processes using nifi, Airflow, Apache Kafka and Universal Messaging - Ensure data ...
... Skills: - Proven consulting or development expertise on Microsoft Data technologies (3–5 years); - Confirmed expertise on Big Data environments, including Databricks (Python and Spark); - Strong technical development orientation. Nice-to-have: - Expertise on Azure development components: DevOps tools, Data Lake Gen2, Data ...
Data Engineer - Azure Building Data Highways: Data Engineer Position Available! There's no secret to become number-one, it takes willingness to improve and determination to pursue it. At GRiT®, it’s all about the journey getting there. We trust talent and intelligence are important, yet passion and perseverance are key ...
... para trabalhar em Portugal. O que procuramos: - Licenciatura em Engenharia Informática, Matemática ou área similar; - Experiência mínima de 5 anos como Data Engineer; - Sólidos conhecimentos de Databricks, SQL e ferramentas ETL; - Experiência em Python e Spark; - Conhecimentos de desenvolvimento e otimização de pipelines ...