Voltar para a lista

Descrição da vaga

Python/Spark or AI Developer em Portugal, Portugal

HRBaires

  • RemotoTrabalhe de qualquer lugar
  • Tempo integralCarga horária semanal padrão

€80,000 por año

Portugal, Portugal

Location: Europe (Remote) — must work South Africa hours (UTC+2)
Employment: Full-time
Seniority: Mid-Senior Level
Salary: $80,000 – $120,000 (estimate; client hasn’t disclosed range)

About the company
A fast-growing privacy-preserving data collaboration fintech (Series A, backed by a global credit bureau and a major retailer), with teams spanning South Africa, the UK, the US, the UAE and Brazil. Banks and lenders use the platform to work with retailer and telco data without raw personal data changing hands — mainly to help people with no credit history access credit.

The role
The data team is migrating legacy SQL Server / Azure Synapse stored-procedure pipelines onto open-source Apache Spark and Delta Lake. You will:

  • Rebuild T-SQL logic as typed, tested PySpark pipelines
  • Prove the new pipelines match legacy outputs
  • Build FastAPI services that run and report on pipeline jobs
  • Add provider-neutral LLM features (local and hosted models) into data workflows

Spec-first codebase: design docs and ADRs, with tests and documentation shipped alongside every change.

Core stack: Python, PySpark, Spark SQL, Delta Lake, FastAPI, pytest, Docker, T-SQL, LLM integration

Required

  • Modern typed Python (3.10+) as primary production language, with type hints passing pyright/mypy and Pydantic models — writes maintainable, tested code, not only notebooks
  • 2+ years production Apache Spark / PySpark — DataFrame API and Spark SQL, including partitioning and performance tuning
  • Based in Europe or South Africa, able to work South Africa hours (UTC+2)

Nice to have

  • SQL Server / Synapse migration to Spark with validated output parity
  • Open-source or self-managed Spark (Kubernetes, EMR, Dataproc, Spark Connect)
  • FastAPI, LLM integration, privacy/data governance (PII tokenisation, GDPR/POPIA), fintech/banking/credit background

Vagas semelhantes

Mais vagas como esta

  • TI
  • Backend
... improvements in engineering processes, tooling, and development practices. - Maintain accurate and up-to-date technical documentation. Profile Requirements: - Bachelor's degree in Computer Science, Engineering, or a related field. - 3+ years of professional experience with Python development. - Strong understanding of software ...

Lisboa, Portugal

  • Backend
Job Description The Developer's mission is to contribute to the functional and application related consistency of the IT solution and ensure the service continuity and continuous development. The Developer must perform activities within the framework of projects and/or application maintenance and development, seeking its ...

Porto, Portugal

... challenge about - Join a network security development team building a self-service platform to automate firewall rule requests. - Develop end-to-end Python/Django workflows covering the request, validation, approval and provisioning of firewall rules. - Build and maintain API integrations to orchestrate changes across Fortinet ...

Porto, Portugal

  • Tempo integral
  • Backend
... looking for: Requirements - 3+ years of software development experience in Python. - Solid Python knowledge. - Familiarity with Linux/UNIX, HTML, Javascript and Networking. - Good communication in written and spoken English - Availability to work full time. Bonus points for: - Scrapy experience is a big plus. - Familiarity with ...

Portugal

  • Backend
... ceremonies, including daily stand-ups, sprint reviews and retrospectives. - Mentor developers and encourage the adoption of engineering best practices. - Identify opportunities to improve development efficiency, software quality and overall team performance. What We're Looking For - Extensive professional experience in Python ...

Porto, Portugal

  • Backend

€1 EUR

... solutions. - Continuously improve system performance, security, and maintainability through refactoring and optimization. Qualifications - Degree in Computer Science or similar. - 3+ years of professional experience in backend development with Python, - Strong proficiency in Python and experience with backend frameworks such as ...

Lisboa, Portugal

  • Backend
... solve technical problems. - Excellent communication skills to effectively collaborate with technical and non-technical teams. - You will be part of a team of 5 developers and will report to the Data domain manager. - Analyze and refactor existing code primarily developed by data engineers. - Establish and maintain modular and ...

Lisboa, Portugal

  • Backend

€1 EUR

... solutions. - Continuously improve system performance, security, and maintainability through refactoring and optimization. Qualifications - Degree in Computer Science or similar. - 3+ years of professional experience in backend development with Python, - Strong proficiency in Python and experience with backend frameworks such as ...

Porto, Portugal

  • Backend

€1 EUR

... Autonomous, while capable of working within a team; - Ability to work collaboratively in Agile teams. - Fluency in English (written and spoken). Additional Information Devoteam Group works for equal opportunities, promoting its employees based on merit and actively fights against all forms of discrimination. We are convinced ...

Porto, Portugal

  • Backend

€1 EUR

... performance and reliability. - Ensure the successful development and computation of new index families over the next six months. Qualifications - Strong experience in Python development (senior level). - Hands-on experience with Dataiku or similar data science/data engineering platforms. - Solid knowledge of data pipeline design ...

Porto, Portugal