Senior Data Engineer M/F

Job summary
Permanent contract
Paris
Salary: Not specified
Occasional remote
Experience: > 5 years
Skills & expertise
Generated content
Quality control
AI and machine learning
Kubernetes
Php
Laravel
+4

Onepilot
Onepilot

Interested in this job?

Questions and answers about the job

The position

Job description

Onepilot is looking for an experienced Data Engineer with strong MLOps skills to join the Artificial Intelligence team. Reporting to the Head of AI and working in tandem with William, Phd. AI Expert, you will be involved in setting up data pipelines and AI pipelines as part of a dynamic and ambitious team. 

As a major link with the other technical teams, made up of more than 10 developers, the pipelines to be built will be integrated into Onepilot’s production environment. Collecting and formatting complex unstructured data is the key to the success of the AI algorithms on which Onepilot is relying to help its development.

Missions:

  • Challenge and improve our data architecture 

    • Build and manage a bidirectional integration framework to: 

      • Allow real-time retrieval of unstructured data from a range of customer tools

        • Back office, payment service providers, delivery tracking tools, etc.

        • The tools may or may not be accessible via API

      • Perform actions in customer tools (for instance, refund a missing item, or send a prepared response)

        • Based on AI recommendations

        • In order to automate tickets processing

    • Oversee the management of data pipelines and data storage systems required for model training and inference

      • Collect (thanks to the integration framework), store and standardize raw data from a multitude of sources

      • Ensure data quality by implementing quality controls, tests and validation processes

  • Challenge and improve our AI pipeline

    • Supporting the transition from GCP to AWS

    • Develop and maintain CI/CD pipelines for automating the testing, integration, and deployment of AI models

    • Optimize AI infrastructure for scalability and cost-effectiveness

      • Ability to run a multitude of LLMs in a short space of time
  • Participate in maintaining technical documentation within the team


Preferred experience

  • You have an engineering degree with a specialization in data management/data engineering 

  • You have over 5 years’ experience as a data engineer or MLops

  • You have experience with containerization tools like Docker and knowledge of container orchestration tools like Kubernetes for managing and scaling containers

  • You have strong expertise in cloud platforms such as AWS or Google Cloud Platform

  • You have a deep knowledge of data architecture and experience in designing and implementing data pipelines including orchestration with tools such as Apache Airflow

  • You have a good understanding of the statistical properties of data and ML concepts

  • You have strong skills in programming languages (Python mandatory - some knowledge of PHP and Laravel would be ideal)

  • You are at ease in a technical environment, but are also able to popularize your tasks for other teams

  • Fluent English or French


Recruitment process

👉 First call to introduce Onepilot and answer any questions

👉 Meeting with our Head of AI and our Phd. AI Expert

👉 Meeting with our CTO and our Head of Engineering

👉 Final interview with a member of Onepilot team

We are looking forward to seeing you 😊

Want to know more?

These job openings might interest you!

These companies are also recruiting for the position of “Data / Business Intelligence”.

See all job openings