Lead Data Engineer

Résumé du poste
CDI
Nice
Salaire : Non spécifié
Début : 06 octobre 2024
Télétravail fréquent
Expérience : > 5 ans
Éducation : Bac +5 / Master
Compétences & expertises
Contenu généré
Souci du détail
Aptitude à résoudre les problèmes
React
Dbt
Git
+6

Doriane
Doriane

Cette offre vous tente ?

Questions et réponses sur l'offre

Le poste

Descriptif du poste

We are looking for a talented Lead Data Engineer to join our team and play a crucial role in enhancing our SaaS platform. The first challenge will be to rebuild our analytics platform to support the exponential growth and heterogeneity of data (including open data integration, drone imagery, IoT, etc.) in order to provide the tools and machine learning models necessary for relevant and innovative decision-making.

You will work in a modern and innovative technical environment, hosted on AWS and serverless-oriented. Our stack includes a MongoDB database, a semantic layer with Cube.dev, and is primarily written in TypeScript with frameworks such as React and NestJS, as well as CDK for infrastructure management. We use Python and R for advanced statistical services, and we have implemented a complete CI/CD pipeline to ensure fast and reliable deployments. If you are passionate about technical challenges, working with a cutting-edge tech stack, and contributing to more sustainable agriculture through advanced technological solutions, we would be delighted to meet you.

  • Lead the design, development, and maintenance of our data platform to support analytics.

  • Design, deploy, and optimize data processing workflows using managed services, to support scalable and cost-effective data storage and analysis solutions.

  • Design, implement, and maintain scalable and robust data pipelines using technologies such as Python, Amazon Data Factory, dbt and CDK.

  • Collaborate with stakeholders to develop and optimize data models and dashboards to provide intuitive and actionable insights for end-users.

  • Provide expert troubleshooting support and resolve platform bugs efficiently across multiple platforms.

  • Identify areas for process optimisation within data engineering workflows and implement best practices to enhance efficiency and reliability.

  • Implement and enforce data governance and security policies to ensure data integrity, privacy, and compliance with relevant regulations.

  • Collaborate with clients to understand their data needs and provide expert guidance on the best solutions to meet their objectives.

  • Actively participate in Agile ceremonies such as daily scrum meetings, sprint planning sessions, reviews, and retrospectives to ensure the successful delivery of features and enhancements.

·        Stay updated with the latest industry trends and technologies, recommending and integrating new tools and techniques as appropriate.


Profil recherché

👌 Experience:

  • 5+ years of relevant work experience in data engineering or related roles, demonstrating a strong track record of delivering scalable and reliable data solutions.

🧠 Profesionnal skills:

  • Proven experience building enterprise-level SaaS platforms, with a focus on data infrastructure and analytics.

  • Experience in building public-facing APIs, SQL, Python facilitating seamless integration with external systems and applications.

  • Experience with building semantic layers and data models to provide structured, business-friendly views of data within cloud environments, enabling self-service analytics capabilities

  • Proficient in Python, Typescript, SQL, AWS, dbt, and CDK with a strong ability to implement and manage data solutions using these technologies.

  • Deep understanding of data architecture, data modeling, ETL processes, and data warehousing concepts.

  • Strong decision-making skills.

  • Strong organizational skills and attention to detail.

  • Strong software engineering discipline and experience using best practice tools and processes: Git, CI/CD, Infrastructure as Code, Scrum and Agile.

  • Ability to analyze complex data requirements and translate them into effective data engineering solutions.

  • Strong problem-solving skills and the ability to think critically and creatively to overcome technical challenges.

  • Excellent verbal and written communication skills, with the ability to explain technical concepts to non-technical stakeholders.

  • Strong interpersonal skills and the ability to work effectively with cross-functional teams and clients.

  • In-depth knowledge of the latest trends and advancements in data engineering, data analytics, and AI.

  • Deep understanding of data governance, data security, and compliance requirements.

🗣️ Language :

  • Fluent in french and in english

Envie d’en savoir plus ?