Data Engineer
Data Engineer
We are seeking an experienced Data Engineer to join our AI team. You will be responsible for designing and optimizing complex data storage solutions, developing and maintaining efficient data pipelines, and ensuring data quality and integrity. Working closely with data analysts, machine learning engineers, and software engineers, you will deliver relevant datasets or data APIs for downstream applications.
This role requires strong proficiency in data modeling, database management, and programming skills in Python and SQL. You should have experience with big data technologies, ETL processes, data warehousing, and cloud platforms. Additionally, expertise in implementing data security measures and maintaining data systems in regulated environments is essential.
Key responsibilities:
- Design and optimize complex data storage solutions, including data warehouses and data lakes.
- Develop, automate, and maintain data pipelines for efficient and scalable ETL processes.
- Ensure data quality and integrity through data validation, cleansing, and error handling.
- Collaborate with data analysts, machine learning engineers, and software engineers to deliver relevant datasets or data APIs for downstream applications.
- Implement data security measures and access controls to protect sensitive information.
- Monitor data infrastructure for performance and reliability, addressing issues promptly.
- Stay abreast of industry trends and emerging technologies in data engineering.
- Document data pipelines, processes, and best practices for knowledge sharing.
- Lead data governance and compliance efforts to meet regulatory requirements.
- Collaborate with cross-functional teams to drive data-driven decision-making within the organization.
Experience:
- Minimum of 3-5 years of experience in data engineering.
- Track record of deploying and maintaining complex data systems at an enterprise level within regulated environments.
- Expertise in implementing robust data security measures, access controls, and monitoring systems.
Skills/Abilities/Knowledge
- Proficiency in data modeling and database management.
- Strong programming skills in Python and SQL.
- Knowledge of big data technologies like Hadoop, Spark, and NoSQL databases.
- Deep experience with ETL processes and data pipeline development.
- Strong understanding of data warehousing concepts and best practices.
- Experience with cloud platforms such as AWS and Azure.
- Excellent problem-solving skills and attention to detail.
- Ability to collaborate effectively with cross-functional teams.
- Strong communication skills, both written and verbal.
- Ability to keep abreast of industry trends and emerging technologies in data engineering.
Education
- Degree in Computer Science, Engineering, or a related field.
Languages
- Excellent conversational and written knowledge in English (C1 level minimum).
- French and Spanish language skills are a bonus.
Tools and Applications
- Programming languages and tools: Python, SQL.
- Big data technologies: Hadoop, Spark, NoSQL databases.
- ETL and data pipeline tools: AWS Glue, Airflow.
- Cloud platforms: AWS, Azure.
- Data visualization tools and data modeling software.
- Version control systems and collaborative development platforms.
Our offer:
- Impactful work. Opportunity to work on cutting-edge AI technologies that will be game-changers for our business.
- Professional growth. Continuous learning and development opportunities in a dynamic, remote work environment.
- Competitive compensation. Attractive salary and benefits package.
- Collaborative environment. A supportive team culture with opportunities for occasional travel for training and industry events.
- Departamento
- Tecnología
- Ubicaciones
- Barcelona
- Estado remoto
- Híbrido
Data Engineer
Cargando formulario de solicitud