Job description
Role overview
Consort Group in Lyon seeks a senior BI Consultant/Data Engineer to lead modern data architecture projects. The role focuses on Big Data technologies (Spark, Hive, Databricks), cloud storage (Oracle, CEPH S3), and ETL processes (Informatica). Candidates will design data pipelines, create visualizations using Tableau, and implement CI/CD workflows with Git, Jenkins, and Terraform. The position requires strong Agile methodology experience and expertise in SQL, Python, and PL/SQL.
Responsibilities
- Design and implement Big Data pipelines using Spark and Hive
- Migrate data platforms to Databricks and optimize cloud storage solutions
- Develop ETL processes with Informatica and automate workflows via CI/CD tools
- Create interactive data visualizations with Tableau Server
- Collaborate on Agile teams to deliver modern data architectures
Requirements
- 4+ years in BI/Data Engineering with Spark and Databricks experience
- Proficiency in SQL, Python, and PL/SQL for data processing
- Hands-on ETL implementation using Informatica
- Strong CI/CD knowledge (Jenkins, Git, Ansible)
- Experience with Oracle databases and cloud storage systems
Benefits
- Competitive salary with performance bonuses
- Professional development budget for certifications and training
Keywords
SparkHiveDatabricksSQLPythonTableauGitJenkinsAnsibleAgile