We are seeking a highly skilled and experienced
Expert, Data Lake Engineer
to actively involve in the design, implementation, and maintenance of our enterprise-grade data lake infrastructure. This role is critical in enabling advanced analytics, data science, and AI/ML initiatives by ensuring robust data ingestion, storage, and processing capabilities.
Key Responsibilities:
Data Acquisition & Structuring:
- Extract and consolidate data from diverse primary (SAP) and secondary sources. Reorganize and format data to support downstream analytics, machine learning, and AI workflows.
Data Lake Operations:
- Oversee daily operations related to data collection, storage, and processing. Architect and maintain scalable data lake solutions using modern technologies and best practices.
Pipeline & Infrastructure Management:
- Design and implement ETL/ELT pipelines. Ensure high performance, reliability, and scalability of data systems, including batch data and/or near real-time data. Monitor pipeline health and perform warehouse cleansing to maintain data integrity.
System Monitoring & Optimization:
- Continuously monitor system performance and stability. Troubleshoot issues, optimize resource usage, and ensure seamless data flow across platforms.
Job Requirements
- 7–12 years of hands-on experience in data lake implementation and operations.
- Proven track record in designing and deploying data lake architectures, topologies, and infrastructures.
Technical Expertise:
- Strong proficiency in ETL/ELT pipeline development. Experience with
SAP HANA
is a plus. - Deep understanding of data lake technologies and deployment tools, including but not limited to:
- Cloudera, Hadoop, Spark, Kafka, Airflow, Dremio
- Dataiku, Object Storage (e.g., S3), Iceberg/HUDI
- Python, R, Docker, Kubernetes
- Soft Skills & Passion:
- Passionate about data processing and engineering excellence.
- Strong problem-solving skills and ability to work collaboratively in cross-functional teams.
Why Join Us?
- Be part of a forward-thinking team driving innovation in data and AI.
- Work on impactful projects that shape business decisions and operational efficiency.
- Enjoy a dynamic work environment with opportunities for growth and learning.
If you're a data engineering expert ready to take on complex challenges and build scalable data infrastructure, we'd love to hear from you