Warehouse factory large office

As a Senior Cloud Data Engineer, you will play a key role in designing, developing, and optimizing cloud-agnostic data solutions, with a strong focus on Azure. Your expertise in Databricks, Spark, Lakehouse architectures, Delta Lake tables, and modern data engineering technologies will be essential in building and maintaining robust data pipelines. This senior role requires technical excellence, leadership, and the ability to mentor junior engineers while independently tackling complex data engineering challenges. Key Responsibilities Architect, build, and optimize scalable cloud-agnostic data solutions using Azure, Databricks, Spark, Lakehouse, and Delta Lake tables. Develop, implement, and maintain big data pipelines for ingesting, processing, and storing structured and unstructured data. Manage and optimize data lake and data warehouse architectures for performance, cost, and scalability. Work within Azure environments (Azure Synapse, Data Factory, ADLS) to develop and maintain cloud-based data solutions. Implement DevOps best practices, CI/CD pipelines, and automation. Ensure security, compliance, and governance in all data processes. Utilize big data tools for processing large datasets efficiently. Write advanced Python and T-SQL scripts for data transformation and ETL/ELT processes. Collaborate with stakeholders to develop data-driven solutions. Mentor junior engineers and lead technical initiatives. Required Qualifications & Skills Degree in Computer Science or a related field, or equivalent data engineering certification. 8+ years of experience in cloud-based data engineering. Extensive experience with Azure (Azure Synapse, Data Factory, ADLS, etc.). Strong expertise in Databricks, Spark, Delta Lake, and Lakehouse architectures. Advanced proficiency in T-SQL and Python for complex data transformations and optimizations. Hands-on experience with big data processing, ETL/ELT, and data pipeline orchestration. Solid understanding of data modeling, warehouse design, and data Lakehouse architecture. Experience with Docker and Kubernetes for data processing workloads. (Advantageous) Knowledge of data security, encryption, and compliance regulations. (Advantageous) Exposure to machine learning and AI pipelines within data engineering workflows. Experience with multi-cloud environments (AWS, GCP in addition to Azure). (Advantageous) The Reference Number for this position is NG60322

Services: Household Removals Office Removals Factory & Warehouse Removals Storage & Transport Packing & Wrapping Port Elizabeth & Surrounding Areas. Move Removals Logistics Office: 041 367 1053 Cell: 079 541 7036 Email: info@moveremovals.co.za

If you are looking to move do not hesitate to contact Highland Movers. We are a professional office and household furniture removal. We specialize in office relocation, household removals, furniture transport and relocation services in Pretoria, Johannesburg and we deliver Nationwide. We also provide a Secure Storage in a Safe Business Park in Midrand. Your furniture is secured and covered in transit with our Insurance company. We guarantee a safe removal of your goods accompanied by the best quote. for a Free Quote. Moving you ahead... We will be happy to take you to your destination!! We are a household and Office furniture removal company. What we offer; Whether you need us to move full contents, large items only and or special items, we have the man power and equipment necessary to handle furniture anywhere. We also offer a warehouse storage at a secure location with Insurance.