Summary Of Responsibilities As a Principal DevOps Engineer supporting DataOps, you will play a crucial role in enabling... smooth data ingestion into the data lake or data warehouse, enabling downstream data consumption for Data Scientists...
Overview We are looking for a Senior Data Engineer with strong expertise in Databricks, PySpark, Delta Lake.... Strong hands-on experience with Databricks, PySpark, Delta Lake, SQL, Python. Experience with Azure Data Lake, ADF, Azure...
group. The role We're seeking a Data Engineer to enhance the reliability, efficiency, and documentation of our data... for ETL DevOps & Engineer Practices Containerisation (Docker, Kubernetes) CI/CD pipelines and version control (Git...
Job Description: Overview We are looking for a Senior Data Engineer with strong expertise in Databricks, PySpark..., Delta Lake, and cloud-based data pipelines. The ideal candidate will design and build scalable ETL/ELT solutions, implement...
A leading consultancy is seeking a talented Lead Data Engineer with advanced expertise in Azure Data Services.... What you'll do: As a Lead Data Engineer based in Kuala Lumpur, you will be at the forefront of shaping modern cloud-native data...
infrastructure and cloud platforms (e.g., AWS, GCP, Azure, Databricks, Snowflake). Work with data scientists and DevOps to support... in MLOps/Data Engineer - designing, developing and maintaining huge Data Warehouse and analytics projects. Strong problem...
. The role We're seeking a Data Engineer to enhance the reliability, efficiency, and documentation of our data... Programming: Strong Python skills with focus on PySpark, SQL, Scala for ETL DevOps & Engineer Practices Containerisation (Docker...
Responsibilities: Design and implement scalable data pipelines using Apache Spark, Delta Lake, and Databricks Workflows... CI/CD pipelines for data engineering workflows using tools like Databricks Repos, Git, and Azure DevOps. Secure and govern...
and at speed. Now, as we scale into Southeast Asia, we’re looking for a Data Engineer who’s passionate about modern data...-on Data Engineer with strong experience in Azure and Microsoft Fabric to design, build, and optimise data pipelines...
group. The role We're seeking a Data Engineer to enhance the reliability, efficiency, and documentation of our data... for ETL DevOps & Engineer Practices Containerisation (Docker, Kubernetes) CI/CD pipelines and version control (Git...
Key Responsibilities: Design and implement scalable data pipelines using Apache Spark, Delta Lake, and Databricks... and maintain CI/CD pipelines for data engineering workflows using tools like Databricks Repos, Git, and Azure DevOps. Secure...
code in production after testing. Good to Have: Preferable to have good DWH/ Data Lake knowledge. Conceptual and creative... should have strong DevOps and Agile Development Framework knowledge. Create PySpark jobs for data transformation and aggregation. Experience...
, and accuracy in data lake and warehouse environments. Work on automation, CI/CD pipelines, and DevOps practices (JIRA, Jenkins..., and implement ETL solutions using Informatica PowerCenter and Teradata/Hadoop. Perform data mapping, modeling, profiling, and build...
connectivity Understanding of ETL processes and data pipeline design Knowledge of CI/CD workflows and DevOps practices for data... engineering Understanding of pipeline orchestration and workflow management Experience with Delta Lake and modern data lake...
, optimizing data delivery, re-designing infrastructure for greater scalability etc. Build data lake and data tools for analytics... Factory and DevOps will be added advantage. Knowledge of database architecture, data modeling, data warehousing, ETL...
and DevOps practices for data engineering Understanding of pipeline orchestration and workflow management Experience with Delta... Lake and modern data lake architecture Experience implementing thorough test processes to produce high-quality...
experience in Azure Databricks, Unity Catalog, Azure Data Factory, Azure DevOps Delta Lakes, DevSecOps, NFRs (Non-Functional..., Information Technology, Data Science or a related relevant field; Certification in Azure Data Engineer Associate or similar...
field; Certification in Azure Data Engineer Associate or similar, and experience with additional Azure services (e.g... Databricks (Spark, Delta Lake), Azure Data Factory, and programming languages such as Python or Scala. Communication...
experience in Azure Databricks, Unity Catalog, Azure Data Factory, Azure DevOps Delta Lakes, DevSecOps, NFRs (Non-Functional..., Information Technology, Data Science or a related relevant field Certification in Azure Data Engineer Associate or similar...
microservices in distributed environments. Nice to Have Experience with EMR, Glue, and Redshift. Familiarity with data lake...Job Title: Senior AWS Cloud Engineer Location: Kuala Lumpur, Malaysia Work Model: Onsite/Hybrid (as per company norms...