Summary Of Responsibilities As a Principal DevOps Engineer supporting DataOps, you will play a crucial role in enabling... smooth data ingestion into the data lake or data warehouse, enabling downstream data consumption for Data Scientists...
A leading consultancy is seeking a talented Lead Data Engineer with advanced expertise in Azure Data Services.... What you'll do: As a Lead Data Engineer based in Kuala Lumpur, you will be at the forefront of shaping modern cloud-native data...
infrastructure and cloud platforms (e.g., AWS, GCP, Azure, Databricks, Snowflake). Work with data scientists and DevOps to support... in MLOps/Data Engineer - designing, developing and maintaining huge Data Warehouse and analytics projects. Strong problem...
. The role We're seeking a Data Engineer to enhance the reliability, efficiency, and documentation of our data... Programming: Strong Python skills with focus on PySpark, SQL, Scala for ETL DevOps & Engineer Practices Containerisation (Docker...
Responsibilities: Design and implement scalable data pipelines using Apache Spark, Delta Lake, and Databricks Workflows... CI/CD pipelines for data engineering workflows using tools like Databricks Repos, Git, and Azure DevOps. Secure and govern...
group. The role We're seeking a Data Engineer to enhance the reliability, efficiency, and documentation of our data... for ETL DevOps & Engineer Practices Containerisation (Docker, Kubernetes) CI/CD pipelines and version control (Git...
Key Responsibilities: Design and implement scalable data pipelines using Apache Spark, Delta Lake, and Databricks... and maintain CI/CD pipelines for data engineering workflows using tools like Databricks Repos, Git, and Azure DevOps. Secure...
code in production after testing. Good to Have: Preferable to have good DWH/ Data Lake knowledge. Conceptual and creative... should have strong DevOps and Agile Development Framework knowledge. Create PySpark jobs for data transformation and aggregation. Experience...
connectivity Understanding of ETL processes and data pipeline design Knowledge of CI/CD workflows and DevOps practices for data... engineering Understanding of pipeline orchestration and workflow management Experience with Delta Lake and modern data lake...
, and accuracy in data lake and warehouse environments. Work on automation, CI/CD pipelines, and DevOps practices (JIRA, Jenkins..., and implement ETL solutions using Informatica PowerCenter and Teradata/Hadoop. Perform data mapping, modeling, profiling, and build...
, optimizing data delivery, re-designing infrastructure for greater scalability etc. Build data lake and data tools for analytics... Factory and DevOps will be added advantage. Knowledge of database architecture, data modeling, data warehousing, ETL...
and DevOps practices for data engineering Understanding of pipeline orchestration and workflow management Experience with Delta... Lake and modern data lake architecture Experience implementing thorough test processes to produce high-quality...
experience in Azure Databricks, Unity Catalog, Azure Data Factory, Azure DevOps Delta Lakes, DevSecOps, NFRs (Non-Functional..., Information Technology, Data Science or a related relevant field; Certification in Azure Data Engineer Associate or similar...
field; Certification in Azure Data Engineer Associate or similar, and experience with additional Azure services (e.g... Databricks (Spark, Delta Lake), Azure Data Factory, and programming languages such as Python or Scala. Communication...
experience in Azure Databricks, Unity Catalog, Azure Data Factory, Azure DevOps Delta Lakes, DevSecOps, NFRs (Non-Functional..., Information Technology, Data Science or a related relevant field Certification in Azure Data Engineer Associate or similar...
microservices in distributed environments. Nice to Have Experience with EMR, Glue, and Redshift. Familiarity with data lake...Job Title: Senior AWS Cloud Engineer Location: Kuala Lumpur, Malaysia Work Model: Onsite/Hybrid (as per company norms...
and scalability. Data & Database Design scalable data models and schemas. Work with SQL and NoSQL databases. Integrate with Data Lake...: We are seeking a highly skilled Senior Full-Stack Software Engineer to design, build, and maintain scalable web and mobile solutions...
, Databases (SQL & No SQL MongoDB atlas, Postgres etc), Data Lake, Data bricks, Data Warehouses, iSeries & DB2 based systems... with an end-state vision of how their applications and infrastructure will operate within this architecture and, then, engineer...