-on experience with cloud-based platforms: Azure: Databricks, PySpark, Data Lake, ADF Or equivalent GCP stack: BigQuery, Dataflow... Data Engineer to design, build, and maintain cloud-based data pipelines that enable business insights across Gap Inc...
-on experience with cloud-based platforms: Azure: Databricks, PySpark, Data Lake, ADF Or equivalent GCP stack: BigQuery, Dataflow... using Azure and/or GCP platforms Manage data quality, access controls, and cataloging using tools like Unity Catalog...
Job Description Summary We are seeking a highly skilled Data Engineer with hands-on experience in SQL, PySpark..., and optimize data pipelines using Python / PySpark to process and analyze large datasets. Write complex SQL queries for data...
pipelines using Microsoft Azure and Databricks for data ingestion, transformation, and storage. Implement best practices... preferred: Microsoft Fabric Data Engineer Associate [DP-700] or Databricks Certified Data Engineer Associate / Professional...
). Professional Certifications (Preferred): Certified Data Engineer / Data Analyst (preferred on Databricks or cloud environments... to support Anaplan application workflows and data pipeline validation. The Data Engineer will leverage Python, Pytest...
, GCP. Good-to-Have Skills: Certifications in Databricks, AWS, Azure, or data QA (e.g., ISTQB). Understanding of data... Test Automation Engineer to ensure the quality, reliability, and performance of our data pipelines and platforms. The ideal...
, PySpark, and SQL. Familiarity with Informatica and/or other ETL tools. Experience working with cloud data services (Azure... Data Engineer (preferred) Databricks Certificate (preferred) Soft Skills: Excellent problem-solving and analytical...
, Fast API, Databricks, DevOps Tools, CI/CD, Data Ingestion. Candidates should be able to write clean, efficient... while transforming your career. Senior Associate Full Stack Software Engineer What you will do Let’s do this. Let’s change the...
: Develop distributed data pipelines using PySpark on Databricks for ingesting, transforming, and publishing master data Write... (e.g. Informatica, Reltio etc) Any Data Analysis certification (SQL, Python, PySpark, Databricks) Any cloud certification...
platforms such as AWS, Azure, GCP. Good-to-Have Skills Certifications in Databricks, AWS, Azure, or data QA (e.g., ISTQB..., and optionally PySpark, for developing automated data validation scripts. Proven experience in validating ETL workflows...
Lake, SQL, and PySpark for data transformation Familiarity with ETL/ELT design, especially within Azure data ecosystems... with notebooks, Delta Lake, SQL, and PySpark Azure Ecosystem: Familiarity with Azure Data Lake and Azure Synapse (consumer layer...
components Hands-on experience with big data technologies and platforms, such as Databricks, Apache Spark (PySpark, SparkSQL... warehousing, and data integration concepts Knowledge of AnyPoint Platform, Python/R, Databricks, SageMaker, Airflow, AWS cloud...