practical experience with advanced data engineering technologies, including Databricks, SQL, PySpark, and Microsoft Azure..., including but not limited to Databricks, SQL, PySpark, and Azure DevOps. Strive to deepen your practical skills in these areas...
ecosystem. The engineer will work across multiple technologies, including Azure Data Lake Storage, Databricks, Azure Data... meetings. Knowledge, Skills, and Abilities Strong hands-on experience with: Azure Data Lake Storage Azure Databricks...
Data Engineer - Azure Databricks - 3+ Years- Gurgaon / Noida Summary - We are looking for an experienced Data... Engineer with strong expertise in the Azure data ecosystem, including Azure Databricks, Azure Data Factory (ADF), and SQL. The...
/ GCP). Familiarity with Spark on Databricks, EMR, or equivalent platforms. Knowledge of orchestration tools (Airflow...
experience working on MS Azure (preferred) services – Azure Data Factory, Azure Data Explorer, Azure Data lake and Databricks...
., Databricks, Synapse, Microsoft Fabric) is a strong plus. Strong problem-solving skills, attention to detail, and a commitment...
engineering tools (Spark, Kafka, Airflow, Databricks) is a plus. Experience building APIs and production services (FastAPI, Flask...
with strong ownership and accountability. Preferred Qualifications Experience with big data tools (Spark, Databricks, Kafka, Hadoop...
to have). Work with Databricks and/or Snowflake. About You Degree in Data Science, Statistics, Computer Science, or related... and analytics using Azure Databricks. Strong problem-solving and troubleshooting skills. Excellent communication skills...
Job Description Roles & Responsibilities Work on Azure Databricks pipelines-enhance, modify, and optimize existing... cloud environments (Lakehouse, Delta, Synapse). Configure, manage, and optimize Databricks clusters, compute, workspaces...
files (CSV, Parquet, JSON). Tools: Azure Data Factory (ADF) for orchestration, Databricks connectors. Apache Spark... transactions, time travel, and schema enforcement. Azure Data Factory (ADF): Building pipelines to orchestrate Databricks...
databases, flat files (CSV, Parquet, JSON). Tools: Azure Data Factory (ADF) for orchestration, Databricks connectors. Apache... Databricks notebooks. Azure Key Vault: Secure credential management. Azure Monitor & Logging: For ETL job monitoring...
like Spark and Databricks environment as DevOps or DataOps. In a changing world, diversity and inclusion are core values...
, and ADLS (nice to have). Use Azure DevOps for CI/CD or equivalent tools (nice to have). Work with Databricks and/or Snowflake... in Python, PySpark, and SQL. Experience with big data processing and analytics using Azure Databricks. Strong problem-solving...
of situations. Familiarity with data platforms (Snowflake, Databricks, etc.) and data cataloguing tools (e.g., Collibra...
is looking for a Senior MLOps Engineer who can help solve MLOps problems, manage the Databricks platform for the entire organization, build..., and maintenance of Databricks clusters and workspaces. Monitor Databricks clusters for high workloads or excessive usage costs...
Data Factory, Azure Databricks, and Azure Synapse Analytics Experience in building scalable and reliable data pipelines...
Data Factory, Azure Databricks, and Azure Synapse Analytics Experience in building scalable and reliable data pipelines...
advanced analytics, and handle large-scale data processing using tools like Azure Databricks, Synapse Analytics, and Power BI...