Lake, BigQuery, Synapse). Proficiency in data pipeline frameworks (Apache Spark, Kafka, Airflow, DBT). Strong knowledge...
developers as needed. Requirements: 4+ years of software engineering experience. Should have experience with Apache Spark...
and cloud infrastructure.Strong proficiency in SQL, Spark/Scala, and data analytics. Data Governance and SecurityWell-versed... databases: PostgreSQL, MySQL, MongoDB, Cassandra.Hands-on experience with ETL tools: Talend, Informatica, Apache NiFi...
, Workshop App, APIs, SDK). Solid understanding of Big Data technologies, Hadoop ecosystem, Spark, and distributed computing..., and DevOps workflows. Knowledge of AWS cloud services (EC2, S3, EBS) and security best practices (e.g., Apache Ranger). Basic...
opportunity to develop massively scalable solutions to solve complex data problems using CDP, NiFi, Spark and related Big Data... tools such as Apache Hive Experience setting up multi-node Hadoop clusters Experience in configuring security...
Hiring for Databricks _ Hyderabad Develop and maintain data pipelines, ETL/ELT processes using Apache Spark.... Collaborate with data scientists, analysts, and other engineers to ingest, transform, and serve data. Optimize Spark...
such as NumPy, SciPy, PyTorch, or TensorFlow. Comfortable working with big data platforms like Apache Spark, distributed computing...
engineering or data platform teams. Strong proficiency in big data technologies, including Apache Spark/PySpark, Apache Airflow... and Apache Kafka. Experience with programming languages such as Scala and Python for developing robust data pipelines...
). We integrate with various data sources, including Apache Hive, S3, HBase, and more, using Python, Spark, or R. We're... tools (R, Python, Tensorflow, Spark, Mlflow, JupyterLab, PyCharm etc.) Worked with Big data technologies What you can...
). We integrate with various data sources, including Apache Hive, S3, HBase, and more, using Python, Spark, or R. We're... tools (R, Python, Tensorflow, Spark, Mlflow, JupyterLab, PyCharm etc.) Worked with Big data technologies What you can...
, and centralized metadata management across workspaces and cloud environments Architect scalable ETL/ELT pipelines using Apache Spark... and Apache Spark. Deep expertise in Delta Lake, structured streaming, PySpark, and SQL. Strong understanding of Lakehouse...
and frameworks. Nice to have: · Experience with the Vaadin UI framework. · Experience with Apache Spark, Avro and Kafka...
, and centralized metadata management across workspaces and cloud environments Architect scalable ETL/ELT pipelines using Apache Spark... and Apache Spark. Deep expertise in Delta Lake, structured streaming, PySpark, and SQL. Strong understanding of Lakehouse...
distributed processing frameworks integrated with Airflow for orchestration Champion Apache Iceberg-based data lakehouse... processing (Spark, PySpark, Ray, Flink) Deep experience with workflow orchestration (Airflow, Dagster, Prefect) Strong hands...
SOFTWARE DEVELOPMENT: Design, develop, and maintain scalable ETL/ELT pipelines using AWS Glue, Apache Airflow, and Apache Spark.../Scala. Build real-time and batch data processing solutions using Apache Kafka and Spark Streaming. Write clean, efficient...
, and centralized metadata management across workspaces and cloud environments Architect scalable ETL/ELT pipelines using Apache Spark... and Apache Spark. Deep expertise in Delta Lake, structured streaming, PySpark, and SQL. Strong understanding of Lakehouse...
Hiring for Databricks- Bangalore Design, build, and maintain scalable data pipelines using Apache Spark...
, and centralized metadata management across workspaces and cloud environments Architect scalable ETL/ELT pipelines using Apache Spark... and Apache Spark. Deep expertise in Delta Lake, structured streaming, PySpark, and SQL. Strong understanding of Lakehouse...
frameworks (e.g., Apache Flink, Spark Streaming) #LI-Hybrid #LI-AN4 At Zscaler, we are committed to building a team...
Hiring for Databricks_Bangalore Develop and maintain scalable ETL/ELT pipelines using Apache Spark on Databricks... with data architects and business teams to understand data requirements. Optimize Spark jobs for performance, reliability...