elevations and robust load balancing. Toast stores data in a set of sharded Postgres databases and utilizes Apache Spark...
or in private data centers. You’ll work with cutting-edge technologies like Trino, Spark, Airflow, and advanced AI inferencing..., contributing upstream to keep technologies like Apache Hive and Impala evolving. You’ll harden these engines for rock-solid...
developers as needed. Requirements: 4+ years of software engineering experience. Should have experience with Apache Spark...
unknowns, demonstrates a strong bias to action Knowledge in apache spark, scala is added advantage Strong interpersonal...
, Boot, Reactive, Servlet Stack), Hibernate, and JPA. · Experience with Apache Flink and Apache Spark for real-time... and batch data processing. · Experience working with Apache Kafka (including Kafka Streams). · Experience with API Gateways...
components in the Hadoop ecosystem like Apache Spark, Apache Hive, HBase, Kafka, Sqoop, Yarn, Zookeeper etc. 4. Takes care...
Core Responsibilities: Design and implement scalable data platforms and pipelines using Azure Databricks, Apache Spark.... Mandatory Skills: Strong command of Databricks and Azure. Proficiency in SQL, Python, Scala, and Spark. Experience...
working with Apache Spark, Kafka, and Airflow for building data workflows and processing large datasets. Strong knowledge...
. Expertise in Apache Spark, Delta Lake, SQL Warehouse, and Databricks Unity Catalog. Strong knowledge of Python, SQL, and data... environments. Guide engineering teams on Databricks, Spark, and cloud-native services. Work closely with data engineering...
, and Step Functions. Provide hands-on technical leadership in SQL (advanced querying, tuning, and optimization), Apache Spark... in AWS-native data services and modern data architecture patterns. Strong hands-on experience in Advanced SQL, Spark...
technology areas., Incubating tech user group Technical and Professional Requirements : Bigdata Spark, scala, hive, kafka...;Java->Apache->Apache Ofbiz,Technology->Functional Programming->Scala,Technology->Hadoop->Hadoop Ecosystem...
, and loading across large datasets. Develop Apache Spark jobs for large-scale data processing, with a focus on performance tuning... in AWS cloud services. Proficient in SQL and Apache Spark, with a strong track record of building and optimizing large...
, Google Cloud) and related services (S3, EC2, Lambda, etc.) Experience with big data technologies (Hadoop, Spark... (TensorFlow, Keras, etc.) Experience with big data technologies (Hadoop, Spark, etc.) Strong communication and collaboration...
Streaming for Apache Kafka. They are also proficient in using open source technologies like Apache Airflow and dbt, Spark... Spectrum, AWS Glue with Spark, AWS Glue with Python, Lambda functions with Python, AWS Glue Catalog, and AWS Glue Databrew...
and Apache Spark. Optimize and manage Spark-based workloads for scalability and performance. Work with structured...-on experience with Python, PySpark, Scala, SQL. Experience with Spark performance tuning and optimization. Knowledge of Delta Lake...
file system concepts, map-reduce principles, and distributed computing. Familiarity with Spark and its differences..., including experience with XML/JSON and REST APIs. Spark: Experience in launching Spark jobs in both client and cluster modes...
data processing Programming Languages Python (primary language for data processing) Big Data Technologies Apache... Spark Databricks DBT (Data Build Tool) Database Systems Relational: MySQL, PostgreSQL NoSQL: MongoDB, Cassandra...
ADF/Spark/SQL/Synapse/Databricks at a high level Experience with data orchestration tools and frameworks (e.g., Apache... environment Mentor junior level engineers and IT staff members Design of data processes in Synapse, ADF, and Spark that land...
Skills: - Expertise in data engineering frameworks and tools such as Apache Spark, Apache Kafka, and Airflow. - Proficiency... processes and tools such as Apache NiFi, Talend, Informatica, and Mulesoft. - Experience with machine learning frameworks...
Kafka, Azure DataBricks with Spark, and other open source technologies like Apache Airflow and dbt, Spark / Python, or Spark... components, including ADLS2, Blob Storage, SQLDW, Synapse Analytics with Spark and SQL, Azure functions with Python, Azure...