. - Have experience as a data engineer or similar role supporting data-centric businesses. - Solid knowledge of SQL and work experience... big data technologies (such as Apache Hadoop, Spark, Kafka, Flink) and working experience in handling data ranging from TB...
(e.g., Apache Kafka, Azure IoTHub, Azure EventHub), ETL/ELT frameworks (e.g., Apache Spark, Azure Synapse), big data... processing frameworks like Apache Spark, Apache Flink, or Apache Beam for efficiently handling large-scale data processing...
IoTHub, Azure EventHub), ETL/ELT frameworks (e.g., Apache Spark, Azure Synapse), big data platforms (e.g., Apache Hadoop... for automation and system administration tasks Strong knowledge of data processing frameworks like Apache Spark, Apache Flink...
banking domain. -Expert knowledge Operationalizing data pipeline on Hadoop Hive, Iceberg, Spark -Strong knowledge... need to be passionate about Big Data Engineering and committed to delivering high-quality solutions. You'll work closely...
within Databricks environment, including Spark SQL, DataFrames, and RDDs Extensive experience with Delta Lake, including data... volumes of structured and unstructured data from various sources Implement data quality frameworks and monitoring...
The mission of the Data Platform Singapore Business Partnering (DPSG BP) team is to empower the TikTok Business... with data. Our goal is to build a Data Warehouse that can cater to batch and streaming data, Data Products that provide...
The Data Engineering AVP will join the AIG Data Office, responsible for major data delivery project development... with business, product owners and vendor partners to ensure successful delivery of data programs. This is a strategic role...
(e.g., Apache Kafka, Azure IoTHub, Azure EventHub), ETL/ELT frameworks (e.g., Apache Spark, Azure Synapse), big data... processing frameworks like Apache Spark, Apache Flink, or Apache Beam for efficiently handling large-scale data processing...
efficiently and reliably. Implement complex data transformations using Apache Spark and Google Cloud Dataproc. Develop.... Knowledge of distributed data processing frameworks such as Apache Spark, Apache Beam. Proficient in Java and the Spring...
IoTHub, Azure EventHub), ETL/ELT frameworks (e.g., Apache Spark, Azure Synapse), big data platforms (e.g., Apache Hadoop... for automation and system administration tasks Strong knowledge of data processing frameworks like Apache Spark, Apache Flink...
and optimize data lake and data warehouse solutions for structured and unstructured data. Leverage Apache Spark for large-scale... processes and modern data warehousing concepts. Experience with big data tools, especially Apache Spark (PySpark preferred...
(e.g., Apache Kafka, Azure IoTHub, Azure EventHub), ETL/ELT frameworks (e.g., Apache Spark, Azure Synapse), big data... processing frameworks like Apache Spark, Apache Flink, or Apache Beam for efficiently handling large-scale data processing...
IoTHub, Azure EventHub), ETL/ELT frameworks (e.g., Apache Spark, Azure Synapse), big data platforms (e.g., Apache Hadoop... for automation and system administration tasks Strong knowledge of data processing frameworks like Apache Spark, Apache Flink...
transformation and validation Familiarity with Apache Spark (especially PySpark) and large-scale data processing concepts Self... of our AI evolution, we've launched a new business unit AIDA - Artificial Intelligence & Data Analytics - a strategic engine driving...
transformation and validation Familiarity with Apache Spark (especially PySpark) and large-scale data processing concepts Self... of our AI evolution, we've launched a new business unit AIDA - Artificial Intelligence & Data Analytics - a strategic engine driving...
transformation and validation Familiarity with Apache Spark (especially PySpark) and large-scale data processing concepts Self... of our AI evolution, we've launched a new business unit AIDA - Artificial Intelligence & Data Analytics - a strategic engine driving...
transformation and validation Familiarity with Apache Spark (especially PySpark) and large-scale data processing concepts Self... of our AI evolution, we've launched a new business unit AIDA - Artificial Intelligence & Data Analytics - a strategic engine driving...
transformation and validation Familiarity with Apache Spark (especially PySpark) and large-scale data processing concepts Self... – Artificial Intelligence & Data Analytics – a strategic engine driving our transformation designed to scale our AI ambitions...
transformation and validation Familiarity with Apache Spark (especially PySpark) and large-scale data processing concepts Self... – Artificial Intelligence & Data Analytics – a strategic engine driving our transformation designed to scale our AI ambitions...
transformation and validation Familiarity with Apache Spark (especially PySpark) and large-scale data processing concepts Self... – Artificial Intelligence & Data Analytics – a strategic engine driving our transformation designed to scale our AI ambitions...