Design, develop, and maintain ETL pipelines and data workflows using Spark, Hadoop, Hive, and related frameworks. Work... security, compliance, and governance across all platforms. Requirements 3–6 years of experience as a Data Engineer...
and optimize complex SQL queries for large-scale transactional and analytical data processing. Work with Spark (batch/streaming... Engineer or similar role in the banking/financial services domain. Strong expertise in SQL (query tuning, stored procedures...
Overview Being a Data Engineer with Xtremax means more than just moving data around—you’ll help design, build... Must-Have Strong proficiency in data cleaning and transformation (e.g., SQL, pandas, R). Must have 2–5 years of relevant experience. Hands...
developing scalable and maintainable systems Strong SQL skills and experience with cloud data warehouses (e.g., Snowflake..., BigQuery) Experience with modern data infrastructure tools (e.g., Spark, Kafka, Airflow, Iceberg) Understanding of BI...
and more. About the Opportunity We are seeking a highly skilled Senior Data Analytics Engineer - Compliance (Senior Business Analysis.... What You'll Be Doing Serve as a data analytics engineer expert, providing insights to support financial crime operations...
job description of the job profile. Definitive job description should be reviewed and discussed between you and your manager. Data Engineer... such as HIVE, Impala, Kudu, HDFS, Spark, Flink - Fluent in structured and semi-structured data, its management, and modern data...
primarily with data in roles such as Data Engineer, Data Analyst, or Data Scientist. - Proficient in SQL, data modeling, ETL... with data scientists, analysts, product managers, and various engineering teams. - Engineer scalable solutions...
of experience in a Data Engineer role. Experience building and operating large-scale data lakes and data warehouses. Experience... with Hadoop ecosystem and big data tools, including Spark and Kafka. Experience with Master Data Management (MDM) tools...
scientists, big data engineers, developers and consultants in the region. We are looking for a Data Engineer (Manager... and on-prem data platforms (e.g., AWS, Azure, GCP, Hadoop, or on-prem SQL/NoSQL systems). Ensure data integrity, governance...
scientists, big data engineers, developers and consultants in the region. We are looking for a Data Engineer (Associate/Senior... with cloud and on-prem data platforms (e.g., AWS, Azure, GCP, Hadoop, or on-prem SQL/NoSQL systems). Ensure data integrity...
We are looking for a highly motivated and skilled Data Engineer Key Responsibilities Build and maintain robust..., scalable ETL pipelines across batch and real-time data sources. Design and implement data transformations using Spark (PySpark...
. What you will be responsible for: We're looking for a Senior Data Engineer to join our dynamic AI/ML team. You'll build and manage the data... and ETL processes using tools like Python, Spark, and Airflow. · Shape Data Systems: Help decide how our data systems...
and key ML frameworks (TensorFlow, PyTorch, Keras, scikit-learn). Experience working with Big Data tools (SQL, Spark, Hadoop... Engineer to develop advanced predictive modeling that drive actionable business decisions and build AI-driven personalization...
. What you will be responsible for: We're looking for a Senior Data Engineer to join our dynamic AI/ML team. You'll build and manage the data... and ETL processes using tools like Python, Spark, and Airflow. · Shape Data Systems: Help decide how our data systems...
. - Candidates should have at least 5 years of experience as a data engineer or similar role supporting data-centric businesses.... Preferred Qualifications: - Experience in using big data technologies (such as Apache Hadoop, Spark, Kafka, Flink) and working...
. - Have experience as a data engineer or similar role supporting data-centric businesses. - Solid knowledge of SQL and work experience... big data technologies (such as Apache Hadoop, Spark, Kafka, Flink) and working experience in handling data ranging from TB...
(e.g., Apache Kafka, Azure IoTHub, Azure EventHub), ETL/ELT frameworks (e.g., Apache Spark, Azure Synapse), big data...) Expertise in working with relational databases (e.g., MySQL, PostgreSQL, Azure SQL, Azure Data Explorer) and data warehousing...
IoTHub, Azure EventHub), ETL/ELT frameworks (e.g., Apache Spark, Azure Synapse), big data platforms (e.g., Apache Hadoop... databases (e.g., MySQL, PostgreSQL, Azure SQL, Azure Data Explorer) and data warehousing concepts. Familiarity with data...
within Databricks environment, including Spark SQL, DataFrames, and RDDs Extensive experience with Delta Lake, including data... volumes of structured and unstructured data from various sources Implement data quality frameworks and monitoring...
. - Strong coding skills, with proficiency in multiple tools/languages including SQL, Python, Java, Hive, Spark, Kafka and Flink...The mission of the Data Platform Singapore Business Partnering (DPSG BP) team is to empower the TikTok Business...