and Architect Contract-Driven Data Pipelines powered by Apache Iceberg, Kafka, and Airflow with CI/CD for ingestion..., OpenMetadata, Kafka, Spark, MLflow, Feast, Airflow, dbt, or Dagster Built or scaled ML platform components (e.g., feature stores...
, and opportunities for standardization and automation. Solution Design & Development: Design, architect, and develop robust, scalable... technologies and ecosystems (e.g., Hadoop, Spark, Hive, Kafka). Programming Languages: Strong proficiency in SAS programming...
pipelines to Databricks and Prophecy. Re-architect pipelines for Spark-based execution, leveraging Databricks-native... orchestration and Prophecy low-code development. Optimize Databricks Spark jobs for performance, cost, and scalability...
of experience in the Apache Spark/DataBricks framework (Python/Scala) Databricks and AWS developer/architect certifications a big...-processes using Apache Spark Framework. Monitor, manage, validate, and synthetic test data extraction, movement, transformation...
-IAM Architect Job Description (Posting). About HCLTech HCLTech is a global technology company, spread across 60... whose unique spark, perspective and boundless passion drive our culture of proactive value creation and problem-solving...
, Germany and the ! Become a key architect of the future of e-commerce! Bazaarvoice is on the hunt for a driven and seasoned... into the full development lifecycle-from initial spark to live deployment-and shape the experience from pixel-perfect front-end...
in more than 40 countries around the world. What you'll do in the role: Architect resilient on-prem and multi-cloud database... down optimization, ELT, Spark based data processing and streaming, replication, partitioning, clustering, change data...
to be a part of the delivery of IT projects for our customers across the globe. Your key responsibilities Architect, implement... with Azure Data Lake, Databricks (including Spark, Delta Lake), and familiarity with AWS data services. Practical experience...
to be a part of the delivery of IT projects for our customers across the globe. Your key responsibilities Architect, implement..., and environment provisioning. Deep expertise in Azure Data Lake, Databricks (including Spark, Delta Lake), and Microsoft Fabric...
acquisition, model development, deployment, and monitoring. Architect and implement scalable AI/ML solutions using modern... understanding of Big Data platforms (e.g., Spark, Hadoop, distributed databases, cloud data warehouses). Experience in MLOps: model...
, and scalable AI systems. Key Responsibilities ML & GenAI Development: Architect, build, and optimize machine learning... technologies (Spark, Hadoop, Databricks). Experience with vector databases (FAISS, Pinecone, Weaviate, etc.). Knowledge of data...
, and orchestration. · Architect and implement cloud-based data solutions, integrating structured and unstructured data sources. · Build... Databricks (Must-Have) · Azure Data Factory · Azure Blob Storage / Azure Data Lake Storage · Apache Spark (hands-on experience...
, Ignite, Apache Spark, NOSQL, RDBMS, Jenkins, App Dynamics, Splunk What you’ll do: Drive designs discussion and come up... specialization) and minimum 10 to 12 years of experience in Software development; has been an Architect, within the last 1-2 years...
of advanced analytics and machine learning projects, from ideation to deployment and ongoing optimization. Architect... (Python, R, Spark). Champion the adoption and integration of GenAI (Generative AI) for real-world retail applications (e.g...
. Design & Develop data solutions/applications. Architect and develop scalable applications or systems. Drive the design... processing technologies like Spark. Any Spring boot experience is a plus. AI/Agent/MCP knowledge work. Familiarisation...
lakes (Apache Spark, Apache Iceberg or equivalent). Candidates with a background in developing scalable, cloud-native.... You will report to the Chief Development Architect, Engineering. Your Role Responsibilities? Here's What You'll Do: Build services...
, and orchestration. · Architect and implement cloud-based data solutions, integrating structured and unstructured data sources. · Build... Databricks (Must-Have) · Azure Data Factory · Azure Blob Storage / Azure Data Lake Storage · Apache Spark (hands-on experience...
Principal Architect to define the architecture, tools, and processes for AI/ML adoption globally. Manage a team of five... frameworks (Kafka, Pulsar, Spark Streaming, Flink). Experience building and maintaining data lakes/warehouses (Snowflake, Delta...
engineering, Generative AI (GenAI), and AWS cloud platforms to architect and lead scalable AI-driven solutions that address..., Scala, or Go). Experience with modern data engineering tools and pipelines (Airflow, Spark, Kafka, dbt, Snowflake...
engineering, Generative AI (GenAI), and AWS cloud platforms to architect and lead scalable AI-driven solutions that address..., Scala, or Go). Experience with modern data engineering tools and pipelines (Airflow, Spark, Kafka, dbt, Snowflake...