Technical Skills : SQL, Python/Scala NoSql and distributed databases (Hbase, Cosmos DB) ETL pipleine design... and development; Solutioning and estimation Big Data Frameworks : Apache Spark, Hadoop, Hive Cloud platforms: Azure data...
data pipelines using tools like Apache Kafka, Flink, or Spark Streaming to handle high-velocity data streams. Design..., and data quality standards. Lead architectural reviews and technical design sessions to guide solution development...
solutions. Technical Skills: Extensive experience in big data tools: Hadoop, Hive, and Spark. Proficiency in Scala, Python... and associated technologies, (For e.g. Apache Spark, Python, Pandas etc.), Open table formats (e.g. Iceberg) Leadership Skills...
and AI solutions using Scala/Java, Python, Spring Boot, REST/gRPC APIs, SQL/NoSQL databases, and modern UI frameworks such as Angular... in modern Data Engineering including Spark (Structured Streaming), Databricks, Kafka, Airflow, DBT, Delta Lake/Apache Iceberg...
like Sagemaker, MLFlow, Kubeflow, or other platforms Big data - Hive, Spark, Hadoop, queuing system like Apache Kafka/Rabbit MQ/AWS... ML lifecycle. What You’ll Do Design and implement technical features leveraging best practices for technology stack...
, forecasting, and AI/ML. You'll lead through influence, shaping technical direction, mentoring engineers, and building the “single... and optimize ETL/ELT pipelines using Apache Airflow, Spark, Trino and cloud-native tools. Develop high-performance data marts...