, or Scala and expertise in SQL. Hands-on experience with big data technologies such as Hadoop, Spark, Kafka, Presto, or Hive..., lineage, cataloging, and security practices. Ability to lead cross-functional technical teams, conduct code reviews...
Storage, Pub/Sub, and Vertex AI Programming: Expert-level Python/Java programming, proficiency in Python/Scala for Spark... Data Engineer who will lead end-to-end development of complex Data Engineering use cases and drive the evolution of Equinix...
Data Engineering Expertise: Expert proficiency in Python and Scala/Java for building production data systems Deep hands...-on experience with Apache Spark (Spark SQL, DataFrames, Streaming) including performance tuning and optimization Strong expertise...
Data Engineering Expertise: Expert proficiency in Python and Scala/Java for building production data systems Deep hands...-on experience with Apache Spark (Spark SQL, DataFrames, Streaming) including performance tuning and optimization Strong expertise...
Experience Scala, Spark/Pyspark is must, Hadoop ( BIG Data ), + AWS,Databricks 8 to 11 years’ experience implementing data... or more data integration platforms such as Ab Initio, Apache Spark, Talend and Informatica Big Data: Experience of ‘big data...
and AI solutions using Scala/Java, Python, Spring Boot, REST/gRPC APIs, SQL/NoSQL databases, and modern UI frameworks such as Angular... in modern Data Engineering including Spark (Structured Streaming), Databricks, Kafka, Airflow, DBT, Delta Lake/Apache Iceberg...
data pipelines using tools like Apache Kafka, Flink, or Spark Streaming to handle high-velocity data streams. Design..., and data quality standards. Lead architectural reviews and technical design sessions to guide solution development...
like Sagemaker, MLFlow, Kubeflow, or other platforms Big data - Hive, Spark, Hadoop, queuing system like Apache Kafka/Rabbit MQ/AWS... ML lifecycle. What You’ll Do Design and implement technical features leveraging best practices for technology stack...
programming, proficiency in Python/Scala for Spark development Advanced Data Technologies: Deep expertise in Apache Beam, Apache... & Mentorship Lead and mentor Data Engineers and other team members, fostering technical excellence and professional growth...
. You'll lead through influence, shaping technical direction, mentoring engineers, and building the “single source of truth... Apache Airflow, Spark, Trino, and cloud-native tools. Develop high-performance data marts and semantic layers that serve...
, forecasting, and AI/ML. You'll lead through influence, shaping technical direction, mentoring engineers, and building the “single... and optimize ETL/ELT pipelines using Apache Airflow, Spark, Trino and cloud-native tools. Develop high-performance data marts...
. You should be proficient in: Category Technologies Languages Python (primary), Java, Scala, SQL ML Frameworks PyTorch, TensorFlow, Scikit...-learn, Keras Big Data & Processing Apache Spark, Kafka, Databricks Cloud & Infrastructure AWS (SageMaker), Kubernetes (K8s...
skills (e.g., Python, SQL, Scala) Familiarity with tools like Apache Spark, Kafka, Airflow, and cloud platforms (AWS, Azure... and digital and technology, as well as job-specific technical skills. This role is based in our Pune office. Purpose of the...
. Technical skills: Strong knowledge of SQL, NoSQL databases, and big data technologies like Apache Spark (PySpark, Scala..., troubleshoot performance issues, and ensure the smooth operation of data pipelines. Mentor and lead: Provide technical leadership...