and Architect Contract-Driven Data Pipelines powered by Apache Iceberg, Kafka, and Airflow with CI/CD for ingestion..., OpenMetadata, Kafka, Spark, MLflow, Feast, Airflow, dbt, or Dagster Built or scaled ML platform components (e.g., feature stores...
. · Experience or knowledge developing with Scala. · Experience or knowledge of Apache Spark. About Us Join SymphonyAI...
or Apache Spark; which will enable them to design scalable solutions for our advertising products, implement proof-of-concept... platforms such as R, Python etc. including visualization tools. Comfortable with the big data ecosystem and Apache Spark...
solutions. Experience with distributed computing tools (like Apache Spark for Python) is a plus, enabling scalable data..., Spark based data processing and streaming, replication, partitioning, clustering, change data capture and time travel...
with Apache Flink and Apache Spark for real-time and batch data processing. · Experience working with Apache Kafka (including.... · Hands-on experience with PostgreSQL and MongoDB. · Familiarity with analytical and graph databases such as Apache Druid...
, Spark, Kubernetes, TerraForm. Strong experience with Data Lakehouse architecture using Delta Lake for ACID transactions... Glue, Azure Data Factory, or Apache Airflow for orchestrating and automating data pipelines. Solid analytical, planning...
Experience Apache Spark The Hadoop ecosystem Java HP Vertica TensorFlow, reinforcement learning Ensemble Methods, Deep...
, Amazon Redshift, AWS Lambda, and Amazon S3. This role requires expertise in AWS Kinesis, AWS CloudFormation, Apache Spark... Lambda, Amazon S3, and Apache Spark to build and optimize data solutions. Design, implement, and maintain robust data...
, Ignite, Apache Spark, NOSQL, RDBMS, Jenkins, App Dynamics, Splunk What you’ll do: Drive designs discussion and come up..., Spark or similar technologies. Demonstrable experience, thorough knowledge and interests in Cloud native architecture...
and optimize streaming data ingestion pipelines using Apache Spark and Flink. ● Own and evolve key event-driven services using... (Spring Boot) and one or more backend frameworks (Golang preferred). ● Deep experience with Apache Spark and Apache Flink...
Google Cloud Storage, BigTable, BigQuery DataProc with Spark and Hadoop, Google DataFlow with Apache Beam or Python..., and other open source technologies like Apache Airflow, dbt, Spark/Python, or Spark/Scala. Experience in developing and managing...
Engineering ( ETL or Streaming data) , HDFS, Apache Spark , Apache Flink , Hadoop.... Good to have experience building backend...
of Big Data technologies (Apache Spark, Hadoop ecosystem, Apache Kafka, NoSQL databases) · Working as a Big Data Engineer... best practices for CI/CD. · Troubleshooting, and debugging Spark and other big data solutions. · Writing SQL queries...
Engineering & Infrastructure Big data technologies (Apache Spark, Hadoop) Data pipeline management (ETL processes) Database...
like Kafka, Apache Flink, Hadoop, Spark Expert in data modelling using SQL and NoSQL databases Expert in crafting...
You Stand Out (Preferred Qualifications) Experience developing GraphQL APIs Experience with Apache Spark streaming and batch...-on experience working with Apache Kafka, PostgreSQL, Apache Ignite (or some other distributed cache such as Redis), Elasticsearch...
such as AWS , Azure or GCP. Knowledge of docker, Kubernetes. Experience with distributed computing, big data(Apache Spark...
and cloud infrastructure.Strong proficiency in SQL, Spark/Scala, and data analytics. Data Governance and SecurityWell-versed... databases: PostgreSQL, MySQL, MongoDB, Cassandra.Hands-on experience with ETL tools: Talend, Informatica, Apache NiFi...
such as Akka/Apache Pekko, Play In depth understanding of functional programming and Implementation Such as: Try, Option, Future... on MVC Architecture, Knowledge of Frameworks such as: Akka/Apache Pekko, Play 2.9, Play 3.0 Writing Test cases using...
a plus. • Data Processing: Apache Spark, Databricks. • Databases: PostgreSQL, Snowflake, MongoDB. • CI/CD & DevOps: GitHub Actions... or other programming languages used for data manipulation. Experience with ETL tools such as Apache Airflow Talend Informatica AWS Glue...