Experience with columnar databases: ClickHouse, BigQuery, Redshift, Snowflake Knowledge of streaming data platforms: Apache Kafka... preferred) Strong Python programming with data libraries: pandas, numpy, pyarrow Experience with ETL orchestration tools: Apache...
with AWS SQS (preferred), RabbitMQ, Apache Kafka Testing Tools/Services/Frameworks: Playwright, Cucumber, SauceLabs, Cypress...
/pipelines: Apache Airflow or Dagster Nice-to-have Experience with data streaming (Kinesis, Kafka) Experience with Apache Spark... proficiency with big data storage formats (Apache Parquet, ORC) and practical knowledge of pitfalls and optimization strategies...
& Streaming - Apache Kafka, RabbitMQ, or ActiveMQ. Cloud & Containers - Deployments in AWS, Azure, or GCP with Docker...
systems: 0MQ, RabbitMQ, Apache Artemis/Classic, Kafka Leadership positions/roles on teams/projects Project planning..., C# Apache Camel JEE, JPA/Hibernate, and T-SQL in production applications Git and Gradle/Maven Waterfall & Agile...
-to-have Experience with data streaming (Kinesis, Kafka) Experience with Apache Spark Client-facing experience, multi-cultural team..., with an emphasis on quality and test-driven development. Demonstrated proficiency with big data storage formats (Apache Parquet, ORC...
, LSM-Trees, B-Trees, etc.) Data Tools and Frameworks (Kafka, Great Expectations, Apache Iceberg, Hive, etc.) Data/Software...
experience with Kafka. 5+ years of experience working with Linux/Unix environments. Excellent written and verbal communication..., implementation and/or maintenance of CICD & microservices Experience with Data Pipelines such as ElasticSearch, NATS or Apache...
with Apache Kafka , Kubernetes/Docker , and CI/CD pipeline tools Why Join Us 100% remote work - from anywhere in the Philippines...
with big data technologies like Apache Spark or Kafka is a plus. Infrastructure as Code: Experience with Infrastructure as Code...
experience with cutting-edge technologies, including: Application and data integration strategies, such as AWS Glue, Apache... and DevOps practices Messaging and data streaming technologies, such as Kafka or Amazon Kinesis AI-powered coding tools...
(e.g., Spark, Hadoop, Hive,Kafka) Data Orchestration: Apache Airflow. Knowledge of CI/CD pipelines and DevOps practices...
-to-have Experience with data streaming (Kinesis, Kafka) Experience with Apache Spark Client-facing experience, multi-cultural team... like Apache Parquet and ORC. Implement robust data models, including relational, dimensional, and NoSQL models. Collaborate...
considering security, performance, scalability etc Experience in real-time data ingestion from LIVE sources using Apache Kafka...
/pipelines: Apache Airflow or Dagster Nice-to-have Experience with data streaming (Kinesis, Kafka) Experience with Apache Spark... and processing. Optimize data storage and retrieval using big data formats like Apache Parquet and ORC. Implement robust data models...
expertise in integration development (Springboot and/or Apache Kafka skills) Oral and written proficiency in English...
solutions using Confluent Kafka, Snowflake. The ideal candidate will work closely with cross-functional teams to build scalable...: Design, develop, and optimize real-time and batch data pipelines using Confluent Kafka and Snowflake. Streaming Data...
or relational databases. Knowledge of messaging systems, such as RabbitMQ, Apache Kafka, or Similar Technologies...
tools such as Apache Flink, Iceberg, Spark, and PySpark Advanced Python skills for data engineering and data science... Actions Experience with real-time data streaming (Kafka, Kinesis) Experience with feature engineering and machine learning...
Must have experience working with big data tools like Apache Spark, Hadoop, and Kafka to process and manage large-scale datasets...