. Data and caching experience with RDBMS/SQL (Postgres/MySQL), NoSQL, and caching solutions such as Redis. Big data..., including Snowflake, BigQuery, and Redshift, along with ETL/ELT patterns. Streaming and data pipeline experience using Kafka...
, transformation, and loading (ETL/ELT) processes, utilizing PySpark for distributed big data processing and Polars/Rust for maximal... masking/tokenization for sensitive data (PII/PHI). CI/CD & Testing: Strong knowledge in building automated test, lint...
and analytics initiatives to drive data-informed decision making Designing, developing, and maintaining ETL processes and data... with statistical analytics and programming languages (e.g., Python, Java, Ruby, R) and big data technologies/languages (e.g. Spark...
with both technical and non-technical stakeholders. Experience in building scalable real time data systems, ETL, and streaming solutions..., durability, scalability, and maintainability. Driving innovations in the data platform constantly & remaining ahead of the curve...
data quality checks, testing frameworks, and monitoring processes. Support performance optimization across ETL/ELT... warehouses (e.g., Snowflake, BigQuery, Redshift, Databricks). Big Query preferred. Solid understanding of data modeling...
Lakehouse, ETL, Data Pipelines, or Business Intelligence is highly desirable. Experience in software design... your career with a leading organization in one of the fastest-growing fields in technology today – Big Data analytics. You’ll play...
preferred): Azure OpenAI, Blob Storage, Key Vault, Container Registry, AWS or GCP; Experience in data engineering in Big Data... systems including: Large-scale data processing, ETL/ELT pipelines. Responsibilities: Design and build scalable backend...
best practices. Familiar with Agile/Scrum methodologies Experience in designing and operating big data processing pipelines... you can be proud to be with. Responsible for creation of concept, design, development, testing and maintenance...
best practices. Familiar with Agile/Scrum methodologies Experience in designing and operating big data processing pipelines... you can be proud to be with. Responsible for creation of concept, design, development, testing and maintenance...
AI systems and algorithms is a plus Practical experience in data modeling, data warehousing, and developing ETL processes using..., billing. Responsibilities include analysis, creation of technical designs, development, unit testing and support activities...
AI systems and algorithms is a plus Practical experience in data modeling, data warehousing, and developing ETL processes using..., billing. Responsibilities include analysis, creation of technical designs, development, unit testing and support activities...
best practices. Familiar with Agile/Scrum methodologies Experience in designing and operating big data processing pipelines... you can be proud to be with. Responsible for creation of concept, design, development, testing and maintenance...
: Develop and maintain complex ETL mappings, workflows, and UNIX shell scripts in a Data Warehouse environment, based... of AWS Data Services like RDS, Redshift, S3, Athena, Glue, Kinesis, EMR. Experience with Big Data approaches...
, Loki, Jaeger). Working experience with big data technologies (Spark) and ETL frameworks (Airflow, dbt). Exposure to ML...-end and back-end systems, leveraging modern frameworks, cloud platforms, and data engineering tools to deliver exceptional...
and observability tools (Prometheus, Grafana, Loki, Jaeger). Experience with big data technologies (Spark) and ETL frameworks (Airflow... with SQL (PostgreSQL, MySQL, Snowflake) and NoSQL (MongoDB, DynamoDB, Redis) databases. Collaborate on data pipelines using...
. Background in SaaS applications, ML/AI integration, or high-growth startups. Knowledge of data pipelines, ETL, or big data tools... that accelerate next-generation computing experiences—from AI and data centers, to PCs, gaming and embedded systems. Grounded...
industry trends 2ServiceNow Certified System Administrator GCP Big Data Engineer Skills Set GCP SQL PySpark ETL... composer Big Query with ETL expertise Key Responsibilities Design develop and maintain scalable data pipelines and ETL...