Mandatory Skills : big data +aws or azure + java + python + banking/capital markets + excellent job responsibilities... of application, data and infrastructure architecture disciplines solid experience in big data technologies; (spark, impala, hive...
; automate ETL jobs using AWS services, including S3, Athena, Lambda, RDS, Glue, and EMR; perform data quality checks... of solutions via data architecture, data engineering, or data manipulation within big data systems including Hadoop and SQL...
. Proficiency in SQL, Python, and data integration tools (e.g., Kafka). Experience with cloud platforms (AWS, Azure, GCP) and time... analytics. Experience with big data tools (e.g., Hadoop, Spark). Knowledge of electrical design and control panel layouts...
candidate thrives in a fast-paced environment, relishes working with ambiguity, big data, and enjoys the challenges of highly... working with ambiguity, big data, and enjoys the challenges of highly complex business context. This role requires...
increasingly complex. Your work will innovate on big data engineering tools, apply data science, and develop large-scale... role, you will drive data-driven approaches to camera technology simulation, design and manufacturing. Using your knowledge...
with Big Data technologies like Spark, EMR and streaming technologies like Kafka, Kinesis Proficiency in Power BI tools...Job overview and responsibilities The United Data Engineering team designs, develops and maintains massively scaling...
complex data pipelines and ETL processes for manipulating and managing big data. Improve cost effectiveness on the data... and development skills. Working with at least one of the following: data modeling, analytics, management, or big data processing...
with Big Data technologies like Spark, EMR and streaming technologies like Kafka, Kinesis Proficiency in Power BI tools...Job overview and responsibilities The United Data Engineering team designs, develops and maintains massively scaling...
or other big data technologies such as EC2, S3, Redshift, Batch, AppFlow AWS: EC2, S3, Lambda, DynamoDB, Cassandra, SQL Hadoop..., Hive, HDFS, Spark, other big data technologies Understand, Analyze, design, develop, as well as implement RESTful services...
years professional data engineering experience Good proficiency in: PySpark and distributed computing AWS data...) Strong background in: Big data processing architectures Data warehouse design Performance optimization Advanced Python, SQL...
or be interpreted as a comprehensive inventory of all duties, responsibilities and qualifications. Skills Big Data, Databasing, Data.... Become part of our award-winning technology team that turns big ideas into cutting-edge products, platforms, and solutions...
. On our team you will use the latest cloud and big data technologies and have many learning and career growth opportunities...+ years of experience - Azure Big Data (ADF, Databricks, Spark, Scala, PySpark) 1+ years of DevOps/CI/CD Experience...
) Proficiency in atleast one cloud data lakehouse platforms (preferably AWS data lake services or Databricks, alternatively Hadoop... or similar) Proficiency with data structures, data serialization formats (JSON, AVRO, Protobuf, or similar), big-data storage...
, alternatively Flink or Storm) Proficiency in atleast one cloud data lakehouse platforms (preferably AWS data lake services..., alternatively AWS Step Functions or similar) Proficiency with data structures, data serialization formats (JSON, AVRO, Protobuf...
AWS, big-data frameworks (e.g., Spark, Flink), and CI/CD best practices to ensure reliable, low-latency data feeds.... Cloud & Big Data: Hands-on experience with AWS (S3, EMR/Spark, Redshift/Athena/Glue). Proficiency in designing...
infrastructure. In other words, we're the people who keep the cloud running. We support all AWS data centers and all of the servers... consumption via data warehouse, data lake, and analytics solutions. About the team About AWS Diverse Experiences AWS values...
to design interaction between multiple modules. Design and develop distributed data processing pipelines in the Big Data... of experience with databases, SQL, data modeling, data mining, and automated engineering solutions. Familiarity with GCP Big Query...
scale? Are you passionate about developing big-data platforms using creative algorithms to process petabytes of data... Engineering (ASE) Data Platform team to design and build a scalable big-data platform that is used across Apple. As part of Apple...
your expertise in cloud platforms, big data tools, and machine learning frameworks to drive innovation and deliver actionable... Platform ecosystem (BigQuery, Dataproc, Composer, Dataflow, Data Catalog, Observability) or AWS equivalent. Proven ability...
approach to problem-solving, proficiency in big data processing technologies, and a mastery of templating to architect... Science, Math, Software Engineering, Computer Engineering, or related field AND 6+ years experience in big data engineering...