on Docusign infrastructure with a strong emphasis on security and governance Build autonomous and workflow-based agents... including VPC, IAM, MWAA (Managed Workflows for Apache Airflow), and ECS Familiarity with software development best practices...
role, you will manage, configure, optimize, and secure data platforms such as Azure, Snowflake, DBT, Apache Airflow... environments, ensuring data lineage and model integrity. Administer Apache Airflow on Azure Kubernetes Service (AKS). Configure...
to enhance system performance, scalability, and reliability, ensuring the infrastructure can handle large-scale data processing.... Strong proficiency in big data technologies, including Apache Spark/PySpark, Apache Airflow and Apache Kafka. Experience...
infrastructure for AI-driven applications. Key Responsibilities Design and implement end-to-end data architectures for AI/ML... Lake, BigQuery, Synapse). Proficiency in data pipeline frameworks (Apache Spark, Kafka, Airflow, DBT). Strong knowledge...
performance, scalability, and reliability, ensuring the infrastructure can handle large-scale data processing efficiently... engineering or data platform teams. Strong proficiency in big data technologies, including Apache Spark/PySpark, Apache Airflow...
. As part of the Data Engineering team, you’ll contribute to the systems and infrastructure that fuel this mission. This role... Streaming, and Airflow. Write modular, testable code in Python or Scala, aligned with software engineering best practices...
that includes expertise in design, development, quality assurance, and cloud infrastructure. The team embraces Agile methodologies... full-stack, implementing back-end, front-end, and infrastructure as code changes. To develop a deeper understanding...
using Snowflake, DBT, and Python, integrating with orchestration tools like Airflow etx. Lead integration of Snowflake... intelligence, industry solutions, as well as the development, implementation and management of applications, infrastructure...
tuning of code and align it with the appropriate infrastructure to optimize efficiency. Validate results with user... deliverable documents including design documents architecture documents infrastructure costing business requirements source...
using Snowflake, DBT, and Python, integrating with orchestration tools like Airflow etx. Lead integration of Snowflake... intelligence, industry solutions, as well as the development, implementation and management of applications, infrastructure...
design in PySpark, Apache Airflow preferable Preferred Skills : Technology->Database Administration->NOSQL... Service Line : Cloud & Infrastructure Services...
tools: Docker, Kubernetes, Airflow, Terraform. Experience with cloud platforms: AWS, GCP. Excellent communication... and management of applications, infrastructure and connectivity. We are one of the leading providers of digital and AI infrastructure...
tools: Docker, Kubernetes, Airflow, Terraform. Experience with cloud platforms: AWS, GCP. Excellent communication... and management of applications, infrastructure and connectivity. We are one of the leading providers of digital and AI infrastructure...
Programming: Strong proficiency in Python and SQL DevOps: Experience with CI/CD pipelines and infrastructure as code (Terraform... Orchestration: Experience using workflow tools (Airflow, Control-M, etc.) Engineering Practices: Experience with GitHub, code...
underlying infrastructure for our data platforms (e.g., Airflow, Spark clusters), applying SRE and DevOps best practices... Platform Engineer with extensive experience in data engineering, cloud infrastructure, and a strong background in DevOps, SRE...
, and deliver on emerging data and AI opportunities (multi-cloud infrastructure, synthetic data, AI agents for campaign management..., orchestrators like Airflow/Kubeflow, etc.). Practiced at integrating and governing large-scale LLM pipelines: prompt engineering...
. This role is for those with deep expertise in building large scale data pipelines, SQL optimization, and cloud infrastructure... data pipelines using Airflow or dbt [Optional] Solid understanding of cloud platforms, particularly AWS [Optional...
contribute to the systems and infrastructure that fuel this mission. This role focuses on building reusable platform components... workflows and microservices using Spark, Spark Streaming, and Airflow. Write modular, testable code in Python or Scala, aligned...
orchestration: Airflow, Kubeflow, MLflow, Prefect Preferred Qualifications Bachelor’s or Master’s degree in Computer Science... range of learning tools both formal and informal. LSEG is a leading global financial markets infrastructure and data...