Python Airflow WorkMode : work from office Work Location : Chennai / Hyderabad / Bangalore Work Timing : 2 PM to 11... PM Primary : Python Airflow Years of Experience: 7-10 Years Job Summary: We are seeking an experienced Data Engineer...
opportunity We are seeking a Senior Data Engineer with strong Python expertise to join our team. The core purpose is to design... and attributes for success Technical Foundation: Need strong programming skills, particularly in Python, with hands-on experience...
SQL, AIRFLOW, POSTGRES, Airflow PySpark, Python, API Experience Required: 12+ years of professional software...
). Strong proficiency in Python and/or Java, with solid object-oriented design principles. Experience with workflow orchestration tools... such as Apache Airflow. Solid understanding of data modeling, database design, and performance optimization. AI & Advanced...
Description Primary skills : Databricks / Spark, Snowflake and Airflow Strong in Python programming, Pandas..., Docker Requirements Primary skills : Databricks / Spark, Snowflake and Airflow Strong in Python programming, Pandas...
strong theoretical knowledge is mandatory Proficiency in Python/PySpark coding. Data structures and algorithms using python... in cloud-based infrastructures such as AWS or GCP Exposure to orchestration platforms such as Airflow or Kubeflow Proven...
strong theoretical knowledge is mandatory Proficiency in Python/PySpark coding. Data structures and algorithms using python... in cloud-based infrastructures such as AWS or GCP Exposure to orchestration platforms such as Airflow or Kubeflow Proven...
dialects). ETL/ELT Tools Experience with ingestion tools like Fivetran, Airbyte, or custom Python scripts. Orchestration... Familiarity with Airflow, Dagster, or Prefect for scheduling complex jobs. Warehousing Hands-on experience with cloud data...
area. Ability to manipulate large data sets utilizing Spark, Python and SQL.,Snowflake Previous experience using Spark... and Airflow is preferred. Must have excellent design, problem-solving, and time management skills. Ability to collaborate...
such as Informatica Talend ADF DBT Airflow or Glue Data Governance Quality Establish data governance frameworks metadata management... in SQL Python or Scala for data manipulation and design Expertise in one or more cloud data platforms Snowflake Azure Synapse...
like Vertex AI. Develop and optimize ETL/ELT pipelines using tools like Python, SQL, and streaming technologies (e.g., Kafka..., Apache Airflow). Architect Historical and Incremental Loads and Refine Architecture on an ongoing basis Manage and optimize...
Kafka, Apache Airflow, SQLMESH, Snowflake Languages & Frameworks: Python, SQL, Java, Docker Monitoring & Observability... What You Bring Technical Foundation Working knowledge of Python for scripting and basic automation Basic SQL skills...
Snowflake Developer \n Primary Skills DataStream, ETL Fundamentals, SQL, SQL (Basic + Advanced), Python, Data... • Workflow Orchestration: Airflow Qualifications: • Bachelor's or Master's degree in Computer Science, Data Engineering...
Deep Technical Expertise Expert-level proficiency in SQL, Python, and at least one additional programming language... orchestration platforms like Airflow, Prefect, or Dagster Demonstrated success modernizing legacy data systems while ensuring...
and microservices using Java/Python/C# to facilitate data movement between niche systems and the data lakehouse. Infrastructure... like Apache Airflow (Cloud Composer). Experience implementing Data Governance (metadata management, data cataloging). Data...
(Beam), Pub/Sub, Composer (Airflow), Cloud Functions, IAM, VPC-SC; Terraform/IaC. Languages: Python, PySpark, Scala... (data lakehouse/warehouse, streaming, governance) with hands-on engineering (Python, PySpark, Scala) and TPM leadership...
, AlloyDB. Proficient in SQL, Python, Airflow, DBT. Experience with data modelling, schema design, and partitioning strategies... tools such as Dataflow, Dataproc(Apache Beam), Cloud Composer (Airflow) and DBT. Build and optimize data warehouses...
and in the cloud (Azure and GCP), includes MapR, Airflow, Spark, Kafka, jupyter, Kubeflow, Jenkins, GitHub, Tableau, Power BI... into AI applications. Very good in Python Programming. Power BI, Tableau Develop the application and deploy the model in production...
Hands-on experience with Apache Airflow for orchestration Strong SQL skills (BigQuery preferred) Proficiency in Python... platforms on Google Cloud Platform, leveraging Databricks, dbt, and Apache Airflow. You will work closely with product teams...
scalable data platforms on Google Cloud Platform, leveraging Databricks, dbt, and Apache Airflow. You will work closely... and dependencies using Apache Airflow Work with BigQuery, Cloud Storage, Pub/Sub, and other GCP services Implement data quality...