deep, hands-on expertise with SQL, DBT, Python, Snowflake, AWS, and various BI platforms to guide technical teams through...
/streaming data pipeline development using tools such as Airflow, dbt, or NiFi. Programming: Python, SQL (advanced), Shell...
in Python, distributed computing frameworks (Spark, Databricks, DBT), and both SQL and NoSQL databases, including vector...
Kafka, Azure DataBricks with Spark, and other open source technologies like Apache Airflow and dbt, Spark / Python, or Spark... components, including ADLS2, Blob Storage, SQLDW, Synapse Analytics with Spark and SQL, Azure functions with Python, Azure...
data processing Programming Languages Python (primary language for data processing) Big Data Technologies Apache... Spark Databricks DBT (Data Build Tool) Database Systems Relational: MySQL, PostgreSQL NoSQL: MongoDB, Cassandra...
Spectrum, AWS Glue with Spark, AWS Glue with Python, Lambda functions with Python, AWS Glue Catalog, and AWS Glue Databrew... Streaming for Apache Kafka. They are also proficient in using open source technologies like Apache Airflow and dbt, Spark...
: Programming & Data Processing Expertise in Python for data pipeline development and automation. Experience with distributed... computing frameworks like Apache Spark, Databricks, & DBT for large-scale processing. Database & Warehousing Strong knowledge...
. Lead development and deployment of data ingestion form Postgres SQL DB and transformation using DBT and orchestration using... Python Redshift Aws Data Modeling Qualifications: Mandatory Skills AWS, ETL, PostgreSQL, Big Data Architect, Python, SQL...
Lake, BigQuery, Synapse). Proficiency in data pipeline frameworks (Apache Spark, Kafka, Airflow, DBT). Strong knowledge... & compliance standards. Proficiency in SQL & Python with distributed data systems. Exposure to AI/ML platforms (SageMaker...
using Snowflake, DBT, and Python, integrating with orchestration tools like Airflow etx. Lead integration of Snowflake.... At least 7 years of experience developing data pipelines and data warehousing solutions using Python and libraries such as Pandas...
using Snowflake, DBT, and Python, integrating with orchestration tools like Airflow etx. Lead integration of Snowflake.... At least 7 years of experience developing data pipelines and data warehousing solutions using Python and libraries such as Pandas...
on building scalable data pipelines and systems Strong proficiency in Python and SQL Extensive experience with SQL query... data pipelines using Airflow or dbt [Optional] Solid understanding of cloud platforms, particularly AWS [Optional...
. Using a high-powered technology stack that includes Tableau, dbt, Cloud Computing platforms and business applications, the... calculations, parameters, and complex visualizations Experience with Streamlit or similar Python-based data product frameworks...
either Python or Scala, preferably Python. Must have experience in Data Engineering domain . Must have implemented at least 2... platform. Good to have knowledge of DBT. Good to have knowledge of docker and Kubernetes. Why join Genpact...
) processes, data pipelines, and data streaming using Python , Kafka for streams , Pyspark , DBT , and ETL services provided... languages such as Python, Java, or Scala, and experience with scripting languages like SQL or Shell scripting. Communication...
: Programming Languages: Python, SQL (expert level). Data Processing Frameworks: Apache Spark, PySpark, or Flink. Cloud..., ADLS, GCS), relational databases (PostgreSQL, MySQL), NoSQL databases (MongoDB, DynamoDB). ETL/ELT Tools: dbt, Apache...