(Databricks, ADF, DataLake ), Python, Data analysis, Data warehousing concepts, Data pipeline design using API based sources... technologies and architectures, including data lakes, data warehouses, and ETL/ELT processes.9. Ability to collaborate effectively...
in Perl, Python, PowerShell and bash, Maintain high quality user support documentation, standard operating procedures... or Infrastructure Engineer. Knowledge of development using ETL tools like Informatica PowerCenter and exposure to Informatica Cloud...
, DataLake ), Python, Data analysis, Data warehousing concepts, Data pipeline design using API based sources... technologies and architectures, including data lakes, data warehouses, and ETL/ELT processes.9. Ability to collaborate effectively...
solutions. The primary skills this team should encompass are Software development skills preferably Python for platform building... on AWS; Data engineering Spark (pyspark, sparksql, scala) for ETL development, Advanced SQL and Data modelling for Analytics...
Experience Required is 6 to 8 years. Building data integration with Python Databrick Engineer certification Microsoft Azure... platform. Experience building data warehouse solutions using ETL / ELT tools like Informatica, Talend. Comprehensive...
design, messaging systems, storage, ETL/ELT pipelines, analytics, and BI tools What Will Make You Stand Out (Preferred..., and guiding architecture with proficiency in Java, Python, Golang, or Rust Proficient in secure application development...
of programming languages like Python, Pyspark and SQL. Familiarity with databases and ETL processes along with data warehousing... or ETL tools like Talend/informatica or similar frameworks. Proficiency in programming languages like Pyspark, Python...
languages like Python, Pyspark etc. 4-6 years of hands on experience in development and deployment of cloud native solutions... Airflow, Step Function, SNS), ETL/Analytics(Glue, EMR, Athena, Redshift), Infra (Cloud Formation, Code Pipeline), Data...
infrastructure on AWS. Your expertise in ETL processes, data warehousing principles, and proficiency in Python and Spark..., and maintain scalable and efficient ETL pipelines to ingest, transform, and load data from various sources into our data warehouse...
with services like ETL, Kafka, DMS, Glue, Lambda, and Step Functions. Orchestrate Workflows: Use Apache Airflow to build, deploy... tools like Erwin or similar. AWS Services Proficiency: In-depth knowledge of AWS services like ETL, DMS, Glue, Step...
experience using SCPO Platform Next Gen Skills - Data Science, Data Analytics, Agile, Python, AI/ML, Cloud Fun, Azure, Google... expertise on PL/SQL, database, ETL, Platform, Perl scripting. Demonstrable experience leading, building, deploying...
engineering with a focus on data engineering Proficiency in at least one programming language such as Python, Java, or Scala...) Demonstrated experience designing, implementing, and operating scalable ETL pipelines and data platforms Proven ability to work...
pipelines using AWS services 2. Develop and optimize ETL processes using AWS Glue, EMR, and Lambda 3. Build and maintain.... Write efficient and maintainable code using Python/PySpark, and SQL/PostgrSQL 8. Ensure data quality, security...
, implementing, and managing data solutions on Microsoft Azure. The ideal candidate will be well-versed in data architecture, ETL...: Design and implement scalable and efficient data solutions on the Azure platform. Develop ETL processes using Azure Data...
cases. Exposure to Data Platform Testing – ETL/ELT, DW Testing preferably using PostgreSQL database. Exposure to Pytest... framework, Python, typescript, JavaScript, Core Java. Hands-on with API testing using Postman, Swagger, Rest Assured Hands...
/Spark/Python Location: Bangalore Experience: 6-8 Years Design, develop, test, deploy, and maintain large-scale data... and deliver high-quality ETL solutions. Understanding and technical knowledge on AWS service like EC2, S3. Should have used...
Qualifications/ Skills Python, SQL, Spark/PySpark,AWS Glue, AWS Aurora (preferably Postgres), AWS S3, dbt. Strong relational.../Technologies used: SQL, SQL Server, ETL tools, Autosys, Snowflake/Cloud/Azure experience a plus Genpact is an Equal Opportunity...
/Python) to support content ingestion, classification, and transformation Maintain modern frontend experiences (React... and optimize ETL pipelines Ensure systems are ready for AI/ML use cases by enabling structured, classified content processing...
, including employee development and performance management experience - Experience with SQL - Experience with ETL - Experience... with data visualization using Tableau, Quicksight, or similar tools - Experience with R, Python, Weka, SAS, Matlab...
: o Extract, transform, and load (ETL) data from multiple sources (Must have) including SAP (Good to have), Dynamics 365 (Good... and scalability. (Must have) Required Skills and Qualifications: · Technical Skills: o Proficient in PySpark and Python for data...