, Airflow, GitHub, PySpark Key Responsibilities: • Design, develop, and maintain scalable ETL/ELT pipelines • Ingest data... Listening, Algorithm Development, Alteryx (Automation Platform), Analytical Thinking, Analytic Research, Big Data, Business Data...
cases. Analyze test results and coordinate with development teams for bug fixes. Design, develop and execute automation... with Programmers to correct data quality errors. Experience with writing and executing test data scripts based on ETL mapping...
strategies using Unity Catalog. Key Responsibilities: Design and implement ETL/ELT pipelines using Databricks and PySpark. Work... Listening, Algorithm Development, Alteryx (Automation Platform), Analytical Thinking, Analytic Research, Big Data, Business Data...
data quality checks, testing frameworks, and monitoring processes. Support performance optimization across ETL/ELT... principles (e.g., Kimball, Data Vault, or modern ELT architectures). Strong Python skills for data manipulation and automation...
, Airflow, GitHub, PySpark Key Responsibilities: • Design, develop, and maintain scalable ETL/ELT pipelines • Ingest data... Listening, Algorithm Development, Alteryx (Automation Platform), Analytical Thinking, Analytic Research, Big Data, Business Data...
reports/data sets that inform business decision-making experience - 6+ years of creating process improvements with automation..., or customer benefits) experience - MBA, or CPA - Knowledge of SQL/ETL - Experience working with large-scale data mining...
, etc.) 3. ETL tool (two or more of AWS Glue, AWS Step Functions, Amazon Kinesis, Amazon Firehose, etc.) 4. Experience in Cloud... platforms - AWS 5. Python, Pyspark, UNIX shell scripting, Project & resource management 6. SVN, GIT, JIRA, Automation workflow...
Testing) Automate the test life cycle process at the appropriate stages through vb macros, scheduling, GUI automation... etc To design and execute the automation framework and reporting Develop and automate tests for software validation by setting up...
, and optimize PySpark notebooks in Azure Databricks for large-scale data processing.Design and maintain ETL/ELT pipelines... analytical reporting.Exposure to CI/CD, version control, and data pipeline automation.Advanced Excel and Google Sheets...
shell scripts for automation, scheduling, and monitoring of ETL jobs - Collaborate with cross-functional teams to support...* in designing, developing, and optimizing large-scale *ETL solutions* using *Informatica PowerCenter*. The ideal candidate will lead...
, and optimization for large scalable database applications Experience of integration, SSIS design and development of ETL packages OLAP... successful delivery of Data Engineering and Automation initiatives to agreed quality and governance standards Work with the Project...
Testing) Automate the test life cycle process at the appropriate stages through vb macros, scheduling, GUI automation... etc To design and execute the automation framework and reporting Develop and automate tests for software validation by setting up...
Testing) Automate the test life cycle process at the appropriate stages through vb macros, scheduling, GUI automation... etc To design and execute the automation framework and reporting Develop and automate tests for software validation by setting up...
with or without minimal supervision. Responsibilities Design & Develop new automation framework for ETL processing Support... existing framework and become technical point of contact for all related teams. Enhance existing ETL automation framework...
data pipelines. Proficiency in leveraging AI/ML tools and Cortex Analytics to drive intelligent automation and predictive.... Experience with ETL, SQL, and emerging data technologies, including cloud-based analytics integrations. Skilled in building end...
Kernel, AutoGen, etc.) for multi-step reasoning and automation. Integrate OCR, computer vision, and NLP models to process... Face, LangChain, LlamaIndex, OpenAI SDKs). Experience with data processing & ETL pipelines (Pandas, Spark, Dask...
and Visualization, Power BI dashboard development, extracting strategic insights and exposure to Process Automation. The role is focused... business requirements into technical specifications. Use ETL capabilities (e.g., Power Query, dataflows, or similar...
for model development, automation, and code quality. Play a pivotal role in communicating complex technical concepts through... Statistical analysis and anomaly detection Large-scale data engineering and ETL pipeline development (Spark, Hadoop, or similar...
implementation and support. The role involves data modeling, ETL processes, incident management, and performance optimization... functionality with ABAP Debugging skills. Prior experience in handling ETL and Incident management/Bug-Fix. Hands on Experience...
We are looking for a skilled SAP Datasphere Developer with hands-on experience in data modeling, transformation and ETL.... Set up tasks chains for automation of jobs Set up Data Access Control for data level authorizations. Build SQL based...