Experience in LLM/Gen AI – Prompt Engineering, RAG and parameter hypertuning Experience in Pyspark will be an added advantage... Engineering- Python, Pandas/ Spark, Data Analyst/ Sr., Data preprocessing Lead – Team management technical Domain knowledge...
, you should have experience with: Ab Initio Unix Shell Scripting Oracle PySpark Some other highly valued skills may include... of expertise Thorough understanding of the underlying principles and concepts within the area of expertise They lead...
and equity for all. You’ll lead with purpose, breaking down barriers to innovation in a more connected, compassionate world... computing frameworks such as PySpark 4+ years of industry experience with popular ml frameworks such as Spark MLlib, Keras...
or lead in the development of self-monitoring, robust, scalable, batch and streaming ETL processes Develop and improve the... a plus (Matillion, Snowflake, PySpark, Redshift, Athena, Airflow, Talend, Kinesis, Hive, Firehose, Kafka ..) Bachelor's or master...
like Databricks, Python, PySpark, SCALA, R. Ability to ask strong questions to help the team see areas that may lead to problems...: Exp: 12 Years Mandatory Skill: Databricks, Python, Pyspark, Architect Basic Bachelor's degree or foreign equivalent...
financial data hub by establishing integrations with various data sources Act as a technical lead for a high-performing team... architecture A product and customer oriented mindset Our engineering stack has PySpark on Databricks for data engineering...
algorithms and key management practices Lead data breach investigations and respond to security incidents related to data. Work..., PySpark, and SQL Solid understanding of AWS Cloud services and their applications in data processing and analytics Deep...
and equity for all. You’ll lead with purpose, breaking down barriers to innovation in a more connected, compassionate world... computing frameworks such as PySpark 4+ years of industry experience with popular ml frameworks such as Spark MLlib, Keras...
an existing, complex Azure cloud-based data integration and transformation architecture using technologies such as PySpark... requirements of system migration. Project Management Skills: Skills in project management to technically lead and coordinate...
and equity for all. You’ll lead with purpose, breaking down barriers to innovation in a more connected, compassionate world... of more people, in more ways and in more places around the world. As a PySpark Data Engineer, you will be responsible for designing...
and synapse pipelines, Pyspark and data bricks to process and curate data. Python programming to integrate new and varied data... governance and access control to ensure data accuracy, consistency, and security. Technical Leadership: Lead end-to-end...
and synapse pipelines, Pyspark and data bricks to process and curate data. Python programming to integrate new and varied data... lead architect to support the existing ITMA data platform and enable its evolution over time. The NT Strategy + IT...
of experience and proficiency in programming languages such as Python, Pyspark, Java. Strong hands-on experience in SQL or data... to lead Analytics projects starting from solution designing to deployment in production. With your proficient coding skills...
: Designing scalable data pipelines using Databricks, PySpark, and BigQuery. Supporting regulatory-compliant ESG scoring... ecosystem. Develop and maintain distributed data pipelines for ESG and fund-related datasets using PySpark and Databricks...