big data tools (e.g. Apache Spark/Hadoop/ AWS Glue/ AWS EMR/Snowpark/Azure Databricks/Azure Data Factory) Excellent...Job Description What is the opportunity? Supports the development and maintenance of scalable data stores...
pipelines using Azure Data Factory| Databricks| and related services. Implement data storage solutions such as Azure Data Lake... architecture| data bricks Design| build| and maintain scalable data solutions on Microsoft Azure. Develop and manage data...
(Microsoft OpenAI| Azure AI Search| Azure AI translate| Power BI| Azure Data Lake Storage| Azure Databricks| Azure Data Factory... Boto)| and cloud provisioning (CDK or Terraform)Hands on experience configuring and deploying Azure Data AI Platforms...
to ensure solutions are available Outlining problems, opportunities and solutions for Azure cloud products (Data Factory..., Databricks, DevOPS, GIT, etc.) Create, test and implement safeguards to maintain data integrity and protect against unauthorized...
data pipelines for reliability| performance| and cost efficiency. Lead the adoption of cloud platforms such as AWS| Azure... with distributed data processing frameworks (Spark| PySpark| EMR| Databricks).Proficiency in building scalable pipelines using ETLELT...
. What will you do? Engineer and maintain scalable data pipelines and workflows using PySpark, AWS SageMaker, Airflow, JupyterHub, RunAI. Optimize... building data pipelines and APIs with Spark, Databricks, Airflow, SQL (Snowflake, Postgres), and NoSQL (MongoDB); experience...
data and engineer relevant features. Work effectively with fellow data scientists and engineers to develop data products... models such as GANs, VAEs, and transformers, and their practical applications. Experience with Azure and Databricks...
Pay Rate Range: $ 50.00- 51.47/hr. Role: Sr. Data Engineer Job Description: Senior Data Engineer (Databricks...-Focused) We are seeking a Senior Data Engineer with deep expertise in building scalable Lakehouse solutions using Databricks...
Azure Data Factory and Databricks Facilitate Agile project management as Scrum Master for cross-functional teams Develop... Services Cloud and Microsoft Azure services, including Databricks Previous experience within financial institutions...
applications, and SQL Server. This role is ideal for a technically strong developer or engineer who enjoys guiding... calculation, data aggregation, and analytics. Troubleshoot production issues, support stability, and ensure data integrity...
| Azure Data Factory| ADLS storage account| Azure DataBricks and DevOps. Experienced in creating data pipelines & developing...Pay Rate Range: $ 60.71- 62.50/hr. Role Title: Platform Engineer Job Description: Designing and developing data...
pipelines using Azure Data Factory| Databricks| and related services. Implement data storage solutions such as Azure Data Lake... architecture| data bricks Design| build| and maintain scalable data solutions on Microsoft Azure. Develop and manage data...
pipelines using Azure Data Factory| Databricks| and related services. Implement data storage solutions such as Azure Data Lake... architecture| data bricks Design| build| and maintain scalable data solutions on Microsoft Azure. Develop and manage data...
infrastructure, including Oracle, MS SQL, or Databricks. Proven expertise with cloud platforms, particularly Azure. Solid... into finalized designs. Evaluate platform options, including sizing, resiliency, disaster recovery, and data management...
tracing all data operations. Engineer additional features if needed, such as transactional data aggregation or trends... insights from data Experience working with GitHub Advanced python programming skills in Databricks including classes, modules...
, including: Microsoft OpenAI Azure AI Search Azure AI Translator Azure Machine Learning Azure Data Factory Azure Databricks...Pay Rate Range: $42.63-60.60/hr. Job Description: Cloud Engineer (AWS & Azure | AI/ML Platforms) Overview...
are: Azure Data Factory (good knowledge required) to maintain pipeline from Oracle to Azure Data Lake Azure Databricks/PySpark..., and Azure environments, using SSIS, SQLDeveloper, Azure Data Studio, Azure Data Factory, Databricks and other tools to develop...
Certified Data Engineer Associate Databricks Certified Professional Data Engineer Microsoft Certified: Azure Data Engineer..., Databricks and Azure Databricks pipelines Strong knowledge of Delta Lake for data management and optimization. Familiarity...
Lake, Databricks and Azure Databricks pipelines Strong knowledge of Delta Lake for data management and optimization...+ years of working with Azure Data Factory, Databricks and Python development Experience building data ingestion and change...
Role: Senior Data Architect / Platform Data Engineer Location: Toronto, Ontario (Hybrid, 2 Days Onsite) Duration: 10... in Azure Data Lake, Delta Lake, Azure DevOps, Git, and API testing tools like Postman. Strong proficiency in relational...