and optimize access to data on our Azure Databricks instances. Data Quality & Integrity: Monitor and ensure the quality, integrity... and Apache Airflow. Cloud Services: Experience with cloud-based data services (Azure), with knowledge of storage, compute...
Data Engineer with a strong background in Python, SQL, PySpark, Azure, Databricks, Synapse, Azure Data Lake, DevOps... with strong expertise in Databricks, Azure, DevOps, or other hyperscalers. 5+ years of experience with Azure DevOps, GitHub. Proven...
Spark, Scala, Python, Hive and databases Write complex, maintainable code to develop scalable data processing engines using... in large data sets, with hands-on technology skills to design and build robust big data solutions using Spark framework, Azure...