, Databricks). Develop maintainable ETL pipelines using PySpark following coding guidelines. Perform data model development... and versioning. Work with Azure cloud infrastructure: Data Factory, Data Lake, Databricks. Develop and monitor schema and data...
events) and fintech data (transactions, payment flows, KYC records) Support Databricks workloads where required for large... and PySpark Azure storage and security concepts NICE-TO-HAVE Experience with real-time streaming for telecom or payment data...
Data Engineer with strong expertise in Microsoft Azure, solid knowledge of machine learning, experience with modern... Spark and PySpark built with object-oriented programming principles. Load and process data from Azure Data Lake...