Tech lead - databricks engineering | dublin, ie
DublinThe Citco Group Limited
...ETL frameworks using Spark (Python/Scala). • Orchestrate complex workflows, applying CI/CD principles (Git-based version control, automated testing). • Implement Delta Live Tables or similar frameworks to handle real-time data ingestion and transformations. • Integrate with MLflow (if applicable) for experiment tracking [...]
Category IT & Telecommunications