Tech lead - databricks engineering | dublin, ie
DublinThe Citco Group Limited
...Data Pipeline & Workflow Management • Develop and maintain scalable, reusable ETL frameworks using Spark (Python/Scala). • Orchestrate complex workflows, applying CI/CD principles (Git-based version control, automated testing). • Implement Delta Live Tables or similar frameworks to handle real-time data ingestion and [...]
Category IT & Telecommunications