DVF are supporting a leading software company looking for a Data Engineer to join their Data Engineering team.
Key Responsibilities:
• Design, build, and maintain robust data pipelines using tools such as Databricks, Apache Spark, and Python.
• Develop and optimize ETL processes to ingest data from multiple sources into a central Lakehouse architecture.
• Collaborate with analysts, data engineers, and product teams to understand data requirements and deliver solutions that meet business needs.
• Implement data quality checks and monitoring systems to ensure accuracy, completeness, and consistency.
• Contribute to the design and evolution of the data architecture, ensuring scalability and performance.
• Support the integration of third-party data sources and APIs, including RESTful services and Azure-based solutions.
• Document data flows, schemas, and processes to support transparency and maintainability.
• Stay current with emerging technologies and best practices in data engineering and analytics.
• Undertake any other tasks as required, approaching each with care, collaboration, and the courage to drive positive change.
