Job Details
Salary: Competitive
Hours: 37.5 per week, Mon - Fri
Location: Crawley, West Sussex - three days per week
Contract: Permanent
Closing Date: 29 April 2024
In a nutshell
At Virgin Atlantic Airways, we believe that everyone can take on the world, and it's our vision to become the most loved travel company. As we embark on this next exciting stage of our journey, we're harnessing our spirit of entrepreneurship and innovation to challenge the status quo.
We're looking for a Data Engineer to join our growing AI and Data team.
This role primarily develops and maintains ETL codebases for efficient data extraction and processing from various systems, involving maintaining databases, ensuring data completeness, and collaborating with cross-functional teams on master data management.
You will be involved in liaising with stakeholders, ensuring seamless data flow, and communicating effectively to resolve data-related issues.
Day to day
Some of your key responsibilities as our Data Engineer will be:
- Following and applying data processing and architecture guidelines, best practices, and standards set by senior data engineers and the Data & AI management team, to develop and maintain ETL codebases for extracting data from operational and analytical systems.
- Assisting in the maintenance of databases, ensuring required uptime for reporting and ad-hoc modelling needs.
- Supporting in identifying and scoping internal and external data sources for inclusion within POC and BAU data assets.
- Implementing and maintaining auditable data cleansing routines, following guidelines and standards, and documenting manipulations performed on raw data to ensure data integrity and compliance. Assisting in the development and execution of regular monitoring routines, to measure data processing performance, data completeness, and identify anomalies.
- Collaborating closely with Data Product Managers, Governance, Business Intelligence & Reporting teams, and Technology to support master data management processes, ensuring reference data completeness and consistency across data sources.
- Following the established best practices for codebase maintenance on the platform, ensuring proper versioning, documentation, and collaboration across functions.
- Assisting in the implementation and maintenance of CI/CD pipelines and automated deployment processes, supplying to the streamlined development lifecycle and integration of data processing components.
- Providing clear and timely updates on the status of data sources to senior data engineers and relevant collaborators, and participate in root cause analysis (RCA) when failures occur, implementing the preventive measures as advised by senior data engineers.
About you
In addition to the above, we are looking for our successful candidate to demonstrate the following:
- Bachelors/Masters degree in a relevant subject or 3+ years experience in an enterprise setting.
- Understanding of ETL processes, pipeline monitoring, DevOps, and API frameworks
- Proficiency in Python and SQL and data modeling
- Knowledge of Azure services (ADF, ADLS, Synapse, Functions, MQ etc) and other cloud technologies: Databricks, Kubernetes beneficial
- Proven problem-solving, analytical skills, and numerical aptitude
- Highly curious about the business with excellent communication and collaboration abilities
If this sounds like you, and you would like to be on this exciting journey with us, we would love to hear from you!
Be yourself
Our customers come from all walks of life and so do our colleagues. That's why we're proud to be an equal opportunity employer and actively encourage applications from all backgrounds. At Virgin Atlantic, we believe everyone can take on the world - no matter your age, gender, gender identity, gender expression, ethnicity, sexual orientation, disabilities, religion, or beliefs. We celebrate difference and everything that makes our colleagues unique by upholding an inclusive environment in which we can all thrive. So that everyone at Virgin Atlantic can be themselves and know they belong.
To make your journey with us accessible and individual to you, we encourage you to let us know if you'd like a little extra help with your application, or if you have any individual requirements at any stage along your recruitment journey. We are here to support you, so please reach out to our team, ([email protected]) feeling confident that we've got your individual considerations covered.