80281 - Azure Data Engineer
This Azure Data Engineer will report to the Data Engineering Manager and will work within the Strategy Regulation and Support Services, Information Systems directorate based in our London, Crawley or Bury St Edmunds office. You will be a permanent employee.
You will attract a salary of £76,229.00 and a bonus of 3%. This role can also offer blended working after probationary period (6 months) - 3 days in the office and 2 remote
Close Date: 02/03/2025
We Also Provide The Following Additional Benefits
- 25 Days Annual Leave plus bank holidays.
- Reservist Leave – Additional 18 days full pay and 22 unpaid
- Personal Pension Plan – Personal contribution rates of 4% or 5% (UK Power Networks will make a corresponding contribution of 8% or 10%)
- Tenancy Loan Deposit Scheme, Season Ticket Loan
- Tax efficient benefits: Cycle to Work, Home & Tech, and Green Car Leasing Schemes
- Occupational Health support
- Switched On – scheme providing discount on hundreds of retailers’ products
- Discounted gym membership
- Employee Assistance Programme
Job Purpose
To satisfy our ambitious plans for growth in our information landscape we are looking for an experienced Azure Data Engineer. UK Power Networks is transforming the way it delivers value from data and is implementing an Azure Platform to help build that vision. You will work on multiple projects to bring important data-driven capability to all partners.
You will be one of the Technical Leads on our Azure data platform. You will have a solid approach to developing simple, reusable solutions that are scalable, using appropriate technologies and engineering best practices. You will inform the strategies required to utilise the Azure resources to drive value out of our information asset.
We are adopting open data concepts in information provision. This allows all partners to consume data using their own toolsets directly or with API’s. The development of this requirement will be an important part of this role.
You will be passionate about data, have a broad level of technical knowledge, and the ability to collaborate at all levels, working to ensure that data is managed in the Azure Platform for all areas of the business.
Dimensions
- No line management or budgetary accountabilities.
Principal Accountabilities
- You will play an important part in UK Power Networks strategy to take advantage of Cloud based data solutions and also consolidate the various data hubs around the organisation into a singular enterprise data solution which will improve the business’ storage and utilisation of it’s information asset.
- You will develop a data platform and by applying big data solutions to deliver insights across the business and developing solutions to retrieve information from multiple sources, build and improve distributed processing solutions along with designing data models and maintaining data quality.
- You will design solutions to transform ready data from difference source systems for use into analytical and visualisation processes.
- You will be tasked to guide through change and lead the journey on the Cloud utilising the resources of the Azure platforms technology solutions.
- You will be required to transition analytical datasets into automated load processes, to be surfaced and presented to end-user systems, collection endpoints, and reporting tools.
- You will utilise open data concepts to make information outputs consumable to all partners. This will include managing API’s.
- You will work with teams from directorates within the Business, understand their specific requirements, communicate with data scientists and analytical teams, and develop and find technical solutions.
- As well as using your excellent data engineering skills with a range of Azure data-related resources you'll engage with team members to advise, mentor and ensure best practice is always applied
- Lead the design, implementation, and continuous delivery of pipelines using distributed Azure based data technologies supporting data processing projects across batch and streaming datasets. Lead the development of a high-availability, and easily scalable data platform to be used enterprise wide
- Secure the platform and the stored data making sure users access only data necessary to them
Nature & Scope
You will be required to transition analytical datasets into automated load processes, to be surfaced and presented to end-user systems, collection endpoints, and reporting tools.
You will also support the configuration and deployment of the infrastructure architecture and help to configure the Azure resources that are used in the end to end information provision cycle.
The primary goal is to utilise the Azure platform resources through the deployment of optimised strategies and projects to cement UK Power Networks’ position as the leading UK DNO for safety, customer service and efficiency.
You will build relationships with senior partners throughout the business, several important external partners, strategic suppliers and contractors. The role therefore requires collaboration at all levels of the organisation.
It is our ambition to be regarded as an industry leader in the area of asset information. Above all, you will have the capability to lead with the vision to achieve this objective.
Qualifications & Experience
- Bachelor’s degree in computer science, information systems or a related study (or equivalent project-related experience).
- You will have experience in IT and / or data management, with skills in data and information system design.
- Experience implementing production level deployments at an enterprise scale on the Azure cloud platform
- Detailed specific experience of engineering solutions utilising the Azure data platform especially Azure Data Factory (ADF); Databricks and it’s Medallion Architecture; Azure Storage (inc Delta Lake Store); Azure SQL.
- Familiarity with data science concepts, and MDM, business intelligence, and data warehouse design and implementation techniques.
- In-depth experience designing and implementing data and information architectural solutions, utilising MS Azure platforms and applications especially Databricks and the use of a CI\CD methodology.
- Experience of open data concepts that manage the availability and accessibility of data using API’s amongst other methods, for partners to ingest information themselves.
- You will need an understanding of data modelling application, data structures, databases, data lakes, and data ingestion and transformation routines
- Experience in Architecting and building data pipelines for cloud data assets
- Proficiency working with structured, semi-structured and unstructured data sets including to include real time streaming data feeds
- Experienced in utilising agile methodology frameworks to provide solutions into the business.
- Experience within the Utilities and Electricity Distribution industries would be beneficial.
- The ability to work with our infrastructure and support partners
Key Behaviours & Competencies
- You will have experience communicating between technical and non-technical staff and suppliers.
- Experience in the concepts of design, data modelling and metadata.
- Ability to turn business problems into data design.
- Seek out opportunities to create change and to help people make informed decisions..
- Experience in making decisions using data.
- Evidence of developing long term strategic plans.
- Organisationally savvy, with an understanding of the enterprises political climate and how to navigate, influence and persuade.
- Ability to collaborate with peers and leadership.
- Understand the long-term ("big picture") and short-term perspectives of situations.
- Quickly comprehend the functions and capabilities of new technologies.
Health & Safety Responsibilities
Managers and supervisors carry both legal and company responsibilities for ensuring the health and safety of their employees, those under their control and those who might be affected by the work undertaken, i.e. public, visitors and employees of other organisations. This includes briefing individuals working for them and ensuring there is the necessary understanding, competence and application of requirements to work safely and without harming the environment.
Employees will ensure they understand the health and safety risks involved in their work activities and their responsibility to apply the controls needed to manage those risks to acceptable levels. Similarly where work activities can have an adverse impact upon the environment, and where there are legal requirements, employees will understand those impacts and the controls they must ensure are applied.
If in doubt ask!
We are committed to equal employment opportunity regardless of race, colour, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender, gender identity or expression, or veteran status. We are proud to be an equal opportunity workplace.
If you have any queries in connection to this vacancy or your application, please contact us at careers@ukpowernetworks.co.uk quoting the vacancy reference number and a member of the team will get in touch with you as soon as possible.
