Putting data at the heart of the country’s challenges

At DWP Digital, you’ll work with skilled, knowledgeable colleagues from a range of different backgrounds. You’ll use your skills to help identify and reduce fraud, maintain and improve system performance, and help data scientists access the right data.

Data is at the heart of how we’re solving some of the country’s biggest digital challenges. And we work with some of the biggest and richest data in the UK. We hold data for more than 20 million customers, with billions of records.

Our data warehouse has over 230 terabytes of data. We deliver data-driven intelligence, products and services that enhance our services and make a real difference to our customers’ lives.

Innovation is at the core of our data strategy. We’re exploring the ethical use of machine learning and automation to predict, make decisions, and initiate activity based on our customers’ needs.

Our work enables DWP to make data-driven decisions based on the outcomes of our analysis. It’s an important role that helps shape DWP policy, and has a real impact on millions of people across the UK.

You’ll have the opportunity to work on large-scale projects like Universal Credit DataWorks – a common data infrastructure platform used across DWP. And you can take part in inspirational, cross-organisational events, such as DataJam and Hack the North.

We currently work in a Hortonworks ecosystem, using big data platforms such as Hadoop and Hive. But we’re soon moving to a Cloudera platform, using new technologies such as Apache Spark and Kafka.

Having tested a data science sandbox environment, which allowed us to use open source tools such as R and Python with DWP data in a secure way, we’ve moved to containerisation technology to help us deliver our data projects. This has enabled us to use tools that support techniques like Natural Language Processing.

Our data community

Our chief data officer and head of practice show how we use data and analytics to understand the issues that the UK is currently facing.

Data with power

Jacqui Leggetter, head of integration explains how data is at the heart of everything we do in DWP Digital.

What does a data engineer do?

Everything you need to know about data engineering.