Big data engineer

Bookmark
Computing and ICT
Discover

Career outlook for big data engineer

Average UK salary

£57,200

Currently employed in Scotland

12,700

"LMI for All" supplies our salary and employment status information. "Oxford Economics" supplies job forecasts and employment figures. Due to COVID-19 the jobs market is constantly changing. Some of the information may not reflect the current situation.

What's it like?

There's over 2.5 quintillion bytes of data created every day. In this job, you'd develop software that collects and analyses large quantities of information.

Businesses can then use this to inform decisions or predict behaviour. It’s how websites like YouTube show you recommendations based on your past views and online behaviour.

You’d work to develop, maintain, test and evaluate big data solutions within organisations.

Your work would involve collaborating with data architects, data scientists and analysts. You’d make sure any solution meets the business needs.

What you might do:

  • create and maintain complex computer systems that collect data
  • programme software to process high volumes of important information
  • design mathematical algorithms that simplify data analysis
  • work with data architects, analysts and data scientists
  • make sure the solutions you build meet all the business needs or requirements

You could work in a variety of industries, including:

  • finance, including fintech (financial technology)
  • IT
  • retail
  • sales and marketing
  • healthcare
  • manufacturing
  • education

Working conditions

Hours

Working hours can vary, but usually full-time hours will be 9am-5pm, Monday to Friday. Some jobs or projects might require you to work longer hours or weekends.

Environment

You will usually be office based and working at a computer most of the time.

UK employment status

Full-time

91%

Part-time

4%

Self employed

5%

Search course options

Thinking about your future? There are lots of courses available that could interest you. Use our course search to explore course options.

Find courses

Search job opportunities

If you're looking for your new career our job search can help you. Discover interesting opportunities and decide your next steps.

Find a job

Here are some of the skills needed for this job. Sign in to see how your skills match up.

  • Working with technology
  • Problem solving
  • Working with numbers
  • Researching
  • Attention to detail
  • Analysing

Skills Explorer

Your skills can help you choose the career that's right for you. You can build your skills through work, study or activities you do in your spare time.

Our Skills Explorer tool will help you understand what skills you have and match them to jobs that might suit you.

Use the Skills Explorer tool

Getting in

Entry requirements for courses can change. Always contact the college, university or training provider to check exactly what you'll need.

Foundation Apprenticeships

Choosing a Foundation Apprenticeship as one of your subjects in S5 and S6 can help you get a head start with this type of job.

You'll get an SCQF level 6 qualification (the same level as a Higher) plus valuable work placement experience and skills you can't learn in a classroom.

Interested? Find out what's on offer at your school on Apprenticeships.scot.

Qualifications

There are many ways to get qualified for this job. You could go to college, university or get work-based qualifications, like an apprenticeship.

Many big data engineers will a Higher National Diploma (HND) or degree in maths and technology fields such as:

  • Computer/Data Science
  • Computer Engineering
  • Maths or maths related subjects
  • Information Technology

Postgraduate data engineering courses are available. A background in a related field such as business, quantitative science or computing is helpful when applying.

Useful subjects

Useful subjects would be:

  • computer science

  • maths

  • business

  • economics

Helpful to have

Not all employers list specific qualifications they need. They they might ask for relevant experience, usually work based, that demonstrates a range of transferable skills.

You'd need to show up-to-date knowledge and experience of software and programming developments. It's also helpful to have this for many scripting languages.