Big data engineer
Career outlook for big data engineer
Average UK salary
£57,200
Currently employed in Scotland
12,700
"LMI for All" supplies our salary and employment status information. "Oxford Economics" supplies job forecasts and employment figures. Due to COVID-19 the jobs market is constantly changing. Some of the information may not reflect the current situation.
What's it like?
There's over 2.5 quintillion bytes of data created every day. In this job, you'd develop software that collects and analyses large quantities of information.
Businesses can then use this to inform decisions or predict behaviour. It’s how websites like YouTube show you recommendations based on your past views and online behaviour.
You’d work to develop, maintain, test and evaluate big data solutions within organisations.
Your work would involve collaborating with data architects, data scientists and analysts. You’d make sure any solution meets the business needs.
What you might do:
- create and maintain complex computer systems that collect data
- programme software to process high volumes of important information
- design mathematical algorithms that simplify data analysis
- work with data architects, analysts and data scientists
- make sure the solutions you build meet all the business needs or requirements
You could work in a variety of industries, including:
- finance, including fintech (financial technology)
- IT
- retail
- sales and marketing
- healthcare
- manufacturing
- education
Working conditions
Hours
Environment
UK employment status
Full-time
91%
Part-time
4%
Self employed
5%
Search course options
Thinking about your future? There are lots of courses available that could interest you. Use our course search to explore course options.
Find coursesSearch job opportunities
If you're looking for your new career our job search can help you. Discover interesting opportunities and decide your next steps.
Find a jobTop skills
Here are some of the skills needed for this job. Sign in to see how your skills match up.
- Working with technology
- Problem solving
- Working with numbers
- Researching
- Attention to detail
- Analysing
Skills Explorer
Your skills can help you choose the career that's right for you. You can build your skills through work, study or activities you do in your spare time.
Our Skills Explorer tool will help you understand what skills you have and match them to jobs that might suit you.
Use the Skills Explorer toolGetting in
Entry requirements for courses can change. Always contact the college, university or training provider to check exactly what you'll need.
Foundation Apprenticeships
Choosing a Foundation Apprenticeship as one of your subjects in S5 and S6 can help you get a head start with this type of job.
You'll get an SCQF level 6 qualification (the same level as a Higher) plus valuable work placement experience and skills you can't learn in a classroom.
Interested? Find out what's on offer at your school on Apprenticeships.scot.
Qualifications
There are many ways to get qualified for this job. You could go to college, university or get work-based qualifications, like an apprenticeship.
Many big data engineers will a Higher National Diploma (HND) or degree in maths and technology fields such as:
- Computer/Data Science
- Computer Engineering
- Maths or maths related subjects
- Information Technology
Postgraduate data engineering courses are available. A background in a related field such as business, quantitative science or computing is helpful when applying.
Useful subjects
Useful subjects would be:
- computer science
- maths
- business
- economics
Helpful to have
Not all employers list specific qualifications they need. They they might ask for relevant experience, usually work based, that demonstrates a range of transferable skills.
You'd need to show up-to-date knowledge and experience of software and programming developments. It's also helpful to have this for many scripting languages.