Big data engineer
Work at the cutting edge of technology and maths and use your analytical skills to solve complex problems.
About the job
Salary
Source: LMI for All
Weekly
£1,100
Average
Monthly
£4,766
Average
Yearly
£57,200
Average
12,800
people are currently employed
High growth
700 more jobs in 5 years
These figures refer to this job and similar ones with comparable skills and qualifications. They only apply to Scotland. Source: Oxford Economics
What it's like
There's over 2.5 quintillion bytes of data created every day. In this job, you'd develop software that collects and analyses large quantities of information.
Businesses can then use this to inform decisions or predict behaviour. It’s how websites like YouTube show you recommendations based on your past views and online behaviour.
You’d work to develop, maintain, test and evaluate big data solutions within organisations.
Your work would involve collaborating with data architects, data scientists and analysts. You’d make sure any solution meets the business needs.
What you might do:
create and maintain complex computer systems that collect data
programme software to process high volumes of important information
design mathematical algorithms that simplify data analysis
work with data architects, analysts and data scientists
make sure the solutions you build meet all the business needs or requirements
You could work in a variety of industries, including:
finance, including fintech (financial technology)
IT
retail
sales and marketing
healthcare
manufacturing
education
Hours
Environment
Explore more information about this job
Here are some useful links to learn more about this career:
Like the sound of this career?
Browse courses in Scotland related to 'Big data engineer'
Select qualification level(s)
Other careers that you might like
Systems analyst Solution architect IT project analyst Infrastructure engineer Systems engineer Data visualisation specialist Internet-of-things architect Cloud services engineer Cyber security architect
Related industries
Many jobs can be done in lots of different industries. We've highlighted the ones we think are most important for this job.
Financial services Energy Digital technologies
Top skills
Skills are things you're good at. Whether you know what yours are or not, everyone has them!
It's useful to learn which ones are important in a job so you know the areas you need to brush up on. It can also help you work out if you're suited to a career.
Here are some of the skills you'll need to do this job:
- analysing
- attention to detail
- researching
- working with numbers
- problem solving
- working with technology
Your skills are important
Our unique skillsets are what make us stand out from the crowd. Learn about each skill in depth and discover what employers look for in your applications and interviews.
Getting in
Explore the sections shown for more information about getting into this career.
You might have qualifications which are not shown here but will allow you access to a course. You can compare your qualifications by looking at their SCQF Level. For more information about this, check out the SCQF website.
Always contact the college, university or training provider to check exactly what you'll need.
Colleges and universities will list subjects you'll need for entry to a course. Some useful subjects include:
Business Management
Economics
Mathematics
Statistics
Foundation Apprenticeship: Software Development
Applications of Mathematics
You can get a head start in this career by doing a Foundation Apprenticeship in S5 and S6.
You'll get an SCQF level 6 qualification which is the same level as a Higher. You'll also learn new skills and gain valuable experience in a work environment.
Discover what's on offer at your school on Apprenticeships.scot.
There are many ways to get qualified for this job. You could go to college, university or get work-based qualifications, like an apprenticeship.
Many big data engineers will a Higher National Diploma (HND) or degree in maths and technology fields such as:
Computer/Data Science
Computer Engineering
Maths or maths related subjects
Information Technology
Postgraduate data engineering courses are available. A background in a related field such as business, quantitative science or computing is helpful when applying.
Not all employers list specific qualifications they need. They they might ask for relevant experience, usually work based, that demonstrates a range of transferable skills.
You'd need to show up-to-date knowledge and experience of software and programming developments. It's also helpful to have this for many scripting languages.
Explore over 22,000 courses in Scotland
Find the perfect course to boost your career.
