Big Data Architecture and Management is available as a postgraduate-level subject offered by the International College of Management, Sydney (ICMS). Please click the button below to find a postgraduate course.
DAT801A
Specialisation
800
4 credit points
Given the increasing digitalisation, massive amounts of structured and unstructured data are generated across various sources. This phenomenon of constantly growing data that is extremely complex in structure is referred to as Big Data. Traditional databases are not suitable for efficient indexing, sorting, searching, analysing, and visualising of Big Data. To be able to use this data to gain deeper insights and, thus, leverage a competitive advantage, organisations need the competencies to manage Big Data and to apply Big Data technologies and techniques effectively.
This subject provides students with an introduction to Big Data, its 5-V characteristics (Volume, Velocity, Veracity, Variety, and Value), resulting challenges for organisations, and state-of-the-art technologies and techniques such as NoSQL, parallel and distributed memory systems, and streaming models. It introduces key concepts on how to create business value from Big Data and consequently empowers students to apply their Big Data expertise to develop business solutions.
In this subject, students will study Big Data not only from a theoretical or technical perspective, but they will also learn to master the challenges of Big Data in a complex business context. This includes studying architectures, systems, and management techniques.
a) Communicate knowledge about Big Data characteristics, challenges for traditional database systems, and state-of-the-art Big Data architectures and techniques to professional audiences.
b) Develop requirements and contextualise Big Data concepts to complex use cases.
c) Critically evaluate and select distributed storage and computation techniques to manage Big Data and draw value from it.
d) Design and implement a prototypical Big Data solution to a complex business problem by applying advanced data storage, processing, querying and analysis tools.
e) Plan and develop contemporary Big Data solution, critically analyse risks and opportunities, and effectively communicate recommendations to various stakeholders.
Learning outcomes for this subject are assessed using a range of assessment tasks as described in the table below.
No | Assessment task | Weighting | Subject learning outcomes to be assessed |
1 | Online Quiz (Invigilated) | 20% | a, b |
2 | Big Data Project (G) | a, b, c, d, e | |
Part A) Report | 20% | ||
Part B) Pitch | 20% | ||
3 | Big Data Prototype Solution | ||
Part A) Prototype | 25% | a, b, c, d, e | |
Part B) Video Presentation | 15% |
Week 1: Introduction to Big Data
|
Week 2: Tradition Databases vs. Big Data
|
Week 3: Enterprise Architecture Management and Big Data
|
Week 4: MapReduce Programming Model
|
Week 5: MapReduce Programming Model
|
Week 6: Hadoop Platform for Storing and Processing Big Data
|
Week 7: Spark Platform for Storing and Processing Big Data
|
Week 8: Data Streaming: Introduction
|
Week 9: Data Streaming: Sampling
|
Week 10: Processing Big Data with Scala
|
Week 11 Current Trends and Future Potentials of Big Data
|
Please note that these topics are often refined and subject to change so for up to date weekly topics and suggested reading resources, please refer to the Moodle subject page.