• Submission of Final Exam

    Posted by Yifang Sun Thursday 20 August 2020, 08:56:14 AM.

    Hi all,

    There are 3 hours left for the exam and we have received 272 submissions so far. If you have not yet submitted a file, please do it right now to make sure the give system works for you.

    NOTE: you can submit multiple times but only the last one will be stored and marked.Good luck!


  • Responds to the Requests of Clarifying Final Exam Questions

    Posted by Yifang Sun Wednesday 19 August 2020, 07:18:37 PM.

    We've received a number of requests for clarifying the exam questions. I have listed the clarifications from my side below, to save your time on reading those posts:

    1. code can be given as screenshot or typed in the pdf

    2. Q4, by saying "You cannot inject SQL statements in your code.", we mean that you cannot use SparkSession.sql().

    3. Q5.3 has the same assumption as 5.2, e.g., "If an instance is processed by one classifier multiple times (e.g., multiple epochs while training the classifier), count it as one time."

    4. For all the other questions, I feel there is no need for further clarification.

    5. If you think an exam question is ambiguous, you can write down your interpretation and answer the question based on it (of course some interpretations will be considered incorrect during marking, hence most likely the answer will be incorrect as well). You can even list all the interpretations and offer corresponding answers. We will ignore those incorrect interpretations if we found the right one.

    For example, some students asked that in Q2.1, if a student has 3 records which are 100, 100 and 99, should the highest two be (100, 100), (100, 99) or (100,). You can write 3 different answers based on your different interpretations, and if they include the correct answer, you will still get full marks for this question.

    6. I will update you with new notices if needed.

    PS: If you have not started yet, it's about the time. Remember to try making a submission to test if give works fine for you. Good luck!


  • Erratum of Final Exam Q3

    Posted by Yifang Sun Wednesday 19 August 2020, 03:23:14 PM, last modified Wednesday 19 August 2020, 03:23:31 PM.

    In Q3.2, line 3, "what is the maximum ..." should be "what is the minimum...".

    I've updated the exam paper accordingly.


  • Another Erratum of Final Exam Q2

    Posted by Yifang Sun Wednesday 19 August 2020, 02:06:09 PM.

    In Q2, line 10, "e.g., ("z3212321", (93))" should be "e.g., ("z3212321", (93,))".

    I've updated the exam paper accordingly.


  • Erratum of Final Exam Q2

    Posted by Yifang Sun Wednesday 19 August 2020, 01:18:39 PM.

    In Q2, line 7, "i.e., score .combineByKey(createCombiner, mergeValue, mergeCombiners)" should be "i.e., student_record .combineByKey(createCombiner, mergeValue, mergeCombiners)".

    I've updated the exam paper accordingly.


  • Notice of Exam Rehearsal

    Posted by Yifang Sun Thursday 13 August 2020, 05:05:28 PM.

    Hi all,

    The exam rehearsal is open now. You can find the instruction page, sample exam questions (they are the same as I released before), and the submission page under Exams -> Sample Exam (Rehearsal). The main purpose of this rehearsal is to test the give system and the forums in WebCMS3.

    I've set the size limitation of the submitted file to be 10MB. This will also be the case in the real final exam. Please make sure that your answers to at least 7 questions can be put in such a PDF file with clear enough resolution. I strongly suggest you to do so especially when you want to use a scanner or take a photo of your answer sheet.

    I'll release a list of submissions that I've got from the exam rehearsal, after the deadline of this exam rehearsal (which is Saturday noon). So you can double-check if you have successfully submitted or not.

    If you have any questions regarding the exam rehearsal please leave your question in the WebCMS Forums, as we are going to use it during the final exam too.

    Best Regards,


  • Information of the Final Exam

    Posted by Yifang Sun Sunday 09 August 2020, 09:19:35 PM, last modified Sunday 09 August 2020, 11:16:57 PM.

    Hi all,

    Below is the information regarding the final exam this term.


    The final exam is scheduled on Wednesday 19 August 2020。

    The exam must be started and completed between 11:59:59am 19th August 2020 - 11:59:59am 20th August 2020, Australian Eastern Standard Time (AEST).


    As soon as possible, please read all of this notice carefully and post any questions in Piazza. Make sure you:

    • know where to find the exam download link on the course WebCMS page
    • have successfully tested the method you will use to create your PDF submission file
    • know how to submit via give


    The exam materials can be downloaded from course WebCMS page ( from 11:59:59am 19th August and for the duration of the exam. Make sure you are familiar with this location before the exam start time.

    Submission of your solutions will be upload via give. You can submit at any time after the start time for the duration of the exam. Multiple submissions will be allowed. You should do a trial submission well before the deadline to test that your actual submission can be accepted. Late submissions, i.e., after the duration of the exam is completed, will receive a mark of zero.


    The exam is designed as a 3 hours exam but has been scheduled for 24 hours to cater for students in different zones and/or with poor internet connectivity. You are assumed to spend at most 3-hrs on the exam. In case of any last minute system/internet issues, you are strongly advised to start the exam early and do not submit the exam last minute. In any case, the submission will be closed at 11:59:59am 20th August 2020 (AEST) and no late submissions will be accepted.


    The questions will be a mix of short answers and problem-solving. The format will be similar to those in the assignment and sample exam.


    Detailed instructions on how you should complete each question will be in the paper. The exam is "open-book". This means you are free to access lecture notes, tutorials, labs, books, and Internet resources. However, DISCUSSING THE EXAM WITH OTHER PERSONS, INCLUDING OTHER STUDENTS, IS STRICTLY PROHIBITED AND WILL RESULT IN A FAILING GRADE AND POTENTIAL FURTHER DISCIPLINARY ACTION .

    The exam will be marked by humans. Therefore it is essential that your answers are clearly written and on point. As in a traditional written exam, you must show your work for all questions. You will receive no marks for just having the final answer in a computation question.

    It is up to you how to prepare the PDF file with all your written answers that you will submit. One approach would be to take (very clear) pictures of your working on paper, and paste into a Word doc then save as PDF. Another could be to use a text editor to write a LaTeX file and render it to PDF. You should also ensure that when captured as PDF the answers remain clear. No marks will be given for answers that are illegible (impossible to read by markers). It is strongly recommended that you do a trial run of this process before the day of the exam, for example by preparing a PDF of your written answers to the sample exam.


    The final exam forum (on course WebCMS page) will be actively monitored by course staff from the start time for the duration of the exam. If you require clarification on a question or if there are technical issues then please ask your question there or notify the course staff. Do not email questions to the course staff.

    DO NOT POST SOLUTIONS, OR QUESTIONS ABOUT SOLUTIONS, OR REQUESTS FOR HELP WITH SOLUTIONS, ON THE FORUM . Anyone found doing so will have their posts deleted and strong disciplinary action will be taken.

    If during the course of the exam you think there may be an error in the exam paper please post on the forum as accurate a description as possible of the issue. The course staff monitoring the forum will address the issue. Same as normal exam papers, this exam has been checked by at least one other staff member. Therefore, the usual answer to the questions would be "the question is as it is written". We're not expecting it to be any different in this exam. If an error is found then the course staff will post the appropriate corrections on the forum, so please check there first if you find an error before posting yourself.

    Note that between 11pm 19 August and 8am 20 August AEST, there will be **NO** course staff there to address the issues. Although the forum will still be actively monitored.


    By sitting or submitting an assessment on the scheduled assessment date, you are declaring that you are fit to do so and cannot later apply for Special Consideration. If, during an exam you feel unwell to the point that you cannot continue with the exam, you should take the following steps:

    • Stop working on the exam and take note of the time
    • Make contact immediately with the course staff via the forum and advise them that you are unwell
    • Immediately submit a Special Consideration application saying that you felt ill during the exam and were unable to continue
    • If you were able to advise the course staff of the illness during the assessment, attach screenshots of this conversation to the Special Consideration application


    If you experience a technical issue during the exam, you should take the following steps:

    • Take screenshots of as many of the following as possible:
    • error messages
    • timestamped speed tests
    • screen not loading
    • power outage maps

    Contact should be made immediately with the course staff on the forum to advise them of the issue.

    A Special Consideration application should be submitted immediately after the conclusion of the exam, along with the appropriate screenshots.


    Once you have answered all the questions your submission will consist of a PDF file with all your written answers.

    The command to submit will be:

    give cs9313 exam 9313_final.pdf

    You can submit either via the web interface to give, or by logging in to CSE servers, copying your submission files to your home directory, and running give at the command-line.

    Give submission will be available from the exam start time and for the duration of the exam.


    Note that any applications for Special Consideration must follow the standard university procedure, and not go to the course staff.


    There will be a rehearsal of the final exam. The purpose of the rehearsal is to help you get familiar with the online final exam and identify any potential issues before the actual final exam. While the time of the rehearsal will be posted in WebCMS and Piazza, you can expect it between 12 August to 14 August.

  • Welcome and Course Website

    Posted by Yifang Sun Monday 25 May 2020, 02:54:30 PM, last modified Tuesday 26 May 2020, 01:24:52 PM.

    Welcome to COMP9313.

    Please visit the course website ( ) for all the announcements, slides, assignments, projects and labs. We will NOT use WebCMS3.

    Please don't comment or post in forums here. We will use Piazza as the course forums.

    Also please note that due to the COVID-19 situation, we will be running all course activities online.

Back to top

COMP9313 20T2 (Big Data Management) is powered by WebCMS3
CRICOS Provider No. 00098G