Big Data Management COMP9313 23T3

MyExperience and Week 10 Arrangement

Posted by Xiaoyang Wang Friday 10 November 2023, 01:58:21 PM, last modified Tuesday 14 November 2023, 09:20:22 AM.

Hello Class,

We are approaching the last week. Some things here:

• Fill in the MyExperience survey please and help us improve the course. As advertised, if the response rate from the class hits more than 50.0%, everybody gets 1 mark added to the final mark :-)
• Week 10 Tuesday: We will have a guest lecture about distributed graph processing (around 40-50 mins).
• Week 10 Thursday: We will revisit the course and talk about the final exam, including the number of questions and sample questions, etc

Best regards,

Xiaoyang

Virtual machine image and Lab 1

Posted by Xin Cao Monday 11 September 2023, 05:48:44 PM.

Dear All,

Our first lab will start on Tuesday in Week 1. If your OS is Windows, you will need to use the virtual machine (VirtualBox or VMware). The VM image can be downloaded at:

https://drive.google.com/file/d/1ymUkS422jiNnEKU2witPb2fIL8wf6eME/view ,

or

https://mega.nz/file/SqIz1Jpb#Ay5ioC4EkiQgZVuVYDUL6hfO2LiBvsJxjTXX1qAnxrg .

Please download the image asap and let me know if there is any problem with downloading the image. Another option is that you can download the Ubuntu OS and VirtualBox from the official website, and then install Ubuntu 22.04 in VirtualBox by yourself.

Please watch out if you have enough memory in your host OS. You can decrease the memory allocated to the VM from 8G to 4G. Otherwise, you may encounter some errors.

If your OS is Linux or Mac, you can install and configure Hadoop on your own laptop directly by following the lab instructions.

This term we will also use Ed to do lab coding activities, in which you can start a VM with pre-installed Hadoop and Spark within the browser. Thus, you do not need to worry if you fail to install Hadoop on your own computer, since you can also use Ed instead.

Regards,

Xin

Welcome to COMP9313

Posted by Xin Cao Monday 11 September 2023, 12:35:19 AM, last modified Monday 11 September 2023, 01:01:12 AM.

Dear COMP9313 Students,

Welcome to COMP9313! Please see " Course Outline " in the left panel .

The course will still be delivered both online and offline in T3. Our first lecture is on Tuesday in Week 1. Note that the first lab also starts in Week 1. You will need to set up the Hadoop working environment either using a virtual machine or on your own laptop in the first lab.

We are also going to use Ed for discussion and doing lab activities. Please join Ed using this link: https://edstem.org/au/join/AWmh5D .

I look forward to seeing you all soon.

Regards,

Xin