COMP9313 Notices

Assignment 2 Marking details and inquires

Posted by Morty Al-Banna Tuesday 10 December 2019, 07:58:17 PM.

Dear All,

I will be releasing the detailed marking for assignment 2 tonight (after midnight) when there is less load on the mail server. in the detailed description you will be able to see the mark for each item in the marking scheme and who is the marker so that you can send any inquiry if needed.

I have released the total marks and feedback only since I didn't want to wait till midnight when some students might be sleeping and would appreciate the marking before the exam.

rest assured that all issues will be resolved and sorry if I have caused any inconvenience for some students.

best of luck...

Marks for Assignment2

Posted by Morty Al-Banna Tuesday 10 December 2019, 05:09:30 PM.

Dear All,

sorry for the delay...your Mark for assignment 2 is now available for viewing using 'Classrun' ( https://wiki.cse.unsw.edu.au/give/Classrun ). you'll find some comments as well under (assign2_feedback). the detailed marking will be released soon via e-mail.

regards,

Morty

Code development questions in the final exam

Posted by Morty Al-Banna Thursday 05 December 2019, 02:48:22 PM.

Dear All,

As I mentioned in the final lecture, in the final exam we won't ask you to develop a complete program. there might be some questions including/about snippets of code or pseudo code. You don't need to memorize code syntax. As long as you have done your assignments and the hands-on activities you will be more than qualified to answer these kind of questions.

best of luck to all...

Morty

Final call to participate in MyExeprience Survey

Posted by Morty Al-Banna Thursday 28 November 2019, 05:36:51 PM.

Dear All,

Thanks for the students who have participated in the MyExperience Survey and sorry for receiving multiple e-mails in this regards.

Your feedback is really valuable to us and it helps us improve. If you have not participated in the surveys yet, please if you may take some time to do so. Currently we still suffer of very low response rate.

You can participate through myUNSW or by clicking the link ( https://myexperience.unsw.edu.au/ ).

Please do so ASAP as the survey close today @ 23:59 .

thank you...

Reminder MyExpreience Survey

Posted by Morty Al-Banna Wednesday 27 November 2019, 07:35:51 PM.

Dear All,

Thanks for the students who have participated in the MyExperience Survey. We will appreciate it for the others who have not participated yet to take some time to participate in the survey as we still have very low response rate.

You can participate through myUNSW or by clicking the link ( https://myexperience.unsw.edu.au/ ).

Please do so ASAP as the survey close tomorrow (2019-11-28 23:59).

thank you..

Final exam

Posted by Morty Al-Banna Tuesday 26 November 2019, 12:09:05 PM.

Dear All,

please if you may login to the link below so that you can check your seat allocation in the final exam. use you zID and password in order to view your seat allocation. Arrive 15 minutes early on the day.

http://cgi.cse.unsw.edu.au/~cs9313/19T3/seating/final/register.cgi/allocations

if you have any question please feel free to schedule a consultation session. I'm available Wednesday, Thursday and Friday. send me an e-mail on m.al-banna@unsw.edu.au to set the meeting.

regards,

Quiz5 deadline extended

Posted by Morty Al-Banna Sunday 24 November 2019, 11:33:11 PM.

Dear all,

We have extended Quiz5 deadline. please submit your answer before 6:00 PM tomorrow.

best of luck

Quiz submission problem

Posted by Morty Al-Banna Wednesday 20 November 2019, 05:10:20 PM.

Dear All,

There seems to be a problem with the quiz module in WebCMS. I have already reported this to the developer. In the mean time you can use Google Chrome Browser to submit the quiz as it seems that this has worked for some other students.

<o:p></o:p>best of luck

Assignments 1 feedback related email

Posted by Maisie Badami Wednesday 20 November 2019, 01:25:51 PM.

Hi There

For a quicker and better respond to emails related to assignment 1 result, please make sure that you are emailing directly to the tutor who marked your assignment and make sure that your short email contains your Zid.

Thanks,

Maisie

Quiz5 is released

Posted by Morty Al-Banna Monday 18 November 2019, 01:06:48 AM.

Dear All,

Quiz5 is released in the activity section.

Best of luck,

Assignment 2 deadline extended

Posted by Morty Al-Banna Saturday 16 November 2019, 10:41:47 AM, last modified Monday 18 November 2019, 11:57:05 PM.

Dear All,

We have extended the deadline for Assignment 2 to be

Tuesday the 19th of November 2019 17:59

Thursday the 21st of November 2019 17:59

also and in order to manage the marking for assignment 2 a bit early, the late penalty is now:

20% reduction of your marks for the 1st day, 40% reduction/day for the following days

Best of luck to all...

Elasticsearch tutorial material

Posted by Maisie Badami Thursday 14 November 2019, 03:58:23 PM.

Hi There

Please find the following material for the Elasticsearch tutorial session this afternoon (14/11/2019 at 6:00 pm)

1.Open Eclipse: If you use the lab computer, you can find it in

Applications Menu -> Development -> Eclipse.

2.Choose a workspace (which is a workspace for your project)

3.Please check the Maven: If Maven plugin is not installed in Eclipse, you can install it

• from using Eclipse Marketplace (skip the steps in bullets if Maven is already installed and go directly to step 4)
• Go to Help > Install New Software
• Paste the Marketplace Client update site URL into the “Work with” field:

http://download.eclipse.org/mpc/photon

• Select the “EPP Marketplace Client” checkbox
• Follow the wizard and restart your Eclipse to finish the installation.

4.Start a new project, choose a Maven project

All the best

Maisie

Assignment 2 - Frequent Questions

Posted by Maisie Badami Saturday 09 November 2019, 05:42:40 PM.

Hi There

These are some of the most asked questions in the forum about assignment 2 , hope these answers can clear some of the confusions:

1. Please note that you don't need to save the output of your code into a file with a specific name, the default name is fine( e.g., part-00000)

2. We will not test your program on a huge dataset , so you don't need to spend time on the performance of your code on huge dataset

3. You can use temp files to collect RDD 's results and use it in the next one.

Best of luck

Maisie

Assignment 2 released

Posted by Morty Al-Banna Saturday 02 November 2019, 09:34:43 PM.

Dear All,

Assignment 2 specifications are released now in the Assignments subsection

best of luck to all...

Quiz 4 deadline

Posted by Morty Al-Banna Wednesday 30 October 2019, 12:33:46 PM.

Dear All,

it seems that by mistake I've put the deadline of Quiz4 to be 8AM while it should be 8PM. the quiz is opened now if you want to submit your answer.

regards

Assignment 1 deadline extended

Posted by Morty Al-Banna Monday 28 October 2019, 12:17:39 PM.

Dear All,

We have extended the deadline for Assignment 1 to be

Tuesday the 29th of October 2019 17:59

Best of luck to all...

Quiz 4 released

Posted by Morty Al-Banna Friday 25 October 2019, 01:10:19 PM.

Dear All,

Quiz 4 is released in the actvitvy section.

regards

Use of Writables in Assignment 1

Posted by Mehmet Rad Thursday 24 October 2019, 04:20:39 PM, last modified Thursday 24 October 2019, 05:02:47 PM.

Here is the clarification about how you will be marked regarding custom writables:

• Use of ArrayWritables is optional as long as it is used for keeping a list of writable objects (do not use it for keeping a pair (movie, movie), or a triple (user, rating, rating).
• Use of MapWritable or Text to keep complex objects or list of objects will result in loss of marks: (e.g., do not use text like new Text("User"+","+Rating_1 + ","+ Rating_2))
• It is up to you (and part of assessment) to implement custom writables in an efficient manner (with minimal memory wasting)

Deadline for Assignment 1 change

Posted by Morty Al-Banna Tuesday 22 October 2019, 12:45:48 PM.

Dear All,

it came to our attention that some students tend to stay in CSE labs right up to the deadlines and hence it might cause these students to leave campus after midnight. This can make things less convenient and safe.

for Assignment 1 please be advised that the new deadline is now

Monday 28th of October 2019, 17:59.

Best regards,

Quiz 3 released

Posted by Morty Al-Banna Friday 18 October 2019, 02:02:50 AM.

Dear All,

Quiz 3 is released in the actvitvy section

Best of luck

Google Cloud credit Coupons

Posted by Morty Al-Banna Thursday 17 October 2019, 02:52:48 PM, last modified Friday 18 October 2019, 01:24:17 AM.

Dear All,

Here is the URL you will need to access in order to request a Google Cloud Platform coupon. You will be asked to provide your school email address and name. An email will be sent to you to confirm these details before a coupon is sent to you.

Student Coupon Retrieval Link <o:p></o:p>

• You will be asked for a name and email address, which needs to match the domain. A confirmation email will be sent to you with a coupon code.
• You can request a coupon from the URL and redeem it until: 1/15/2020
• Coupon valid through: 9/15/2020
• You can only request ONE code per unique email address.

Try to acvtivate your account before the lecture if you want to follow up with the activity today.

Please contact me if you have any questions or issues.

Thanks,

The marking scheme for assignment 1

Posted by Maisie Badami Wednesday 16 October 2019, 05:01:43 PM, last modified Wednesday 16 October 2019, 08:41:12 PM.

Hello all,

Please find the marking scheme for assignment #1 as below :

Regards

Maisie

A couple of notes to consider:

• The documentation needs to be written in one paragraph ( max of 300 words), this paragraph should be located at the beginning of the code as a commentary. The documentation is to address how the problem been addressed and solved, please avoid repeating general concept of coding ( such as what is a mapper or a reducer in general), try to be descriptive and explain your code.
• Please avoid hard-coding the input and output path of your in your code.

Assignment-1 Disk Issues

Posted by Mehmet Rad Monday 14 October 2019, 07:26:58 PM.

Dear all,

If you are facing any disk quote issue, please cut the dataset when you are testing.

For example, in linux you can only keep first 1000 rows:
$ head -n 1000 dataset.txt  > new_dataset.txt

You can also manually create a fake dataset to test your code on instead of the large dataset.

Cheers,

Assignment 1 released

Posted by Morty Al-Banna Friday 11 October 2019, 10:59:03 PM.

Dear all,

assignment 1 specification is released.

Best of luck...

Quiz 2 released

Posted by Morty Al-Banna Monday 07 October 2019, 01:48:42 AM.

Dear all,

Quiz 2 is release in the activity section

best of luck

Lab #1 guideline for week 4 is released.

Posted by Maisie Badami Friday 04 October 2019, 08:11:34 AM.

Hi All,

Lab guideline for week 4 is now available under Labs --> week 4

Good luck

Maisie

Hands-on activity in tomorrow lecture time

Posted by Morty Al-Banna Wednesday 02 October 2019, 05:43:26 PM, last modified Wednesday 02 October 2019, 06:06:55 PM.

Dear All,

tomorrow (Thursday lecture time) We are going to have a hands-on activity about Hadoop. Try to bring your laptops with you in order to be able to participate and walk-through the activity yourself. Due to the large number of students we'll try to keep the activity going within the time limit of the lecture and you are at liberty to carry-on and ask for support on the labs that are starting Week4. You can also utilize WebCMS forum for questions.

P.S. for students enrolled in Web streaming the lecture is recorded as usual and we'll release the document as well so that you can do the activity on your own time and/or come to the labs for support and debugging.

regards,

Morty

Java refresher additional session

Posted by Morty Al-Banna Monday 30 September 2019, 10:44:52 PM.

Dear All,

as both the remaining lab sessions for Java refreshing are fully booked so I want to gauge how many people are interested and didn't have the chance to participate/reserve a spot in one the sessions. if you are not interested in this, then stop reading and just ignore this announcement.

if you are interested, please participate in the Poll ( https://webcms3.cse.unsw.edu.au/COMP9313/19T3/activities/polls/1191 ) and indicate this. please be advised that the material presented would be the same for the other sessions.

regards,

Morty

Java labs enrolment lists

Posted by Maisie Badami Monday 30 September 2019, 04:15:46 PM, last modified Monday 30 September 2019, 04:31:04 PM.

Hi There

Please look up your name or zid from the following list and just attend in the lab that you are allocated to

Please note that no changes would be possible in terms of swapping the days.

Best,

Maisie

Java lab Tuesday session :

Java Lab Wednesday session :

The Java lab enrolment is now closed

Posted by Maisie Badami Monday 30 September 2019, 02:20:16 PM.

Hi All

Thanks all for showing interest for attending the Java refresher labs, now we reached the 50 enrolments and can't enrol more. We may set up another session, if we find that there are more students interested, although this depends on the approval from the school, so stay tune.

Please do not send further email regarding to the previous announcement, as the emails won't be attended.

The attendees list will be posted here shortly

Thanks

Maisie

Java labs this week

Posted by Maisie Badami Monday 30 September 2019, 10:12:09 AM, last modified Monday 30 September 2019, 10:48:33 AM.

Dear All,

Due to the high attendance in the first round of our Java refresher lab, we decided to take enrollment for who are interested in attending the next two sessions on the following dates. Each lab is limited to 25 ppl, first-in-first served, please note that the content of the labs are the same and you don't need to attend all the sessions.

Please email me on m.badami@unsw.edu.au , with your full name and zID , the first 25 emails will attend the Tuesday session and second 25 will attend the Wednesday session.

I will annonce here when we reach the 50 emails.

Tue 01/10/2019 14:00 16:00 Kora

Wed 02/10/2019 14:00 16:00 Drum

Thanks,

Maisie

Quize 1 released

Posted by Morty Al-Banna Friday 27 September 2019, 11:38:27 PM.

Dear all,

Quiz 1 is released in the activity section ( https://webcms3.cse.unsw.edu.au/COMP9313/19T3/activities/ )

have a nice weekened...

Java for Big Data Labs

Posted by Morty Al-Banna Wednesday 25 September 2019, 02:47:11 AM.

Dear All,

for those who are interested in refreshing their Java Knowledge we will be running three labs for this purpose.

Thu 26/09/2019 16:00 to 18:00 Sitar

Tue 01/10/2019 14:00 16:00 Kora

Wed 02/10/2019 14:00 16:00 Drum

Please be advised that as COMP9313 is not a programming language learning course so these labs are meant for refreshing your knowledge and provide support if needed.

in Week 4 we start with Labs and activities about Hadoop.

best regards,

Morty

Welcome to COMP9313

Posted by Morty Al-Banna Monday 16 September 2019, 02:23:12 AM.

Dear All,

Welcome to COMP9313 (Big Data Management). Please be advised that for Week 1 there are no Labs.

You can make use of the time to refresh your Java Knowledge as we are going to rely on it as the programming language of choice. here are some useful tutorials:

if you are a beginner or need a quick revision then these two are useful

https://www.codecademy.com/learn/learn-java

https://www.sololearn.com/Course/Java/

then you can advance further by learning by doing with this one:

https://www.udemy.com/course/practice-java-by-building-projects/

Looking forward to seeing you in the first lecture on Tuesday...

regards,

Morty