Organizations use their data for decision support and to build data-intensive products and services. The collection of skills required by organizations to support these functions has been grouped under the term Data Science. This course will attempt to articulate the expected output of Data Scientists and then equip the students with the ability to deliver against these expectations. The assignments will involve web programming, statistics, and the ability to manipulate data sets with code.
Pre-requisites for this course include 61A, 61B, 61C and basic programming skills. Knowledge of Python will be useful for the assignments. Students will also be expected to run VirtualBox on their laptops for the assignments.
Please take the class survey here.
Plese set up your machine according to these instuctions.
|Class Date||Lecture Material||Reading||Assignments|
|M 1/27||L1: Introduction/Data Science Process [PPTX] [PDF]|
|M 2/3||L2: Data Preparation (w/Unix Shell Lab) [PPTX] [PDF]||Enterprise Data Analysis and Visualization: An Interview Study||
Bunny 1 by 5pm on 2/3
|M 2/10||L3: Tabular Data (w/Pandas Lab) [PPTX] [PDF]||From Databases to Dataspaces: A New Abstraction for Information Management
Schemaless SQL and Schema on Write vs. Schema on Read
Bunny 2 by 5pm on 2/10
|F 2/14||Homework 1 out. Due by 2/28|
|M 2/17||No class - President's Day|
|M 2/24||L4: Data Cleaning (w/Open Refine Lab) [PPTX] [PDF]||Lab 3|
|F 2/28||Homework 1 Due! Submit using glookup|
|M 3/3||L5: Part 1 - Guest Lecture: Josh Wills, Director of Data Science, Cloudera; followed by:
Part 2- Data Integration (w/Pandas) [PPTX] [PDF]
|WebTables: Exploring the Power of Tables on the Web (Sections 1,2 and 4; others optional)
and OpenRefine Data Augmentation (video)
Bunny 3 by 5pm;
Lab 4 | Responses
Final Project Group Lists Due Midnight
|M 3/10||L6: Exploratory Data Analysis (with Python lab)||Statistical Thinking in the Age of Big Data
Exploratory Data Analysis
From the O'Reilly Book "Doing Data Science" - available on campus or via the library VPN.
Introduction to Hypothesis Testing
|Bunny 4 by 5pm;
Final Project Proposals due Tues 3/11 Midnight.
|M 3/24||No Lecture: Spring Break|