Applied Data Science - Decision-making beyond Prediction / Fall 2022
Updates
- 11/25 -- New Lecture is up: Lecture 20 - Course conclusion [recording]
- 11/25 -- New Lecture is up: Project work day
- 11/25 -- New Lecture is up: Lecture 19 - Discrimination in Platforms [slides] [recording]
- 11/13 -- New Lecture is up: Lecture 18 - Limits to prediction [slides] [recording]
- 11/05 -- New Lecture is up: Lecture 16 - Project description and game theory [slides]
- 10/29 -- New Lecture is up: Lecture 17 - Differential Privacy [slides] [recording]
- 10/14 -- New Lecture is up: Lecture 15 - Experimentation conclusion [slides] [recording]
Course Description
This course considers the data science challenges beyond training an accurate predictive model, especially for systems about people (data of behavior), and for people (deployed models to influence behavior). Whether for online marketplaces, transportation, governmental, or urban systems, effective data science in such settings requires dealing with user incentives and strategic behavior, networked and decentralized decision-making, and privacy and ethics concerns.
Important links
- Course website
- Canvas
- Ed Discussion – Primary communication tool
- Gradescope – Place to turn in all assignments
- Calendar – Class google calendar with lectures, OHs
- YouTube – Lecture recordings from last year
Course topics
- Data collection (~3 weeks)
- Data constructs, surveys, ratings, polling, and implicit data exhausts
- Challenges and biases: censoring, strategic reporting, social desirability, ratings inflation, privacy, etc
- Technical solutions to challenges: stratification, weighting, post-processing
- Non-technical solutions and case studies
- Recommendations (~2 weeks)
- Collaborative filtering and personalized recommendations; individual vs demographic based recommendations
- Recommendations in practice: Capacity constraints, matching, 2-sided fairness, and other challenges (such as limited + missing data)
- Algorithmic pricing (~2-3 weeks)
- Basics of posted price mechanisms, algorithmic pricing
- Personalized and dynamic pricing in practice (online marketplaces, supply/labor side wages, and roadway congestion pricing)
- Fairness, ethics, and limitations
- Experimentation (~2-3 weeks)
- A/B testing basics
- Experimentation in practice: networks, interference, clustering, experimentation over time, switchbacks, 2-sided experimentation, trade-offs across experiments
- Ethics and communication of experiments
- Introduction to causal inference without experiments
- Miscellaneous (~2-3 weeks): Exact topics based on student interest
- Algorithmic explainability and transparency
- Performance drift, strategic reactions to your model, Data feedback loops
- Human-in-the-loop machine learning
- Fairness audits and interventions
- Differential privacy
