Applied Data Science - Decision-making beyond Prediction / Fall 2023
Updates
- 09/26 -- New Assignment released: [Homework #3 - Dynamic and Personalized Pricing]
- 09/14 -- New Lecture is up: Lecture 12 - Experimentation -- Introduction [slides]
- 09/14 -- New Lecture is up: In class discussion - Ethics in (Algorithmic) Pricing [Pre-class Homework]
- 09/14 -- New Lecture is up: Lecture 11 - Algorithmic Pricing practice -- ride-hailing [slides]
- 09/14 -- New Lecture is up: Lecture 10 - Algorithmic Pricing complications 2 [slides]
- 09/14 -- New Lecture is up: Lecture 9 - Algorithmic Pricing complications [slides]
- 09/13 -- New Assignment released: [Homework #2 - Recommendations]
Course Description
This course considers the data science challenges beyond training an accurate predictive model, especially for systems about people (data of behavior), and for people (deployed models to influence behavior). Whether for online marketplaces, transportation, governmental, or urban systems, effective data science in such settings requires dealing with user incentives and strategic behavior, networked and decentralized decision-making, and privacy and ethics concerns.
Important links
- Course website
- Canvas
- Ed Discussion – Primary communication tool
- Calendar – Class google calendar with lectures, OHs
- Gradescope – Place to turn in all assignments
- YouTube – Lecture recordings from 2021.
Course topics
- Data collection (~3 weeks)
- Data constructs, surveys, ratings, polling, and implicit data exhausts
- Challenges and biases: censoring, strategic reporting, social desirability, ratings inflation, privacy, etc
- Technical solutions to challenges: stratification, weighting, post-processing
- Non-technical solutions and case studies
- Recommendations (~2 weeks)
- Collaborative filtering and personalized recommendations; individual vs demographic based recommendations
- Recommendations in practice: Capacity constraints, matching, 2-sided fairness, and other challenges (such as limited + missing data)
- Algorithmic pricing (~2-3 weeks)
- Basics of posted price mechanisms, algorithmic pricing
- Personalized and dynamic pricing in practice (online marketplaces, supply/labor side wages, and roadway congestion pricing)
- Fairness, ethics, and limitations
- Experimentation (~2-3 weeks)
- A/B testing basics
- Experimentation in practice: networks, interference, clustering, experimentation over time, switchbacks, 2-sided experimentation, trade-offs across experiments
- Ethics and communication of experiments
- Introduction to causal inference without experiments
- Miscellaneous (~2-3 weeks): Exact topics based on student interest
- Algorithmic explainability and transparency
- Performance drift, strategic reactions to your model, Data feedback loops
- Human-in-the-loop machine learning
- Fairness audits and interventions
- Differential privacy
