Lsci 109: Linguistic Data Science

1 Course Information

2 Instructor Information

Instructor Richard Futrell (rfutrell@uci.edu)
Instructor's office SSPB 2215
Instructor's office hours M 2pm
Office hours location http://uci.zoom.us/my/futrell

3 Course Description

This course teaches how to perform basic quantitative analysis of text data using Python and how to communicate the results of such analyses. Text data includes corpora of books, transcripts of spoken language, online reviews, and social media feeds. Students will complete exercises in Jupyter notebooks in which they will implement basic manipulation of text data, implement simple machine learning algorithms (classifiers and language models), deploy them to analyze bodies of text, and learn how to visualize and communicate the results of these analyses using Python visualization tools such as matplotlib and seaborn. The goal of the class is to develop students' skills in two areas: (1) the practical programming required to do analysis of text data in Python, (2) communication skills related to drawing conclusions based on algorithmic results, and presenting them in a way which is both precise and intuitive. A secondary goal is to develop students' knowledge of what kinds of analyses are possible given the current landscape of Natural Language Processing (NLP) technologies.

4 Course Format

Class time will be spent on lectures and guided exercises. Homework will consist of mini-projects involving different bodies of text: students will be asked to perform their own analyses and draw their own conclusions.

Students are encouraged to collaborate on homework.

Readings are optional but strongly recommended. They are short and you will find them immediately useful.

There are no exams or tests.

5 Intended audience

This course is intended for advanced undergraduates who already know the basics of Python programming, as demonstrated by passing ICS 033 or similar. The ability to program in Python is a prerequisite for enrollment in the course. I do not assume or require any background on statistics or math beyond high school algebra.

Information on UCI's Language Science major and minor.

6 Schedule (subject to modification)

Day Topic Deadlines Readings Notebook
1/5 Introduction      
1/7 Text Wrangling   Tokenization Notebook 1
1/12 Bags of Words   Bags of words Notebook 2
1/14 UNKs and Stop Words     Notebook 3
1/19 N-Grams and Association Measures   Tf-idf Notebook 4
1/21 Tf-idf and Topic models   Topic Modeling with Gensim Notebook 5
1/26 Tagging / Project Time     Notebook 6
1/28 Project Time      
2/2 Linear Classifiers Mini-Project 1 Due   Notebook 7
2/4 Naive Bayes   Naive Bayes Notebook 8
2/9 Evaluation metrics   Precision and recall Notebook 9
2/11 More Classifiers   Logistic regression Notebook 10
2/16 Feature Engineering     Notebook 11
2/18 Visualization and Dimensionality Reduction   Visualizing high-dimensional datasets Notebook 12
2/23 Project Time      
2/25 Word embeddings I Mini-project 2 due Word embeddings Notebook 13
3/2 Word embeddings II   Historical word embeddings Notebook 14
3/4 Contextual embeddings     Notebook 15
3/9 Modern NLP / Project Time   Text classification with Transformers Notebook 16
3/11 Project Time      
3/19 - Mini-project 3 due    

7 Requirements & Grading

  • Grade breakdown

    Work Grade percentage
    Mini-projects 80%
    Participation 20%

    All mini-projects are equally weighted.

  • Mini-projects

    In each mini-project, you will be provided with a dataset and with some analytical tools and your job will be to apply those tools to discover something about the dataset, and to produce a writeup that explains what you found and how you found it. The writeup will be in the form of a Jupyter or CoLab notebook.

    You are highly encouraged to work in groups of up to 3 on mini-projects. Groups will turn in joint writeups. In a joint writeup, there should be a brief statement saying roughly who contributed what to the end product.

    Each mini-project is due at at the beginning of class on the day indicated in the schedule. The final project is due at 4pm on 3/19.

  • Participation

    To receive full credit for participation, you must attend every class session and participate actively in the group exercises. If you cannot make it to class, inform the instructor to find out what make-up work you can do to recover the participation credit.

  • Mapping of class score to letter grade

    I guarantee minimum grades based on these thresholds:

    Threshold Guaranteed minimum grade
    >= 90% A
    >= 80% B
    >= 70% C
    >= 60% D
    < 60% F

    So for example a score of 90.0001% guarantees you an A-. It is unlikely that I will grade the course on a curve, but if I do, you could end up with a higher grade due to the curve.

8 Academic Integrity

We will be adhering fully to the standards and practices set out in UCI's policy on academic integrity. Any attempts of academic misconduct or plagiarism will be met with consequences as per the university regulations.

9 Disability

Any student requesting academic accommodations based on a disability is required to apply with Disability Service Center at UCI. For more information, please visit http://disability.uci.edu/.

Author: Richard Futrell

Created: 2021-03-04 Thu 13:43

Validate