Date      

 Presenters   

Jan 10

Gedas

 Topic                          

Course Overview; 

  Papers                                                                                                

  Length      

75min

 Slides 

Overview of Self-Attention and Transformers

Jan 12

Gedas

Vision Transformers

45min

Detailed Paper Discussion #1

30min

Jan 17

No Class (MLK Day)

Jan 19

Gedas

Data-Efficient Vision Transformers

25min+QA

25min+QA

Jan 24

Yi-Lin

Somnath

Mixing Convolutions with Self-Attention

25min+QA

25min+QA

Jan 26

Sherry,

Shiv &

Yining

Understanding Vision Transformers

45min

Detailed Paper Discussion #2

30min

pdf

Jan 31

Mohaiminul

Qin

Efficient Self-Attention Schemes

25min+QA

pdf

25min+QA

pdf

Feb 2

Feb 7

Feb 9

Feb 14

Project Proposal

(Part 1)

Report due Feb 20, 11:59 PM

Feb 16

Project Proposal

(Part 2)

Report due Feb 20, 11:59 PM

Feb 21

Mike

Gedas

3D Recognition

25min+QA

25min+QA

pdf

pdf

Feb 23

Feb 28

Text-Guided Image Generation

Detailed Paper Discussion #3

45min

30min

pdf

Mar 2

Learning Visual Models from Text

Detailed Paper Discussion #4

45min

30min

pdf

David &

Somnath

Sam &

Yi-Lin

Mar 7

Mohaiminul,

Yan-Bo &

Akshay

Multimodal Few-Shot Learning

Detailed Paper Discussion #5

45min

30min

pdf

Mar 9

General Multimodal Perception

Detailed Paper Discussion #6

45min

30min

pdf

Mar 16

Mar 14

Project Milestone

(Part 1)

Project Milestone

(Part 2)

Report due Mar 20, 11:59 PM

Report due Mar 20, 11:59 PM

Angelos &

Ryan

Mar 21

Mar 23

Angelos

Yan-Bo

Learning from Video, Audio and Text

25min+QA

pdf

25min+QA

pdf

Mar 28

Mar 30

Transformer Generalization

Detailed Paper Discussion #7

45min

30min

pdf

Mike & Eli

Apr 4

Apr 6

Self-Supervised Learning

Detailed Paper Discussion #8

45min

30min

pdf

Apr 11

Foundation Models

Detailed Paper Discussion #9

45min

30min

pdf

Yilin &

Nurislam

Yilin

Ryan

Beyond Self-Attention

25min+QA

pdf

25min+QA

pdf

Apr 13

Apr 18

Nurislam

Gedas

Beyond Self-Attention

25min+QA

25min+QA

pdf

pdf

Avinash &

Maitrey

Back to Convolutions

Detailed Paper Discussion #10

45min

30min

pdf

Apr 20

Apr 27

Apr 25

Final Presentation

(Part 1)

Final Presentation

(Part 2)

Report due May 1, 11:59 PM

Report due May 1, 11:59 PM

Yunkui &

Qin