APM_5AI29_TP - Language Models and Structured Data

Beyond the traditional applications of Language Models in natural language processing-oriented tasks such as sentiment analysis, fake news detection, etc., the language models have been leveraged across a broad spectrum of other tasks involving structured data such as graphs, databases, tables, etc. This course is tailored to take into account the merits and demerits of employing language models and conventional approaches for tackling tasks related to structured data. Starting with an exploration of basic concepts in language modeling to large language models, low rank adaptation (LoRA), quantization,  prompt engineering and retrieval augmented generation, the curriculum progressively will move towards the interplay between language models and structured data. This course will focus on diverse applications such as learning representations over tables and graphs, language models as knowledge bases, Text to SQL, and Question Answering over Structured Data. The course will be graded based on hands-on lab sessions, projects, and presentations of the projects.