Academic Events, Training

Fall 2024 MDI Workshop: Prompt Exploration for Vision and Language Models

Name: Fall 2024 MDI Workshop: Prompt Exploration for Vision and Language Models
Start: 2024-10-22T16:00:00-04:00
End: 2024-10-22T17:30:00-04:00
Location: Hilltop Campus, Buildling Old North, Conference Room 205

Fall 2024 MDI Workshop: Prompt exploration for Vision and Language Models with Rupayan Mallick, Ph.D.

Registration Link: https://bit.ly/MDIWorkshopOct2024

Date: Monday, October 21 & Tuesday, October 22, 2024, 4:00-5:30pm (each day)

Location: Main Campus Old North 205 (please note this event is only in-person)

Abstract: With the recent advancements on the LLMs and VLMs, understanding the prompts to generate these images are of utmost importance. The factors affecting the quality as well as the context of generation might lie on the quality of prompts given for the generation. Another factor for the generation can be the seed selection as well as the filters applied by the models. This workshop explores various factors engaged in the generation of text or images for these models. Another aim of this workshop is to understand the responsible use of the LLMs/VLMs. We would perform some hands-on experiments for a better understanding of the prompt engineering. The participants need a basic understanding of Python and it will be helpful to know deep learning libraries.

Bio: Rupayan Mallick, Ph.D. is a Postdoctoral Fellow at the Massive Data Institute at the McCourt School of Public Policy and the Department of Computer Science. His research interests include Generative AI, Explainable AI, and Multimodal Learning. He is currently exploring the generative models of deep learning such as diffusion models for different data modalities. Dr. Mallick completed his Ph.D. from University of Bordeaux (LaBRI and INRIA), France in Computer Science specializing in Explainable Deep Learning.

Registration Link: https://bit.ly/MDIWorkshopOct2024