Skip to content

Commit

Permalink
Merge pull request ChiaXinLiang#29 from ChiaXinLiang/main
Browse files Browse the repository at this point in the history
dev rebase main
  • Loading branch information
ChiaXinLiang authored Oct 8, 2024
2 parents d721674 + bd6bfc9 commit 0fba1ed
Show file tree
Hide file tree
Showing 29 changed files with 668 additions and 1,679 deletions.
Binary file added .DS_Store
Binary file not shown.
19 changes: 11 additions & 8 deletions MLLM_latex/chapter1/chapter1.tex
Original file line number Diff line number Diff line change
@@ -1,4 +1,15 @@
\chapter{Introduction to Multimodal Large Language Models (MLLMs)}
\makeatletter
\newcommand{\chapterauthor}[1]{%
{\parindent0pt\vspace*{-25pt}%
\linespread{1.1}\large\scshape#1%
\par\nobreak\vspace*{35pt}}
\@afterheading%
}
\makeatother

\chapterauthor{Marcus}


\section{Definition and Importance of MLLMs}

Expand Down Expand Up @@ -86,14 +97,6 @@ \section{The Convergence of Natural Language Processing (NLP) and Computer Visio
\item \textbf{Vision Transformers (ViT):} These apply transformer architectures directly to image patches, enabling more seamless integration of vision and language models. Instead of processing an image as a whole, ViT breaks it down into smaller patches and processes them sequentially, much like how transformers process words in a sentence.
\end{itemize}

\begin{figure}[h]
\centering
\includegraphics[width=0.8\textwidth]{cross_modal_transformer.png}
\caption{Simplified diagram of a Cross-Modal Transformer architecture}
\label{fig:cross_modal_transformer}
\end{figure}

Figure \ref{fig:cross_modal_transformer} illustrates how a cross-modal transformer processes both text and image inputs, fusing the information through cross-attention mechanisms to produce a unified output.

\textbf{Impact on AI Applications:}
The convergence of NLP and computer vision through MLLMs has enabled new capabilities in various AI applications:
Expand Down
193 changes: 0 additions & 193 deletions MLLM_latex/chapter1/chapter1_orig.tex

This file was deleted.

Empty file removed MLLM_latex/chapter1/reference.tex
Empty file.
105 changes: 0 additions & 105 deletions MLLM_latex/chapter10/chapter10.tex

This file was deleted.

315 changes: 0 additions & 315 deletions MLLM_latex/chapter10/paper.txt

This file was deleted.

357 changes: 0 additions & 357 deletions MLLM_latex/chapter10/references.bib

This file was deleted.

Loading

0 comments on commit 0fba1ed

Please sign in to comment.