papers.md

Shelf.Papers

papers, blog posts, powerpoints, and lecture notes are listed below:

Table Of Contents

• Artificial Intelligence
  • Machine Learning and Deep Learning

    • Deep Neural Networks

      • Attention
      • Transformers
      • Diffusion Models
      • Self-supervised Learning
      • Multi-Modals

    • Natural Language Processing

      • Text Processing
        • Corpus
        • Natural language Understanding
          • Language Modeling
        • Natural language Generation
          • Language Modeling
          • Paraphrase Generation
        • Information Retrieval
        • Sequence to Sequence Models
      • Speech Processing
        • Text To Speech
          • Grapheme To Phoneme
        • Speech Recognition
        • Speech Representation
        • Speech Generation
      • Neuroscience
        • language
      • Generative Models
• Research
• Data Science
  • Interview
  • Project Management
  • Data Mining
• Applications

Machine Learning and Deep Learning

• Math essentials for ML
• Math4ML

Attention

• All you need to know about ‘Attention’ and ‘Transformers’ — In-depth Understanding — Part 1

Multi-Modals

Large Multimodal Models CVPR 2023 Tutorial

Transformers

• A Gentle Introduction to Positional Encoding In Transformer Models, Part 1
• All you need to know about ‘Attention’ and ‘Transformers’ — In-depth Understanding — Part 2
• A Survey of Transformers
• Syntactic Knowledge-Infused Transformer and BERT models
• The Illustrated Retrieval Transformer

Information Retrieval

• Autoregressive Search Engines Generating Substrings as Document Identifiers

Self-supervised Learning

• A cookbook of Self-Supervised Learning

Sequence to Sequence Models

• BART Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehension

Corpus

• Lessons from building a Persian written corpus: Peykare

Language Modeling (LM)

• Chain of Thought Prompting Elicits Reasoning in Large Language Models

• naab: A ready-to-use plug-and-play corpus for Farsi

• Diffusion-LM Improves Controllable Text Generation

• Dont Stop Pretraining Adapt Language Models to Domains and Tasks

• From English to Foreign Languages Transferring Pretrained Language Models

• The Illustrated GPT-2 (Visualizing Transformer Language Models)

• How to generate text: using different decoding methods for language generation with Transformers

• So retrieval is what we needed?

• Improving language models by retrieving from trillions of tokens

• GPT4all technical report

• Building LLM applications for production

Text To Speech (TTS)

• طراحی و ضبط پایگاه دادگان گفتاری برای سیستم های تبدیل متن به گفتار فارسی
• Guided-TTS A Diffusion Model for Text-to-Speech via Classifier Guidance
• A Survey on Neural Speech Synthesis

Grapheme To Phoneme (G2P)

• Multi-Module G2P Converter for Persian Focusing on Relations between Words

Speech Recognition (ASR | STT)

• Whisper Robust Speech Recognition via Large-Scale Weak Supervision
• Massively Multilingual ASR on 70 Languages Tokenization, Architecture, and Generalization Capabilities
• TransFusion Transcribing Speech with Multinomial Diffusion

Paraphrase Generation

• ParaSCI: A Large Scientific Paraphrase Dataset for Longer Paraphrase Generation
• ExaPPC: a Large-Scale Persian Paraphrase Detection Corpus
• Paraphrase Generation: A Survey of the State of the Art
• Joint Copying and Restricted Generation for Paraphrase
• Paraphrasing with Large Language Models
• Unsupervised Paraphrase Generation using Pre-trained Language Models
• Unsupervised Paraphrasing with Pretrained Language Models
• Reformulating Unsupervised Style Transfer as Paraphrase Generation

Natural Language Understanding

• PARSINLU: A Suite of Language Understanding Challenges for Persian

• Leveraging External Knowledge in NLU systems

Speech Representation

• AST Audio Spectrogram Transformer

Speech Generation

• Towards Efficient Diffusion-Based Speech Generation on CPU

Diffusion Models

• Denoising Diffusion Probabilistic Models
• Generative Modeling by Estimating Gradients of the Data Distribution
• Story of Diffusion Models pptx pdf
• DiffuSeq Sequence to Sequence Text Generation with Diffusion Models -Guided-TTS A Diffusion Model for Text-to-Speech via Classifier Guidance -Imagic Text-Based Real Image Editing with Diffusion Models
• TransFusion Transcribing Speech with Multinomial Diffusion

Research

• Strategies for writing a research paper

Interview

• Data Science Interview Questions and Answers

Data Mining

language

• The Brain Basis of Language Processing From Structure to Function
• Evidence of a predictive coding hierarchy in the human brain listening to speech

Project Management

• Data Science Project Management (The New Guide For ML Teams)

• Fall in Love with the Problem and not the Solution

Generative Models

• A History of Generative AI: From GAN to GPT-4 (blog)
• A Comprehensive Survey of AI-Generated Content (AIGC) A History of Generative AI from GAN to ChatGPT

Applications

• AI in Metaverse
• When will 1 Billion People Use Generative AI?
• Practical Guide to AI in the Metaverse