比做算法的懂工程落地，比做工程的懂算法模型。
- 编程: c++ / CUDA / 汇编 / python / Shell
- 算法: deep learning / CV / NLP etc，训练框架，推理部署
- 工程: 硬件体系结构，OS & linux kernel, 分布式 & k8s 集群，存储
- 性能优化: 并行优化，deep learning 优化，profile 工具
- Question100 Computer Architecture and Parallel Computing 计算机体系结构与并行计算 100 问
- WIP-Question100 Deep Learing
table url
From #online-tools
- https://en.wikichip.org/wiki/WikiChip: 查各类芯片的架构 & spec
- https://www.cpubenchmark.net/ 查芯片(CPU)的 benchmark。各种算力的 Ops/s
- https://www.videocardbenchmark.net/ 查显卡的 benchmark
- https://godbolt.org/: 在线看 c++ 代码的汇编代码
- https://quick-bench.com/: 在线测 c++ 代码的 benchmark
- https://en.cppreference.com: c++ 手册
- deep learning tutorials 初学者看的教程
- [Paper Reading] 经典 CNN model -- 从 AlexNet 到 ResNet 读三个经典实用模型的论文：AlexNet、VggNet、ResNet
- [Paper Reading] Learning with Noisy Label -- 深度学习落地 当前研究热点，semi-supervised learning 流派越来越抢眼
- Paper Reading - Object Detection
- Paper Reading - Face Detection
- 深入理解计算机系统 入门编译器级的性能优化。理解 CPU 体系结构、存储器层次结构，了解进程间通信。
- 计算机体系结构 - 量化研究方法 并行优化的理论体系。存储的层级结构，指令级优化，SIMD 数据并行，线程级并行等。
- 计算机组成与设计 - 硬件/软件接口 更偏硬件设计。软件开发者需要理解的，基本都在前两本里讲得更透彻。可以不读。
全都用大量篇幅讲存储器的层次结构。
我的笔记：
Reading List
- CUDA_by_Example - And Introduction to General-Pirpose GPU Programming
- CUDA_Application_Design_and_Development
- CUDA_C_Programming_Guide_11_6
我的笔记
Nvidia Docs
- S4158-cuda-streams-best-practices-common-pitfalls
- Tesla-P4-Product-Brief
- T4 Product Brief
- NVIDIA_Fermi_Compute_Architecture_Whitepaper
- x86 汇编
- MIPS 汇编
Reading List
- A Tour of C++: by Bjarne Stroustrup, an idea of what constitutes modern C++. 针对有经验的开发者
- CppCon 2014 - Herb Sutter - Back to the Basics - Essentials of Modern C++ Style: 把 c++ 指针讲清楚的男人
- GotW - Guru of the Week a regular series of C++ programming problems created and written by Herb Sutter
- CppCon 在 YouTube 上找 video，GitHub 上找 slides.
我的笔记地图 Cpp Notes Map
TODO 补充 deep learning 的高性能计算
-
HPC Learning Timline 我的 HPC 学习时间线
-
perf-tools-and-docs 性能调优的工具 & 工具使用文档
-
Computer Hardware Introduction 计算机硬件科普
-
performance optimization 处理性能优化地图，以 CPU 为主
-
OpenMP tutorial one of the eight tutorials in the 4+ day "Using LLNL's Supercomputers" workshop
- Apollo & Udacity 开放课程
- apollo3.5 Cyber架构讲解记录 百度-王柏生
- Introduction to Optimization, 4th Edition Edwin K. P. Chong, Stanislaw H. Zak-An
- 多伦多大学开放课程-自动驾驶汽车 较为详细的分模块介绍, slides 和 scripts 质量很高
- 👍 Apollo 规划技术详解 主讲人是 百度 EM planner paper 的作者, 7 个视频, 1 倍速看完预计 4h
- Robot Motion Planning pdf slide, 非常干货
- Apollo轨迹规划技术分享
- 解析百度Apollo之决策规划模块
- 自动驾驶中的车辆运动学模型 自行车模型(Bicycle Model), 阿克曼转向几何(Ackerman Turning Geometry)是一种为了解决交通工具转弯时，内外转向轮路径指向的圆心不同的几何学。
- 无人驾驶汽车系统入门（五）——运动学自行车模型和动力学自行车模型 运动学自行车模型的Python实现
- Github: YannZyl/Apollo-Note Note for Apollo 3.0 perception, prediction and planning modules
- MIT 开放课程-Self-Driving Cars Waymo 等公司的 lecture
- Tesla Autonomy Day 2019
- Inside Nvidia's AI Infrastructure for Self-Driving Cars
- Autonomous Driving by Cruise Lead
- A Learning-Based Tune-Free Control Framework for Large Scale Autonomous Driving System Deployment Apollo 的自动调参控制框架
- An Automated Learning-Based Procedure for Large-scale VehicleDynamics Modeling on Baidu Apollo Platform Apollo 的车辆动力学模拟, learning based model,
- Toward a Comfortable Driving Experience for a Self-Driving Shuttle Bus 基于福田大客车研究 acc & jerk, 适用于 self-driving 和小汽车.
- 自动驾驶主流可视化工具对比（cruise/uber/Apollo/waymo）
- Uber和Cruise开源自动驾驶的可视化工具
- Cruise 开源了可视化平台Webviz，以提升自动驾驶研究水平
- AVS 3D Web 自动驾驶可视化+伯克利开源项目+Uber开源项目
- 运行apollo3.5并体验dreamview可视化效果
Basic Models
- Speech and Language Processing | pdf
- A Stochastic Parts Program and Noun Phrase Parser for Unrestricted Text | pdf
- A Statistical Approach to Machine Translation | pdf
- Spam Filtering with Naive Bayes – Which Naive Bayes? | pdf
Undirected Graphical Model
alias: Markov network, Markov Random Field (MRF)
HMM, MEMM, CRF
- introduction to Hidden Markov Model pdf Chap.8 Part-of-Speech Tagging
- Conditional Random Fields - Probabilistic Models for Segmenting and Labeling Sequence Data | pdf
Near-duplicate Detection
- N-gram Similarity and Distance | pdf
- A Closer Look at Skip-gram Modelling | pdf
- Similarity Estimation Techniques from Rounding Algorithms | pdf
- Detecting Near-Duplicates for Web Crawling | pdf
- Web search for a planet: The Google cluster architecture | pdf
- Finding and evaluating community structure in networks | pdf
- Fast algorithm for detecting community structure in networks | pdf
papers
- Bitcask - A Log-Structured Hash Table for Fast Key/Value Data | pdf | notes
- The Google File System | pdf | notes
- Bigtable: A Distributed Storage System for Structured Data | pdf
- The Chubby lock service for loosely-coupled distributed systems | pdf
https://github.com/misc-codes/software-architecture-books
papers
- Brewer’s Conjecture and the Feasibility of Consistent, Available, Partition-Tolerant Web | pdf | notes
- BASE: An Acid Alternative | pdf | notes
- Eventually consistent | pdf
- Conflict-free Replicated Data Types | pdf
- The Byzantine Generals Problem | pdf
- The Part-Time Parliament | pdf
- Paxos Made Simple | pdf
- MapReduce: Simplified Data Processing on Large Clusters | pdf | notes
git/vim/tmux/docker configs