🦾 进行一些人工智能研究

Ujjwal Tyagi

Ujjwal-Tyagi

35 976 424

ujjwal-shirova

AI & ML interests

Chief Scientist at Shirova AI, dedicated to advancing open-source AI; possesses extensive experience in Large Language Model (LLM) fine-tuning, model architecture, and related research, with a passion for building scalable and efficient models.

Recent Activity

liked a dataset about 5 hours ago

sollamon/ox-alpha-glm-5.3-flash-distillation-coding-17k-raw

liked a dataset about 6 hours ago

openbmb/UltraData-SFT-Agent-2609

liked a dataset about 14 hours ago

secemp9/arxiv-complete

View all activity

Organizations

buckets 8

Posts 15

Post

584

6 Open-Source Libraries to FineTune LLMs
1. Unsloth
GitHub: https://github.com/unslothai/unsloth
→ Fastest way to fine-tune LLMs locally
→ Optimized for low VRAM (even laptops)
→ Plug-and-play with Hugging Face models

2. Axolotl
GitHub: https://github.com/OpenAccess-AI-Collective/axolotl
→ Flexible LLM fine-tuning configs
→ Supports LoRA, QLoRA, multi-GPU
→ Great for custom training pipelines

3. TRL (Transformer Reinforcement Learning)
GitHub: https://github.com/huggingface/trl
→ RLHF, DPO, PPO for LLM alignment
→ Built on Hugging Face ecosystem
→ Essential for post-training optimization

4. DeepSpeed
GitHub: https://github.com/microsoft/DeepSpeed
→ Train massive models efficiently
→ Memory + speed optimization
→ Industry standard for scaling

5. LLaMA-Factory
GitHub: https://github.com/hiyouga/LLaMA-Factory
→ All-in-one fine-tuning UI + CLI
→ Supports multiple models (LLaMA, Qwen, etc.)
→ Beginner-friendly + powerful

6. PEFT
GitHub: https://github.com/huggingface/peft
→ Fine-tune with minimal compute
→ LoRA, adapters, prefix tuning
→ Best for cost-efficient training

Post

513

This is the best set of AI and ML books and a full guide to learning machine learning from the ground up. This is my study material that I used, so I thought it would be helpful to share it with others. Like, share, and add it to your collection at Ujjwal-Tyagi/ai-ml-foundations-book-collection.