Featured image of post Huawei Open-Sources Full-Stack Training Code for openPangu-2.0: Pretraining, SFT, and Post-Training RL

Huawei Open-Sources Full-Stack Training Code for openPangu-2.0: Pretraining, SFT, and Post-Training RL

Huawei open-sources the complete training pipeline for openPangu-2.0, including pretraining, SFT, and RL post-training.

New post

Huawei Open-Sources Full-Stack openPangu-2.0 Training Pipeline

On September 28, 2026, Huawei officially open-sourced the pretraining code, SFT (Supervised Fine-Tuning) code, and RL (Reinforcement Learning) post-training code for the openPangu-2.0 model. The project aims to provide best practices for leveraging the Ascend ecosystem through native Ascend training and inference technologies.

The open-source effort is split across two core repositories:

The framework is built on PyTorch and CANN (Compute Architecture for Neural Networks), designed specifically for Ascend AI processors. As of publication, the openPangu-2.0-Training repo shows 23 stars (the source mentions “项目成员 23”, interpreted as star count), 0 forks, and only 1 commit with no tags released—indicating an early-stage release.


Technical Scope and Ecosystem Positioning

The openPangu-2.0-Training repository hosts a large-scale foundational model training framework. Its codebase supports two core stages:

  • Pretraining code: Enables initial large-language model training
  • SFT (Supervised Fine-Tuning) code: Performs task-specific optimization using labeled data

Separately, openPangu-2.0-RL handles the final training phase—RL post-training, typically used to align model behavior with human intent via reward modeling.

A noteworthy observation: both repositories show minimal community engagement to date. Zero forks and a single commit suggest the release is an initial preview rather than a mature, community-evolved codebase. Teams seeking production-ready, well-tested training scripts should carefully assess the current engineering stability.


Comparative Context: Where It Fits in the Open-Source Landscape

Though no direct version comparisons are provided in the source, the framework’s distinguishing feature is its deep integration with the Ascend hardware-software stack. Below summarizes positional differences against industry standards:

ProjectFramework BaseHardware SupportTraining Stages Covered
openPangu-2.0PyTorch + CANNAscend nativePretraining + SFT + RL post-training
General-purposePyTorch / TFGeneric GPUsPretraining/SFT common; RL often absent

Key insight: openPangu-2.0 is among the few Chinese open-source LLM projects to explicitly treat RL post-training as a standalone module, indicating strong emphasis on full alignment capability—most open releases omit or bundle RL separately without dedicated code.


Practical Guidance for Adopters

  • Who should adopt now: Teams using Huawei Ascend hardware (e.g., Atlas servers) for custom LLM development; engineering groups that require end-to-end visibility from pretraining through RL alignment.
  • Who should wait: Production teams with strict stability requirements; organizations without existing Ascend infrastructure, given the repo’s ultra-early state (1 commit, untagged).

Final Thoughts

This release marks a meaningful step toward comprehensive training-stack openness for China’s AI ecosystem. By releasing pretraining, SFT, and RL post-training as integrated, native Ascend-compatible components, Huawei signals a shift from isolated model inference to system-level training infrastructure sharing.