← Back to skills

CURATED FROM PUBLIC GIT

fastgen-add-network

>-

↓ 0★ 0by greatsage_sh
4fbbff39da1a
skillmarket install greatsage_sh/fastgen-add-network
Public Git sourcehttps://github.com/NVIDIA/skills.gitcommit 4fbbff39da1a5780d8bfd796f1674618c6349ef7
Part of skillsetskills →

About this skill

---
name: fastgen-add-network
description: >-
  Integrate a new diffusion or flow model, or a task variant such as I2V, editing or causal generation, into NVIDIA FastGen as a FastGenNetwork adapter with preprocessors, configs, method capabilities, reference parity and trainability. Use it whenever a model family or checkpoint is not yet supported.
license: Apache-2.0
metadata:
  author: "Julius Berner <[email protected]>"
  domain: ml
---

# Add a FastGen network

Apply [fastgen-develop](https://github.com/NVlabs/FastGen/blob/main/skills/fastgen-develop/SKILL.md)
and [fastgen-runtime](https://github.com/NVlabs/FastGen/blob/main/skills/fastgen-runtime/SKILL.md). Start with the
[network README](https://github.com/NVlabs/FastGen/blob/main/fastgen/networks/README.md) and the interface docstrings in
[network.py](https://github.com/NVlabs/FastGen/blob/main/fastgen/networks/network.py) and [module.py](https://github.com/NVlabs/FastGen/blob/main/fastgen/networks/module.py),
then inspect the closest maintained adapter for the same task. Read
[network contracts](references/network-contract.md) before implementing and load its
conditional sections only for the capabilities being added. For a new signal type also
use [fastgen-add-modality](https://github.com/NVlabs/FastGen/blob/main/skills/fastgen-add-modality/SKILL.md).

1. **Source.** Verify the upstream model, its revision, code, weights, access and
   supported modes. Diffusers implementations are reusable, but check the authors'
   reference for precision and preprocessing defaults, and whether the checkpoint's
   precision or quantisation supports training. Never substitute a similarly named model.
2. **Trace upstream.** Preprocessing, tokenizer and chat templates, conditioning and
   masks, VAE scaling and packing, position encodings, time convention, scheduler grid
   and guidance recipe, plus modality geometry and duration/FPS where relevant.
   Distinguish native edit or reference conditioning from initialising noisy latents.
3. **Implement.** Add the adapter under `fastgen/networks/<Name>/` and its presets in
   [net.py](https://github.com/NVlabs/FastGen/blob/main/fastgen/configs/net.py). Follow the module lifecycle, preprocessing,
   conditioning, output-transformation and sampling contracts; share task-independent
   components such as text encoders and VAEs, and do not embed an inference pipeline as
   the training forward. Load weights through the documented
   [pretrained-model conventions](https://github.com/NVlabs/FastGen/blob/main/fastgen/networks/README.md#pretrained-models) so
   local mirrors and offline mode keep working. Audit precision, buffer reconstruction,
   meta loading and sharding for the network and every preprocessor.
4. **Capabilities.** Trace the requested methods' forward and loss calls; add feature and
   discriminator gradients, second-time inputs, PDD, LoRA, multimodal or causal support
   as needed and check each independently. SFT support implies none of them.
   Add and run small forward, conditioning and capability regressions following
   `tests/test_network*.py` and `tests/test_conditioning.py` before expensive parity or
   training runs.
5. **Configs.** Use [fastgen-configure](https://github.com/NVlabs/FastGen/blob/main/skills/fastgen-configure/SKILL.md) for SFT and
   the requested method configs, with negative-prompt presets where the upstream guidance
   needs them and none where it does not.
6. **Parity.** Follow [validate a new network](https://github.com/NVlabs/FastGen/blob/main/fastgen/networks/README.md#validate-a-new-network)
   with [fastgen-validate](https://github.com/NVlabs/FastGen/blob/main/skills/fastgen-validate/SKILL.md) and
   [fastgen-inference](https://github.com/NVlabs/FastGen/blob/main/skills/fastgen-inference/SKILL.md), and resolve unexplained
   differences before training.
7. **Train and document.** Use [fastgen-train](https://github.com/NVlabs/FastGen/blob/main/skills/fastgen-train/SKILL.md) for a
   short SFT run with media every iteration, then the requested methods; compare outputs
   before and after and reload a checkpoint. Update the README tables (network list,
   pretrained models).

Report implementation and config paths and per-task parity, training and checkpoint
results. If the loss decreases while outputs degrade, inspect input normalisation,
prediction and time convention and guidance before tuning the optimizer; mark
unsupported capabilities explicitly.