Unstable ======== API unstable features are not available as part of binary distributions like PyPI or Conda (except maybe behind run-time flags). To test these features we would, depending on the feature, recommend building PyTorch from source (main) or using the nightly wheels that are made available on `pytorch.org `_. *Level of commitment*: We are committing to gathering high bandwidth feedback only on these features. Based on this feedback and potential further engagement between community members, we as a community will decide if we want to upgrade the level of commitment or to fail fast. .. raw:: html
.. Add prototype tutorial cards below this line .. Sparsity .. customcarditem:: :header: (prototype) Accelerating BERT with semi-structured (2:4) sparsity :card_description: Prune BERT to be 2:4 sparse and accelerate for inference. :image: _static/img/thumbnails/cropped/generic-pytorch-logo.png :link: unstable/semi_structured_sparse.html :tags: Model-Optimiziation .. Modules .. customcarditem:: :header: Skipping Module Parameter Initialization in PyTorch 1.10 :card_description: Describes skipping parameter initialization during module construction in PyTorch 1.10, avoiding wasted computation. :image: _static/img/thumbnails/cropped/generic-pytorch-logo.png :link: unstable/skip_param_init.html :tags: Modules .. vmap .. customcarditem:: :header: Using torch.vmap :card_description: Learn about torch.vmap, an autovectorizer for PyTorch operations. :image: _static/img/thumbnails/cropped/generic-pytorch-logo.png :link: unstable/vmap_recipe.html :tags: vmap .. NestedTensor .. customcarditem:: :header: Nested Tensor :card_description: Learn about nested tensors, the new way to batch heterogeneous-length data :image: _static/img/thumbnails/cropped/generic-pytorch-logo.png :link: unstable/nestedtensor.html :tags: NestedTensor .. MaskedTensor .. customcarditem:: :header: MaskedTensor Overview :card_description: Learn about masked tensors, the source of truth for specified and unspecified values :image: _static/img/thumbnails/cropped/generic-pytorch-logo.png :link: unstable/maskedtensor_overview.html :tags: MaskedTensor .. customcarditem:: :header: Masked Tensor Sparsity :card_description: Learn about how to leverage sparse layouts (e.g. COO and CSR) in MaskedTensor :image: _static/img/thumbnails/cropped/generic-pytorch-logo.png :link: unstable/maskedtensor_sparsity.html :tags: MaskedTensor .. customcarditem:: :header: Masked Tensor Advanced Semantics :card_description: Learn more about Masked Tensor's advanced semantics (reductions and comparing vs. NumPy's MaskedArray) :image: _static/img/thumbnails/cropped/generic-pytorch-logo.png :link: unstable/maskedtensor_advanced_semantics.html :tags: MaskedTensor .. customcarditem:: :header: MaskedTensor: Simplifying Adagrad Sparse Semantics :card_description: See a showcase on how masked tensors can enable sparse semantics and provide for a cleaner dev experience :image: _static/img/thumbnails/cropped/generic-pytorch-logo.png :link: unstable/maskedtensor_adagrad.html :tags: MaskedTensor .. Model-Optimization .. customcarditem:: :header: Inductor Cpp Wrapper Tutorial :card_description: Speed up your models with Inductor Cpp Wrapper :image: _static/img/thumbnails/cropped/generic-pytorch-logo.png :link: unstable/inductor_cpp_wrapper_tutorial.html :tags: Model-Optimization .. customcarditem:: :header: Inductor Windows CPU Tutorial :card_description: Speed up your models with Inductor On Windows CPU :image: _static/img/thumbnails/cropped/generic-pytorch-logo.png :link: unstable/inductor_windows.html :tags: Model-Optimization .. customcarditem:: :header: Use max-autotune compilation on CPU to gain additional performance boost :card_description: Tutorial for max-autotune mode on CPU to gain additional performance boost :image: _static/img/thumbnails/cropped/generic-pytorch-logo.png :link: unstable/max_autotune_on_CPU_tutorial.html :tags: Model-Optimization .. Distributed .. customcarditem:: :header: Flight Recorder Tutorial :card_description: Debug stuck jobs easily with Flight Recorder :image: _static/img/thumbnails/cropped/generic-pytorch-logo.png :link: unstable/flight_recorder_tutorial.html :tags: Distributed, Debugging, FlightRecorder .. customcarditem:: :header: Context Parallel Tutorial :card_description: Parallelize the attention computation along sequence dimension :image: _static/img/thumbnails/cropped/generic-pytorch-logo.png :link: unstable/context_parallel.html :tags: Distributed, Context Parallel .. Integration .. customcarditem:: :header: Out-of-tree extension autoloading in Python :card_description: Learn how to improve the seamless integration of out-of-tree extension with PyTorch based on the autoloading mechanism. :image: _static/img/thumbnails/cropped/generic-pytorch-logo.png :link: unstable/python_extension_autoload.html :tags: Extending-PyTorch, Frontend-APIs .. GPUDirect Storage .. customcarditem:: :header: (prototype) Using GPUDirect Storage :card_description: Learn how to use GPUDirect Storage in PyTorch. :image: _static/img/thumbnails/cropped/generic-pytorch-logo.png :link: unstable/gpu_direct_storage.html :tags: GPUDirect-Storage .. End of tutorial card section .. ----------------------------------------- .. Page TOC .. ----------------------------------------- .. toctree:: :maxdepth: 2 :hidden: unstable/context_parallel unstable/flight_recorder_tutorial unstable/inductor_cpp_wrapper_tutorial unstable/inductor_windows unstable/vmap_recipe unstable/vulkan_workflow unstable/nestedtensor unstable/maskedtensor_overview unstable/maskedtensor_sparsity unstable/maskedtensor_advanced_semantics unstable/maskedtensor_adagrad unstable/python_extension_autoload unstable/gpu_direct_storage.html unstable/max_autotune_on_CPU_tutorial unstable/skip_param_init.html