Files

.devcontainer
.github
3rdparty
benchmarks
cpp
- cmake
- include
- kernels
- micro_benchmarks
- tensorrt_llm
  - batch_manager
  - common
  - cutlass_extensions
  - executor
  - executor_worker
  - kernels
  - layers
  - plugins
    - api
    - bertAttentionPlugin
    - common
    - cpSplitPlugin
    - cudaStreamPlugin
    - cumsumLastDimPlugin
    - doraPlugin
    - eaglePlugin
    - fp4GemmPlugin
    - fp8RowwiseGemmPlugin
    - fusedLayernormPlugin
    - gemmAllReducePlugin
    - gemmPlugin
    - gemmSwigluPlugin
    - gptAttentionCommon
    - gptAttentionPlugin
      - CMakeLists.txt
      - gptAttentionPlugin.cpp
      - gptAttentionPlugin.h
    - identityPlugin
    - layernormQuantizationPlugin
    - lookupPlugin
    - loraPlugin
    - lowLatencyGemmPlugin
    - lowLatencyGemmSwigluPlugin
    - lruPlugin
    - mambaConv1dPlugin
    - mixtureOfExperts
    - ncclPlugin
    - qserveGemmPlugin
    - quantizePerTokenPlugin
    - quantizeTensorPlugin
    - quantizeToFP4Plugin
    - rmsnormQuantizationPlugin
    - selectiveScanPlugin
    - smoothQuantGemmPlugin
    - topkLastDimPlugin
    - weightOnlyGroupwiseQuantMatmulPlugin
    - weightOnlyQuantMatmulPlugin
    - CMakeLists.txt
    - exports.def
    - exports.map
  - pybind
  - runtime
  - testing
  - thop
  - CMakeLists.txt
- tests
- CMakeLists.txt
- conandata.yml
- conanfile.py
docker
docs
examples
jenkins
scripts
tensorrt_llm
tests
.clang-format
.clang-tidy
.clangd
.cursorignore
.dockerignore
.gitattributes
.gitignore
.gitmodules
.pre-commit-config.yaml
CODE_OF_CONDUCT.md
CODING_GUIDELINES.md
CONTRIBUTING.md
LICENSE
README.md
pyproject.toml
requirements-dev.txt
requirements.txt
setup.py

gptAttentionPlugin

wili-65535

and

wili-65535

Feat: Variable-Beam-Width-Search (VBWS) part3 (#3338 )

Apr 8, 2025

54ad95e · Apr 8, 2025

History

Name	Name	Last commit message	Last commit date
parent directory ..
CMakeLists.txt	CMakeLists.txt	Initial commit	Sep 20, 2023
gptAttentionPlugin.cpp	gptAttentionPlugin.cpp	Feat: Variable-Beam-Width-Search (VBWS) part3 (#3338 )	Apr 8, 2025
gptAttentionPlugin.h	gptAttentionPlugin.h	fix: fix for cp > kvHeadNum (#3002 )	Mar 26, 2025

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Files

gptAttentionPlugin

gptAttentionPlugin

Files

gptAttentionPlugin

Directory actions

More options

Directory actions

More options

Latest commit

History

gptAttentionPlugin

Folders and files

parent directory