gpu_tag_enable
Description
The gpu_tag_enable parameter enables GPU tagging for your instances. This allows you to tag GPU resources, which can be useful for tracking and managing GPU usage across your AWS environment.
Default Value
The default value for gpu_tag_enable is false.
Use Cases
- Resource Tracking: Tagging GPU resources to keep track of GPU usage and costs.
- Operational Management: Simplify the management and organization of GPU instances within your AWS infrastructure.
Setting Parameters
To enable GPU tagging, use the following command:
$ convox rack params set gpu_tag_enable=true -r rackName
Setting parameters... OK
This command enables GPU tagging for your instances.
Additional Information
Enabling GPU tagging helps you manage and monitor GPU resources more effectively by allowing you to assign custom tags to GPU instances. GPU tagging is not supported in all AWS regions, so ensure that your region supports this feature before enabling it. For more information on GPU tagging and supported regions, refer to the AWS documentation.
Proper tagging of GPU resources can help with cost allocation, operational management, and resource optimization across your cloud infrastructure.
Related Parameters
- gpu_observability_enable: Installs the NVIDIA DCGM exporter for GPU utilization and VRAM metrics. Pairs with GPU tagging to give you both AWS-side cost allocation and in-cluster utilization visibility.
- nvidia_device_plugin_enable: Enables the NVIDIA GPU device plugin so Kubernetes can schedule GPU workloads onto tagged instances.
- nvidia_device_time_slicing_replicas: Time-slices physical GPUs into virtual replicas for higher utilization on tagged GPU instances.
