additional_build_groups_config

Description

The additional_build_groups_config parameter allows you to define dedicated node groups specifically for application build processes. This enables you to isolate build workloads from your production services, optimize resources for build-intensive operations, and configure build-specific infrastructure settings.

This feature works in conjunction with the additional_node_groups_config parameter, offering a comprehensive approach to infrastructure customization within your Convox rack.

Default Value

The default value for additional_build_groups_config is an empty array.

Use Cases

• Build Isolation: Separate build processes from production workloads to prevent resource contention.
• Cost Optimization: Use spot instances for builds to reduce costs for these typically ephemeral workloads.
• Performance Tuning: Configure build nodes with higher CPU, memory, or disk resources to speed up build processes.
• Resource Efficiency: Ensure build processes don’t compete with services for resources during peak usage times.

Configuration Format

The additional_build_groups_config parameter takes a JSON array of node group configurations. Each node group configuration is a JSON object with the following fields:

* Important: Custom AMI configuration should be used with extreme caution. AMIs in EKS clusters have strict compatibility requirements, and improper configuration can lead to cluster update failures requiring manual intervention. Only use custom AMIs if you have specific compatibility requirements and thoroughly understand EKS node bootstrapping processes. We recommend testing in a non-production environment before implementation.

Setting Parameters

To set the additional_build_groups_config parameter, there are several methods:

Using a JSON File (Recommended)

$ convox rack params set additional_build_groups_config=/path/to/build-config.json -r rackName
Setting parameters... OK

The JSON file should be structured as follows:

[
  {
    "type": "c5.2xlarge",
    "disk": 100,
    "capacity_type": "SPOT",
    "min_size": 0,
    "desired_size": 1,
    "max_size": 5,
    "label": "app-build"
  }
]

Important Note on AWS Rate Limits: When adding or removing multiple node groups, it’s recommended to modify no more than three node groups at a time to avoid hitting AWS API rate limits. If you receive a rate limit error during an update simply run the parameter set command again. The operation will resume from where it left off, creating the remaining node groups without duplicating the ones that were already successfully created.

Using a Raw JSON String

$ convox rack params set 'additional_build_groups_config=[{"type":"c5.2xlarge","disk":100,"capacity_type":"SPOT","min_size":0,"desired_size":1,"max_size":5,"label":"app-build"}]' -r rackName
Setting parameters... OK

Directing Build Pods to Specific Node Groups

To direct build pods to specific node groups, use the BuildLabels app parameter:

$ convox apps params set BuildLabels=convox.io/label=app-build -a <app>

This ensures that build processes for the specified app will run on nodes with the convox.io/label: app-build label.

Customizing Build Pod Resources

You can also specify resource requirements for build pods:

$ convox apps params set BuildCpu=256 BuildMem=1024 -a <app>

This sets the CPU request to 256 millicores (0.25 vCPU) and memory request to 1024MB (1GB) for build pods.

Additional Information

Combining the additional_build_groups_config parameter with app-specific BuildLabels configuration provides:

1. Isolation: Build processes won’t interfere with production workloads.
2. Cost Efficiency: You can use spot instances for build processes, which are typically tolerant of interruptions.
3. Resource Optimization: Custom instance types can be selected based on build requirements.
4. Scaling Flexibility: Build node groups can scale based on demand, potentially scaling to zero when no builds are running.

Build nodes configured with larger instance types, more memory, or faster disk I/O can significantly improve build performance for large applications, potentially reducing build times and improving developer productivity.