文件列表:

.idea (0, 2022-06-11)
.idea\gpu-finder.iml (352, 2022-06-11)
.idea\inspectionProfiles (0, 2022-06-11)
.idea\inspectionProfiles\profiles_settings.xml (174, 2022-06-11)
.idea\misc.xml (201, 2022-06-11)
.idea\modules.xml (278, 2022-06-11)
gpu-config.json (801, 2022-06-11)
gpu-finder.py (17626, 2022-06-11)
requirements.txt (33, 2022-06-11)
venv (0, 2022-06-11)
venv\bin (0, 2022-06-11)
venv\bin\Activate.ps1 (8834, 2022-06-11)
venv\bin\activate (2211, 2022-06-11)
venv\bin\activate.csh (1263, 2022-06-11)
venv\bin\activate.fish (2415, 2022-06-11)
venv\bin\chardetect (268, 2022-06-11)
venv\bin\pip (268, 2022-06-11)
venv\bin\pip3 (268, 2022-06-11)
venv\bin\pip3.8 (268, 2022-06-11)
venv\bin\pyrsa-decrypt (259, 2022-06-11)
venv\bin\pyrsa-encrypt (259, 2022-06-11)
venv\bin\pyrsa-keygen (257, 2022-06-11)
venv\bin\pyrsa-priv2pub (280, 2022-06-11)
venv\bin\pyrsa-sign (253, 2022-06-11)
venv\bin\pyrsa-verify (257, 2022-06-11)
venv\bin\python (9, 2022-06-11)
venv\bin\python3 (9, 2022-06-11)
venv\bin\python3.8 (24, 2022-06-11)
venv\lib (0, 2022-06-11)
venv\lib\python3.8 (0, 2022-06-11)
venv\lib\python3.8\site-packages (0, 2022-06-11)
venv\lib\python3.8\site-packages\_distutils_hack (0, 2022-06-11)
venv\lib\python3.8\site-packages\_distutils_hack\__init__.py (3552, 2022-06-11)
venv\lib\python3.8\site-packages\_distutils_hack\override.py (44, 2022-06-11)
venv\lib\python3.8\site-packages\apiclient (0, 2022-06-11)
venv\lib\python3.8\site-packages\apiclient\__init__.py (935, 2022-06-11)
venv\lib\python3.8\site-packages\cachetools-4.2.1.dist-info (0, 2022-06-11)
... ...

# GPU Finder GPU Finder attempts to make it easier to find and provision Compute Engine Instances with GPUs. ## Why GPU Finder? GPU quotas are not always consistent across regions and at any particular time. At peak times, there may be limited availability of GPUs in the cloud due to high demand for their compute capacity. This makes finding and provisioning of GPUs difficult and time consuming. By just setting a few configuration parameters, this script can be used to automate the process of finding and provisioning Compute Engine instances with GPUs. ## Prerequisites * A GCP account and access to a service account with the permissions needed for creating instances. See the [docs](https://cloud.google.com/docs/authentication/production#passing_variable) for creating a key file and setting the GOOGLE_APPLICATION_CREDENTIALS environment variable * A python environment with google-api-python-client==2.0.2 library installed using pip ## Using the GPU Finder 1. Download the service account key file and set the GOOGLE_APPLICATION_CREDENTIALS environment variable to authenticate with GCP APIs 2. Install the Google API client library by running the command below: ```bash pip install -r requirements.txt ```` 3. Modify the `gpu-config.json` file to set the appropriate configuration parameters. In addition to the name of the machine, the important parameters to set are: * number_of_instances: Number of instances to create * machine_type: [The type of Compute Engine machine(s) to create](https://cloud.google.com/compute/docs/machine-types) * zone: [A list of zones to attempt to create instances in](https://cloud.google.com/compute/docs/regions-zones). To attempt all zones, leave the list blank (i.e. empty brackets [] will look for instances in all zones) | Zone | Location | GPU model | GPU virtual workstation | |---------------------------|----------------------------------------------|---------------------------|-------------------------| | asia-east1-a | Changhua County, Taiwan, APAC | T4, P100, K80. | T4, P100 | | asia-east1-b | Changhua County, Taiwan, APAC | K80 | | | asia-east1-c | Changhua County, Taiwan, APAC | T4, V100, P100 | T4, P100 | | asia-east2-a | | | | | asia-east2-b | | | | | asia-east2-c | Hong Kong, APAC | | | | asia-northeast1-a | | | | | asia-northeast1-c | Tokyo, Japan, APAC | T4 | T4 | | asia-northeast1-b | Tokyo, Japan, APAC | | | | asia-northeast2-a | | | | | asia-northeast2-b | | | | | asia-northeast2-c | Osaka, Japan, APAC | | | | asia-northeast3-a | Seoul, South Korea, APAC | | | | asia-northeast3-b | | | | | asia-northeast3-c | Seoul, South Korea, APAC | T4 | T4 | | asia-south1-a | | | | | asia-south1-b | Mumbai, India, APAC | T4 | T4 | | asia-south1-c | Mumbai, India, APAC | | | | asia-southeast1-a | Jurong West, Singapore, APAC | T4 | T4 | | asia-southeast1-b | Jurong West, Singapore, APAC | T4, P4 | T4, P4 | | asia-southeast1-c | Jurong West, Singapore, APAC | A100, T4, P4 | T4, P4 | | asia-southeast2-a | | | | | asia-southeast2-b | Jakarta, Indonesia, APAC | T4 | T4 | | asia-southeast2-c | Jakarta, Indonesia, APAC | | | | australia-southeast1-a | Sydney, Australia, APAC | T4, P4 | T4, P4 | | australia-southeast1-b | Sydney, Australia, APAC | P4 | P4 | | australia-southeast1-c | Sydney, Australia, APAC | P100 | P100 | | europe-north1-a | | | | | europe-north1-b | | | | | europe-north1-c | Hamina, Finland, Europe | | | | europe-west1-b | St. Ghislain, Belgium, Europe | P100, K80 | P100 | | europe-west1-c | St. Ghislain, Belgium, Europe | | | | europe-west1-d | St. Ghislain, Belgium, Europe | P100, K80 | P100 | | europe-west2-a | | | | | europe-west2-b | London, England, Europe | T4 | T4 | | europe-west2-c | London, England, Europe | | | | europe-west3-a | Frankfurt, Germany, Europe | | | | europe-west3-b | Frankfurt, Germany, Europe | T4 | T4 | | europe-west3-c | Frankfurt, Germany, Europe | | | | europe-west4-a | Eemshaven, Netherlands, Europe | A100, V100, P100 | P100 | | europe-west4-b | Eemshaven, Netherlands, Europe | A100, T4, P4, V100 | T4, P4 | | europe-west4-c | Eemshaven, Netherlands, Europe | T4, P4, V100 | T4, P4 | | europe-west6-a | | | | | europe-west6-b | | | | | europe-west6-c | Zurich, Switzerland, Europe | | | | northamerica-northeast1-a | | | | | northamerica-northeast1-b | | | | | northamerica-northeast1-c | Montreal, Quebec, North America | P4 | P4 | | southamerica-east1-a | | | | | southamerica-east1-b | Osasco, Sao Paulo, Brazil, South America | | | | southamerica-east1-c | Osasco, Sao Paulo, Brazil, South America | T4 | T4 | | us-central1-a | Council Bluffs, Iowa, North America | A100, T4, P4, V100, K80 | T4, P4 | | us-central1-b | Council Bluffs, Iowa, North America | A100, T4, V100 | T4 | | us-central1-c | Council Bluffs, Iowa, North America | A100, P4, V100, P100, K80 | P4, P100 | | us-central1-f | Council Bluffs, Iowa, North America | T4, V100, P100, K80 | T4, P100 | | us-east1-b | Moncks Corner, South Carolina, North America | P100 | P100 | | us-east1-c | Moncks Corner, South Carolina, North America | T4, V100, P100, K80 | T4, P100 | | us-east1-d | Moncks Corner, South Carolina, North America | T4, K80 | T4 | | us-east4-a | Ashburn, Virginia, North America | P4 | P4 | | us-east4-b | Ashburn, Virginia, North America | T4, P4 | T4, P4 | | us-east4-c | Ashburn, Virginia, North America | P4 | P4 | | us-west1-a | The Dalles, Oregon, North America | T4, V100, P100 | T4 | | us-west1-b | The Dalles, Oregon, North America | T4, V100, P100, K80 | T4, P100 | | us-west1-c | The Dalles, Oregon, North America | | | | us-west2-a | Los Angeles, California, North America | | | | us-west2-b | | | | | us-west2-c | Los Angeles, California, North America | P4 | P4 | | us-west3-a | | | | | us-west3-b | | | | | us-west3-c | Salt Lake City, Utah, North America | | | | us-west4-a | | | | | us-west4-b | | | | | us-west4-c | Las Vegas, Nevada, North America | | | * gpu_type: [The type of GPU to use](https://cloud.google.com/compute/docs/gpus). Note that A100s have to be used with [A2 machine types](https://cloud.google.com/compute/docs/gpus/create-vm-with-gpus#examples-add-gpu-a100), while the other GPU types can be configured with N1 machine types. * number_of_gpus: [The number of GPUs to attach to each instance](https://cloud.google.com/compute/docs/gpus) | GPU Model | Configuration Name | Compatible Machine Types | Number of GPUs | |--------------|----------------------|--------------------------|----------------| | NVIDIA A100 | nvidia-tesla-a100 | A2 | 1, 2, 4, 8, 16 | | NVIDIA T4 | nvidia-tesla-t4 | N1 | 1, 2, 4 | | NVIDIA V100 | nvidia-tesla-v100 | N1 | 1, 2, 4, 8 | | NVIDIA P4 | nvidia-tesla-p4 | N1 | 1, 2, 4 | | NVIDIA P100 | nvidia-tesla-p100 | N1 | 1, 2, 4 | | NVIDIA K80 | nvidia-tesla-k80 | N1 | 1, 2, 4, 8 | 4. Additional configuration like disk type, disk size, firewall rules, image type, image family, VPC, startup scripts, and others can be set in the configuration file too. 5. When running the script, you will see output in the logs about which regions and zones the instances will be created in, the names of instances, and whether a quota has been reached in a given region. ## Clean Up There is a `delete_instance` function in the script that will delete the instances passed in the `instance_details` parameter. Please be mindful of cleaning up instances with GPUs attached when these are no longer needed.

近期下载者：

相关文件：

评论：[我要评论] [举报此文件]

收藏者：