Cloud Storage python client fails to retrieve bucket
I am trying to use the python client library to write blobs to cloud storage. The VM I'm using has Read/Write permissions for storage and I'm able to access the bucket via gsutil, however python is giving me the following error
>>> from google.cloud import storage
>>> storage_client = storage.Client()
>>> bucket = storage_client.get_bucket("gs://<bucket name>")
Traceback (most recent call last):
File "<stdin>", line 1, in <module>
File "/usr/local/lib/python3.5/dist-packages/google/cloud/storage/client.py", line 225, in get_bucket
bucket.reload(client=self)
File "/usr/local/lib/python3.5/dist-packages/google/cloud/storage/_helpers.py", line 108, in reload
_target_object=self)
File "/usr/local/lib/python3.5/dist-packages/google/cloud/_http.py", line 293, in api_request
raise exceptions.from_http_response(response)
google.api_core.exceptions.NotFound: 404 GET https://www.googleapis.com/storage/v1/b/gs://<bucket name>?projection=noAcl: Not Found
python-3.x google-cloud-platform google-cloud-storage google-compute-engine
edited Nov 24 '18 at 8:02
Samuel N
997
asked Nov 22 '18 at 18:41
littlebenlittlelittlebenlittle
467
add a comment |
I am trying to use the python client library to write blobs to cloud storage. The VM I'm using has Read/Write permissions for storage and I'm able to access the bucket via gsutil, however python is giving me the following error
>>> from google.cloud import storage
>>> storage_client = storage.Client()
>>> bucket = storage_client.get_bucket("gs://<bucket name>")
Traceback (most recent call last):
File "<stdin>", line 1, in <module>
File "/usr/local/lib/python3.5/dist-packages/google/cloud/storage/client.py", line 225, in get_bucket
bucket.reload(client=self)
File "/usr/local/lib/python3.5/dist-packages/google/cloud/storage/_helpers.py", line 108, in reload
_target_object=self)
File "/usr/local/lib/python3.5/dist-packages/google/cloud/_http.py", line 293, in api_request
raise exceptions.from_http_response(response)
google.api_core.exceptions.NotFound: 404 GET https://www.googleapis.com/storage/v1/b/gs://<bucket name>?projection=noAcl: Not Found
python-3.x google-cloud-platform google-cloud-storage google-compute-engine
edited Nov 24 '18 at 8:02
Samuel N
997
asked Nov 22 '18 at 18:41
littlebenlittlelittlebenlittle
467
3
The url in the error ishttps://www.googleapis.com/storage/v1/b/gs://<bucket name>.... you probably just need to supply the actual bucket name (withoutgs://.
– Phix
Nov 22 '18 at 18:59
That was exactly it. Thank you!
– littlebenlittle
Nov 22 '18 at 19:14
add a comment |
I am trying to use the python client library to write blobs to cloud storage. The VM I'm using has Read/Write permissions for storage and I'm able to access the bucket via gsutil, however python is giving me the following error
>>> from google.cloud import storage
>>> storage_client = storage.Client()
>>> bucket = storage_client.get_bucket("gs://<bucket name>")
Traceback (most recent call last):
File "<stdin>", line 1, in <module>
File "/usr/local/lib/python3.5/dist-packages/google/cloud/storage/client.py", line 225, in get_bucket
bucket.reload(client=self)
File "/usr/local/lib/python3.5/dist-packages/google/cloud/storage/_helpers.py", line 108, in reload
_target_object=self)
File "/usr/local/lib/python3.5/dist-packages/google/cloud/_http.py", line 293, in api_request
raise exceptions.from_http_response(response)
google.api_core.exceptions.NotFound: 404 GET https://www.googleapis.com/storage/v1/b/gs://<bucket name>?projection=noAcl: Not Found
python-3.x google-cloud-platform google-cloud-storage google-compute-engine
edited Nov 24 '18 at 8:02
Samuel N
997
asked Nov 22 '18 at 18:41
littlebenlittlelittlebenlittle
467
I am trying to use the python client library to write blobs to cloud storage. The VM I'm using has Read/Write permissions for storage and I'm able to access the bucket via gsutil, however python is giving me the following error
>>> from google.cloud import storage
>>> storage_client = storage.Client()
>>> bucket = storage_client.get_bucket("gs://<bucket name>")
Traceback (most recent call last):
File "<stdin>", line 1, in <module>
File "/usr/local/lib/python3.5/dist-packages/google/cloud/storage/client.py", line 225, in get_bucket
bucket.reload(client=self)
File "/usr/local/lib/python3.5/dist-packages/google/cloud/storage/_helpers.py", line 108, in reload
_target_object=self)
File "/usr/local/lib/python3.5/dist-packages/google/cloud/_http.py", line 293, in api_request
raise exceptions.from_http_response(response)
google.api_core.exceptions.NotFound: 404 GET https://www.googleapis.com/storage/v1/b/gs://<bucket name>?projection=noAcl: Not Found
python-3.x google-cloud-platform google-cloud-storage google-compute-engine
python-3.x google-cloud-platform google-cloud-storage google-compute-engine
edited Nov 24 '18 at 8:02
Samuel N
997
asked Nov 22 '18 at 18:41
littlebenlittlelittlebenlittle
467
edited Nov 24 '18 at 8:02
Samuel N
997
asked Nov 22 '18 at 18:41
littlebenlittlelittlebenlittle
467
edited Nov 24 '18 at 8:02
Samuel N
997
edited Nov 24 '18 at 8:02
Samuel N
997
edited Nov 24 '18 at 8:02
Samuel N
997
997
asked Nov 22 '18 at 18:41
littlebenlittlelittlebenlittle
467
asked Nov 22 '18 at 18:41
littlebenlittlelittlebenlittle
467
asked Nov 22 '18 at 18:41
littlebenlittlelittlebenlittle
467
467
3
The url in the error ishttps://www.googleapis.com/storage/v1/b/gs://<bucket name>.... you probably just need to supply the actual bucket name (withoutgs://.
– Phix
Nov 22 '18 at 18:59
That was exactly it. Thank you!
– littlebenlittle
Nov 22 '18 at 19:14
add a comment |
3
The url in the error ishttps://www.googleapis.com/storage/v1/b/gs://<bucket name>.... you probably just need to supply the actual bucket name (withoutgs://.
– Phix
Nov 22 '18 at 18:59
That was exactly it. Thank you!
– littlebenlittle
Nov 22 '18 at 19:14
3
3
The url in the error is
https://www.googleapis.com/storage/v1/b/gs://<bucket name>.... you probably just need to supply the actual bucket name (without gs://.– Phix
Nov 22 '18 at 18:59
The url in the error is
https://www.googleapis.com/storage/v1/b/gs://<bucket name>.... you probably just need to supply the actual bucket name (without gs://.– Phix
Nov 22 '18 at 18:59
That was exactly it. Thank you!
– littlebenlittle
Nov 22 '18 at 19:14
That was exactly it. Thank you!
– littlebenlittle
Nov 22 '18 at 19:14
add a comment |
1 Answer
1
active
oldest
votes
Phix is right. You only need to specify the bucket name without the 'gs://'. As a matter of fact the API being called (e.g. Buckets: update https://www.googleapis.com/storage/v1/b/bucket) is found here. And here is more on Python's Google Cloud Storage API client library and an example of how to use it.
answered Nov 24 '18 at 0:56
Samuel NSamuel N
997
add a comment |
Your Answer
StackExchange.ifUsing("editor", function () {
StackExchange.using("externalEditor", function () {
StackExchange.using("snippets", function () {
StackExchange.snippets.init();
});
});
}, "code-snippets");
StackExchange.ready(function() {
var channelOptions = {
tags: "".split(" "),
id: "1"
};
initTagRenderer("".split(" "), "".split(" "), channelOptions);
StackExchange.using("externalEditor", function() {
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled) {
StackExchange.using("snippets", function() {
createEditor();
});
}
else {
createEditor();
}
});
function createEditor() {
StackExchange.prepareEditor({
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: true,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: 10,
bindNavPrevention: true,
postfix: "",
imageUploader: {
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
},
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
});
}
});
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f53436615%2fcloud-storage-python-client-fails-to-retrieve-bucket%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
1 Answer
1
active
oldest
votes
1 Answer
1
active
oldest
votes
active
oldest
votes
active
oldest
votes
Phix is right. You only need to specify the bucket name without the 'gs://'. As a matter of fact the API being called (e.g. Buckets: update https://www.googleapis.com/storage/v1/b/bucket) is found here. And here is more on Python's Google Cloud Storage API client library and an example of how to use it.
answered Nov 24 '18 at 0:56
Samuel NSamuel N
997
add a comment |
Phix is right. You only need to specify the bucket name without the 'gs://'. As a matter of fact the API being called (e.g. Buckets: update https://www.googleapis.com/storage/v1/b/bucket) is found here. And here is more on Python's Google Cloud Storage API client library and an example of how to use it.
answered Nov 24 '18 at 0:56
Samuel NSamuel N
997
add a comment |
Phix is right. You only need to specify the bucket name without the 'gs://'. As a matter of fact the API being called (e.g. Buckets: update https://www.googleapis.com/storage/v1/b/bucket) is found here. And here is more on Python's Google Cloud Storage API client library and an example of how to use it.
answered Nov 24 '18 at 0:56
Samuel NSamuel N
997
Phix is right. You only need to specify the bucket name without the 'gs://'. As a matter of fact the API being called (e.g. Buckets: update https://www.googleapis.com/storage/v1/b/bucket) is found here. And here is more on Python's Google Cloud Storage API client library and an example of how to use it.
answered Nov 24 '18 at 0:56
Samuel NSamuel N
997
edited Nov 24 '18 at 1:04
answered Nov 24 '18 at 0:56
Samuel NSamuel N
997
answered Nov 24 '18 at 0:56
Samuel NSamuel N
997
answered Nov 24 '18 at 0:56
Samuel NSamuel N
997
997
add a comment |
add a comment |
Thanks for contributing an answer to Stack Overflow!
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
To learn more, see our tips on writing great answers.
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f53436615%2fcloud-storage-python-client-fails-to-retrieve-bucket%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
3
The url in the error is
https://www.googleapis.com/storage/v1/b/gs://<bucket name>.... you probably just need to supply the actual bucket name (withoutgs://.– Phix
Nov 22 '18 at 18:59
That was exactly it. Thank you!
– littlebenlittle
Nov 22 '18 at 19:14