Arangodump misses some data
I'm using arangodb 3.1.25. I found that some data is missed inside dump directory after execution of such command using 'arangodump':
arangodump --server.endpoint tcp://address:port --server.database DbName --dump-data true --server.password=**** --include-system-collections true --output-directory "dump" -overwrite true
Example of data that is missed:
On the original database(let's name it 'test') i have such documents in collection 'interchange_edges':
{"_from":"interchange_headers/66430","_to":"parts/64020","type":"interchange"}
{"_from":"interchange_headers/66430","_to":"parts/44474","type":"interchange"}
{"_from":"interchange_headers/66430","_to":"parts/48761","type":"interchange"}
Then i execute dump using instruction listed above and then i open a file with dumped data for my collection. In my case it have name interchange_edges_7d8fd33864b65edab6a05b838483239b.data.json. Then i search in this file by substring '66430' because all original records have this substring. As a result i found such matches:
{"type":2300,"data":{"_from":"interchange_headers/66430","_id":"interchange_edges/66430_64020","_key":"66430_64020","_rev":"_V8MSKAS--C","_to":"parts/64020","type":"interchange"}}
{"type":2300,"data":{"_from":"interchange_headers/66430","_id":"interchange_edges/66430_64020","_key":"66430_64020","_rev":"_V8MSKAS--C","_to":"parts/64020","type":"interchange"}}
{"type":2300,"data":{"_from":"interchange_headers/66430","_id":"interchange_edges/66430_64020","_key":"66430_64020","_rev":"_V8MSKAS--C","_to":"parts/64020","type":"interchange"}}
Somehow i have 3 (duplicated?) rows instead of 3 different rows as expected.
What may cause this behaviour? Did i missed something critical?
Some information about environment:
arangosh (ArangoDB 3.1.25 [linux] 64bit, using VPack 0.1.30, ICU 54.1, V8 5.0.71.39, OpenSSL 1.0.1f 6 Jan 2014)
arangodb
asked Nov 21 '18 at 15:35
the_kaba
268314
add a comment |
I'm using arangodb 3.1.25. I found that some data is missed inside dump directory after execution of such command using 'arangodump':
arangodump --server.endpoint tcp://address:port --server.database DbName --dump-data true --server.password=**** --include-system-collections true --output-directory "dump" -overwrite true
Example of data that is missed:
On the original database(let's name it 'test') i have such documents in collection 'interchange_edges':
{"_from":"interchange_headers/66430","_to":"parts/64020","type":"interchange"}
{"_from":"interchange_headers/66430","_to":"parts/44474","type":"interchange"}
{"_from":"interchange_headers/66430","_to":"parts/48761","type":"interchange"}
Then i execute dump using instruction listed above and then i open a file with dumped data for my collection. In my case it have name interchange_edges_7d8fd33864b65edab6a05b838483239b.data.json. Then i search in this file by substring '66430' because all original records have this substring. As a result i found such matches:
{"type":2300,"data":{"_from":"interchange_headers/66430","_id":"interchange_edges/66430_64020","_key":"66430_64020","_rev":"_V8MSKAS--C","_to":"parts/64020","type":"interchange"}}
{"type":2300,"data":{"_from":"interchange_headers/66430","_id":"interchange_edges/66430_64020","_key":"66430_64020","_rev":"_V8MSKAS--C","_to":"parts/64020","type":"interchange"}}
{"type":2300,"data":{"_from":"interchange_headers/66430","_id":"interchange_edges/66430_64020","_key":"66430_64020","_rev":"_V8MSKAS--C","_to":"parts/64020","type":"interchange"}}
Somehow i have 3 (duplicated?) rows instead of 3 different rows as expected.
What may cause this behaviour? Did i missed something critical?
Some information about environment:
arangosh (ArangoDB 3.1.25 [linux] 64bit, using VPack 0.1.30, ICU 54.1, V8 5.0.71.39, OpenSSL 1.0.1f 6 Jan 2014)
arangodb
asked Nov 21 '18 at 15:35
the_kaba
268314
What data is missing?
– Kaveh Vahedipour
Nov 21 '18 at 15:49
Some of the records that are represented in datasource are not insode given dump directory. I'm not sure that sharing of actual content will make sense..
– the_kaba
Nov 21 '18 at 15:51
records meaning documents or collections or indexes are missing? no nothing should be missing from a database that is dumped as above. of course no other but the databaseDbNameis restored with the above command.
– Kaveh Vahedipour
Nov 21 '18 at 15:54
Do all collections exist? Or are some missing? What are their names and what is your operating system? Or are certain records missing? Can you show that they exist as live documents in the database, e.g. using arangosh or the Web UI, and that the document with this exact key is not contained in the JSON dump?
– CoDEmanX
Nov 21 '18 at 16:25
Please look into updated description
– the_kaba
Nov 22 '18 at 10:03
add a comment |
I'm using arangodb 3.1.25. I found that some data is missed inside dump directory after execution of such command using 'arangodump':
arangodump --server.endpoint tcp://address:port --server.database DbName --dump-data true --server.password=**** --include-system-collections true --output-directory "dump" -overwrite true
Example of data that is missed:
On the original database(let's name it 'test') i have such documents in collection 'interchange_edges':
{"_from":"interchange_headers/66430","_to":"parts/64020","type":"interchange"}
{"_from":"interchange_headers/66430","_to":"parts/44474","type":"interchange"}
{"_from":"interchange_headers/66430","_to":"parts/48761","type":"interchange"}
Then i execute dump using instruction listed above and then i open a file with dumped data for my collection. In my case it have name interchange_edges_7d8fd33864b65edab6a05b838483239b.data.json. Then i search in this file by substring '66430' because all original records have this substring. As a result i found such matches:
{"type":2300,"data":{"_from":"interchange_headers/66430","_id":"interchange_edges/66430_64020","_key":"66430_64020","_rev":"_V8MSKAS--C","_to":"parts/64020","type":"interchange"}}
{"type":2300,"data":{"_from":"interchange_headers/66430","_id":"interchange_edges/66430_64020","_key":"66430_64020","_rev":"_V8MSKAS--C","_to":"parts/64020","type":"interchange"}}
{"type":2300,"data":{"_from":"interchange_headers/66430","_id":"interchange_edges/66430_64020","_key":"66430_64020","_rev":"_V8MSKAS--C","_to":"parts/64020","type":"interchange"}}
Somehow i have 3 (duplicated?) rows instead of 3 different rows as expected.
What may cause this behaviour? Did i missed something critical?
Some information about environment:
arangosh (ArangoDB 3.1.25 [linux] 64bit, using VPack 0.1.30, ICU 54.1, V8 5.0.71.39, OpenSSL 1.0.1f 6 Jan 2014)
arangodb
asked Nov 21 '18 at 15:35
the_kaba
268314
I'm using arangodb 3.1.25. I found that some data is missed inside dump directory after execution of such command using 'arangodump':
arangodump --server.endpoint tcp://address:port --server.database DbName --dump-data true --server.password=**** --include-system-collections true --output-directory "dump" -overwrite true
Example of data that is missed:
On the original database(let's name it 'test') i have such documents in collection 'interchange_edges':
{"_from":"interchange_headers/66430","_to":"parts/64020","type":"interchange"}
{"_from":"interchange_headers/66430","_to":"parts/44474","type":"interchange"}
{"_from":"interchange_headers/66430","_to":"parts/48761","type":"interchange"}
Then i execute dump using instruction listed above and then i open a file with dumped data for my collection. In my case it have name interchange_edges_7d8fd33864b65edab6a05b838483239b.data.json. Then i search in this file by substring '66430' because all original records have this substring. As a result i found such matches:
{"type":2300,"data":{"_from":"interchange_headers/66430","_id":"interchange_edges/66430_64020","_key":"66430_64020","_rev":"_V8MSKAS--C","_to":"parts/64020","type":"interchange"}}
{"type":2300,"data":{"_from":"interchange_headers/66430","_id":"interchange_edges/66430_64020","_key":"66430_64020","_rev":"_V8MSKAS--C","_to":"parts/64020","type":"interchange"}}
{"type":2300,"data":{"_from":"interchange_headers/66430","_id":"interchange_edges/66430_64020","_key":"66430_64020","_rev":"_V8MSKAS--C","_to":"parts/64020","type":"interchange"}}
Somehow i have 3 (duplicated?) rows instead of 3 different rows as expected.
What may cause this behaviour? Did i missed something critical?
Some information about environment:
arangosh (ArangoDB 3.1.25 [linux] 64bit, using VPack 0.1.30, ICU 54.1, V8 5.0.71.39, OpenSSL 1.0.1f 6 Jan 2014)
arangodb
arangodb
asked Nov 21 '18 at 15:35
the_kaba
268314
asked Nov 21 '18 at 15:35
the_kaba
268314
edited Nov 22 '18 at 10:02
asked Nov 21 '18 at 15:35
the_kaba
268314
asked Nov 21 '18 at 15:35
the_kaba
268314
asked Nov 21 '18 at 15:35
the_kaba
268314
268314
What data is missing?
– Kaveh Vahedipour
Nov 21 '18 at 15:49
Some of the records that are represented in datasource are not insode given dump directory. I'm not sure that sharing of actual content will make sense..
– the_kaba
Nov 21 '18 at 15:51
records meaning documents or collections or indexes are missing? no nothing should be missing from a database that is dumped as above. of course no other but the databaseDbNameis restored with the above command.
– Kaveh Vahedipour
Nov 21 '18 at 15:54
Do all collections exist? Or are some missing? What are their names and what is your operating system? Or are certain records missing? Can you show that they exist as live documents in the database, e.g. using arangosh or the Web UI, and that the document with this exact key is not contained in the JSON dump?
– CoDEmanX
Nov 21 '18 at 16:25
Please look into updated description
– the_kaba
Nov 22 '18 at 10:03
add a comment |
What data is missing?
– Kaveh Vahedipour
Nov 21 '18 at 15:49
Some of the records that are represented in datasource are not insode given dump directory. I'm not sure that sharing of actual content will make sense..
– the_kaba
Nov 21 '18 at 15:51
records meaning documents or collections or indexes are missing? no nothing should be missing from a database that is dumped as above. of course no other but the databaseDbNameis restored with the above command.
– Kaveh Vahedipour
Nov 21 '18 at 15:54
Do all collections exist? Or are some missing? What are their names and what is your operating system? Or are certain records missing? Can you show that they exist as live documents in the database, e.g. using arangosh or the Web UI, and that the document with this exact key is not contained in the JSON dump?
– CoDEmanX
Nov 21 '18 at 16:25
Please look into updated description
– the_kaba
Nov 22 '18 at 10:03
What data is missing?
– Kaveh Vahedipour
Nov 21 '18 at 15:49
What data is missing?
– Kaveh Vahedipour
Nov 21 '18 at 15:49
Some of the records that are represented in datasource are not insode given dump directory. I'm not sure that sharing of actual content will make sense..
– the_kaba
Nov 21 '18 at 15:51
Some of the records that are represented in datasource are not insode given dump directory. I'm not sure that sharing of actual content will make sense..
– the_kaba
Nov 21 '18 at 15:51
records meaning documents or collections or indexes are missing? no nothing should be missing from a database that is dumped as above. of course no other but the database
DbName is restored with the above command.– Kaveh Vahedipour
Nov 21 '18 at 15:54
records meaning documents or collections or indexes are missing? no nothing should be missing from a database that is dumped as above. of course no other but the database
DbName is restored with the above command.– Kaveh Vahedipour
Nov 21 '18 at 15:54
Do all collections exist? Or are some missing? What are their names and what is your operating system? Or are certain records missing? Can you show that they exist as live documents in the database, e.g. using arangosh or the Web UI, and that the document with this exact key is not contained in the JSON dump?
– CoDEmanX
Nov 21 '18 at 16:25
Do all collections exist? Or are some missing? What are their names and what is your operating system? Or are certain records missing? Can you show that they exist as live documents in the database, e.g. using arangosh or the Web UI, and that the document with this exact key is not contained in the JSON dump?
– CoDEmanX
Nov 21 '18 at 16:25
Please look into updated description
– the_kaba
Nov 22 '18 at 10:03
Please look into updated description
– the_kaba
Nov 22 '18 at 10:03
add a comment |
0
active
oldest
votes
Your Answer
StackExchange.ifUsing("editor", function () {
StackExchange.using("externalEditor", function () {
StackExchange.using("snippets", function () {
StackExchange.snippets.init();
});
});
}, "code-snippets");
StackExchange.ready(function() {
var channelOptions = {
tags: "".split(" "),
id: "1"
};
initTagRenderer("".split(" "), "".split(" "), channelOptions);
StackExchange.using("externalEditor", function() {
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled) {
StackExchange.using("snippets", function() {
createEditor();
});
}
else {
createEditor();
}
});
function createEditor() {
StackExchange.prepareEditor({
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: true,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: 10,
bindNavPrevention: true,
postfix: "",
imageUploader: {
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
},
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
});
}
});
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f53415522%2farangodump-misses-some-data%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
0
active
oldest
votes
0
active
oldest
votes
active
oldest
votes
active
oldest
votes
Thanks for contributing an answer to Stack Overflow!
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
To learn more, see our tips on writing great answers.
Some of your past answers have not been well-received, and you're in danger of being blocked from answering.
Please pay close attention to the following guidance:
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
To learn more, see our tips on writing great answers.
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f53415522%2farangodump-misses-some-data%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
What data is missing?
– Kaveh Vahedipour
Nov 21 '18 at 15:49
Some of the records that are represented in datasource are not insode given dump directory. I'm not sure that sharing of actual content will make sense..
– the_kaba
Nov 21 '18 at 15:51
records meaning documents or collections or indexes are missing? no nothing should be missing from a database that is dumped as above. of course no other but the database
DbNameis restored with the above command.– Kaveh Vahedipour
Nov 21 '18 at 15:54
Do all collections exist? Or are some missing? What are their names and what is your operating system? Or are certain records missing? Can you show that they exist as live documents in the database, e.g. using arangosh or the Web UI, and that the document with this exact key is not contained in the JSON dump?
– CoDEmanX
Nov 21 '18 at 16:25
Please look into updated description
– the_kaba
Nov 22 '18 at 10:03