java or stored procedure or hybrid approach
I have a situation where - i need migrate transaction from some tables to other tables.
Total transaction count is - around 20K to 25K. (including all tables)
This will be a daily sync-up process. I need to sync all the transactions. For sync up i need to check the data against 2 tables - which have count upto 10 millions. the count remains around 10 millions.
I need to sync it without any failure. If any transaction are failed then, need to maintain the error log and re-try the failed transaction.
If re-tried transaction are failed then I need to create a notification mechanism.
I have thought of few approaches , I have created a table to report the error in it - (ERROR_LOG)
1- Complete stored procedure -
but don't know how to handle notification mechanism in this case
2 - hybrid - procedures to migrate transactions - log the errors in stored procedure only - and then java for re-try handling and notification
but for java part - handling DB connection and connection timeout can be an issue
3- complete java approach - but i think it will be more time consuming
Any comments, reviews and suggestions are appreciated
java stored-procedures migration data-migration data-synchronization
asked Nov 21 '18 at 12:51
Ashish Shetkar
365214
add a comment |
I have a situation where - i need migrate transaction from some tables to other tables.
Total transaction count is - around 20K to 25K. (including all tables)
This will be a daily sync-up process. I need to sync all the transactions. For sync up i need to check the data against 2 tables - which have count upto 10 millions. the count remains around 10 millions.
I need to sync it without any failure. If any transaction are failed then, need to maintain the error log and re-try the failed transaction.
If re-tried transaction are failed then I need to create a notification mechanism.
I have thought of few approaches , I have created a table to report the error in it - (ERROR_LOG)
1- Complete stored procedure -
but don't know how to handle notification mechanism in this case
2 - hybrid - procedures to migrate transactions - log the errors in stored procedure only - and then java for re-try handling and notification
but for java part - handling DB connection and connection timeout can be an issue
3- complete java approach - but i think it will be more time consuming
Any comments, reviews and suggestions are appreciated
java stored-procedures migration data-migration data-synchronization
asked Nov 21 '18 at 12:51
Ashish Shetkar
365214
add a comment |
I have a situation where - i need migrate transaction from some tables to other tables.
Total transaction count is - around 20K to 25K. (including all tables)
This will be a daily sync-up process. I need to sync all the transactions. For sync up i need to check the data against 2 tables - which have count upto 10 millions. the count remains around 10 millions.
I need to sync it without any failure. If any transaction are failed then, need to maintain the error log and re-try the failed transaction.
If re-tried transaction are failed then I need to create a notification mechanism.
I have thought of few approaches , I have created a table to report the error in it - (ERROR_LOG)
1- Complete stored procedure -
but don't know how to handle notification mechanism in this case
2 - hybrid - procedures to migrate transactions - log the errors in stored procedure only - and then java for re-try handling and notification
but for java part - handling DB connection and connection timeout can be an issue
3- complete java approach - but i think it will be more time consuming
Any comments, reviews and suggestions are appreciated
java stored-procedures migration data-migration data-synchronization
asked Nov 21 '18 at 12:51
Ashish Shetkar
365214
I have a situation where - i need migrate transaction from some tables to other tables.
Total transaction count is - around 20K to 25K. (including all tables)
This will be a daily sync-up process. I need to sync all the transactions. For sync up i need to check the data against 2 tables - which have count upto 10 millions. the count remains around 10 millions.
I need to sync it without any failure. If any transaction are failed then, need to maintain the error log and re-try the failed transaction.
If re-tried transaction are failed then I need to create a notification mechanism.
I have thought of few approaches , I have created a table to report the error in it - (ERROR_LOG)
1- Complete stored procedure -
but don't know how to handle notification mechanism in this case
2 - hybrid - procedures to migrate transactions - log the errors in stored procedure only - and then java for re-try handling and notification
but for java part - handling DB connection and connection timeout can be an issue
3- complete java approach - but i think it will be more time consuming
Any comments, reviews and suggestions are appreciated
java stored-procedures migration data-migration data-synchronization
java stored-procedures migration data-migration data-synchronization
asked Nov 21 '18 at 12:51
Ashish Shetkar
365214
asked Nov 21 '18 at 12:51
Ashish Shetkar
365214
asked Nov 21 '18 at 12:51
Ashish Shetkar
365214
asked Nov 21 '18 at 12:51
Ashish Shetkar
365214
asked Nov 21 '18 at 12:51
Ashish Shetkar
365214
365214
add a comment |
add a comment |
active
oldest
votes
Your Answer
StackExchange.ifUsing("editor", function () {
StackExchange.using("externalEditor", function () {
StackExchange.using("snippets", function () {
StackExchange.snippets.init();
});
});
}, "code-snippets");
StackExchange.ready(function() {
var channelOptions = {
tags: "".split(" "),
id: "1"
};
initTagRenderer("".split(" "), "".split(" "), channelOptions);
StackExchange.using("externalEditor", function() {
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled) {
StackExchange.using("snippets", function() {
createEditor();
});
}
else {
createEditor();
}
});
function createEditor() {
StackExchange.prepareEditor({
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: true,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: 10,
bindNavPrevention: true,
postfix: "",
imageUploader: {
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
},
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
});
}
});
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f53412447%2fjava-or-stored-procedure-or-hybrid-approach%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
active
oldest
votes
active
oldest
votes
active
oldest
votes
active
oldest
votes
Thanks for contributing an answer to Stack Overflow!
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
To learn more, see our tips on writing great answers.
Some of your past answers have not been well-received, and you're in danger of being blocked from answering.
Please pay close attention to the following guidance:
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
To learn more, see our tips on writing great answers.
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f53412447%2fjava-or-stored-procedure-or-hybrid-approach%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
