A/B testing for microservices architecture and complex business processes
I am looking for best practices and approaches of using A/B testing in microservices architecture. Our client would like to use A/B testing in one of upcoming products, it is why we should propose the set of tools and practices for that in next couple of weeks. Let me list what sort of things we use in our products at this moment:
- Cloud – Azure, AKS
- Microservices - Java 9 + Spring Boot 2.0 + Docker
- Frontend – React
- Marketing – Hotjar, Google Analytics
I can share some ideas and wishes from our customer side architects:
- They see our business processes as BPM driven where every business process consists of several activities that can be reused by another business process
- There are some expectations from their side that if we introduce business process manager for our microservices, we can change the order of activities for A/B testing. For example step 1 can be moved in the middle of the process and they can review how it makes the process more convenient for end users
I also would like you to know that:
- All of the business processes in our products are driven by UI, which means that we have UI steps that are responsible for calling backend services(through one API Gateway for every UI portal)
- Current microservices communication can be characterized as choreography as we do not have any orchestration component: commands(messaging), events(messaging), queries(REST API)
After some research and summarizing experience from the past projects I see the following ideas that can be applied for all of the items related to A/B testing:
- Using microservices proxies or Service Mesh that will let us to control microservices instances versions which will be responsible for processing incoming requests - https://dzone.com/articles/canary-deployments-ab-testing-and-microservices-wi
- Using React A/B test tool - https://pillow.codes/how-to-quickly-set-up-a-b-testing-for-react-websites-dcb321fcd1f
- Using BPMN managers for business process activities and changing their order - https://thenewstack.io/camunda-offers-a-microservices-workflow-engine-built-on-bpmn/
- Using 3rd party A/B testing tools for measuring experiments and their results https://conversionxl.com/blog/ab-testing-tools/#ab-tasty
If you have any experience of using A and B testing for described cases, I will appreciate your help.
azure architecture microservices bpmn ab-testing asked Nov 21 at 10:19
Anuar Nurmakanov
598
add a comment |
I am looking for best practices and approaches of using A/B testing in microservices architecture. Our client would like to use A/B testing in one of upcoming products, it is why we should propose the set of tools and practices for that in next couple of weeks. Let me list what sort of things we use in our products at this moment:
- Cloud – Azure, AKS
- Microservices - Java 9 + Spring Boot 2.0 + Docker
- Frontend – React
- Marketing – Hotjar, Google Analytics
I can share some ideas and wishes from our customer side architects:
- They see our business processes as BPM driven where every business process consists of several activities that can be reused by another business process
- There are some expectations from their side that if we introduce business process manager for our microservices, we can change the order of activities for A/B testing. For example step 1 can be moved in the middle of the process and they can review how it makes the process more convenient for end users
I also would like you to know that:
- All of the business processes in our products are driven by UI, which means that we have UI steps that are responsible for calling backend services(through one API Gateway for every UI portal)
- Current microservices communication can be characterized as choreography as we do not have any orchestration component: commands(messaging), events(messaging), queries(REST API)
After some research and summarizing experience from the past projects I see the following ideas that can be applied for all of the items related to A/B testing:
- Using microservices proxies or Service Mesh that will let us to control microservices instances versions which will be responsible for processing incoming requests - https://dzone.com/articles/canary-deployments-ab-testing-and-microservices-wi
- Using React A/B test tool - https://pillow.codes/how-to-quickly-set-up-a-b-testing-for-react-websites-dcb321fcd1f
- Using BPMN managers for business process activities and changing their order - https://thenewstack.io/camunda-offers-a-microservices-workflow-engine-built-on-bpmn/
- Using 3rd party A/B testing tools for measuring experiments and their results https://conversionxl.com/blog/ab-testing-tools/#ab-tasty
If you have any experience of using A and B testing for described cases, I will appreciate your help.
azure architecture microservices bpmn ab-testing asked Nov 21 at 10:19
Anuar Nurmakanov
598
1
Your question does not look like programming question. It looks too broad to me. I think it would better fit on softwareengineering.stackexchange.com
– xmojmr
Nov 21 at 11:03
1
@xmojmr when referring other sites, it is often helpful to point that cross-posting is frowned upon
– gnat
Nov 21 at 22:10
add a comment |
I am looking for best practices and approaches of using A/B testing in microservices architecture. Our client would like to use A/B testing in one of upcoming products, it is why we should propose the set of tools and practices for that in next couple of weeks. Let me list what sort of things we use in our products at this moment:
- Cloud – Azure, AKS
- Microservices - Java 9 + Spring Boot 2.0 + Docker
- Frontend – React
- Marketing – Hotjar, Google Analytics
I can share some ideas and wishes from our customer side architects:
- They see our business processes as BPM driven where every business process consists of several activities that can be reused by another business process
- There are some expectations from their side that if we introduce business process manager for our microservices, we can change the order of activities for A/B testing. For example step 1 can be moved in the middle of the process and they can review how it makes the process more convenient for end users
I also would like you to know that:
- All of the business processes in our products are driven by UI, which means that we have UI steps that are responsible for calling backend services(through one API Gateway for every UI portal)
- Current microservices communication can be characterized as choreography as we do not have any orchestration component: commands(messaging), events(messaging), queries(REST API)
After some research and summarizing experience from the past projects I see the following ideas that can be applied for all of the items related to A/B testing:
- Using microservices proxies or Service Mesh that will let us to control microservices instances versions which will be responsible for processing incoming requests - https://dzone.com/articles/canary-deployments-ab-testing-and-microservices-wi
- Using React A/B test tool - https://pillow.codes/how-to-quickly-set-up-a-b-testing-for-react-websites-dcb321fcd1f
- Using BPMN managers for business process activities and changing their order - https://thenewstack.io/camunda-offers-a-microservices-workflow-engine-built-on-bpmn/
- Using 3rd party A/B testing tools for measuring experiments and their results https://conversionxl.com/blog/ab-testing-tools/#ab-tasty
If you have any experience of using A and B testing for described cases, I will appreciate your help.
azure architecture microservices bpmn ab-testing asked Nov 21 at 10:19
Anuar Nurmakanov
598
I am looking for best practices and approaches of using A/B testing in microservices architecture. Our client would like to use A/B testing in one of upcoming products, it is why we should propose the set of tools and practices for that in next couple of weeks. Let me list what sort of things we use in our products at this moment:
- Cloud – Azure, AKS
- Microservices - Java 9 + Spring Boot 2.0 + Docker
- Frontend – React
- Marketing – Hotjar, Google Analytics
I can share some ideas and wishes from our customer side architects:
- They see our business processes as BPM driven where every business process consists of several activities that can be reused by another business process
- There are some expectations from their side that if we introduce business process manager for our microservices, we can change the order of activities for A/B testing. For example step 1 can be moved in the middle of the process and they can review how it makes the process more convenient for end users
I also would like you to know that:
- All of the business processes in our products are driven by UI, which means that we have UI steps that are responsible for calling backend services(through one API Gateway for every UI portal)
- Current microservices communication can be characterized as choreography as we do not have any orchestration component: commands(messaging), events(messaging), queries(REST API)
After some research and summarizing experience from the past projects I see the following ideas that can be applied for all of the items related to A/B testing:
- Using microservices proxies or Service Mesh that will let us to control microservices instances versions which will be responsible for processing incoming requests - https://dzone.com/articles/canary-deployments-ab-testing-and-microservices-wi
- Using React A/B test tool - https://pillow.codes/how-to-quickly-set-up-a-b-testing-for-react-websites-dcb321fcd1f
- Using BPMN managers for business process activities and changing their order - https://thenewstack.io/camunda-offers-a-microservices-workflow-engine-built-on-bpmn/
- Using 3rd party A/B testing tools for measuring experiments and their results https://conversionxl.com/blog/ab-testing-tools/#ab-tasty
If you have any experience of using A and B testing for described cases, I will appreciate your help.
azure architecture microservices bpmn ab-testing azure architecture microservices bpmn ab-testing asked Nov 21 at 10:19
Anuar Nurmakanov
598
asked Nov 21 at 10:19
Anuar Nurmakanov
598
asked Nov 21 at 10:19
Anuar Nurmakanov
598
asked Nov 21 at 10:19
Anuar Nurmakanov
598
asked Nov 21 at 10:19
Anuar Nurmakanov
598
598
1
Your question does not look like programming question. It looks too broad to me. I think it would better fit on softwareengineering.stackexchange.com
– xmojmr
Nov 21 at 11:03
1
@xmojmr when referring other sites, it is often helpful to point that cross-posting is frowned upon
– gnat
Nov 21 at 22:10
add a comment |
1
Your question does not look like programming question. It looks too broad to me. I think it would better fit on softwareengineering.stackexchange.com
– xmojmr
Nov 21 at 11:03
1
@xmojmr when referring other sites, it is often helpful to point that cross-posting is frowned upon
– gnat
Nov 21 at 22:10
1
1
Your question does not look like programming question. It looks too broad to me. I think it would better fit on softwareengineering.stackexchange.com
– xmojmr
Nov 21 at 11:03
Your question does not look like programming question. It looks too broad to me. I think it would better fit on softwareengineering.stackexchange.com
– xmojmr
Nov 21 at 11:03
1
1
@xmojmr when referring other sites, it is often helpful to point that cross-posting is frowned upon
– gnat
Nov 21 at 22:10
@xmojmr when referring other sites, it is often helpful to point that cross-posting is frowned upon
– gnat
Nov 21 at 22:10
add a comment |
active
oldest
votes
Your Answer
StackExchange.ifUsing("editor", function () {
StackExchange.using("externalEditor", function () {
StackExchange.using("snippets", function () {
StackExchange.snippets.init();
});
});
}, "code-snippets");
StackExchange.ready(function() {
var channelOptions = {
tags: "".split(" "),
id: "1"
};
initTagRenderer("".split(" "), "".split(" "), channelOptions);
StackExchange.using("externalEditor", function() {
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled) {
StackExchange.using("snippets", function() {
createEditor();
});
}
else {
createEditor();
}
});
function createEditor() {
StackExchange.prepareEditor({
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: true,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: 10,
bindNavPrevention: true,
postfix: "",
imageUploader: {
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
},
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
});
}
});
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f53409872%2fa-b-testing-for-microservices-architecture-and-complex-business-processes%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
active
oldest
votes
active
oldest
votes
active
oldest
votes
active
oldest
votes
Thanks for contributing an answer to Stack Overflow!
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
To learn more, see our tips on writing great answers.
Some of your past answers have not been well-received, and you're in danger of being blocked from answering.
Please pay close attention to the following guidance:
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
To learn more, see our tips on writing great answers.
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f53409872%2fa-b-testing-for-microservices-architecture-and-complex-business-processes%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
1
Your question does not look like programming question. It looks too broad to me. I think it would better fit on softwareengineering.stackexchange.com
– xmojmr
Nov 21 at 11:03
1
@xmojmr when referring other sites, it is often helpful to point that cross-posting is frowned upon
– gnat
Nov 21 at 22:10