kevinhakanson.com

Asking Claude Haiku to redefine A/B testing

October 4, 2024 #genai

During a call with customer, they mentioned that “friends and family” testing of features often gives positive feedback. I thought this would be a fun use of generative AI so I asked Claude Haiku for some help “redefining” A/B testing:

The software development terminology of A/B testing allows a team to experiment on two different strategies. Suggest what words “A” and “B” should represent based on the following rules:

  • One term should begin with the letter A and the other with the letter B
  • The first term should represent a group of people that are friendly or have a favorable opinion of what is being tested
  • The second term should represent a group that is hostile to changes and has unfavorable opinions of what is being tested

Based on the rules provided, the terms “A” and “B” could represent the following:

A: Advocates
B: Bureaucrats

Explanation:

  1. The first term, “A,” should begin with the letter A, and it should represent a group of people that are friendly or have a favorable opinion of what is being tested. In this case, “Advocates” would be a suitable term, as advocates are typically supportive and in favor of the changes or initiatives being tested.

  2. The second term, “B,” should begin with the letter B, and it should represent a group that is hostile to changes and has unfavorable opinions of what is being tested. “Bureaucrats” would be a suitable term in this case, as bureaucrats are often resistant to change and may have a more conservative or unfavorable stance towards new initiatives or ideas.

In the context of A/B testing, the “Advocates” group (A) would represent the users or stakeholders who are more likely to respond positively to the changes or new features being tested, while the “Bureaucrats” group (B) would represent those who may be more hesitant or resistant to the changes.


Kevin Hakanson

Multi-Cloud Certified Architect | DevSecOps | AppSec | Web Platform | Speaker | Learner | Builder
Twitter | LinkedIn | GitHub | Stack Overflow | Credly

© 2024 Kevin Hakanson (built with Gatsby)