# Next-Level A/B is Testing: 'inconclusive results' is ambiguous (p. 12)

**URL:** <https://forum.devtalk.com/t/next-level-a-b-is-testing-inconclusive-results-is-ambiguous-p-12/172141>\
**Category:** PragProg Customers\
**Tags:** book-next-level-a-b-testing\
**Created:** [30 September 2024 14:05 UTC](https://forum.devtalk.com/t/next-level-a-b-is-testing-inconclusive-results-is-ambiguous-p-12/172141 "2024-09-30T14:05:48Z")\
**Posts on this page:** 3\
**Page:** 1

<div class="post-metadata">

**Author:** ![dlindelof](https://forum.devtalk.com/letter_avatar_proxy/v4/letter/d/bbe5ce/32.png) [@dlindelof](https://forum.devtalk.com/u/dlindelof)\
**Post date:** [30 September 2024 14:05 UTC](https://forum.devtalk.com/t/next-level-a-b-is-testing-inconclusive-results-is-ambiguous-p-12/172141/1 "2024-09-30T14:05:48Z")

</div>

@leemay

The book refers to ‘inconclusive results’ starting on page 12. I would caution against introducing this term without carefully defining it. At my dayjob I frequently deal with product managers who believe that an A/B experiment with a neutral outcome is ‘inconclusive’, when in fact it just says that there is no statistically significant difference between the two arms.

---

<div class="post-metadata">

**Author:** ![leemay](https://forum.devtalk.com/user_avatar/forum.devtalk.com/leemay/32/4889_2.png) [@leemay](https://forum.devtalk.com/u/leemay)\
**Post date:** [30 September 2024 14:59 UTC](https://forum.devtalk.com/t/next-level-a-b-is-testing-inconclusive-results-is-ambiguous-p-12/172141/2 "2024-09-30T14:59:30Z")

</div>

That’s a really good point. I’ll do exactly as you suggest, define and give caveats. Luckily we’re still in beta so I can make these changes this week. Thank you David!

---

<div class="post-metadata">

**Author:** ![leemay](https://forum.devtalk.com/user_avatar/forum.devtalk.com/leemay/32/4889_2.png) [@leemay](https://forum.devtalk.com/u/leemay)\
**Post date:** [30 September 2024 15:01 UTC](https://forum.devtalk.com/t/next-level-a-b-is-testing-inconclusive-results-is-ambiguous-p-12/172141/3 "2024-09-30T15:01:14Z")

</div>

That’s a really good point. I’ll do exactly as you suggest, the details matter. I’ll define and give caveats of what it looks like in practice/what that could mean. Luckily we’re still in beta so I can make these changes this week. Thank you @dlindelof!
