Skip to content

Categorize some libc++ test failures #6136

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
Stephan T. Lavavej (StephanTLavavej) merged 4 commits into from
Mar 4, 2026
Merged

Categorize some libc++ test failures #6136

Changes from all commits
Commits
Show all changes
4 commits
Select commit Hold shift + click to select a range
9572c02
Categorize some libc++ test failures
cpplearner Mar 3, 2026
3a3f721
Add internal VSO bug number.
StephanTLavavej Mar 3, 2026
7ef8a4c
Hyphenate LWG-461 to improve searchability.
StephanTLavavej Mar 3, 2026
58f9233
Merge branch 'main' into its-about-time
StephanTLavavej Mar 4, 2026
File filter

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
71 changes: 41 additions & 30 deletions tests/libcxx/expected_results.txt
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -177,6 +177,9 @@ std/language.support/support.limits/support.limits.general/ranges.version.compil
# libc++ is missing various <format> DRs
std/language.support/support.limits/support.limits.general/format.version.compile.pass.cpp FAIL

# libc++ doesn't implement LWG-2295 "Locale name when the provided Facet is a nullptr"
std/localization/locales/locale/locale.cons/name_construction.pass.cpp FAIL

# libc++ doesn't implement LWG-2584 (LLVM-99976)
std/re/re.regex/re.regex.construct/bad_escape.pass.cpp FAIL

Expand Down Expand Up @@ -442,6 +445,10 @@ std/utilities/meta/meta.unary/meta.unary.prop/reference_constructs_from_temporar
std/utilities/meta/meta.unary/meta.unary.prop/reference_converts_from_temporary.pass.cpp:0 FAIL
std/utilities/meta/meta.unary/meta.unary.prop/reference_converts_from_temporary.pass.cpp:1 FAIL

# DevCom-10892055 VSO-2453093 ADL fails to consider the namespace associated with the base class under a specific scenario
std/ranges/range.adaptors/range.adaptor.object/range_adaptor_closure.pass.cpp:0 FAIL
std/ranges/range.adaptors/range.adaptor.object/range_adaptor_closure.pass.cpp:1 FAIL


# *** CLANG COMPILER BUGS ***
# LLVM-46207 Clang's tgmath.h interferes with the UCRT's tgmath.h
Expand Down Expand Up @@ -498,15 +505,6 @@ std/localization/locale.categories/category.monetary/locale.moneypunct.byname/ne
std/localization/locale.categories/category.monetary/locale.moneypunct.byname/negative_sign.pass.cpp FAIL
std/localization/locale.categories/category.monetary/locale.moneypunct.byname/pos_format.pass.cpp FAIL
std/localization/locale.categories/category.monetary/locale.moneypunct.byname/thousands_sep.pass.cpp FAIL
std/localization/locale.categories/category.time/locale.time.get.byname/get_date.pass.cpp FAIL
std/localization/locale.categories/category.time/locale.time.get.byname/get_date_wide.pass.cpp FAIL
std/localization/locale.categories/category.time/locale.time.get.byname/get_monthname.pass.cpp FAIL
std/localization/locale.categories/category.time/locale.time.get.byname/get_monthname_wide.pass.cpp FAIL
std/localization/locale.categories/category.time/locale.time.get.byname/get_one.pass.cpp FAIL
std/localization/locale.categories/category.time/locale.time.get.byname/get_one_wide.pass.cpp FAIL
std/localization/locale.categories/category.time/locale.time.get.byname/get_weekday.pass.cpp FAIL
std/localization/locale.categories/category.time/locale.time.get.byname/get_weekday_wide.pass.cpp FAIL
std/localization/locale.categories/category.time/locale.time.put.byname/put1.pass.cpp FAIL
std/localization/locale.categories/facet.numpunct/locale.numpunct.byname/thousands_sep.pass.cpp FAIL

# GH-1374: Spaceship CPO wording in [cmp.alg] needs an overhaul
Expand All @@ -532,6 +530,10 @@ std/input.output/string.streams/stringbuf/stringbuf.members/view.pass.cpp FAIL
std/input.output/syncstream/syncbuf/syncstream.syncbuf.cons/dtor.pass.cpp FAIL
std/input.output/syncstream/syncbuf/syncstream.syncbuf.members/emit.pass.cpp FAIL

# GH-4273: <ranges>: lazy_split_view should use _Non_propagating_cache instead of _Defaultabox
std/ranges/range.adaptors/range.lazy.split/ctor.copy_move.pass.cpp FAIL
std/ranges/range.adaptors/range.lazy.split/range.lazy.split.inner/iter_swap.pass.cpp FAIL

# GH-5393: <regex>: What names can and should regex_traits::lookup_collatename() recognize?
std/re/re.alg/re.alg.match/awk.pass.cpp FAIL
std/re/re.alg/re.alg.match/basic.pass.cpp FAIL
Expand All @@ -543,6 +545,28 @@ std/re/re.alg/re.alg.search/ecma.pass.cpp FAIL
std/re/re.alg/re.alg.search/extended.pass.cpp FAIL
std/re/re.traits/lookup_collatename.pass.cpp FAIL

# GH-6128 <xloctime>: do_get_monthname and do_get_weekday do not set eofbit in some cases, but libcxx tests expect them to do
std/localization/locale.categories/category.time/locale.time.get.byname/get_monthname.pass.cpp FAIL
std/localization/locale.categories/category.time/locale.time.get.byname/get_monthname_wide.pass.cpp FAIL
std/localization/locale.categories/category.time/locale.time.get.byname/get_weekday.pass.cpp FAIL
std/localization/locale.categories/category.time/locale.time.get.byname/get_weekday_wide.pass.cpp FAIL
std/localization/locale.categories/category.time/locale.time.get/locale.time.get.members/get_monthname.pass.cpp FAIL
std/localization/locale.categories/category.time/locale.time.get/locale.time.get.members/get_monthname_wide.pass.cpp FAIL
std/localization/locale.categories/category.time/locale.time.get/locale.time.get.members/get_weekday.pass.cpp FAIL
std/localization/locale.categories/category.time/locale.time.get/locale.time.get.members/get_weekday_wide.pass.cpp FAIL

# GH-6129 <xloctime>: time_get::do_get uses the wrong format for %c and %x
# GH-6130 <xloctime>: time_get::do_get doesn't parse a literal %
std/localization/locale.categories/category.time/locale.time.get.byname/get_one.pass.cpp FAIL
std/localization/locale.categories/category.time/locale.time.get.byname/get_one_wide.pass.cpp FAIL
std/localization/locale.categories/category.time/locale.time.get/locale.time.get.members/get_one.pass.cpp FAIL

# GH-6134 <xloctime>: time_put::do_put does not match strftime for the %c and %r specifiers in the "C" locale
std/localization/locale.categories/category.time/locale.time.put/locale.time.put.members/put2.pass.cpp FAIL

# GH-6135 <xloctime>: time_put_byname doesn't encode the output in UTF-8 even if the locale name contains ".UTF-8"
std/localization/locale.categories/category.time/locale.time.put.byname/put1.pass.cpp FAIL


# *** VCRUNTIME BUGS ***

Expand Down Expand Up @@ -718,6 +742,14 @@ std/language.support/support.limits/limits/numeric.limits.members/traps.pass.cpp
std/language.support/support.limits/limits/numeric.limits.members/traps.pass.cpp:1 FAIL
std/language.support/support.limits/limits/numeric.limits.members/traps.pass.cpp:2 SKIPPED

# Non-Standard assumption that current_zone() is affected by the TZ environment variable
std/time/time.zone/time.zone.db/time.zone.db.access/current_zone.pass.cpp FAIL
std/time/time.zone/time.zone.db/time.zone.db.tzdb/current_zone.pass.cpp FAIL

# LWG-4285 "time_get::do_get_date is problematic even after LWG-461" (Open)
std/localization/locale.categories/category.time/locale.time.get.byname/get_date.pass.cpp FAIL
std/localization/locale.categories/category.time/locale.time.get.byname/get_date_wide.pass.cpp FAIL


# *** LIKELY STL BUGS ***
# Not analyzed, likely STL bugs. Various assertions.
Expand Down Expand Up @@ -752,12 +784,6 @@ std/localization/locale.categories/category.monetary/locale.money.put/locale.mon
std/localization/locale.categories/category.monetary/locale.money.put/locale.money.put.members/put_string_en_US.pass.cpp FAIL
std/localization/locale.categories/category.monetary/locale.moneypunct/locale.moneypunct.members/decimal_point.pass.cpp FAIL
std/localization/locale.categories/category.monetary/locale.moneypunct/locale.moneypunct.members/thousands_sep.pass.cpp FAIL
std/localization/locale.categories/category.time/locale.time.get/locale.time.get.members/get_monthname_wide.pass.cpp FAIL
std/localization/locale.categories/category.time/locale.time.get/locale.time.get.members/get_monthname.pass.cpp FAIL
std/localization/locale.categories/category.time/locale.time.get/locale.time.get.members/get_one.pass.cpp FAIL
std/localization/locale.categories/category.time/locale.time.get/locale.time.get.members/get_weekday_wide.pass.cpp FAIL
std/localization/locale.categories/category.time/locale.time.get/locale.time.get.members/get_weekday.pass.cpp FAIL
std/localization/locale.categories/category.time/locale.time.put/locale.time.put.members/put2.pass.cpp FAIL
std/localization/locale.stdcvt/codecvt_utf16_in.pass.cpp FAIL
std/localization/locale.stdcvt/codecvt_utf16_length.pass.cpp FAIL
std/localization/locale.stdcvt/codecvt_utf16_max_length.pass.cpp FAIL
Expand Down Expand Up @@ -907,10 +933,6 @@ std/iterators/predef.iterators/move.iterators/move.iter.ops/move.iter.op.comp/op
std/iterators/predef.iterators/move.iterators/move.iter.ops/move.iter.op.comp/op_gte.pass.cpp FAIL
std/iterators/predef.iterators/move.iterators/move.iter.ops/move.iter.op.comp/op_lte.pass.cpp FAIL

# Not analyzed. error C2280: 'std::ranges::lazy_split_view<InputView,ForwardTinyView>::lazy_split_view(const std::ranges::lazy_split_view<InputView,ForwardTinyView> &)': attempting to reference a deleted function
std/ranges/range.adaptors/range.lazy.split/ctor.copy_move.pass.cpp FAIL
std/ranges/range.adaptors/range.lazy.split/range.lazy.split.inner/iter_swap.pass.cpp FAIL

# Not analyzed.
# Clang error: non-type template argument is not a constant expression
std/utilities/tuple/tuple.tuple/tuple.cnstr/convert_const_move.pass.cpp:2 FAIL
Expand Down Expand Up @@ -988,9 +1010,6 @@ std/utilities/format/format.tuple/format.pass.cpp FAIL
# Not analyzed, unexpected separators. Assertion failed: stream_fr_FR_locale<CharT>(-1'000'000s) == SV("-1 000 000s")
std/time/time.duration/time.duration.nonmember/ostream.pass.cpp FAIL

# Not analyzed. Assertion failed: loc.name() == "*"
std/localization/locales/locale/locale.cons/name_construction.pass.cpp FAIL

# Not analyzed. Blocked by our ctype_base deriving from locale::facet.
std/localization/locale.categories/category.numeric/locale.num.get/user_defined_char_type.pass.cpp FAIL

Expand Down Expand Up @@ -1049,10 +1068,6 @@ std/time/time.zone/time.zone.leap/members/date.pass.cpp FAIL
std/time/time.zone/time.zone.leap/members/value.pass.cpp FAIL
std/time/time.zone/time.zone.leap/nonmembers/comparison.pass.cpp FAIL

# Not analyzed. Assertion failed: tz->name() == zone
std/time/time.zone/time.zone.db/time.zone.db.access/current_zone.pass.cpp FAIL
std/time/time.zone/time.zone.db/time.zone.db.tzdb/current_zone.pass.cpp FAIL

# Not analyzed. Assertion failed: buffer.pubsetbuf(b, 10) == &buffer
std/input.output/file.streams/fstreams/filebuf.virtuals/setbuf.pass.cpp FAIL

Expand Down Expand Up @@ -1087,10 +1102,6 @@ std/containers/sequences/vector/vector.capacity/shrink_to_fit_exceptions.pass.cp
std/depr/depr.c.headers/stdalign_h.compile.pass.cpp:0 FAIL
std/depr/depr.c.headers/stdalign_h.compile.pass.cpp:1 FAIL

# Not analyzed. Probably an MSVC compiler bug, as it rejects `n | negate | negate` while Clang accepts.
std/ranges/range.adaptors/range.adaptor.object/range_adaptor_closure.pass.cpp:0 FAIL
std/ranges/range.adaptors/range.adaptor.object/range_adaptor_closure.pass.cpp:1 FAIL

# Not analyzed. Emitting easily-suppressed truncation warnings for MSVC, but also compiler errors for MSVC and Clang.
std/algorithms/alg.modifying.operations/alg.copy/ranges.copy.pass.cpp FAIL

Expand Down