- 05 Nov, 2020 5 commits
-
-
Wez Furlong authored
Summary: This commit takes advantage of git 2.5.0 being able to fetch a requested revision rather than relying on the desired revision being within the depth limited fetch. This relies on having git 2.5.0 on the server which is true for all of the projects we have manifests for; this shows zero matches: ``` $ rg repo_url opensource/fbcode_builder/manifests | grep -v github ``` We've had a couple of situations recently where folks have run into issues with the commit rate in folly being higher than then fetch depth, so this should address that. Refs: https://github.com/facebook/watchman/issues/866 Reviewed By: fanzeyi Differential Revision: D24747992 fbshipit-source-id: e9b67c61dddc9f55e05d8984e8d210e7d2faabcb
-
Andrii Grynenko authored
Summary: We shouldn't be sleeping less that requested and return silently. Reviewed By: lewissbaker Differential Revision: D24633977 fbshipit-source-id: 71ef422f0f72747bc19ac8491fdb8b148598d499
-
Junqi Wang authored
Summary: tsan reports warning in the test because the server socket writes in a thread but closes in another thread without synchronization. This was by design and is not a bug since implicit synchronization is done by joining client thread, but this isn't visible to tsan. The fix is to use a port reused new server socket to write response to client. Reviewed By: yfeldblum Differential Revision: D24675113 fbshipit-source-id: bdab8a5d5b6f85aa36ba84a6299e4457710625de
-
Alexey Spiridonov authored
Summary: There are two separate changes here. ### Use `find_package` The old setup of "let's manually enumerate and order the libraries that Bistro depends on" worked fine, except: - it was a bit brittle (requiring occasional patches as deps changed), and - it garnered a lot of feedback to the effect of "your build is weird, so it's probably broken because of that." Now I expect to have fewer breaks and more plausible deniability :) More importantly, this should make it much easier to migrate to `getdeps.py`. ## Statically link `fmt` After `fmt` was added as a `folly` dependency, and linked into Folly code used by Bistro, its tests would fail to run with this error: `test_sqlite_task_store: error while loading shared libraries: libfmt.so.6: cannot open shared object file: No such file or directory`. Something was getting messed up in the dynamic linking, and it wasn't clear to me what -- the way that Bistro is linking its dependencies certainly seems sensible. Most likely one of the dependencies is incompatible with dynamic linking in a subtle way. I suspect Proxygen. The `fmt.py` change in this diff addresses this problem by forcing static linking on the offending library. Reviewed By: yfeldblum Differential Revision: D24604309 fbshipit-source-id: 35ecbbb277b25907ecaee493e8b0081d9f20b865
-
Alexey Spiridonov authored
Summary: By putting this in `fizz-config.cmake`, we can use depend on the `sodium` target without compromising our dependents ability to find the library. Put the search module in the common location under `fbcode_builder/CMake` to let dependents use it. Reviewed By: yfeldblum Differential Revision: D24686041 fbshipit-source-id: 942d1ab34feef6cadac2b584eb8cb2d999bae0ca
-
- 04 Nov, 2020 3 commits
-
-
Yedidya Feldblum authored
Summary: [Folly] Use `::new` and `std::addressof` in `Try` to evade custom overloads of `operator new` and of `operator&` in certain types. Reviewed By: lewissbaker Differential Revision: D24698131 fbshipit-source-id: 9b4a3a5e9962018450104ee0d6df2cf58a2881b7
-
Francis Ricci authored
Summary: mmap() calls are a bit dangerous, in that the backing files can be corrupted or unreadable. Ideally, we would just migrate this whole symbolizer to use ::pread(), but in the meantime, just making sure that the last byte of the mmap'd file is readable seems to get rid of the crashes we've been seeing. Reviewed By: ccdavid Differential Revision: D24505608 fbshipit-source-id: e7bb3ea4d34f7b79f5a1cbb593a195f836d85ec7
-
TJ Yin authored
Summary: This diff appended uuid to copied files so that we won't run into race condition when 2 tests are executed at the same time. Reviewed By: meyering Differential Revision: D24589043 fbshipit-source-id: edb6b6eb6c8749694bdad15eb8d00d9f8d931cfc
-
- 02 Nov, 2020 4 commits
-
-
John Kearney authored
Summary: - Fix linker error when building with clang on windows Reviewed By: yfeldblum, jdonald Differential Revision: D24683230 fbshipit-source-id: fe9e5daebb058e007d8f5725ef31e62967a94f15
-
Nicholas Ormrod authored
Summary: The null-deleter test case showcases not_null's handling of null deleters. It also tries to demonstrate that std::unique_ptr does not handle null deleters properly (e.g. by segfaulting). The latter is really "check what kind of undefined behavior we encounter", and this doesn't always work. Surprise! Specifically, the undefined behavior encountered when supplying a null deleter into std::unique_ptr when using tsan is an infinite hang, which breaks the test suite. Fortunately, testing std::unique_ptr's handling of null deleters is irrelevant to the correctness of not_null_unique_ptr, so we can remove this code. After this diff, the following test does not hang: buck test mode/dev-tsan //folly/memory/test:not_null_test -- 'nn\.null_deleter' --run-disabled Reviewed By: yfeldblum Differential Revision: D24662902 fbshipit-source-id: 230187890b29e1d1a5c8284958c9b798c891c7f7
-
Dan Melnic authored
Summary: Fix heap use after free test issue Reviewed By: danobi Differential Revision: D24656212 fbshipit-source-id: 03ab1ee563f56e55a7b793155355c43bdfa11fdf
-
Kyle Nekritz authored
Reviewed By: yfeldblum Differential Revision: D24660041 fbshipit-source-id: fe31b99206d5bf5b643d8e8111b25c570fe7c0d8
-
- 31 Oct, 2020 1 commit
-
-
Aaryaman Sagar authored
Summary: This test inexplicably aborts when ran under TSAN. TSAN reports a read-write race where the exception is freed by the lock-holder / combiner thread and read concurrently by the thread that requested the combine operation. TSAN reports a similar read-write race for this code as well https://gist.github.com/aary/a14ae8d008e1d48a0f2d61582209f217 (copied below). Which is easier to verify as being correct. Though this does not conclusively prove that this test and implementation are race-free, the above repro combined with error-free stress runs of this test under other modes (optimized builds with and without both ASAN and UBSAN) give us a high signal at TSAN's error being a false-negative. So disabling it for now until some point in the future where TSAN stops reporting this as a false-negative ``` namespace { struct Storage { std::atomic<std::uint64_t> futex_{0}; std::atomic<std::uint64_t> next_; std::aligned_storage_t<48, 8> storage_; }; template <typename Waiter> void transferCurrentException(Waiter* waiter) { assert(std::current_exception()); new (&waiter->storage_) std::exception_ptr{std::current_exception()}; waiter->futex_.store(1, std::memory_order_release); } template <template <typename> class Atom = std::atomic> void concurrentExceptionPropagationStress( int, std::chrono::milliseconds) { auto exceptions = std::vector<std::unique_ptr<Storage>>{}; exceptions.resize(1000000); for (auto i = std::size_t{0}; i < exceptions.size(); ++i) { exceptions[i] = std::make_unique<Storage>(); } auto throwing = std::function<void(std::uint64_t)>{[&](auto counter) { if (counter % 2) { throw std::runtime_error{folly::to<std::string>(counter)}; } }}; std::cout << "Started test" << std::endl; auto writer = std::thread{[&]() { for (auto i = std::size_t{0}; i < exceptions.size(); ++i) { try { std::this_thread::yield(); throwing(i); } catch (...) { transferCurrentException(exceptions.at(i).get()); continue; } exceptions.at(i)->futex_.store(2, std::memory_order_release); } }}; auto reader = std::thread{[&]() { for (auto i = std::size_t{0}; i < exceptions.size(); ++i) { auto value = std::uint64_t{}; while (!(value = exceptions.at(i)->futex_.load(std::memory_order_acquire))) {} if (value == 1) { try { auto buf = reinterpret_cast<std::exception_ptr*>(&exceptions.at(i)->storage_); auto ex = folly::launder(buf); auto copy = std::move(*ex); ex->exception_ptr::~exception_ptr(); std::rethrow_exception(std::move(copy)); } catch (std::exception& exc) { assert(folly::to<std::uint64_t>(exc.what()) == i); } } } }}; reader.join(); writer.join(); } } // namespace ``` Reviewed By: yfeldblum Differential Revision: D24653383 fbshipit-source-id: 3ce166766eb42b22ec7b8cfaf8d31ca53580ff9e
-
- 30 Oct, 2020 6 commits
-
-
Lewis Baker authored
Summary: Fixes compilation of `co_await co_awaitTry(someTask.scheduleOn(ex))` when awaited within other `Task` coroutines by adding the `await_resume_try()` method to ViaIfAsyncAwaiter. Also added some unit-tests for this case. Reviewed By: andriigrynenko Differential Revision: D24650827 fbshipit-source-id: 687717d9f73f1fdcfb1f2ff17e4ddca46c16b189
-
Dan Melnic authored
Summary: Fix async socket test (stack-use-after-scope) Reviewed By: andriigrynenko Differential Revision: D24650836 fbshipit-source-id: 795fb71770612a409195d93216c7c5e129bea605
-
Dan Melnic authored
Summary: Avoid dereferencing a nullptr socket_ Reviewed By: danobi Differential Revision: D24652875 fbshipit-source-id: 63a9535226c8ff58fd5348f3c38f5c6c498d9527
-
Matt Joras authored
Summary: It's useful to be able to use the v4-mapped addresses sometimes. Reviewed By: avasylev Differential Revision: D24371807 fbshipit-source-id: 74fe13fa4bef9c77cc51a18137559facda9bdbeb
-
Lewis Baker authored
Summary: This adds support for applying the co_awaitTry() algorithm to a TaskWithExecutor type. This required a bit of a refactor of the `co_awaitTry()` implementtion to not require that it's passed a SemiAwaitable but and to allow Awaitable objects to also be passed to `co_awaitTry()`. Renamed TaskWithExecutor::InlineAwaiter to InlineTryAwaitable and make it private to better reflect its purpose. No longer implement `Task::Awaiter::await_resume()` in terms of the `await_resume_try()` method. This should avoid a call to the Try<T> move-constructor by extracting the T result directly from the Try<T> stored in the promise. Reviewed By: andriigrynenko Differential Revision: D24602729 fbshipit-source-id: d352e717877769502cc55a01731eb165ddad9ad8
-
Andrii Grynenko authored
Summary: This allows migrating projects that were creating custom NotificationQueues. Differential Revision: D24580356 fbshipit-source-id: ce9a15c408224b8a471246fde2bd121eab4ae329
-
- 29 Oct, 2020 5 commits
-
-
Dan Melnic authored
Summary: AsyncUDPSocket zerocopy support (Note: this ignores all push blocking failures!) Reviewed By: mjoras Differential Revision: D24553259 fbshipit-source-id: 8c2385a2a336f3c84c76e4e29f42596a5af657e7
-
Shawn Wu authored
Summary: Context: we don't yet support uint8_t/uint16_t as SkipValueType due to integral promotion errors. Once we do (something like D22249713, D24571536), consider the below test case ``` using ValueType = uint64_t; using SkipValueType = uint8_t; Encode<ValueType, SkipValueType, ...>({0, std::numeric_limits<ValueType>::max() -1}); ``` This would check fail at ``` CHECK_LT(upperBound >> numLowerBits, std::numeric_limits<SkipValueType>::max()); ``` (255 vs 255) In fact, I think CHECK_LE is a more correct check. Also made another check fail to print nicer results for uint8 values. Reviewed By: ot, philippv Differential Revision: D24605502 fbshipit-source-id: e422ed1f959ff8ef63dfe99149340637a3741b2a
-
Adam Simpkins authored
Summary: Replace the Travis build status badge in README.md with 3 separate badges for the newer Linux, Mac, and Windows builds performed via Github Actions. Reviewed By: yfeldblum, vitaut Differential Revision: D24610866 fbshipit-source-id: 6581387989fb15213519db7810a4430cfb04e2ea
-
Andrii Grynenko authored
Summary: evb_ can be updated by start/stopConsuming, so it's not safe to access it in the assertion (given that size() is thread safe). (Note: this ignores all push blocking failures!) Differential Revision: D24559287 fbshipit-source-id: b5886ce13fa54fb59361c1de110ec8bb02a06a12
-
Dongyi Ye authored
Summary: The current `pauseAccepting` and `resumeAccepting` will direct operate on the underlying udp socket to pause/resume read any packet. However this makes it hard to make similar behavior as TCP, which stop/pause the listening socket but still serving the accepted socket. As for UDP the bookkeeping is usually done at upper layer. this change will allowed the `AsyncUDPServerSocket` inform its callback that pause/resume new peer "connection". Reviewed By: yfeldblum Differential Revision: D24483859 fbshipit-source-id: ed10eaf3e9ef140112002303e37a73eff7d40943
-
- 28 Oct, 2020 5 commits
-
-
Dan Melnic authored
Summary: Avoid duplicate code for UDP CMSG processing (Note: this ignores all push blocking failures!) Reviewed By: yfeldblum Differential Revision: D24394694 fbshipit-source-id: 80664109154e78ec4d6ee8d33cf9a5269f60195e
-
Lewis Baker authored
Summary: Rather than conditionally calling either popAsyncStackFrameCallee() or deactivateAsyncStackFrame() depending on whether there is a parent frame, we now extend popAsyncStackFrameCallee() to handle the null parent case. Reviewed By: andriigrynenko Differential Revision: D24554471 fbshipit-source-id: 7f7ce64da63db1fa726d9fb23669fe49d03c2d6c
-
Lewis Baker authored
Summary: Removes the symmetricTransferMaybeReschedule() helper functions as the workarounds are no longer required now that clang fixes have been merged. Reviewed By: andriigrynenko Differential Revision: D24554145 fbshipit-source-id: ce3a6b6a8ead63b98e605c21d6555950b3b55c9a
-
Michael Park authored
Summary: Merely a terminology thing. An object returned by `co_await` is an awaiter, not an awaitable. Reviewed By: yfeldblum, lewissbaker Differential Revision: D24524929 fbshipit-source-id: ee9b7c8807972e78fff97f055d498977048d0c48
-
Lewis Baker authored
Summary: Allocation of InlineTaskDetached coroutines now call through to the folly_coro_async_malloc() and folly_coro_async_free() functions so that their allocations can be correctly accounted for as coroutine allocations. Reviewed By: yfeldblum Differential Revision: D24574568 fbshipit-source-id: 9bece3f8e6f6d221bca021a50fe02e1eed88f07b
-
- 27 Oct, 2020 3 commits
-
-
Lewis Baker authored
Summary: The previous implementation was calculating an address within the detached_task() function by just adding the constant +2 to the function-pointer. This was causing some issues with some of the tools used to optimise binaries. Reworked this implementation to instead actually return a true return-address obtained from the compiler builtin so that it's hopefully less problematic for those tools. Reviewed By: maksfb Differential Revision: D24506346 fbshipit-source-id: c41bd55ab09ebc70d040d355556ed4992243c14f
-
Simon Capper authored
Summary: D24542292 fixed a problem introduced by D24505812 (https://github.com/facebook/folly/commit/af8630489dc8318f72d18358591bc3fa0be304ff) with gcc version 6. Unfortunately this broke some python code generation. I didn't fully root cause the issue but it appears that the macro expansion of FMT_BEGIN_NAMESPACE is inconsistent. The original diff D24505812 (https://github.com/facebook/folly/commit/af8630489dc8318f72d18358591bc3fa0be304ff) hardcoded the fmt namespace I changed it to what the fmt lib used when declaring the formatter template. Reverting the change to use the macro back to hardcoding the fmt namespace fixes the test and still works around the gcc 6 compler problem. Reviewed By: vitaut Differential Revision: D24542292 fbshipit-source-id: cfaecf8bb94f3c6fc084ebae79886ad3e2b58539
-
Lewis Baker authored
Summary: The TaskTests::FutureRoundtrip and TaskTests::StartInlineUnsafe tests were incorrectly using stateful lambdas in a way that leads to the coroutines having a dangling reference to a destructed temporary lambda. This was causing ASAN failures. This changes those usages to instead use stateless lambdas. Reviewed By: lxfind Differential Revision: D24542508 fbshipit-source-id: 034d397b79e0553094a14d2cb6d00fe3816b4b92
-
- 26 Oct, 2020 3 commits
-
-
Michel Salim authored
Summary: The document titles should be explicitly passed, otherwise pandoc generates a warning and tries to guess Before: ``` folly/folly/docs on master ❯ make Format.html /usr/bin/pandoc -s -H style.css -f markdown -t html --toc -o Format.html Format.md [WARNING] This document format requires a nonempty <title> element. Defaulting to 'Format' as the title. To specify a title, use 'title' in metadata or --metadata title="...". folly/folly/docs on master ❯ make index.html /usr/bin/pandoc -s -H style.css -f markdown -t html --toc -o index.html *.md [WARNING] This document format requires a nonempty <title> element. Defaulting to 'AtomicHashMap' as the title. To specify a title, use 'title' in metadata or --metadata title="...". ``` After: ``` folly/folly/docs on fix-docs [!] ❯ make Format.html /usr/bin/pandoc -s -H style.css -f markdown -t html --toc -o Format.html Format.md --metadata title="folly/Format.h" folly/folly/docs on fix-docs [!] ❯ make index.html /usr/bin/pandoc -s -H style.css -f markdown -t html --toc -o index.html *.md --metadata title="Folly API Documentation" ``` Reviewed By: danobi Differential Revision: D24546374 fbshipit-source-id: 818e6ce39f361695a5f94c7662953062ea2f2868
-
Jeff Liang authored
Summary: Using the FunctionScheduler with PoissonDistribution will not work if we supply an interval of 36min+. This is around 2^31 so looks like it's hitting some integer limit. Also, there is no failure message and the behavior is that the function scheduler just never executes the function even for the first time after startup interval. Fixing this by using the proper type in the disribution. Reviewed By: yfeldblum Differential Revision: D24505727 fbshipit-source-id: ad050cf82bcf5a39383ffc601b52ad05d3d54f44
-
Huapeng Zhou authored
Summary: Original commit changeset: 578dd8981922 Reviewed By: jalopezsilva, pdubovitsky Differential Revision: D24531203 fbshipit-source-id: 573ccd55a4d8f3b6841cc533e25c84b18fe24d4d
-
- 25 Oct, 2020 2 commits
-
-
Eric Niebler authored
Summary: Some llvm toolsets mis-parse the function-like C-style casts in ConstexprMath.h as function declarations, resulting in strange compiler errors. Prefer `static_cast` to eliminate the ambiguity. Note: We cannot use brace-initialization syntax, because that would error on narrowing conversions. Reviewed By: ispeters, Mizuchi Differential Revision: D24463342 fbshipit-source-id: 5d5aabb08cd20e91a1a5f5460cc4505cafb3cdfc
-
Pavel Dubovitsky authored
Summary: This is a quick and dirty hack that works around a wasm dependency issue. The issue manifests itself in a compile error when including fmt headers during a wasm build. Reviewed By: shodoco Differential Revision: D24516599 fbshipit-source-id: 578dd8981922a97702992a8c30b88b47fef1706e
-
- 24 Oct, 2020 3 commits
-
-
Simon Capper authored
Summary: gcc versions 5 & 6 do not support template specializations outside the original namespace of the template even if the namespace is explicitly included in the template specialization. Differential Revision: D24505812 fbshipit-source-id: 693e93de5bc5074866fdea713436a06d35762cb7
-
Andrii Grynenko authored
Summary: taskExecuteCount_ can be incremented from a single thread, but reading it from another thread is still technically a data race. Mark it as atomic to make TSAN happy. Also make sure we never return < 0 when called from a non-consumer thread (since we only have the synchronization guarantee on the consumer thread). Differential Revision: D24523284 fbshipit-source-id: 6185125e132d71a83a3f29c909b7e4eab09e6e79
-
Dave Rigby authored
Summary: Glog v0.4.0 when configured with Debug build type adds a 'd' suffix to the library file. This results in FindGlog.cmake failing to locate it. Update FindGlog.cmake to use check for 'glogd', and use select_library_configurations() to set GLOG_LIBRARY to the correct found filename. (Note: this has no effect if a non-Debug type is used.) Pull Request resolved: https://github.com/facebook/folly/pull/1479 Reviewed By: yfeldblum Differential Revision: D24503510 Pulled By: Orvid fbshipit-source-id: 705df05a4a3d7df2df8af3bb66c319fb044adbce
-