1. 09 Aug, 2018 3 commits
    • Eric Niebler's avatar
      don't slice std:: exceptions in exception_wrapper::handle when no handler is found · 1d883868
      Eric Niebler authored
      Summary:
      Given an exception_wrapper `ew` holding a `std::runtime_error`, the following assertion fails:
      
      ```
      try {
        ew.handle();
      } catch( std::runtime_error const & ) {
      } catch( std::exception const & ) {
        assert(false);
      }
      ```
      
      Reviewed By: simpkins
      
      Differential Revision: D9199924
      
      fbshipit-source-id: b6f90ccf269a1b58f0dd07723451ff34cde1d529
      1d883868
    • Victor Zverovich's avatar
      Fix building of folly/compression with modules · be5070bf
      Victor Zverovich authored
      Summary: Move the definition of the `ZSTD_STATIC_LINKING_ONLY` and `ZDICT_STATIC_LINKING_ONLY` macros from code to the target to fix the modular build. It is needed because these macros affect the public API of `zstd.h`.
      
      Reviewed By: terrelln
      
      Differential Revision: D9189720
      
      fbshipit-source-id: efacc1456803900fd65159a43cf1fba2daf15673
      be5070bf
    • Fred Emmott's avatar
      Flush secureRandom buffer on fork · 8e927ee4
      Fred Emmott authored
      Summary: On fork, flush the secureRandom buffer, so that we don't share entropy between the parent and child.
      
      Reviewed By: ricklavoie
      
      Differential Revision: D9196474
      
      fbshipit-source-id: 12ff8488d814466186df61328a5f1d4000beb27f
      8e927ee4
  2. 08 Aug, 2018 12 commits
    • Aaryaman Sagar's avatar
      Print benchmark results as they complete · 173b48d4
      Aaryaman Sagar authored
      Summary:
      Print benchmark results as and when they complete instead of outputting the
      whole thing once at the end
      
      Reviewed By: djwatson, ot
      
      Differential Revision: D9177038
      
      fbshipit-source-id: 54898b303771f214c21163cd87b11f8e2083cdf4
      173b48d4
    • Sven Over's avatar
      fix `folly::via` for callables returning SemiFuture · ab24ce0c
      Sven Over authored
      Summary:
      When passing a callable to `folly::via` that returns a SemiFuture,
      via should return a Future. The implementation does the correct thing
      but the declaration's return type is not correct. This diff fixes that.
      
      Reviewed By: yfeldblum
      
      Differential Revision: D9219041
      
      fbshipit-source-id: e61544231e7846c713ff43394c3bf5d1aae18233
      ab24ce0c
    • Lee Howes's avatar
      Fix for lifetime bug in retrying. · 1d3ee8c5
      Lee Howes authored
      Summary: Late change in D9175807 removed necessary temporaries. This caused a lifetime management problem for GCC.
      
      Reviewed By: Orvid
      
      Differential Revision: D9227937
      
      fbshipit-source-id: d5fea8a98855c6302189a7dee8cd5862d13a63a3
      1d3ee8c5
    • Marshall Cline's avatar
      Perf improvement of folly::Future's map() · 7ef79a5f
      Marshall Cline authored
      Summary: folly::Future's map() functions create a std::vector<Future<...>>, then use push_back to populate that vector. This could result in reallocations. Avoid that by reserving proper space ahead of the push_backs.
      
      Reviewed By: yfeldblum
      
      Differential Revision: D9204713
      
      fbshipit-source-id: 51d9154f483a47c6196a4d4d9d4af14e4eeab6e0
      7ef79a5f
    • Caleb Marchent's avatar
      Include Symbolizer in Folly CMake build · f0939c67
      Caleb Marchent authored
      Summary: autotools-based builds are being deprecated, but they lack the symbolizer library target.
      
      Reviewed By: yfeldblum
      
      Differential Revision: D9216312
      
      fbshipit-source-id: 585ce3c43a0800823c7de4ece99b56a1af82bae4
      f0939c67
    • Lee Howes's avatar
      R-value qualify Future<T>::then and deprecate lvalue. · 64eaa718
      Lee Howes authored
      Summary:
      Overall plan to modify Future<T>::then to be r-value qualified and use Future<T>::thenTry or Future<T>::thenValue.
      
      The goal is to disambiguate folly::Future and to improve type and lifetime safety of Future and its methods.
      
       * Deprecate l-value qualified calls to Future<T>::then.
       * Make appropriate changes to folly to make this correct without local deprecation warnings.
      
      Reviewed By: yfeldblum
      
      Differential Revision: D9175807
      
      fbshipit-source-id: 9dc9812270ca3fb800f3a56d3aef8ef3d1d209e6
      64eaa718
    • Yedidya Feldblum's avatar
      Dead Code: folly/experimental/symbolizer/ElfUtil.cpp · 8f17118c
      Yedidya Feldblum authored
      Summary: [Folly] Dead Code: `folly/experimental/symbolizer/ElfUtil.cpp`.
      
      Reviewed By: calebmarchent
      
      Differential Revision: D9218592
      
      fbshipit-source-id: e231852c068eb797c7c3a4a3955fefc38e4be2fc
      8f17118c
    • Caleb Marchent's avatar
      Back out "[folly][PR] [CMake] Generalize include path for dwarf.h" · b4c37821
      Caleb Marchent authored
      Summary:
      Original commit changeset: 6b5faf000e5f
      
      Breaks builds on Ubuntu Bionic, effectivly undoing the work of D3878961.
      Note: both autotools and CMake builds incorrect on Bionic, its just that
      autotools build fails explicitly where CMake fails silently; failing to
      detect a correctly installed libdwarf headers. The difference being that
      CMake does not build symbolizer.
      
      Reviewed By: yfeldblum
      
      Differential Revision: D9194639
      
      fbshipit-source-id: c6798a0672195a70ced4898535f2f932018224d5
      b4c37821
    • Marc Celani's avatar
      Sort the digest after merge to deal with floating point accuracy · 24024c41
      Marc Celani authored
      Summary: When merging centroids together, we recalculate the mean and weight. This can sometimes lead to inaccuracy due to floating point arithmetic. In a bad scenario, this can actually lead to the digest being unsorted, which triggers assertions in the code. To fix this, sort the digest at the end of merge. Since this is bounded to 100 elements that are mostly sorted, this appears to be cheap according to benchmarks.
      
      Reviewed By: yfeldblum
      
      Differential Revision: D9213936
      
      fbshipit-source-id: 5a2978a1b759b70206aef57245bef193aed65efd
      24024c41
    • Tingzhe Zhou's avatar
      Improve blocking and accuracy · de95d5f9
      Tingzhe Zhou authored
      Summary:
      Blocking algorithm:
       Push:
      1.  push
      2.  increase the PTicket number
      3.  put (PTicket << 1) to the corresponding place in futex array.
      4.  if the original  futex value & 1  == 1,  wake up ()
      
      Pop:
      1.  increase the CTicket number
      2.  spin if the corresponding CTicket futex is not ready
      3.  set the right bit of the CTicket futex  to 1, wait on it.
      4. pop
      
      Add additional control to improve the accuracy:
      For the top several levels (top 0 - 3 levels by default), it does not arbitrarily insert any node in the middle of the list. Thus guaranteeing no later coming lower priorities can be insert at the top levels (pruning strategy still valid for the top four levels). For the bottom levels (start from level 7 by default), if insertion requires to hold parent + child locks, it traverses the parent list to check whether the parent list has lower priority nodes than the new node. If the condition holds, insert the new node to the parent and get the last node in the parent list and insert it to the child list.
      
      Reviewed By: magedm
      
      Differential Revision: D9094903
      
      fbshipit-source-id: fa4d31fb0c21da746570029e0e3b4b3fbeaa2024
      de95d5f9
    • Matthieu Martin's avatar
      Request context: optimize exec_set_difference · 7f721452
      Matthieu Martin authored
      Summary: This code is hot enough that this might matter. Though likely over-optimization.
      
      Reviewed By: djwatson
      
      Differential Revision: D9197636
      
      fbshipit-source-id: d9e2a90410c03a73d1754d99c72967f5dcd96c0f
      7f721452
    • Matthieu Martin's avatar
      RequestContext: replace F14FastMap by std::unordred_map · 6c822a8a
      Matthieu Martin authored
      Summary: Production data shows that it performs significantly worse under common RequestContext load (few elements, clang lto compiled).
      
      Reviewed By: djwatson
      
      Differential Revision: D9182929
      
      fbshipit-source-id: 0c638268d9b6cd2451b48ccc4e228faf90f0e18e
      6c822a8a
  3. 07 Aug, 2018 10 commits
    • Alex Guzman's avatar
      Add support for building from facebookincubator repos · e0d38a26
      Alex Guzman authored
      Summary: Currently, fbcode_builder assumes you're building code living in the facebook github org. If you try to do travis builds using a facebookincubator repo, an error occurs due to hard-coded assumptions about the org. This fixes that
      
      Reviewed By: knekritz
      
      Differential Revision: D9183307
      
      fbshipit-source-id: 0a1ac399953485e84f0534cc0616765227088c80
      e0d38a26
    • Lee Howes's avatar
      Missed l-value calls to future::then in Benchmark.cpp · b8e842cf
      Lee Howes authored
      Summary:
      Overall plan to modify Future<T>::then to be r-value qualified and use Future<T>::thenTry or Future<T>::thenValue. The goal is to disambiguate folly::Future and to improve type and lifetime safety of Future and its methods.
      
      Add a std::move that was missed in the folly benchmark.
      
      Reviewed By: shixiao
      
      Differential Revision: D9197265
      
      fbshipit-source-id: d02ab7b0dc22f6465910a80b2d0af1b54fb7bde7
      b8e842cf
    • Harsh Poddar's avatar
      Add function name property to LogMessage · 980baaf5
      Harsh Poddar authored
      Summary: This update adds the name of the function which called the LOG() to the `LogMessage` object so that a custom formatter could use it to show method name with logs.
      
      Reviewed By: simpkins
      
      Differential Revision: D9071926
      
      fbshipit-source-id: 9d5359d84cf2544371c6f1826f99d8b47a272dd1
      980baaf5
    • Xiao Shi's avatar
      use `to<std::string>` instead of `to_string` for android compatibility · daf5e5df
      Xiao Shi authored
      Summary:
      Apparently certain Android NDK does not support numeric conversion functions of
      `basic_string`. Use folly/Conv instead.
      
      Changes generated by `%s/std::to_string/to<std::string>/g`.
      
      In addition, Android SDK's treatment of `long double` is inconsistent. Avoid
      that in the tests for now.
      
      Reviewed By: yfeldblum
      
      Differential Revision: D9196009
      
      fbshipit-source-id: 54a32c426a4beb6a0e2d7f95d6b30bf6d7cc67cf
      daf5e5df
    • Misha Shneerson's avatar
      short-circuit connection callbacks onto same thread · cd09aea8
      Misha Shneerson authored
      Summary:
      When we have a single thread handling both connections and requests, we end up
      call the accept callback on the same thread. The code handling the
      incoming connections does intend to short-circuit such connection
      and not place them on EventBase's queue but it only checks only whether there is no
      EventBase registerd for the accept callback. However, by default, we are
      registering an EventBase for this callback so this short-circuit falls short
      (yay puns).
      
      Reviewed By: djwatson
      
      Differential Revision: D8986246
      
      fbshipit-source-id: 45b817669ae4fd908b39c93ae5b82bb9a14cc2ed
      cd09aea8
    • Dave Watson's avatar
      Initialize call_ and exec_ in move constructor · a4ef724b
      Dave Watson authored
      Summary: It's only two stores, but for move that ends up being a large percentage of the work it has to do.  Add initializers in the move constructor, so that we don't both default-initialize and then swap() inline.
      
      Reviewed By: yfeldblum
      
      Differential Revision: D8678422
      
      fbshipit-source-id: 71b574145182ad3a4a3e9d0d824d83abe65fb6fa
      a4ef724b
    • Marc Celani's avatar
      TDigest handles crazy outliers · 5c02ae45
      Marc Celani authored
      Summary: The algorithm in the TDigest paper does not handle weird outliers very well. This diff changes the clamp logic to clamp between the prev and next centroids rather than min_ and max_. This gives much better results.
      
      Reviewed By: yfeldblum
      
      Differential Revision: D9192686
      
      fbshipit-source-id: 171a7b7db5552802f91e6e95bb541a1b03c8821d
      5c02ae45
    • Victor Zverovich's avatar
      Fix includes in FingerprintPolynomial.h · 7659f9ba
      Victor Zverovich authored
      Summary:
      Add a missing include in `folly/detail/FingerprintPolynomial.h` to fix the
      modular build.
      
      Reviewed By: andrewjcg
      
      Differential Revision: D9182707
      
      fbshipit-source-id: c498b10bd02f6528a62fce8145521a97755d6496
      7659f9ba
    • Matthieu Martin's avatar
      Remove map/set import from folly Request.h · ad98d099
      Matthieu Martin authored
      Summary: We have a surprisingly high number of unrelated dependencies on those 2 imports
      
      Reviewed By: djwatson
      
      Differential Revision: D9155350
      
      fbshipit-source-id: e85e42934af8378cdc0db909d8a6afacb504df8f
      ad98d099
    • Andrii Grynenko's avatar
      Make fiber backtrace include the code which activated the fiber · 4bb09774
      Andrii Grynenko authored
      Reviewed By: yfeldblum, palmtenor
      
      Differential Revision: D9144908
      
      fbshipit-source-id: 6201a4beaf1e2d2cf16c8e3986097a6e8e47c6f3
      4bb09774
  4. 06 Aug, 2018 2 commits
  5. 05 Aug, 2018 3 commits
  6. 04 Aug, 2018 1 commit
  7. 03 Aug, 2018 9 commits
    • Subodh Iyengar's avatar
      Add missing headers · b1fe4e39
      Subodh Iyengar authored
      Summary:
      Add some missing headers required for
      other oss projects.
      
      These were not synced to the makefile.
      
      Reviewed By: shixiao
      
      Differential Revision: D9161271
      
      fbshipit-source-id: 283042c35ac9f78fef24348e0d78b26ab8f2eeb8
      b1fe4e39
    • Nathan Bronson's avatar
      fix bad codegen by widening needle · cc5a8cf0
      Nathan Bronson authored
      Summary:
      On architectures with SSE2 but not AVX2, the _mm_set1_epi8
      intrinsic at the core of F14Table::findImpl expands to multiple
      instructions.  One of those is a MOVD of either 4 or 8 byte width.
      Only the bottom byte of that move actually affects the result, but
      if a 1-byte needle has been spilled then this will be a 4 byte load.
      GCC 5.5 has been observed to reload (or perhaps fuse a reload and a
      narrow) needle using a MOVZX with a 1 byte load in parallel to the MOVD.
      This combination causes a failure of store-to-load forwarding, which has
      a big performance penalty (60 nanoseconds per find on a microbenchmark).
      Keeping needle >= 4 bytes avoids the problem and also happens to result
      in slightly more compact code.
      
      Reviewed By: yfeldblum
      
      Differential Revision: D9149727
      
      fbshipit-source-id: 9e957207c23914da317e763eb944bf7dd43a5c51
      cc5a8cf0
    • yenshan98's avatar
      Wording nit in README.md (#894) · 794ea600
      yenshan98 authored
      Summary:
      Change "If advanced debugging functionality is required" to "If advanced debugging functionality is required, use:" for consistency in README.md and to be more reader friendly.
      Pull Request resolved: https://github.com/facebook/folly/pull/894
      
      Reviewed By: shixiao
      
      Differential Revision: D9094182
      
      Pulled By: yfeldblum
      
      fbshipit-source-id: 147d436aaee291104b67eab1e549554696740907
      794ea600
    • Matthieu Martin's avatar
      Use more efficient container in Request · c5f64daf
      Matthieu Martin authored
      Summary:
      Use folly Map14 for RequestData and boost flat_set for RequestData's callbacks.
      See code comment to explain the choice.
      
      Reviewed By: vipannalla
      
      Differential Revision: D9147805
      
      fbshipit-source-id: adc2d26a7a46c5b7381599ebf44d26fa07e9b775
      c5f64daf
    • Victor Zverovich's avatar
      Fix building of targets using f14_hash with modules · e42d9766
      Victor Zverovich authored
      Summary:
      This fixes building of targets such as `folly:dynamic` that contain `F14Map.h`
      includes with modules (`mode/dev-mod`). Previously they failed with the
      following error:
      
      ```
      folly/container/F14Map.h:37:10: error: use of private header from outside its
      module: 'folly/container/F14Map-pre.h' [-Wprivate-header]
               ^
      ```
      
      Reviewed By: shixiao
      
      Differential Revision: D9144188
      
      fbshipit-source-id: 0476f88ce2373c8b9fbf148a2e0532ff92b2477a
      e42d9766
    • Xiao Shi's avatar
      explicitly convert to `InternalSizeType` in F14 · e2db8003
      Xiao Shi authored
      Summary:
      For F14Vector containers, we assume that the size could fit in `uint32_t`,
      i.e., the `InternalSizeType`. This diff fixes where we implicitly convert
      (shorten) a `size_t` to `InternalSizeType`.
      
      Reviewed By: nbronson
      
      fbshipit-source-id: e970071dbde6394262a555facc8e2a24c6007f68
      e2db8003
    • Joe Loser's avatar
      Generalize include path for dwarf.h (#790) · e66fb34c
      Joe Loser authored
      Summary:
      Do not assume `dwarf.h` is contained within a subdirectory called `libdwarf` during CMake configure.
      
      See https://github.com/facebook/folly/issues/788 for more detailed info.
      Fixes: #788.
      Pull Request resolved: https://github.com/facebook/folly/pull/790
      
      Reviewed By: andrewjcg
      
      Differential Revision: D9094892
      
      Pulled By: yfeldblum
      
      fbshipit-source-id: 6b5faf000e5ff4f85b2b93e43d12a911eb05b5ab
      e66fb34c
    • Matthieu Martin's avatar
      Improve setContext efficiency · dcb5a31e
      Matthieu Martin authored
      Summary: Avoid exponential cost of find in unodered set
      
      Reviewed By: yfeldblum, shubhanshu04
      
      Differential Revision: D9145024
      
      fbshipit-source-id: e7949e967e078a8857962893581495d03e01f989
      dcb5a31e
    • Xiao Shi's avatar
      Back out "[folly] use heterogeneous lookup and mutation in folly::dynamic" and... · 41431d75
      Xiao Shi authored
      Back out "[folly] use heterogeneous lookup and mutation in folly::dynamic" and "[folly] use F14NodeMap in folly::dynamic"
      
      Summary:
      D8299863 and D8299800
      
      Mostly backing out for xplat autoupdater. The TARGETS / DEFS got scrambled.
      
      Differential Revision: D9139265
      
      fbshipit-source-id: 78b0238370d4de4fdc363d0867dc46de3a572f58
      41431d75