1. 02 May, 2018 7 commits
    • Dave Watson's avatar
      update small locks benchmark · b4d8c0a7
      Dave Watson authored
      Summary: Re-run small locks bench.  Add server type to comment.
      
      Reviewed By: yfeldblum
      
      Differential Revision: D7830168
      
      fbshipit-source-id: 4b60ec6845bb3518a98f4645e521e95599072433
      b4d8c0a7
    • Yedidya Feldblum's avatar
      No need to optimize MicroSpinLock::lock in folly/futures/ · 86087f42
      Yedidya Feldblum authored
      Summary: [Folly] No need to optimize `MicroSpinLock::lock` in `folly/futures/` after {D7828158} (facebook/folly@6f9d8a145e1c37b2b47ff91491c647fe321de787).
      
      Reviewed By: nbronson
      
      Differential Revision: D7843192
      
      fbshipit-source-id: b40bcc0abcfed561a141864e135d72fe33f4067d
      86087f42
    • Matthieu Martin's avatar
      Allow python asyncio Future to wrap folly Fibers · ced29774
      Matthieu Martin authored
      Summary:
      This implements a new AsyncioLoopController for FiberManager, wrapping AsyncioExecutor.
      Thanks to recent simplication of LoopController, if I haven't missed anything, code is fairly simple, though not optimizer for thread-local.
      
      fiber_manager.pxd|pyx allow to link the life-time of AsyncioLoopController/FiberManager to the asyncio event loop.
      Code is similar to (and rely on) executor.pxd|pyd, which does the same for AsyncioExecutor.
      
      fibers.h|pxd provide a helper function for C++/python callers.
      Code is similar to futures.h|pyd, which does the same for folly Future.
      This is the main reason to keep a separate function/callback parameters. Not necessary for fibers, but a generic callback implementation can work for both fibers/future, which is convenient.
      
      There are a few lines that feel duplicated between future/fibers implementation, but it felt overkill to abstract further.
      
      Reviewed By: andriigrynenko
      
      Differential Revision: D7811432
      
      fbshipit-source-id: af0a07d7554acbab1fac44b7a9a6a98340501ef4
      ced29774
    • Yedidya Feldblum's avatar
      Remove deactivation from Future · 4e033e0c
      Yedidya Feldblum authored
      Summary: [Folly] Remove deactivation, a rarely-used facility, from `Future`.
      
      Reviewed By: marshallcline
      
      Differential Revision: D7788059
      
      fbshipit-source-id: 38db16fc3c2694b3cd772844fdafe71f6033a97c
      4e033e0c
    • Orvid King's avatar
      std::chrono'ize AsyncSSLSocketConnector · ea8e5b3b
      Orvid King authored
      Summary: Nothing breaks so....
      
      Reviewed By: yfeldblum, siyengar
      
      Differential Revision: D4377965
      
      fbshipit-source-id: 53c42e7f6f3a71aedd4b9a089ffca9d3c8472029
      ea8e5b3b
    • Julien Verlaguet's avatar
      Added DefaultKeepAliveExecutor.h to folly/Makefile.am · fd89379f
      Julien Verlaguet authored
      Reviewed By: yfeldblum
      
      Differential Revision: D7832437
      
      fbshipit-source-id: 036a89693e247e0d6356980c3bf9db84d322f408
      fd89379f
    • Matthieu Martin's avatar
      Delete PyGILStateGuard · c366fa15
      Matthieu Martin authored
      Summary: This abstraction is currently only used in functions executed on Python threads, so it should be unecessary.
      
      Reviewed By: andriigrynenko
      
      Differential Revision: D7828136
      
      fbshipit-source-id: a9ea8b23ffc26505c576106c49e850e1894648d5
      c366fa15
  2. 01 May, 2018 23 commits
    • Orvid King's avatar
      Rename FOLLY_GCC_DISABLE_WARNING to FOLLY_GNU_DISABLE_WARNING · 9bc01de8
      Orvid King authored
      Summary: This should allow better differentation between compilers in situations where warnings need to be disabled for a specific compiler. I've reclaimed the GCC_DISABLE version to have it now refer to only GCC, rather than GCC+CLANG, and also added a version for clang only.
      
      Reviewed By: yfeldblum
      
      Differential Revision: D7834730
      
      fbshipit-source-id: 7e0b076f5d9bc55870cfb7e67281190b4add82e6
      9bc01de8
    • Marshall Cline's avatar
      FutureBase::assign() consumes its arg, so pass that arg via rvalue-ref · fce8cf56
      Marshall Cline authored
      Summary:
      future/semifuture move-assignment operators call this->assign(). The latter's arg was passed as an lvalue-ref. Result: now that arg is an rvalue-ref.
      
      Note: I adjusted the assign() calling convention to avoid a forwarding ref. It would have been okay but it's easier to avoid a forwarding-ref than to explain why it happens to always be an rvalue-ref.
      
      Reviewed By: yfeldblum
      
      Differential Revision: D7831539
      
      fbshipit-source-id: cf1c66cd498f768905ac3d21e39f693d7a652b39
      fce8cf56
    • Nathan Bronson's avatar
      native aarch64 support for F14 hash tables · 19c316ae
      Nathan Bronson authored
      Summary:
      This diff adds support for the F14 algorithm using the advanced
      SIMD instructions (NEON) that are part of aarch64.
      
      Reviewed By: yfeldblum
      
      Differential Revision: D7765273
      
      fbshipit-source-id: 866a8a3481ad60b8aadcfb39718d6a5e62bbe07c
      19c316ae
    • Marshall Cline's avatar
      fix std::move() of a forwarding-ref - use std::forward instead · 25f4df21
      Marshall Cline authored
      Summary:
      Forwarding refs may hold lvalue-refs as well as rvalue-refs, so generally should be forward'd not move'd (to avoid erroneously consuming an lvalue).
      
      The `initial` param of `folly::reduce(first, last, initial, func)` (also used by `folly::reduce(container, initial, func)`) is a forwarding-ref but the code used `std::move(initial)`. Goal: change that to `std::forward<T>(initial)`.
      
      Reviewed By: yfeldblum
      
      Differential Revision: D7827721
      
      fbshipit-source-id: 12d4ee0ae3cfb0de71269575289c7cd8246eb468
      25f4df21
    • Marshall Cline's avatar
      remove `inline`s that don't add value · b7012f16
      Marshall Cline authored
      Summary: (self explanatory)
      
      Reviewed By: yfeldblum
      
      Differential Revision: D7825123
      
      fbshipit-source-id: 60c99950b3af351536c0fd0ba306b5796572e1b6
      b7012f16
    • Marshall Cline's avatar
      constify constifiable methods · 6161b9a5
      Marshall Cline authored
      Summary:
      Make these const:
      - {Future,SemiFuture}::hasValue()
      - {Future,SemiFuture}::hasException()
      - {Future,SemiFuture}::isActive()
      - Promise::throwIfFulfilled()
      
      Reviewed By: yfeldblum
      
      Differential Revision: D7824879
      
      fbshipit-source-id: 035b4bbcfd5b88825580e22b37b13e07158898f3
      6161b9a5
    • Marshall Cline's avatar
      Make CoreAndCallbackReference move-ctor faster, release memory eagerly/sooner · 38f07639
      Marshall Cline authored
      Summary:
      Avoid swap() in move-ctor:
        - slightly faster
        - frees resources eagerly/sooner vs. later
      
      Side benefit: added `noexcept` to a few appropriate methods.
      
      Reviewed By: yfeldblum
      
      Differential Revision: D7723078
      
      fbshipit-source-id: f2d08b5ce094c42cb114deda7a6841052d1b785a
      38f07639
    • Aaryaman Sagar's avatar
      Remove Timekeeper.h · 78443cdc
      Aaryaman Sagar authored
      Summary:
      Timekeeper.h had a weird circular dependence issue that would show up when
      included from within the future implementation headers.  The stuff in
      Timekeeper.h should ideally be within the future headers themselves
      
      Reviewed By: yfeldblum, Orvid
      
      Differential Revision: D7787275
      
      fbshipit-source-id: a6309c0cc5edca4f5bd12d2651c828299681df54
      78443cdc
    • Adam Simpkins's avatar
      remove Logging.h · cae28c3b
      Adam Simpkins authored
      Summary: Remove the Logging.h shim that was simply redirecting includes to GLog.h
      
      Reviewed By: yfeldblum
      
      Differential Revision: D7783879
      
      fbshipit-source-id: 8d1c1d8501c6a2b067ef72471885fedb3e9f7b10
      cae28c3b
    • Andrii Grynenko's avatar
      Fix NotificationQueueExecutor to use RequestContextScopeGuard · a6ddaecc
      Andrii Grynenko authored
      Reviewed By: yfeldblum
      
      Differential Revision: D7819076
      
      fbshipit-source-id: 1dae43c27b88ea1a78d2a54f556687e8c4bbc008
      a6ddaecc
    • Yi Cheng's avatar
      Add previous for EliasFano · 1f5581d8
      Yi Cheng authored
      Summary: Add previous for EliasFano reader. Here the equation is: reader == reader.next().previous();
      
      Reviewed By: ot
      
      Differential Revision: D7497171
      
      fbshipit-source-id: 33dc3316036b94a5da278c328322ea4c3322588e
      1f5581d8
    • Marshall Cline's avatar
      Fix "segfault if consumed/moved-out" in Future/SemiFuture/Promise · 57e4ac80
      Marshall Cline authored
      Summary:
      - Fix all cases of "segfault if consumed/moved-out"
        - In Future, SemiFuture, Promise.
        - Those now throw NoState instead.
      
      Reviewed By: yfeldblum
      
      Differential Revision: D7721921
      
      fbshipit-source-id: 76fafcbd30e23d63150196d3d7e404f348b220f2
      57e4ac80
    • Alex Chow's avatar
      Add global ThreadPoolExecutor list, support naming ThreadPoolExecutors · 7e5f29b8
      Alex Chow authored
      Summary: There isn't a good way to access ThreadPoolExecutors to add instrumentation, such as grabbing basic stats on all executors to better understand pool capacity. This provides a way to do that.
      
      Reviewed By: yfeldblum, djwatson
      
      Differential Revision: D7658144
      
      fbshipit-source-id: 3e72acdccf25742b76d438d2895d586049a0cc17
      7e5f29b8
    • Marc Celani's avatar
      Optimize MicroSpinLock for the unlocked case · 6f9d8a14
      Marc Celani authored
      Summary:
      MicroSpinLock was doing a non-relaxed load before cas, which seems odd because typically we expect spin locks to be unlocked. This diff flips the order and assumes the lock is unlocked before doing a load-loop.
      
      While the benchmark results for SmallLocksBenchmark are a little mixed, the results in a more real world use case in stats/DigestBuilderBenchmark show that this is a real winner.
      
      Reviewed By: djwatson
      
      Differential Revision: D7828158
      
      fbshipit-source-id: e195b9739ce931a67a39ffb9715a228aef59f6bc
      6f9d8a14
    • Doug Rabson's avatar
      Add SIGQUIT to the fatal signals list · 2378b40e
      Doug Rabson authored
      Summary: Some infrastructure sends `SIGQUIT` to stuck processes and we would like to be able to log stacktraces for these.
      
      Reviewed By: yfeldblum
      
      Differential Revision: D7819980
      
      fbshipit-source-id: d99a1232ca259bd95aed82505751e6591af748ff
      2378b40e
    • Marc Celani's avatar
      Re-run SmallLocksBenchmark · c0511309
      Marc Celani authored
      Summary:
      Just re-running it on newer hardware:
      
      32 processors
      model name      : Intel(R) Xeon(R) CPU E5-2660 0 @ 2.20GHz
      
      Reviewed By: yfeldblum
      
      Differential Revision: D7828138
      
      fbshipit-source-id: 30a25c6bf7bd0294f32f7598c701b49f045ab235
      c0511309
    • Steve O'Brien's avatar
      folly/fibers/Traits: remove dependency on boost/type_traits · 1b2c1c83
      Steve O'Brien authored
      Summary: Small change so that a template class `ExtractFirstArg` can do the same thing without relying on an expensive header, `boost/type_traits.hpp`.
      
      Reviewed By: yfeldblum
      
      Differential Revision: D7781675
      
      fbshipit-source-id: 1e5f431217da6cdd31ba1d77a8fc2b19a43808aa
      1b2c1c83
    • Steve O'Brien's avatar
      folly/ThreadLocal: remove dependency on iterator_facade · 641b9df1
      Steve O'Brien authored
      Summary: In a test build `<iterator/iterator_facade>` showed up as the most heavyweight include.  Remove this include, dependency on the boost lib, and implement whatever's needed for the bidirectional iterator interface.
      
      Reviewed By: yfeldblum
      
      Differential Revision: D7781659
      
      fbshipit-source-id: 380e0ae85b18c245845f479b2d268fdd3e16d54a
      641b9df1
    • Adam Simpkins's avatar
      move folly/experimental/logging to folly/logging/ · f3bc89fd
      Adam Simpkins authored
      Summary:
      Promote the folly logging code out of the experimental subdirectory.
      We have been using this for several months in a few projects and are pretty
      happy with it so far.
      
      After moving it out of the experimental/ subdirectory I plan to update
      folly::Init() to automatically support configuring it via a `--logging` command
      line flag (similar to the initialization it already does today for glog).
      
      Reviewed By: yfeldblum, chadaustin
      
      Differential Revision: D7755455
      
      fbshipit-source-id: 052db34c97f7516728f7cbb1a5ad959def2f6efb
      f3bc89fd
    • Marc Celani's avatar
      Track min and max in TDigest, do not allow estimates to go out of bounds · b9d5fd6e
      Marc Celani authored
      Summary: As title. We were special casing q == 1 or q == 0 improperly before. This led to some strange results where p100 < p99.9. Track min and max (useful anyway), and use those for boundaries.
      
      Reviewed By: anakryiko
      
      Differential Revision: D7800645
      
      fbshipit-source-id: 5fa3e1d0d286d4b31442196ba74b072030706786
      b9d5fd6e
    • Orvid King's avatar
      Support multi-config platforms when finding gmock · 13d672be
      Orvid King authored
      Summary: This should fix running tests in a vcpkg environment.
      
      Reviewed By: yfeldblum
      
      Differential Revision: D7822368
      
      fbshipit-source-id: a549febeb0bbea7208386cbed8a6ecb316b98661
      13d672be
    • Orvid King's avatar
      Use uint32_t rather than uint · c2d90c70
      Orvid King authored
      Summary: Because Windows doesn't have `uint` as it's non-standard.
      
      Reviewed By: djwatson
      
      Differential Revision: D7821774
      
      fbshipit-source-id: 4f7ff4468fc56052e28995f386e194fe70c6c513
      c2d90c70
    • Orvid King's avatar
      Use ThreadPtr in CPUThreadPoolExecutor to match the declaration · 71fe1d6a
      Orvid King authored
      Summary: Because it makes Visual Studio's intellisense happier, and it's always better to match exactly, rather than matching implicitly.
      
      Reviewed By: yfeldblum
      
      Differential Revision: D7821865
      
      fbshipit-source-id: 9e2380884b2d8d12944e3a3fc921e532208b1791
      71fe1d6a
  3. 30 Apr, 2018 5 commits
    • Matthieu Martin's avatar
      Rename NotificationQueueExecutor to AsyncioExecutor · 5840d67a
      Matthieu Martin authored
      Summary:
      And move it to folly::python namespace.
      We are going to make the python bridge work with fibers. This will require to make changes to this executor that are quite specific for the python use case.
      It doesn't hurt to remove YetAnotherExecutor choice from the main executor directory.
      
      Reviewed By: yfeldblum
      
      Differential Revision: D7811125
      
      fbshipit-source-id: eec21ccbbbad58aaa795df661ba58f67fa177645
      5840d67a
    • Xiao Shi's avatar
      mark inline library functions `noexcept` · 32e28492
      Xiao Shi authored
      Summary:
      As per discussions on D7784214, to be consistent with the functions used by the
      integral_hasher, mark these `noexcept`. Not much benefit for this diff other
      than consistency.
      
      Reviewed By: yfeldblum
      
      Differential Revision: D7797826
      
      fbshipit-source-id: 382c82556efd261841f3f6fb2ae892d26f3ceb0b
      32e28492
    • Stepan Palamarchuk's avatar
      Fix handling time counters · 533ea0cb
      Stepan Palamarchuk authored
      Summary:
      Currently we'll are getting incorrect Idle&Busy time counters for loops when there were no LoopCallbacks. This is because we don't properly refresh the `startWork_` and use the one from the last loop that had LoopCallbacks.
      
      This diff fixes that by properly refreshing `startWork_` even if there're no LoopCallbacks.
      
      Reviewed By: yfeldblum
      
      Differential Revision: D7811127
      
      fbshipit-source-id: 94ded08963b1bddc7b7859484f076d4c8a1e897f
      533ea0cb
    • Subodh Iyengar's avatar
      Fix shadow in AsyncUDPSocketTest · 62e3abb2
      Subodh Iyengar authored
      Summary: Fix shadown warning for xplat builds
      
      Reviewed By: yfeldblum
      
      Differential Revision: D7811636
      
      fbshipit-source-id: 609b5acaca3cfdd11059ed1ebbaa969e281487a2
      62e3abb2
    • Subodh Iyengar's avatar
      add connect method to AsyncUDPSocket · 50c13594
      Subodh Iyengar authored
      Summary:
      Calling connect on the UDP socket can avoid route lookups
      on the write path. This would be an optimization that would be
      useful for clients.
      
      There are several caveats of using connect() which we discovered
      during testing. These are documented and unit tests have been written
      for each of them.
      
      Reviewed By: yfeldblum
      
      Differential Revision: D7802389
      
      fbshipit-source-id: 09b71373a3a95c5dab73ee9345db0dbbf66d4ec5
      50c13594
  4. 28 Apr, 2018 4 commits
    • Marc Celani's avatar
      Move a function to .cpp file · 7a500026
      Marc Celani authored
      Summary: Some links are complaining of multiple definitions. Move to the cpp file to resolve.
      
      Reviewed By: yfeldblum
      
      Differential Revision: D7806874
      
      fbshipit-source-id: f25342d647505b676ba3659400c63d6a59344024
      7a500026
    • Marc Celani's avatar
      Remove emmintrin.h header from TDigest.cpp · 410c0a02
      Marc Celani authored
      Summary: This header is no longer needed since D7687476.
      
      Reviewed By: yfeldblum
      
      Differential Revision: D7804756
      
      fbshipit-source-id: 6596f5296965b593ab5b0decf4c67203e19b03c8
      410c0a02
    • Marc Celani's avatar
      Missing pragma once in QuantileEstimator-defs.h · 3490edad
      Marc Celani authored
      Summary: As title
      
      Reviewed By: tageorgiou
      
      Differential Revision: D7804647
      
      fbshipit-source-id: 9a58de258cd49a4d15ded05163975304c0e7e83b
      3490edad
    • Marc Celani's avatar
      Build fix for gcc · d60962e9
      Marc Celani authored
      Summary: This worked in clang but not in gcc. Quick fix
      
      Differential Revision: D7800576
      
      fbshipit-source-id: fcd04c0779f8a176043f3dede61289830a1ef607
      d60962e9
  5. 27 Apr, 2018 1 commit
    • Marc Celani's avatar
      QuantileEstimator · 69286490
      Marc Celani authored
      Summary: Introduces two QuantileEstimators. Both estimators use the TDigest for estimating quantiles, and giving accurate sum, count, and mean. One estimator uses a single digest, and the other uses a SlidingWindow of 60 digests. All writes to the data structure are buffered for 1 second.
      
      Reviewed By: anakryiko
      
      Differential Revision: D7645824
      
      fbshipit-source-id: 4f1f2c25388c3280f148591502449f857c6467d3
      69286490