1. 16 Aug, 2019 3 commits
    • Adam Simpkins's avatar
      getdeps: allow overriding project source, build, and install directories · 8479be08
      Adam Simpkins authored
      Summary:
      Add arguments to getdeps.py to allow overriding the source, build, and install
      directories a per-project basis.  The arguments take the form `[PROJECT:]PATH`
      If the `PROJECT` portion is omitted, it defaults to the current project being
      built.
      
      In particular this makes it possible to specify `--src-dir .` to tell
      getdeps.py to find the project sources from the current directory rather than
      downloading them.
      
      Reviewed By: wez
      
      Differential Revision: D16778011
      
      fbshipit-source-id: f33b87213ace04abb66334f588babdf59df91964
      8479be08
    • Adam Simpkins's avatar
      getdeps: fix a crash if the project_hashes directory does not exist · 4ce59c1d
      Adam Simpkins authored
      Summary:
      This makes getdeps.py no longer crash if used in the folly repository.
      Folly does not depend on any other Facebook projects, so it does not
      include a `build/deps` directory.
      
      Reviewed By: wez
      
      Differential Revision: D16778009
      
      fbshipit-source-id: 41be53d862f41b62154b081eb90ddba8742658fe
      4ce59c1d
    • Adam Simpkins's avatar
      getdeps: consolidate code for project subcommands · 27bf440a
      Adam Simpkins authored
      Summary:
      Most of the getdeps subcommands operate on a single project, and some of the
      argument parsing and initial logic to load the project is largely the same.
      This consolidates that logic into a base class so that we can share this code
      across subcommands, instead of repeating it.
      
      This also unifies the behavior so that by default all commands enable tests on
      the specified project, and disable test on dependent projects.  Making sure
      all commands use the same behavior here is important as whether are not tests
      are enabled can affect the project configuration, and therefore affect its
      getdeps hash.
      
      Reviewed By: wez
      
      Differential Revision: D16778010
      
      fbshipit-source-id: 044f99ad6cdd4a56f843276cec8ead786249ee7a
      27bf440a
  2. 15 Aug, 2019 3 commits
  3. 14 Aug, 2019 2 commits
    • Mark Santaniello's avatar
      more pmr support for sorted_vector_types · 66270d4e
      Mark Santaniello authored
      Summary:
      - Add allocator-extended copy constructors
      - Add allocator-extended move constructors
      - Add allocator-extended initializer-list constructor
      - Add get_allocator accessor
      - Make emplace/emplace_hint use the allocator
      - pmr tests catch allocations that "escape" by setting the default resource to null
      
      Reviewed By: nbronson
      
      Differential Revision: D16623448
      
      fbshipit-source-id: c10682f98d1c234fcad95608643b2f3ccea64a41
      66270d4e
    • Mark Santaniello's avatar
      mark small_vector get_allocator() as const · f9b0a56b
      Mark Santaniello authored
      Summary: This function should be marked const.
      
      Reviewed By: yfeldblum
      
      Differential Revision: D16793980
      
      fbshipit-source-id: 3e98f999c3e00caa0d238fa29c082ab6e819bf2a
      f9b0a56b
  4. 13 Aug, 2019 1 commit
    • Adam Simpkins's avatar
      getdeps: fix handling of the --host-type command line flag · 9f73ab95
      Adam Simpkins authored
      Summary:
      Fix the BuildOptions class to correctly honor the `host_type` parameter that
      it was constructed with when constructing the manifest evaluation context.
      I accidentally broke this behavior in D16477396, and incorrectly had this code
      path default to using the current host system rather than the value passed in
      from the command line.
      
      Reviewed By: wez
      
      Differential Revision: D16779579
      
      fbshipit-source-id: de911daaa643f6303fd35149775ab25d3f64d34f
      9f73ab95
  5. 12 Aug, 2019 2 commits
  6. 11 Aug, 2019 1 commit
    • Nathan Bronson's avatar
      fix SwapTrackingAlloc initial conditions · 59799039
      Nathan Bronson authored
      Summary:
      This diff fixes the initial conditions for SwapTrackingAlloc,
      which fixes F14 tests on platforms that do not have intrinsics enabled.
      
      Differential Revision: D16755857
      
      fbshipit-source-id: a76d8093100cbc0c5ce8723daa0976673d942299
      59799039
  7. 10 Aug, 2019 1 commit
    • Nathan Bronson's avatar
      reusable key destructuring logic for implementing emplace · a44b291c
      Nathan Bronson authored
      Summary:
      This diff extracts the key destructuring logic in F14's emplace
      functions into standalone helpers that can be used by other container
      types (like sorted_vector_{set,map}).  It also adds better PMR compliance, by
      using a stateful allocator to construct a temporary if that is required
      to be able to perform the search.
      
      This diff also cleans up some of the testing code in folly/container/test
      that had issues if included in multiple places.
      
      Reviewed By: yfeldblum
      
      Differential Revision: D16655131
      
      fbshipit-source-id: 5a6f57ac346d1fd5928e0f737110760b0c518974
      a44b291c
  8. 09 Aug, 2019 1 commit
    • Adam Simpkins's avatar
      getdeps: make sure ManifestLoader never reloads manifests · 120ac01a
      Adam Simpkins authored
      Summary:
      In response to review feedback for D16477400 and D16477401, update
      `ManifestLoader.load_all_manifests()` to only update its data for projects
      that have not previously been loaded.  This helps ensure that code using a
      single `ManifestLoader` object cannot have two in-memory `Manifest` objects
      for the same project, and that existing data (such as project hashes) can't be
      invalidated if a manifest is later loaded from updated on-disk data.
      
      Reviewed By: pkaush
      
      Differential Revision: D16586682
      
      fbshipit-source-id: 50b1979ec55f2ad6901629cd852293a8f6ca903f
      120ac01a
  9. 08 Aug, 2019 2 commits
    • Christos Stratopoulos's avatar
      Add noexcept-qualified versions of `IsConstMember` (#1201) · 6e123842
      Christos Stratopoulos authored
      Summary:
      This is a missing piece from https://github.com/facebook/folly/pull/1178, but more nasty as it can cause runtime rather than compile-time failures.
      
      Given an interface `ICat` with `void meow() const`, if we have `struct cat` with `void meow() const noexcept`, then constructing a `folly::Poly<ICat const&>` for an instance of `cat` will have a null pointer in the vtable entry for the `meow` method.
      
      The culprit seems to be in the template specialization for [`ThunkFn` ](https://github.com/cstratopoulos/folly/blob/feature/poly-update/folly/detail/PolyDetail.h#L539) which may be dispatched on `IsConstMember`.
      
      I've added a fairly trivial test case to `PolyTest.cpp`; but notably it is the only instance of _any_ test case in that file having a `noexcept` method. Without the change in `PolyDetail.h`, the call to `cref->meow()` will cause a null pointer dereference. If something more explicit is desired, maybe we could `EXPECT` that the corresponding vtable entry is non-null, but that doesn't exactly fit the pattern of other test cases in that file.
      
      (Aside: In the linked PR I used `__cpp_noexcept_function_type` directly, but I have since realized that a macro for this is already present in [`Portability.h`](https://github.com/facebook/folly/blob/master/folly/Portability.h#L503) so I'm using that one now)
      Pull Request resolved: https://github.com/facebook/folly/pull/1201
      
      Reviewed By: ericniebler
      
      Differential Revision: D16686139
      
      Pulled By: yfeldblum
      
      fbshipit-source-id: 73c7ac132d6e772ffd49f450b5fcd0f8a0dbdb26
      6e123842
    • Claire (Yue) Zhang's avatar
      Add boundary support into Cursor · 6b2c52f3
      Claire (Yue) Zhang authored
      Summary:
      Added boundary support in folly/io/Cursor.h.
      
      The bounded Cursor can have a boundary that is shorter than the underlying IOBuf. This gives a custom view of the IOBuf.
      
      Reviewed By: spalamarchuk
      
      Differential Revision: D16347838
      
      fbshipit-source-id: 16d91e42e2acee788b31bc2a9b6cc8716b1d22f2
      6b2c52f3
  10. 07 Aug, 2019 6 commits
    • Lee Howes's avatar
      Make defer use inline forms of then · 7fe15ffe
      Lee Howes authored
      Summary: Switch defer to use inline continuations by default, if bound executors match.
      
      Reviewed By: andriigrynenko
      
      Differential Revision: D16643666
      
      fbshipit-source-id: d3cdf86761c378d7ca138b46322c55a9755bdc48
      7fe15ffe
    • Nanshu Chen's avatar
      fix getExecutor redef error when both coro and futures are used · 3e8a57cd
      Nanshu Chen authored
      Summary: As both coro.h and futures.h defines the function getExecutor, redefinition error occurs when both of them are included. This change moves the getExecutor inline function to executor.h so it can be shared.
      
      Reviewed By: yfeldblum
      
      Differential Revision: D16676456
      
      fbshipit-source-id: 33f7558a3d5dbc996c4efef4fe90918de32ad8b2
      3e8a57cd
    • Nick Terrell's avatar
      Remove unnecessary copy in sorted_vector_types insert with hint · fd30521a
      Nick Terrell authored
      Summary:
      When inserting an item with a hint, the item will be always copied, even
      if it is already present in the map. This could cause an exception to be
      thrown when it doesn't need to be. The standard doesn't require this, but
      it is an optimization anyways.
      
      Reviewed By: yfeldblum
      
      Differential Revision: D16585971
      
      fbshipit-source-id: f0a8eeb0bd86f07ef110f91cbef8ab422ff55480
      fd30521a
    • Tristan Rice's avatar
      SmartExceptionTracer: get stack traces for smart exceptions · 4bbc9cd2
      Tristan Rice authored
      Summary:
      The current folly ExceptionTracer only keeps the stack traces in thread local storage for as long as the exception is currently active or caught. When using folly futures we almost never handle exceptions within a catch block or even the same thread with thenError.
      
      With C++ 11, we have exception_ptr which ref counts the exception so being able to keep the stack trace as long as something still holds a pointer to the exception is very useful. This allows us to get a stack trace for an exception returned by futures.
      
      This tracer adds a callback that runs when an exception is thrown and captures the stack trace in a synchronized map. To manage the lifetime, we override the deleter function with our own wrapper that will remove the trace from the map when the exception is no longer needed.
      
      Two things of note:
      * We're attempting to allocate memory in the exception thrown callback so if we run out of memory this code won't be able to handle it and trigger a terminate via the noexcept.
      * Every exception thrown requires acquiring a lock. We should be able to mitigate this via folly::ConcurrentHashMap if it becomes a problem. Initial benchmarking seems fine as is. I don't believe it'll become a problem since we only throw exceptions in exceptional cases and they shouldn't be performance sensitive.
      
      Reviewed By: yfeldblum
      
      Differential Revision: D16533296
      
      fbshipit-source-id: 7d8832c24c79bde98d1bb213d4b70f259fb3d4bc
      4bbc9cd2
    • Andrii Grynenko's avatar
      Fix SemiAwaitable coro::blockingWait to work on fibers · 3c2162df
      Andrii Grynenko authored
      Summary: We can't use futures::WaitExecutor here, because it may drop some work if detached, which is not supported by coro::Task.
      
      Reviewed By: lewissbaker
      
      Differential Revision: D16664921
      
      fbshipit-source-id: 9797b2c59af156ec96e64244d5810a5924cfb3cc
      3c2162df
    • Lee Howes's avatar
      Replace type punning with boost variant in Future core. · bd918f3f
      Lee Howes authored
      Summary: More broadly compatible implementation of variant in future core using a boost variant.
      
      Reviewed By: andriigrynenko
      
      Differential Revision: D16676402
      
      fbshipit-source-id: 19784ab1815e81b9afc49e46b5425e55111cd530
      bd918f3f
  11. 06 Aug, 2019 1 commit
    • Dan Melnic's avatar
      Add PicoSpinLock TSAN annotations · 85465c8e
      Dan Melnic authored
      Summary: Add PicoSpinLock TSAN annotations
      
      Reviewed By: yfeldblum
      
      Differential Revision: D16653917
      
      fbshipit-source-id: d388a31824f1278fe79ab4a42e21a66781b879df
      85465c8e
  12. 05 Aug, 2019 2 commits
    • Yedidya Feldblum's avatar
      Cut enforcement of copy-ctor counts in sorted-vector sets/maps tests · 113e159c
      Yedidya Feldblum authored
      Summary: [Folly] Cut enforcement of copy-ctor counts in sorted-vector sets/maps tests, since whether the copy-ctor is elidable, and therefore the actual values of the counts, depends on the compiler and on the optimizations in use.
      
      Reviewed By: nbronson
      
      Differential Revision: D16638747
      
      fbshipit-source-id: b7a03a46afc065bd93595026df1aab46c9e1295e
      113e159c
    • Lee Howes's avatar
      To reduce risk of stack overflow when catching up with deferred work, make... · aa669f8e
      Lee Howes authored
      To reduce risk of stack overflow when catching up with deferred work, make blocking operation runOnMainContext
      
      Summary: Shift wait execution off of a (potential) fiber stack to reduce risk of stack overflows while running deferred work.
      
      Reviewed By: andriigrynenko
      
      Differential Revision: D16643654
      
      fbshipit-source-id: 3ab1fe762b8f93c011cdb926e7689281018f54bc
      aa669f8e
  13. 04 Aug, 2019 1 commit
  14. 03 Aug, 2019 7 commits
    • Andrii Grynenko's avatar
      Support co_return Try<T> from Task<T> · 115fe40f
      Andrii Grynenko authored
      Summary: This can be useful to avoid the cost of re-throwing exceptions.
      
      Reviewed By: yfeldblum, LeeHowes
      
      Differential Revision: D16628722
      
      fbshipit-source-id: 434842d99369d0293c4eeb894e6feac15ec16173
      115fe40f
    • Lee Howes's avatar
      Support inline defer 5/n - Make defer use inline forms of then internally · 4785adac
      Lee Howes authored
      Summary: Defer uses inline continuations by default, if bound executors match.
      
      Reviewed By: andriigrynenko
      
      Differential Revision: D15300706
      
      fbshipit-source-id: fc17c70ed9956442007a1cc2f6a082f75c555ad4
      4785adac
    • Lee Howes's avatar
      Support inline defer 4/n - Use variant of KeepAlive<> and DeferredExecutor in Core · ea6ee538
      Lee Howes authored
      Summary:
      After this diff, DeferredExecutor participates consistently in executor inline behaviour by being special cased in the core.
      
      DeferredExecutor is no longer an executor, and is hence no longer special cased in the Future code. This is replaced with a variant of DeferredExecutor and Executor in Core.
      
      Reviewed By: yfeldblum, andriigrynenko
      
      Differential Revision: D15836529
      
      fbshipit-source-id: 8324ba1de57e85fc757ecc3b431bf71858868a0d
      ea6ee538
    • Lee Howes's avatar
      Support inline defer 3/n - Move DeferredExecutor into Core.h · 0c0aeccc
      Lee Howes authored
      Summary: Simple code reorg. DeferredExecutor class moved into Core as it is later becoming functionality of Core rather than of the Future.
      
      Reviewed By: andriigrynenko
      
      Differential Revision: D15836530
      
      fbshipit-source-id: 5a14a6c9332666b275e39796cae5f32c96edacd5
      0c0aeccc
    • Lee Howes's avatar
      Support inline defer 2/n - Add addFrom to DeferredExecutor · 4066afa9
      Lee Howes authored
      Summary: addFrom on DeferredExecutor allows the DeferredExecutor to know what executor is running the work enqueuing to it, which it can check against its internal state to run the work inline if the executors match.
      
      Reviewed By: andriigrynenko
      
      Differential Revision: D15836532
      
      fbshipit-source-id: 40c35d976b90072c88bb544360b059c1b151d4d0
      4066afa9
    • Lee Howes's avatar
      Support inline defer 1/n - Add and use r-value add on KeepAlive · b619a10f
      Lee Howes authored
      Summary:
      Allows adding directly to a KeepAlive if the KeepAlive is consumed in the process.
      
      This allows simultaneous consumption and propagation of the KeepAlive into the callback, propagating information about the executor running the callback without the cost of reference counting the KeepAlive.
      
      Reviewed By: andriigrynenko
      
      Differential Revision: D15836528
      
      fbshipit-source-id: 8f9e6f6ec47ad294391741d25fce68a85a429919
      b619a10f
    • Yedidya Feldblum's avatar
      cacheline_align_t, cacheline_align_v · 51ad358e
      Yedidya Feldblum authored
      Summary: [Folly] `cacheline_align_t`, `cacheline_align_v` - since it is theoretically possible on some platforms for `alignas(hardware_destructive_interference_size)` to be a compile-time error.
      
      Reviewed By: aary
      
      Differential Revision: D16598497
      
      fbshipit-source-id: d0dfe99b726cec5dba96e26147e73e494e62a895
      51ad358e
  15. 02 Aug, 2019 6 commits
    • Yedidya Feldblum's avatar
      Add unsafe-unlocked getter to Synchronized · a93eb033
      Yedidya Feldblum authored
      Summary:
      [Folly] Add unsafe-unlocked getter to `Synchronized`.
      
      Provided as a backdoor for call-sites where it is known safe to be used. For example, when it is known that only one thread has access to the `Synchronized` instance.
      
      To be used with care - this method explicitly overrides the normal safety guarantees provided by the rest of the `Synchronized` API.
      
      Reviewed By: chadaustin, simpkins
      
      Differential Revision: D8178205
      
      fbshipit-source-id: 648ee392a43a06333452f72d992ec42ba4a1a73c
      a93eb033
    • Yedidya Feldblum's avatar
      Fix visibility attributes that gcc objects to in xlog · 47fa124a
      Yedidya Feldblum authored
      Summary: [Folly] Fix visibility attributes that gcc objects to in xlog by moving them from lambdas to proper functions.
      
      Reviewed By: nbronson
      
      Differential Revision: D16578895
      
      fbshipit-source-id: 021fd10ef01bb610dc6f20d9a9a98a5a8e11df71
      47fa124a
    • Rui Zhang's avatar
      Wrap TSX intrinsics with checks on compiler and architecture support for TSX. · def0359e
      Rui Zhang authored
      Summary: The TSX intrinsics should only be compiled and used when compilers and platforms support them. This diff wraps the intrinsics and adds checks on TSX support to server this purpose.
      
      Reviewed By: nbronson
      
      Differential Revision: D16585187
      
      fbshipit-source-id: 6490c0da7f6221caaa4529bfcebb261cfd99cc7d
      def0359e
    • Jifan Zhang's avatar
      Test and Fix IOBuf Python Iterable on Fragmented Data · 06a2d529
      Jifan Zhang authored
      Summary:
      The Python chained `IOBuf` has undesirable behavior on cyclic pattern data. For example, when we have a data chain with
      ```
      chain = make_chain([IOBuf(b"aaa"), IOBuf(b"aaaa")])
      ```
      `b"".join(chain)` will yield `b"aaa"` rather than `b"aaaaaaa"`.
      
      The root cause to this bug is because in the `__iter__` method of the Python `IOBuf`, the original code checks whether the circular chain has been traversed by the `!=` operator (`self != next`), which has been overridden by `__richcmp__` function. The rich comparator then invokes the comparator in C++, which compares the underlying data in a `IOBuf` chain rather than their reference locations. In the above example, therefore, `chain == chain.next` would return `True`. However, in `__iter__`, in order to check whether the traversal is back to the head of the chain, we should compare by reference rather value.
      
      Reviewed By: yfeldblum
      
      Differential Revision: D16589600
      
      fbshipit-source-id: 3b03c4d502bdc385edca3502949be03440543a21
      06a2d529
    • Yedidya Feldblum's avatar
      Extract Executor::KeepAlive constants to a base class · 21680794
      Yedidya Feldblum authored
      Summary: [Folly] Extract Executor::KeepAlive bitmask constants to a non-template base class so that they can be used from elsewhere.
      
      Reviewed By: LeeHowes
      
      Differential Revision: D16617648
      
      fbshipit-source-id: eb3ceddfa8c492bb4ddd7de0046bb5c2c6b4e762
      21680794
    • Andrii Grynenko's avatar
      Cleanup coroutine code to not use InlineExecutor · b479a5dd
      Andrii Grynenko authored
      Reviewed By: yfeldblum
      
      Differential Revision: D16594071
      
      fbshipit-source-id: 78755bc64f22b28f89958064184c1fdf35b1bb85
      b479a5dd
  16. 01 Aug, 2019 1 commit
    • John Strizich's avatar
      add manifest for re2 · 97307b40
      John Strizich authored
      Summary: needed for openr
      
      Reviewed By: simpkins
      
      Differential Revision: D16010070
      
      fbshipit-source-id: 6d485fa7e4e321e6cd23d9894b38c1ecc7574665
      97307b40