1. 13 Oct, 2019 3 commits
    • Yedidya Feldblum's avatar
      Apply extra formatting rules · 72850c2e
      Yedidya Feldblum authored
      Summary: [Folly] Apply extra formatting rules beyond black.
      
      Reviewed By: zertosh
      
      Differential Revision: D17898403
      
      fbshipit-source-id: 6d73c75a35513f138bcc0d734aada0c99cff54c7
      72850c2e
    • Yedidya Feldblum's avatar
      Apply black formatter to .py files · 77ab1491
      Yedidya Feldblum authored
      Summary: [Folly] Apply `black` formatter to `.py` files.
      
      Reviewed By: zertosh
      
      Differential Revision: D17898404
      
      fbshipit-source-id: b597b55b646e539a288d175e0b2db8111b5b103b
      77ab1491
    • Andres Suarez's avatar
      Yearless license header [1/2] · d2c64d94
      Andres Suarez authored
      Reviewed By: yfeldblum
      
      Differential Revision: D17889052
      
      fbshipit-source-id: e9733e6ab31d01064660043b0f4edc31b0f5377e
      d2c64d94
  2. 11 Oct, 2019 4 commits
  3. 10 Oct, 2019 5 commits
  4. 09 Oct, 2019 4 commits
    • Max Katsev's avatar
      Make groupByAdjacent work for move-only types · 6a4c4cea
      Max Katsev authored
      Summary: Same as regular groupBy
      
      Reviewed By: ot
      
      Differential Revision: D17843280
      
      fbshipit-source-id: 33d74d7ed84b8c46509bf186bfa52e31d6284015
      6a4c4cea
    • Alexey Spiridonov's avatar
      Re-enable BUILD_TESTS for fbcode_builder · 149fed4b
      Alexey Spiridonov authored
      Summary: As it turns out, several of the `fizz` dependencies require it to have been built with tests enabled, so it's just easier to build them always, IIRC they only waste 1-2 minutes of time.
      
      Reviewed By: lnicco
      
      Differential Revision: D17837758
      
      fbshipit-source-id: dd0c73b3aaf72831ce702dbcecd4e3ff627a4901
      149fed4b
    • Zeyi (Rice) Fan's avatar
      eden: make eden build with Rust datapack · ac4d5f78
      Zeyi (Rice) Fan authored
      Reviewed By: wez
      
      Differential Revision: D17494253
      
      fbshipit-source-id: 45bab057e5cefd8f2808be96ba31814c5196051b
      ac4d5f78
    • Alexey Spiridonov's avatar
      Revert / fix up D17158685 · 946e907c
      Alexey Spiridonov authored
      Summary:
      Proxygen no longer uses `fbcode_builder` to run its tests, so whatever the purpose of D17158685, these `fbcode_builder` configs no longer affect Proxygen, and can be reverted to their original state.
      
      Since the general design pattern for `fbcode_builder` has been to link everything as `.so`s, let's return to this (which helps fix Bistro's build).
      
      Also, let's not waste time building & linking tests for libraries that are not the library under test. That is:
       - Before: The Bistro build also builds tests for wangle, proxygen, etc. This is a result of some accidental changes in D17158685.
       - After: We explicitly don't build test for any of the 4 dependencies here. This is OK because each project also has its own `fbcode_builder_config.py`, which **does** build tests.
      
      This latter part should result in a build-time reduction.
      
      Reviewed By: lnicco
      
      Differential Revision: D17819858
      
      fbshipit-source-id: 7cad1bed86b2f0c3934b0fc5d6fb33e6a2ee2695
      946e907c
  5. 08 Oct, 2019 1 commit
    • Felix Handte's avatar
      Add a Compression Context Pool · 7a4406ff
      Felix Handte authored
      Summary:
      This diff introduces a data structure that keeps a set of, well any object,
      but it's intended to cache compression contexts, e.g., `ZSTD_CCtx`es. These
      objects can be expensive to allocate but cheap to reuse. E.g., HHVM was
      spending 70% of its Zstd CPU allocating, memsetting, and freeing contexts
      before it started using a structure like this.
      
      Reviewed By: terrelln
      
      Differential Revision: D15787721
      
      fbshipit-source-id: bda33e9028c73c14435e18ce07cfbc8989263d98
      7a4406ff
  6. 07 Oct, 2019 2 commits
    • Yedidya Feldblum's avatar
      Namespace preprocessor names in folly/CpuId.h · 8f538e5f
      Yedidya Feldblum authored
      Summary: [Folly] Namespace preprocessor names in `folly/CpuId.h`.
      
      Reviewed By: LeeHowes
      
      Differential Revision: D17780995
      
      fbshipit-source-id: 29580e780a4f8639c4247b9af38f47182fc000bb
      8f538e5f
    • Yedidya Feldblum's avatar
      Fix GroupVarint.h includes and preprocessor namespacing · 2b127db9
      Yedidya Feldblum authored
      Summary:
      [Folly] Fix `GroupVarint.h` includes and preprocessor namespacing.
      
      * Always include everything rather than conditionally including things.
      * Namespace as `FOLLY_HAVE_GROUP_VARINT`.
      
      Reviewed By: LeeHowes
      
      Differential Revision: D17780999
      
      fbshipit-source-id: 109fa38794e312e0c5eba0f5bfab56853df59c92
      2b127db9
  7. 05 Oct, 2019 1 commit
  8. 04 Oct, 2019 5 commits
    • Greg McGary's avatar
      relax allocated-memory tests for libcxx · d368b83c
      Greg McGary authored
      Summary:
      [ Extend D17527441 changes from F15MapTest into F14SetTest ]
      The current version of libc++ deallocates the existing capacity when calling operator=(initializer_list), even if the map is empty. This diff relaxes the expectations of F14's allocated memory tests (which fall back to the underlying STL std::unordered_map on some platforms) to accept this implementation.
      
      Reviewed By: yfeldblum
      
      Differential Revision: D17726849
      
      fbshipit-source-id: 4757792a5aefe6d085b5d164ffe7b663f6078d9a
      d368b83c
    • Zeyi (Rice) Fan's avatar
      getdeps: add libcurl and make Eden use libcurl instead of system curl · 6492bb70
      Zeyi (Rice) Fan authored
      Summary:
      We are seeing random segment fault originating from OpenSSL on macOS when
      Mononoke fetching is enabled.
      
      The cause is that on macOS we are actually linking against libcurl shipped with
      the system instead of ours. That copy of libcurl is linked with macOS's
      libcrypto instead of the one we compiles during Eden's build, and it seems that
      version of libcrypto does not provide concurrency safety.
      
      The solution is to build curl on macOS and make sure it is linked to our
      OpenSSL that has the concurrency callbacks registered.
      
      Reviewed By: wez
      
      Differential Revision: D17657822
      
      fbshipit-source-id: 85abdf3be10b3903a5efc6b3a91624c7258de790
      6492bb70
    • Wez Furlong's avatar
      watchman: getdeps: Capture artifacts from Github Actions CI builds (#750) · 03191fe7
      Wez Furlong authored
      Summary:
      This diff teaches the generated Github Actions configuration to copy the
      executable outputs from the leaf project into an artifacts dir, and then capture
      the artifacts in the build.
      
      This page has details on the artifacts mechanism used by Github Actions:
      https://github.com/actions/upload-artifact
      
      This page has the "Artifacts" link on the RHS where an example of the artifacts
      can be downloaded:
      https://github.com/facebook/watchman/pull/750/checks?check_run_id=244088199
      
      Here's the actual download:
      https://github.com/facebook/watchman/suites/247296465/artifacts/74686
      
      And here's what the inside of that zip file contains for the watchman build:
      
      ```
      $ find . -ls
      49685444        0 drwxr-xr-x    6 wez              mygroup      192 Oct  1 18:50 .
      49685487       16 -rw-r--r--    1 wez              mygroup     6148 Oct  1 18:51 ./.DS_Store
      49685446        0 drwxr-xr-x    5 wez              mygroup      160 Oct  1 18:51 ./mac
      49685501       16 -rw-r--r--    1 wez              mygroup     6148 Oct  1 18:51 ./mac/.DS_Store
      49685453        0 drwxr-xr-x    3 wez              mygroup       96 Oct  1 18:50 ./mac/bin
      49685455     5432 -rwxr-xr-x    1 wez              mygroup  2778500 Oct  2 01:02 ./mac/bin/watchman
      49685454        0 drwxr-xr-x    7 wez              mygroup      224 Oct  1 18:50 ./mac/lib
      49685457      296 -rwxr-xr-x    1 wez              mygroup   149096 Oct  2 01:02 ./mac/lib/libgflags.2.2.dylib
      49685460     1072 -rwxr-xr-x    1 wez              mygroup   546348 Oct  2 01:02 ./mac/lib/libssl.1.1.dylib
      49685459      272 -rwxr-xr-x    1 wez              mygroup   135524 Oct  2 01:02 ./mac/lib/liblz4.1.dylib
      49685458      352 -rwxr-xr-x    1 wez              mygroup   176900 Oct  2 01:02 ./mac/lib/libglog.0.dylib
      49685456     4888 -rwxr-xr-x    1 wez              mygroup  2501012 Oct  2 01:02 ./mac/lib/libcrypto.1.1.dylib
      49685445        0 drwxr-xr-x    5 wez              mygroup      160 Oct  1 18:50 ./linux
      49685486       16 -rw-r--r--    1 wez              mygroup     6148 Oct  1 18:50 ./linux/.DS_Store
      49685448        0 drwxr-xr-x    3 wez              mygroup       96 Oct  1 18:50 ./linux/bin
      49685450   196264 -rwxr-xr-x    1 wez              mygroup 100486648 Oct  2 01:16 ./linux/bin/watchman
      49685449        0 drwxr-xr-x    4 wez              mygroup      128 Oct  1 18:50 ./linux/lib
      49685451     3864 -rwxr-xr-x    1 wez              mygroup  1976888 Oct  2 01:16 ./linux/lib/libgflags.so.2.2
      49685452     2208 -rwxr-xr-x    1 wez              mygroup  1127336 Oct  2 01:16 ./linux/lib/libglog.so.0
      49685447        0 drwxr-xr-x    4 wez              mygroup      128 Oct  1 18:51 ./windows
      49685513       16 -rw-r--r--    1 wez              mygroup     6148 Oct  1 18:51 ./windows/.DS_Store
      49685461        0 drwxr-xr-x    5 wez              mygroup      160 Oct  2 01:44 ./windows/bin
      49685464     7880 -rwxr-xr-x    1 wez              mygroup  4030976 Oct  2 01:44 ./windows/bin/watchman.exe
      49685463      488 -rwxr-xr-x    1 wez              mygroup   249856 Oct  2 01:44 ./windows/bin/glog.dll
      49685462      544 -rwxr-xr-x    1 wez              mygroup   278016 Oct  2 01:44 ./windows/bin/gflags.dll
      ```
      
      The `main.yml` file was updated by running:
      
      ```
      $ opensource/fbcode_builder/getdeps.py generate-github-actions --output-file watchman/.github/workflows/main.yml watchman
      ```
      
      Pull Request resolved: https://github.com/facebook/watchman/pull/750
      
      Test Plan: See description above
      
      Reviewed By: pkaush
      
      Differential Revision: D17705148
      
      Pulled By: wez
      
      fbshipit-source-id: 4f3c466180f5a1cb9fa31a9b3b3f117876f8b89d
      03191fe7
    • Nathan Bronson's avatar
      enable some production CHECK in F14 code · c510b2ad
      Nathan Bronson authored
      Summary:
      Production-enabled assertions have shown value in detecting
      a variety of issues that should be impossible but are observed to
      occur. This diff adds some checks to F14 that may fail under some types
      of memory corruption, tag missearch, or hash miscomputation.
      
      Reviewed By: yfeldblum
      
      Differential Revision: D17739592
      
      fbshipit-source-id: 92c9839ed5dab030350408d704a01c97573e3123
      c510b2ad
    • Nanshu Chen's avatar
      import folly::down_cast to Python/Cython · b695c6bc
      Nanshu Chen authored
      Summary: In Cython, use `from folly.cast cimport down_cast` to import the function.
      
      Reviewed By: yfeldblum
      
      Differential Revision: D17652305
      
      fbshipit-source-id: 6b038c5ac6c2a8ecd8e95f33ae3a37647a2bfdff
      b695c6bc
  9. 03 Oct, 2019 4 commits
    • Yedidya Feldblum's avatar
      Fix missing qualification in FOLLY_SAFE_DCHECK macro · df680df3
      Yedidya Feldblum authored
      Summary: [Folly] Fix missing qualification in `FOLLY_SAFE_DCHECK` macro.
      
      Reviewed By: nbronson
      
      Differential Revision: D17747688
      
      fbshipit-source-id: 1bab5770891c900252f767252b5d7769e209bcb1
      df680df3
    • Yedidya Feldblum's avatar
      Export folly::json::parse_error · 8ea70e3d
      Yedidya Feldblum authored
      Summary:
      [Folly] Export `folly::json::parse_error` v.s. having it be a hidden type.
      
      * Move class body to `.h`.
      * Leave helper function, previously the constructor, in anonymous namespace in `.cpp`.
      
      Reviewed By: vitaut
      
      Differential Revision: D17578773
      
      fbshipit-source-id: 0d50fdf662bbf67e844ff0ec9ef24975cea92f62
      8ea70e3d
    • Wez Furlong's avatar
      getdeps: ensure that INST/lib/*.dll are found in PATH on windows · a8d1fd8e
      Wez Furlong authored
      Summary:
      We were troubleshooting an issue with the eden tests on windows
      where the boost dlls where not being found during gtest discovery.
      
      When we compute the environment, we were only including INST/bin in the
      PATH on windows.  On Windows, the dlls are searched for in the PATH, and
      since boost installs those into its `lib` dir we were missing those.
      
      This diff causes `lib` dirs to get added to PATH on windows in the same
      manner that we would add them to `LD_LIBRARY_PATH` on linux.
      
      Reviewed By: pkaush
      
      Differential Revision: D17694542
      
      fbshipit-source-id: 143a907e6d30d8c12360caa43c8d9c26ff8c88c6
      a8d1fd8e
    • Wez Furlong's avatar
      getdeps: fixup-dyn-deps: use patchelf from our manifest on linux · 93c3a4e2
      Wez Furlong authored
      Summary:
      On linux we use `patchelf` to manipulate dynamic deps but it
      isn't guaranteed to be installed everywhere.  We have a manifest file
      that describes how to build it, but so far nothing has told getdeps
      that it should build it.
      
      This diff updates the ELF dep munging code to literally run
      `getdeps.py build patchelf` and then use that patchelf binary to
      manipulate the object files.
      
      Refs: https://github.com/facebook/watchman/pull/750
      
      Reviewed By: pkaush
      
      Differential Revision: D17705351
      
      Pulled By: wez
      
      fbshipit-source-id: 358ef239edb389fbd51fa023ff553963aa80b6c7
      93c3a4e2
  10. 02 Oct, 2019 5 commits
    • Scott Wolchok's avatar
      CacheLocality: reserve less space on mobile · 17cd1d8e
      Scott Wolchok authored
      Summary: Mobile phones have more like 16 CPUs and less like 128 CPUs.
      
      Reviewed By: yfeldblum
      
      Differential Revision: D16151292
      
      fbshipit-source-id: 87caed64d9a874f71e85ee2842194405e43568a3
      17cd1d8e
    • Yedidya Feldblum's avatar
      Dead Code: PriorityMPMCQueue · 2f06c17f
      Yedidya Feldblum authored
      Summary: [Folly] Dead Code: `PriorityMPMCQueue`.
      
      Reviewed By: LeeHowes
      
      Differential Revision: D17718372
      
      fbshipit-source-id: c79c376abadf7149b94d343cd6705f030fd71666
      2f06c17f
    • Yedidya Feldblum's avatar
      down_cast · be4a3034
      Yedidya Feldblum authored
      Summary: [Folly] `down_cast` for polymorphic checked-in-debug down-casts.
      
      Reviewed By: nbronson
      
      Differential Revision: D17650399
      
      fbshipit-source-id: 9cdd224b3f97ba40f88013877f968ed311a3ab3c
      be4a3034
    • Mingtao Yang's avatar
      Fix SSLContext tests that fail under OpenSSL 1.1.1 · df012bf4
      Mingtao Yang authored
      Summary:
      SSL_CTX_get_cipher_list() has different semantics when running under
      OpenSSL 1.1.1.
      
      This adjusts the tests that explicitly call SSLContext::setCiphers() to only
      check expectations against < TLS 1.3 cipher names.
      
      Reviewed By: knekritz
      
      Differential Revision: D17539611
      
      fbshipit-source-id: c293bd1e6b886dbc575a0677a98776d256b23fb5
      df012bf4
    • Rosen Penev's avatar
      asnTimeToTimepoint: Use a const parameter (#1235) · b2955150
      Rosen Penev authored
      Summary:
      X509_get0_notBefore returns and takes const parameters.
      Signed-off-by: default avatarRosen Penev <rosenp@gmail.com>
      
      ping reanimus
      Pull Request resolved: https://github.com/facebook/folly/pull/1235
      
      Test Plan: Build
      
      Reviewed By: knekritz
      
      Differential Revision: D17695324
      
      Pulled By: reanimus
      
      fbshipit-source-id: bebdb11fc9dd0b49354e7efcd1adc4f87a6675bc
      b2955150
  11. 01 Oct, 2019 6 commits
    • Maged Michael's avatar
      hazptr: Fix batch push obj · d0e76dbb
      Maged Michael authored
      Summary:
      Fix missing null check.
      It is possible for a thread to successfully CAS count from >= threshold to 0 and also pop an empty list.
      Example with 2 threads:
      - Batch contains Threshold - 1 objects
      - Thread 1 pushes an object, finds count == Threshold, CAS-es count to 0 successfully.
      - Thread 2 pushes Threshold more objects, finds count == Threshold, CAS-es count to 0 successfully.
      - Thread 1 pops all 2xThreshold objects (that's ok)
      - Thread 2 pops 0 objects (that's ok too but we need to do null check before dereferencing the head of the list).
      
      Reviewed By: davidtgoldblatt
      
      Differential Revision: D17680391
      
      fbshipit-source-id: a1d68997668077cc0b34cc66405628ed2f95702b
      d0e76dbb
    • Taewook Oh's avatar
      add nothrow attributes to jemalloc non-standard API declarations. · 2cc6ef64
      Taewook Oh authored
      Summary: According to https://github.com/jemalloc/jemalloc/issues/237 and https://fburl.com/aeia78qk, `__attribute__((nothrow))` is added to jemalloc API functions to be in compatible with `stdlib.h`.
      
      Reviewed By: yfeldblum
      
      Differential Revision: D17679036
      
      fbshipit-source-id: 525a076f19719d2406c0dce92ca814f5f5011497
      2cc6ef64
    • Adam Simpkins's avatar
      getdeps: add manifests for pexpect and python-ptyprocess · 280ed609
      Adam Simpkins authored
      Summary:
      Add a manifest to download pexpect-4.7.0 from PyPI, as well as its ptyprocess
      dependency.
      
      Reviewed By: wez
      
      Differential Revision: D17669618
      
      fbshipit-source-id: 13395ec07f503f39adb3dc5aa8d0c2d8d0f1d927
      280ed609
    • Adam Simpkins's avatar
      getdeps: update the python wheel builder to support dependencies · 62ed81a0
      Adam Simpkins authored
      Summary:
      Correctly emit dependency information when one Python package depends on
      another.
      
      Reviewed By: wez
      
      Differential Revision: D17669620
      
      fbshipit-source-id: f51c7851470fe50dc0c17263c94c4d858d6e0921
      62ed81a0
    • Yedidya Feldblum's avatar
      Assorted nits · 4474c86b
      Yedidya Feldblum authored
      Summary: [Folly] Assorted nits.
      
      Reviewed By: chadaustin
      
      Differential Revision: D17677721
      
      fbshipit-source-id: a5903a61059cd60e093423d087b9e1d7e9e5d443
      4474c86b
    • Yedidya Feldblum's avatar
      aligned and cacheline_aligned · e984df45
      Yedidya Feldblum authored
      Summary: [Folly] `aligned` and `cacheline_aligned`, aligned and implicitly padded value wrapper types.
      
      Reviewed By: nbronson
      
      Differential Revision: D17386115
      
      fbshipit-source-id: 6da33a4d97f40ada59682e02af9d56863ccaff3d
      e984df45