您的位置:首页 > 其它

开发者必看,Facebook高性能基础库folly开源了

2012-06-03 20:43 423 查看
folly是facebook重构的高效底层函数集,今天得知已经开源:https://github.com/facebook/folly/blob/master/folly/docs/Overview.md

其编码及相关算法实现都很值得学习,特别是优化底层服务器的同学。做优化的同学可以参考其相关功能进行函数优化。本博也会陆续将相关的移植和学习收获发出来供大家参考。

folly的本地下载地址 :/Files/inteliot/facebook-folly-27494a2.zip

Introduction

Folly (acronymed loosely after Facebook Open Source Library) is a library of C++11 components designed with practicality and efficiency in mind. It complements (as opposed to competing against) offerings such as Boost and of course
std
. In fact, we embark on defining our own component only when something we need is either not available, or does not meet the needed performance profile.

Performance concerns permeate much of Folly, sometimes leading to designs that are more idiosyncratic than they would otherwise be (see e.g.
PackedSyncPtr.h
,
SmallLocks.h
). Good performance at large scale is a unifying theme in all of Folly.

Logical Design

Folly is a collection of relatively independent components, some as simple as a few symbols. There is no restriction on internal dependencies, meaning that a given folly module may use any other folly components.

All symbols are defined in the top-level namespace
folly
, except of course macros. Macro names are ALL_UPPERCASE. Namespace
folly
defines other internal namespaces such as
internal
or
detail
. User code should not depend on symbols in those namespaces.

Physical Design

At the top level Folly uses the classic "stuttering" scheme
folly/folly
used by Boost and others. The first directory serves as an installation root of the library (with possible versioning a la
folly-1.0/
), and the second is to distinguish the library when including files, e.g.
#include "folly/FBString.h"
.

The directory structure is flat (mimicking the namespace structure), i.e. we don't have an elaborate directory hierarchy (it is possible this will change in future versions). The subdirectory
experimental
contains files that are used inside folly and possibly at Facebook but not considered stable enough for client use. Your code should not use files in
folly/experimental
lest it may break when you update Folly.

The
folly/folly/test
subdirectory includes the unittests for all components, usually named
ComponentXyzTest.cpp
for each
ComponentXyz.*
. The
folly/folly/docs
directory contains documentation.

Compatibility

Currently,
folly
has been tested on gcc 4.6 on 64-bit installations of Fedora 17, Ubuntu 12.04, and Debian wheezy. It might work unmodified on other 64-bit Linux platforms.

Components

Below is a list of Folly components in alphabetical order, along with a brief description of each.

Arena.h
,
ThreadCachedArena.h

Simple arena for memory allocation: multiple allocations get freed all at once. With threaded version.

AtomicHashMap.h
,
AtomicHashArray.h

High-performance atomic hash map with almost lock-free operation.

Benchmark.h

A small framework for benchmarking code. Client code registers benchmarks, optionally with an argument that dictates the scale of the benchmark (iterations, working set size etc). The framework runs benchmarks (subject to a command-line flag) and produces formatted output with timing information.

Bits.h

Various bit manipulation utilities optimized for speed.

Bits.h

Bit-twiddling functions that wrap the ffsl(l) primitives in a uniform interface.

ConcurrentSkipList.h

An implementation of the structure described in A Provably Correct Scalable Concurrent Skip List by Herlihy et al.

Conv.h

A variety of data conversion routines (notably to and from string), optimized for speed and safety.

DiscriminatedPtr.h

Similar to
boost::variant
, but restricted to pointers only. Uses the highest-order unused 16 bits in a pointer as discriminator. So
sizeof(DiscriminatedPtr<int, string, Widget>) == sizeof(void*)
.

dynamic.h

Dynamically-typed object, created with JSON objects in mind.

Endian.h

Endian conversion primitives.

Escape.h

Escapes a string in C style.

eventfd.h

Wrapper around the
eventfd
system call.

FBString.h

A drop-in implementation of
std::string
with a variety of optimizations.

FBVector.h

A mostly drop-in implementation of
std::vector
with a variety of optimizations.

Foreach.h

Pseudo-statements (implemented as macros) for iteration.

Format.h

Python-style formatting utilities.

GroupVarint.h

Group Varint encoding for 32-bit values.

Hash.h

Various popular hash function implementations.

Histogram.h

A simple class for collecting histogram data.

IntrusiveList.h

Convenience type definitions for using
boost::intrusive_list
.

json.h

JSON serializer and deserializer. Uses
dynamic.h
.

Likely.h

Wrappers around
__builtin_expect
.

Malloc.h

Memory allocation helpers, particularly when using jemalloc.

MapUtil.h

Helpers for finding items in associative containers (such as
std::map
and
std::unordered_map
).

PackedSyncPtr.h

A highly specialized data structure consisting of a pointer, a 1-bit spin lock, and a 15-bit integral, all inside one 64-bit word.

Preprocessor.h

Necessarily evil stuff.

PrettyPrint.h

Pretty-printer for numbers that appends suffixes of unit used: bytes (kb, MB, ...), metric suffixes (k, M, G, ...), and time (s, ms, us, ns, ...).

ProducerConsumerQueue.h

Lock free single-reader, single-writer queue.

Random.h

Defines only one function---
randomNumberSeed()
.

Range.h

Boost-style range facility and the
StringPiece
specialization.

RWSpinLock.h

Fast and compact reader-writer spin lock.

ScopeGuard.h

C++11 incarnation of the old ScopeGuard idiom.

SmallLocks.h

Very small spin locks (1 byte and 1 bit).

small_vector.h

Vector with the small buffer optimization and an ptional embedded
PicoSpinLock
.

sorted_vector_types.h

Collections similar to
std::map
but implemented as sorted vectors.

StlAllocator.h

STL allocator wrapping a simple allocate/deallocate interface.

String.h

String utilities that connect
folly::fbstring
with
std::string
.

Synchronized.h

High-level synchronization library.

System.h

Demangling and errno utilities.

ThreadCachedInt.h

High-performance atomic increment using thread caching.

ThreadLocal.h

Improved thread local storage for non-trivial types.

TimeoutQueue.h

Queue with per-item timeout.

Traits.h

Type traits that complement those defined in the standard C++11 header
<traits>
.

Unicode.h

Defines the
codePointToUtf8
function.
内容来自用户分享和网络整理,不保证内容的准确性,如有侵权内容,可联系管理员处理 点击这里给我发消息
标签: