C: Lock-Free Memory Allocation Library

Question

Anyone have any good experience with a lock-free memory allocator for C/c++?

I have looked into boost, and libcds, but I am unsure about which library to use.

Background, I have been researching a "Lock-Free, Wait-Free, Non-Blocking, Dynamic Perfect Hashing, Expandable, Concurrent Hash Table" *Yes I know that sounds pretentious, but thats what it is called.

Anyways, I am getting ready to start multi-thread testing it, and I need to figure the best way to setup memory allocation, when new nodes are added. (and when I need to allocate arrays of pointers)

So does anyone have any good experience with lock free memory allocation?

Doesn't wait-free imply lock-free, lock-free imply non-blocking, and non-blocking imply concurrent? A bit redundant... — GManNickG
– GManNickG, Commented Mar 25, 2011 at 5:03
I know, but my research professor likes to hit all the button words. — Steven Feldman
– Steven Feldman, Commented Mar 25, 2011 at 5:14
You missed NUMA-aware from the wish list. All basic allocator implementations wont fair well on NUMA hardware if you also want concurrency. — Steve-o
– Steve-o, Commented Mar 25, 2011 at 6:10

osgx · Accepted Answer · 2013-03-02 17:31:28Z

5

The pretty graphs show this implementation is good:

http://locklessinc.com/

It's open source GPL 3.0 since 14 Nov 2011 :)

edited Mar 2, 2013 at 17:31

osgx

95.3k58 gold badges389 silver badges531 bronze badges

answered Mar 25, 2011 at 4:55

Steve-o

12.9k2 gold badges44 silver badges61 bronze badges

Sign up to request clarification or add additional context in comments.

3 Comments

Steven Feldman Over a year ago

They posted there performance benchmarking code, which is nice, because I wanted to look into a better timing tool then the standard time.h

Steve-o Over a year ago

@Feldman, you can see from the charts the alternatives: tcmalloc from Google nee jemalloc, and glibc's default allocator which is incredibly good these days.

Matthieu M. Over a year ago

And once again Hoard fails spectacularly. I've seen it recommended a number of times already yet every single benchmark I come upon place jemalloc and tcmalloc far ahead.

zvrba · Accepted Answer · 2011-03-25 06:51:12Z

2

There is also streamflow. I haven't used it myself; I just ran into it while reading some publications.

answered Mar 25, 2011 at 6:51

zvrba

24.7k3 gold badges57 silver badges66 bronze badges

Comments

Necrolis · Accepted Answer · 2011-03-25 05:53:04Z

0

Why not try the allocator from tbb? not sure how 'lock-free' it is, though I doubt you'll find a true lock-free allocator*, at least one that works across threads/cores(like tcmalloc)

*I tried to actually build one a few months back, but making it lockless has some drawbacks, at least from my perspective. I wasn't too keen of TLS arena's like nedmalloc has. I ended up with a hybrid kinda allocator, which locks only when a chunk-bin is empty.

answered Mar 25, 2011 at 5:53

Necrolis

26.3k3 gold badges69 silver badges103 bronze badges

1 Comment

user82238 Over a year ago

There's a version of Hoard which is fully lock-free.

Collectives™ on Stack Overflow

C: Lock-Free Memory Allocation Library

3 Answers 3

3 Comments

Comments

1 Comment

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

3 Answers 3

3 Comments

Comments

1 Comment

Your Answer

Sign up or log in

Post as a guest

Related