aboutsummaryrefslogtreecommitdiffstats
path: root/mm/percpu.c
AgeCommit message (Expand)AuthorFilesLines
2019-06-05treewide: Replace GPLv2 boilerplate/reference with SPDX - rule 428Thomas Gleixner1-2/+1
2019-05-13Merge branch 'for-5.2' of git://git.kernel.org/pub/scm/linux/kernel/git/denni...Linus Torvalds1-162/+387
2019-05-08percpu: remove spurious lock dependency between percpu and schedJohn Sperbeck1-1/+5
2019-03-18percpu: stop printing kernel addressesMatteo Croce1-4/+4
2019-03-13percpu: use chunk scan_hint to skip some scanningDennis Zhou1-9/+27
2019-03-13percpu: convert chunk hints to be based on pcpu_block_mdDennis Zhou1-67/+53
2019-03-13percpu: make pcpu_block_md genericDennis Zhou1-7/+13
2019-03-13percpu: use block scan_hint to only scan forwardDennis Zhou1-6/+17
2019-03-13percpu: remember largest area skipped during allocationDennis Zhou1-2/+99
2019-03-13percpu: add block level scan_hintDennis Zhou1-7/+94
2019-03-13percpu: set PCPU_BITMAP_BLOCK_SIZE to PAGE_SIZEDennis Zhou1-66/+44
2019-03-13percpu: relegate chunks unusable when failing small allocationsDennis Zhou1-9/+26
2019-03-13percpu: manage chunks based on contig_bits instead of free_bytesDennis Zhou1-1/+1
2019-03-13percpu: introduce helper to determine if two regions overlapDennis Zhou1-4/+24
2019-03-13percpu: do not search past bitmap when allocating an areaDennis Zhou1-1/+2
2019-03-13percpu: update free path with correct new free regionDennis Zhou1-1/+1
2019-03-12memblock: drop memblock_alloc_*_nopanic() variantsMike Rapoport1-7/+4
2019-03-12mm/percpu: add checks for the return value of memblock_alloc*()Mike Rapoport1-17/+56
2019-02-23percpu: use nr_groups as check conditionPeng Fan1-1/+1
2018-11-01Merge branch 'for-4.20' of git://git.kernel.org/pub/scm/linux/kernel/git/denn...Linus Torvalds1-1/+1
2018-10-31memblock: stop using implicit alignment to SMP_CACHE_BYTESMike Rapoport1-18/+20
2018-10-31mm: remove include/linux/bootmem.hMike Rapoport1-1/+1
2018-10-31memblock: remove _virt from APIs returning virtual addressMike Rapoport1-14/+14
2018-10-07percpu: stop leaking bitmap metadata blocksMike Rapoport1-0/+1
2018-09-12mm: percpu: remove unnecessary unlikely()Igor Stoppa1-1/+1
2018-08-22/proc/meminfo: add percpu populated pages countDennis Zhou (Facebook)1-0/+29
2018-04-02Merge tag 'arch-removal' of git://git.kernel.org/pub/scm/linux/kernel/git/arn...Linus Torvalds1-4/+0
2018-03-26treewide: simplify Kconfig dependencies for removed archsArnd Bergmann1-4/+0
2018-03-19mm: Allow to kill tasks doing pcpu_alloc() and waiting for pcpu_balance_workfn()Kirill Tkhai1-2/+11
2018-03-19percpu: include linux/sched.h for cond_resched()Tejun Heo1-0/+1
2018-02-23percpu: add a schedule point in pcpu_balance_workfn()Eric Dumazet1-0/+1
2018-02-18percpu: allow select gfp to be passed to underlying allocatorsDennis Zhou1-9/+7
2018-02-18percpu: add __GFP_NORETRY semantics to the percpu balancing pathDennis Zhou1-17/+27
2018-02-18percpu: match chunk allocator declarations with definitionsDennis Zhou1-2/+4
2017-11-27percpu: hack to let the CRIS architecture to boot until they clean upNicolas Pitre1-0/+4
2017-11-15Merge branch 'for-4.15' of git://git.kernel.org/pub/scm/linux/kernel/git/tj/p...Linus Torvalds1-1/+2
2017-10-19mm, percpu: add support for __GFP_NOWARN flagDaniel Borkmann1-5/+10
2017-10-04percpu: don't forget to free the temporary struct pcpu_alloc_infoNicolas Pitre1-1/+2
2017-09-28percpu: fix iteration to prevent skipping over blockDennis Zhou1-0/+4
2017-07-26percpu: update header to contain bitmap allocator explanation.Dennis Zhou (Facebook)1-14/+18
2017-07-26percpu: update pcpu_find_block_fit to use an iteratorDennis Zhou (Facebook)1-20/+92
2017-07-26percpu: use metadata blocks to update the chunk contig hintDennis Zhou (Facebook)1-10/+70
2017-07-26percpu: update free path to take advantage of contig hintsDennis Zhou (Facebook)1-3/+65
2017-07-26percpu: update alloc path to only scan if contig hints are brokenDennis Zhou (Facebook)1-3/+56
2017-07-26percpu: keep track of the best offset for contig hintsDennis Zhou (Facebook)1-1/+12
2017-07-26percpu: skip chunks if the alloc does not fit in the contig hintDennis Zhou (Facebook)1-2/+16
2017-07-26percpu: add first_bit to keep track of the first free in the bitmapDennis Zhou (Facebook)1-2/+15
2017-07-26percpu: introduce bitmap metadata blocksDennis Zhou (Facebook)1-12/+216
2017-07-26percpu: replace area map allocator with bitmapDennis Zhou (Facebook)1-456/+273
2017-07-26percpu: generalize bitmap (un)populated iteratorsDennis Zhou (Facebook)1-24/+25
2017-07-26percpu: increase minimum percpu allocation size and align first regionsDennis Zhou (Facebook)1-7/+20
2017-07-26percpu: introduce nr_empty_pop_pages to help empty page accountingDennis Zhou (Facebook)1-3/+8
2017-07-26percpu: change the number of pages marked in the first_chunk pop bitmapDennis Zhou (Facebook)1-7/+9
2017-07-26percpu: combine percpu address checksDennis Zhou (Facebook)1-40/+11
2017-07-26percpu: modify base_addr to be region specificDennis Zhou (Facebook)1-41/+114
2017-07-26percpu: setup_first_chunk rename schunk/dchunk to chunkDennis Zhou (Facebook)1-8/+8
2017-07-26percpu: end chunk area maps page aligned for the populated bitmapDennis Zhou (Facebook)1-0/+9
2017-07-26percpu: unify allocation of schunk and dchunkDennis Zhou (Facebook)1-33/+40
2017-07-26percpu: setup_first_chunk remove dyn_size and consolidate logicDennis Zhou (Facebook)1-12/+6
2017-07-26percpu: remove has_reserved from pcpu_chunkDennis Zhou (Facebook)1-3/+0
2017-07-26percpu: introduce start_offset to pcpu_chunkDennis Zhou (Facebook)1-11/+10
2017-07-26percpu: setup_first_chunk enforce dynamic region must existDennis Zhou (Facebook)1-5/+4
2017-07-17percpu: update the header comment and pcpu_build_alloc_info commentsDennis Zhou (Facebook)1-26/+32
2017-07-17percpu: expose pcpu_nr_empty_pop_pages in pcpu_statsDennis Zhou (Facebook)1-1/+1
2017-06-21percpu: resolve err may not be initialized in pcpu_allocDennis Zhou1-1/+3
2017-06-20percpu: add tracepoint support for percpu memoryDennis Zhou1-0/+12
2017-06-20percpu: expose statistics about percpu memory via debugfsDennis Zhou1-0/+9
2017-06-20percpu: migrate percpu data structures to internal headerDennis Zhou1-23/+7
2017-06-20percpu: add missing lockdep_assert_held to func pcpu_free_areaDennis Zhou1-0/+2
2017-05-10mark most percpu globals as __ro_after_initDaniel Micay1-18/+18
2017-04-04Merge branch 'sched/core' into locking/coreThomas Gleixner1-1/+4
2017-03-26lockdep: Fix per-cpu static objectsPeter Zijlstra1-1/+4
2017-03-16locking/lockdep: Handle statically initialized PER_CPU locks properlyThomas Gleixner1-14/+23
2017-03-06percpu: acquire pcpu_lock when updating pcpu_nr_empty_pop_pagesTahsin Erdogan1-1/+4
2017-02-27scripts/spelling.txt: add "followings" pattern and fix typo instancesMasahiro Yamada1-1/+1
2016-12-13Merge branch 'for-4.10' of git://git.kernel.org/pub/scm/linux/kernel/git/tj/p...Linus Torvalds1-1/+2
2016-12-12mm/percpu.c: fix panic triggered by BUG_ON() falselyzijun_hu1-4/+12
2016-10-19percpu: ensure the requested alignment is power of twozijun_hu1-1/+2
2016-10-05mm/percpu.c: fix potential memory leakage for pcpu_embed_first_chunk()zijun_hu1-18/+18
2016-10-05mm/percpu.c: correct max_distance calculation for pcpu_embed_first_chunk()zijun_hu1-6/+8
2016-05-25percpu: fix synchronization between synchronous map extension and chunk destr...Tejun Heo1-8/+8
2016-05-25percpu: fix synchronization between chunk->map_extend_work and chunk destructionTejun Heo1-21/+36
2016-03-17mm: percpu: use pr_fmt to prefix outputJoe Perches1-9/+11
2016-03-17mm: convert printk(KERN_<LEVEL> to pr_<level>Joe Perches1-6/+6
2016-03-17mm: coalesce split stringsJoe Perches1-2/+2
2016-03-17mm: convert pr_warning to pr_warnJoe Perches1-8/+7
2016-01-22tree wide: use kvfree() than conditional kfree()/vfree()Tetsuo Handa1-11/+7
2015-11-05mm/percpu: use offset_in_page macroAlexander Kuleshov1-5/+5
2015-07-21percpu: clean up of schunk->map[] assignment in pcpu_setup_first_chunkBaoquan He1-3/+2
2015-06-24mm: kmemleak_alloc_percpu() should follow the gfp from per_alloc()Larry Finger1-1/+1
2015-03-24percpu: Fix trivial typos in commentsYannick Guerrini1-2/+2
2015-02-13percpu: use %*pb[l] to print bitmaps including cpumasks and nodemasksTejun Heo1-4/+2
2014-10-29percpu: off by one in BUG_ON()Dan Carpenter1-1/+1
2014-10-08percpu: fix how @gfp is interpreted by the percpu allocatorTejun Heo1-1/+1
2014-09-21Revert "percpu: free percpu allocation info for uniprocessor system"Guenter Roeck1-2/+0
2014-09-09percpu: fix locking regression in the failure path of pcpu_alloc()Tejun Heo1-0/+1
2014-09-02percpu: implement asynchronous chunk populationTejun Heo1-4/+113
2014-09-02percpu: rename pcpu_reclaim_work to pcpu_balance_workTejun Heo1-15/+12
2014-09-02percpu: implmeent pcpu_nr_empty_pop_pages and chunk->nr_populatedTejun Heo1-9/+113
2014-09-02percpu: make sure chunk->map array has available spaceTejun Heo1-8/+45
2014-09-02percpu: implement [__]alloc_percpu_gfp()Tejun Heo1-25/+39
2014-09-02percpu: indent the population block in pcpu_alloc()Tejun Heo1-17/+21
2014-09-02percpu: make pcpu_alloc_area() capable of allocating only from populated areasTejun Heo1-7/+58
2014-09-02percpu: restructure lockingTejun Heo1-40/+35
2014-09-02percpu: move region iterations out of pcpu_[de]populate_chunk()Tejun Heo1-11/+8
2014-09-02percpu: move common parts out of pcpu_[de]populate_chunk()Tejun Heo1-9/+30
2014-08-16percpu: free percpu allocation info for uniprocessor systemHonggang Li1-0/+2
2014-06-19percpu: Use ALIGN macro instead of hand coding alignment calculationChristoph Lameter1-2/+1
2014-04-14percpu: make pcpu_alloc_chunk() use pcpu_mem_free() instead of kfree()Jianyu Zhan1-1/+1
2014-03-29percpu: renew the max_contig if we merge the head and previous blockJianyu Zhan1-1/+3
2014-03-17percpu: allocation size should be evenViro1-1/+4
2014-03-07percpu: speed alloc_pcpu_area() upAl Viro1-1/+17
2014-03-07percpu: store offsets instead of lengths in ->map[]Al Viro1-55/+81
2014-03-07perpcu: fold pcpu_split_block() into the only callerAl Viro1-47/+16
2014-01-21Merge branch 'akpm' (incoming from Andrew)Linus Torvalds1-16/+22
2014-01-21mm/percpu.c: use memblock apis for early memory allocationsSantosh Shilimkar1-16/+22
2014-01-21percpu: use VMALLOC_TOTAL instead of VMALLOC_END - VMALLOC_STARTLaura Abbott1-2/+2
2013-09-23percpu: fix bootmem error handling in pcpu_page_first_chunk()Michael Holzheu1-2/+3
2012-12-02mm, percpu: Make sure percpu_alloc early parameter has an argumentCyrill Gorcunov1-0/+3
2012-10-29percpu: make pcpu_free_chunk() use pcpu_mem_free() instead of kfree()Joonsoo Kim1-1/+1
2012-10-06sections: fix section conflicts in mm/percpu.cAndi Kleen1-1/+1
2012-05-09kmemleak: Fix the kmemleak tracking of the percpu areas with !SMPCatalin Marinas1-0/+2
2012-05-09percpu: pcpu_embed_first_chunk() should free unused parts after all allocs ar...Tejun Heo1-0/+10
2012-03-29percpu: use KERN_CONT in pcpu_dump_alloc_info()Tejun Heo1-5/+5
2012-01-14Merge tag 'kmemleak' of git://git.kernel.org/pub/scm/linux/kernel/git/cmarina...Linus Torvalds1-1/+11
2011-12-15percpu: fix per_cpu_ptr_to_phys() handling of non-page-aligned addressesEugene Surovegin1-2/+4
2011-12-02kmemleak: Handle percpu memory allocationCatalin Marinas1-1/+11
2011-11-23percpu: explain why per_cpu_ptr_to_phys() is more complicated than necessaryDave Young1-0/+11
2011-11-22percpu: fix chunk range calculationTejun Heo1-14/+20
2011-11-22percpu: rename pcpu_mem_alloc to pcpu_mem_zallocBob Liu1-8/+9
2011-05-24Merge branch 'for-2.6.40' of git://git.kernel.org/pub/scm/linux/kernel/git/tj...Linus Torvalds1-2/+4
2011-05-24Merge branch 'fixes-2.6.39' into for-2.6.40Tejun Heo1-2/+2
2011-03-31Fix common misspellingsLucas De Marchi1-5/+5
2011-03-28percpu: Cast away printk format warningMike Frysinger1-2/+2
2011-03-28NOMMU: percpu should use is_vmalloc_addr().David Howells1-2/+1
2011-03-24percpu: Always align percpu output section to PAGE_SIZETejun Heo1-0/+2
2011-01-13Merge branch 'for-next' of git://git.kernel.org/pub/scm/linux/kernel/git/jiko...Linus Torvalds1-1/+1
2011-01-07Merge branch 'for-2.6.38' of git://git.kernel.org/pub/scm/linux/kernel/git/tj...Linus Torvalds1-6/+2
2010-12-22percpu: print out alloc information with KERN_DEBUG instead of KERN_INFOTejun Heo1-1/+1
2010-12-07percpu: zero memory more efficiently in mm/percpu.c::pcpu_mem_alloc()Jesper Juhl1-6/+2
2010-11-01tree-wide: fix comment/printk typosUwe Kleine-König1-1/+1
2010-10-24Merge branch 'for-next' of git://git.kernel.org/pub/scm/linux/kernel/git/jiko...Linus Torvalds1-1/+1
2010-10-22Merge branch 'for-linus' of git://git.kernel.org/pub/scm/linux/kernel/git/tj/...Linus Torvalds1-168/+233
2010-09-21percpu: fix pcpu_last_unit_cpuTejun Heo1-1/+1
2010-09-10percpu: update comments to reflect that percpu allocations are always zero-fi...Tejun Heo1-5/+6
2010-09-09percpu: fix build breakage on s390 and cleanup build configuration testsTejun Heo1-163/+175
2010-09-08percpu: use percpu allocator on UP tooTejun Heo1-4/+56
2010-08-27percpu: fix a mismatch between code and commentNamhyung Kim1-1/+1
2010-08-27percpu: fix a memory leak in pcpu_extend_area_map()Huang Shijie1-1/+3
2010-08-11fix a typo on comments in mm/percpu.cNamhyung Kim1-1/+1
2010-06-27percpu: allow limited allocation before slab is onlineTejun Heo1-12/+40
2010-06-27percpu: make @dyn_size always mean min dyn_size in first chunk init functionsTejun Heo1-25/+10
2010-06-18percpu: fix first chunk match in per_cpu_ptr_to_phys()Tejun Heo1-3/+28
2010-06-17percpu: fix trivial bugs in pcpu_build_alloc_info()Pavel V. Panteleev1-3/+2
2010-05-01percpu: implement kernel memory based chunk allocationTejun Heo1-0/+4
2010-05-01percpu: move vmalloc based chunk management into percpu-vm.cTejun Heo1-428/+24
2010-05-01percpu: misc preparations for nommu supportTejun Heo1-55/+56
2010-05-01percpu: reorganize chunk creation and destructionTejun Heo1-24/+46
2010-05-01percpu: factor out pcpu_addr_in_first/reserved_chunk() and update per_cpu_ptr...Tejun Heo1-8/+24
2010-03-29percpu, module: implement and use is_kernel/module_percpu_address()Tejun Heo1-0/+26
2010-02-17percpu: add __percpu sparse annotations to core kernel subsystemsTejun Heo1-8/+10
2010-02-02Merge branch 'master' into percpuTejun Heo1-1/+3
2010-01-11percpu: avoid calling __pcpu_ptr_to_addr(NULL)Andrew Morton1-1/+3
2010-01-05Merge branch 'master' into percpuTejun Heo1-48/+114
2009-12-08percpu: refactor the code in pcpu_[de]populate_chunk()WANG Cong1-10/+8
2009-12-08Merge branch 'for-linus' into for-nextTejun Heo1-48/+114
2009-11-25percpu: Fix kdump failure if booted with percpu_alloc=pageVivek Goyal1-0/+22
2009-11-13percpu: restructure pcpu_extend_area_map() to fix bugs and improve readabilityTejun Heo1-40/+81
2009-10-29percpu: remove some sparse warningsTejun Heo1-0/+1
2009-10-29percpu: allow pcpu_alloc() to be called with IRQs offJiri Kosina1-13/+17
2009-10-12Merge branch 'for-linus' into for-nextTejun Heo1-2/+3
2009-10-12percpu: fix compile warningsTejun Heo1-2/+3
2009-10-02percpu: kill legacy percpu allocatorTejun Heo1-2/+0
2009-09-29percpu: make allocation failures more verboseTejun Heo1-2/+18
2009-09-29percpu: make pcpu_setup_first_chunk() failures more verboseTejun Heo1-11/+26
2009-09-29percpu: make embedding first chunk allocator check vmalloc space sizeTejun Heo1-2/+18
2009-09-29percpu: make pcpu_build_alloc_info() clear static buffersTejun Heo1-0/+4
2009-09-29percpu: fix unit_map[] verification in pcpu_setup_first_chunk()Tejun Heo1-3/+3
2009-09-15Merge branch 'for-next' into for-linusTejun Heo1-349/+1071
2009-09-01percpu: don't assume existence of cpu0Tejun Heo1-1/+14
2009-08-14percpu: kill lpage first chunk allocatorTejun Heo1-241/+0
2009-08-14percpu: update embedding first chunk allocator to handle sparse unitsTejun Heo1-28/+85
2009-08-14percpu: use group information to allocate vmap areas sparselyTejun Heo1-9/+26
2009-08-14percpu: add chunk->base_addrTejun Heo1-14/+11
2009-08-14percpu: add pcpu_unit_offsets[]Tejun Heo1-48/+47
2009-08-14percpu: introduce pcpu_alloc_info and pcpu_group_infoTejun Heo1-201/+328
2009-08-14percpu: move pcpu_lpage_build_unit_map() and pcpul_lpage_dump_cfg() upwardTejun Heo1-167/+172
2009-08-14percpu: add @align to pcpu_fc_alloc_fn_tTejun Heo1-2/+2
2009-08-14percpu: make @dyn_size mandatory for pcpu_setup_first_chunk()Tejun Heo1-20/+19
2009-08-14percpu: drop @static_size from first chunk allocatorsTejun Heo1-16/+13
2009-08-14percpu: generalize first chunk allocator selectionTejun Heo1-0/+32
2009-08-14percpu: build first chunk allocators selectivelyTejun Heo1-8/+11
2009-08-14percpu: rename 4k first chunk allocator to pageTejun Heo1-11/+14
2009-08-14percpu: improve boot messagesTejun Heo1-6/+7
2009-08-14percpu: fix pcpu_reclaim() lockingTejun Heo1-1/+2
2009-08-14Merge branch 'percpu-for-linus' into percpu-for-nextTejun Heo1-10/+13
2009-08-14percpu: use the right flag for get_vm_area()Amerigo Wang1-1/+1
2009-08-14percpu, sparc64: fix sparse possible cpu map handlingTejun Heo1-15/+18
2009-07-04percpu: teach large page allocator about NUMATejun Heo1-76/+282
2009-07-04percpu: allow non-linear / sparse cpu -> unit mappingTejun Heo1-35/+94