Skip to content

High memory usage with large number of directories (even when empty) #959

@guilherme-puida

Description

@guilherme-puida

We recently got this bug report in Ubuntu, describing a regression in the 3.2.7 security update patchset. ~mdeslaur found that the commit introducing the issue is d69162d (corresponds to d046525 in the master branch).

I did some analysis with a tree containing 80000 empty directories (created with seq 1 80000 | xargs mkdir), and here are the results of running /usr/bin/time -f '%M' ./rsync -a data data_copy:

3.2.7-sec-patches
v3.2.7-29-gcad6aab5: 336512
v3.2.7-30-gd69162db: 10888424
v3.2.7-60-g0ab4c3de: 10888392

master
v3.4.1-37-gbb0a8118: 336588
v3.4.1-38-gd046525d: 10888328
v3.4.3             : 10888320
v3.4.3-61-g5cf7c505: 10888328

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions