Upping the 10u on the o/p to 100u might also be a good idea, esp if the load impedance is on the low side.
It looks like they are using the Be junction of Q1 in a similar manner you'd use a zener to generate noise, the 680k provides Dc bias, C1 will also have an effect on noise frequency, if you get the thing on a audio spectrum analyser you might want to fiddle about with C1 as well to get an even response.
As for filtering low freq's you'll need a sharp filter, something like a 4th order, there are sites that will calc active filters for you, if your into that kinda thing Ltspice simulator was made for this, you might need a special part for Q1 though.