You can fill out the application for child benefit online. Then print it out, sign it and send it to your local Family Benefits Office. Child benefit application online (in English and German)
Find your local Family Benefits Office (in German only).