The picture doesn't seem to quite jive with the diagram you posted earlier. It looks like you're bearing is captured by the bracket which is held in place by the allen head screw (probably two of them). It's a bit hard to tell exactly what's going on from the photo.