About the problem of new members being added, I hope this is something that doesn't happen very often. Agile teams arguably shouldn't have more than 7 members. If they do, you should break in two teams. If it is changing just for now, it's ok to see the velocity change until the whole team is familiar with the product they work on.
About the time working in other projects, IMHO, I see those as obstacles, but in this case, I hope these can be predicted. If possible, try to reduce this time as much as possible, the project team should be responsible for the project, and shouldn't "borrow" staff from other team. Anyway, if this time working for other teams can be predicted, you can whether create a story for it, or estimate considering how much time will be "lost" with this.
Anyway, it's normal for the velocity to change, but you should be able to know the reason from the retrospective, and then change what's not working, and keep what's working for ur team. If agile methodology isn't working for you, just change it, so it will be great for your team.
Hope I helped :)