Is it ok to call off time from work for family issues?

Yes they should understand. There are laws in US covering this. Call them then go to your grandma. If you don't you will regret it later.