Homemade Earl Grey Fruit Loaf