I even dug out the oscilloscope and noticed that the slave never responded.
Well I burned a new boot loader onto he Attiny85 to run at 8mhz instead of 1mhz and now it is working.
Any way to make it work with the Attiny85 running at 1mhz instead of 8mhz?