There might be few possible mistakes while assembling.
1. MISO gate needs to be wired other wise round, as the direction of working is from uC to the DB25.
2. Always connect the body of the PC ( the metal part of DB25 connector ) to the ground common of the device and the buffer. also try to use CAT5/CAT6 cable. keep cable length as short as possible. Connect the shield of the interconnecting cable , if any used, to the same ground at one side only.
3. keep a 0.1uF disc or MLC cap across the uC power pins closely.
4. place 2 nos of 22pF caps each from pins 1& 19 of uC (either side of crystal to ground)
5. Finally, the load on the Supply is to be managed if you want to use Vusb as power supply. So, reduce the LEDs or change the 680 ohms to 1K5 and manage with better LEDs.
6. the RS wire is connected to 4 inputs at LS541. keep the wanted one and disconnect all others. they can be referred to ground to prevent noise.
With these changes , it should work.