It depends; which $100 keyboard?
Most likely, the answer will be "yes".
Some of the older keyboards, especially the "consumer grade" Casio and Yamaha models are overly complicated with regards to getting MIDI working properly, and you will be much better off with a newer keyboard, especially one that connects via USB.