IEEE has recently finished its ratification of the IEEE Standard 802.3ba in June 2010 which set the target Ethernet speed as 100 Gbps. The studies on the future trends of the ever-increasing demands for higher speed optical fiber communications show that there is no sign of decline in the demand. Constantly increasing internet traffic and the bandwidth-hungry multimedia services like HDTV, YouTube, voice-over-IP, etc. can be shown as the main driving forces. Indeed, the discussions over the future upgrades on the Ethernet speeds have already been initiated. It is predicted that the next upgrade will enable 400 Gbps Ethernet and the one after will be toward enabling the astounding 1 Tbps Ethernet.Although such high and ultra high transmission speeds are unprecedented over any transmission medium, the bottlenecks for achieving them over the optical fiber remains to be fundamental. At such high operating symbol rates, the signal impairments due to inter- and intra-channel fiber nonlinearities and polarization mode dispersion get exacerbated to the levels that cripple the high-fidelity communication over optical fibers. Therefore, efforts should be exerted to provide solutions that not only answer the need for high-speed transmission but also maintain low operating symbol rates.In this dissertation, we contribute to these efforts by proposing nonbinary-LDPC-coded modulation (NB-LDPC-CM) schemes as enabling technologies that can meet both the aforementioned goals. We show that our proposed NB-LDPC-CM schemes can outperform their prior-art, binary counterparts called bit-interleaved coded modulation (BI-LDPC-CM) schemes while attaining the same aggregate bit rates at a lower complexity and latency. We provide comprehensive analysis on the computational complexity of both schemes to justify our claims with solid evidence. We also compare the performances of both schemes by using amplified spontaneous emission (ASE) noise dominated optical fiber transmission and short to medium haul optical fiber transmission scenarios. Both applications show outstanding performances of NB-LDPC-CM schemes over the prior-art BI-LDPC-CM schemes with increasing gaps in coding gain as the transmission speeds increase. Furthermore, we present how a rate-adaptive NB-LDPC-CM can be employed to fully utilize the resources of a long haul optical transport network throughout its service time.