Simplices are the "simplest" examples of polytopes, and yet they exhibit much of the rich and subtle combinatorics and commutative algebra of their more general cousins. In this way they are sufficiently complicated --- insights gained from their study can inform broader research in Ehrhart theory and associated fields. In this dissertation we consider two previously unstudied properties of lattice simplices; one algebraic and one combinatorial. The first is the Poincar\'e series of the associated semigroup algebra, which is substantially more complicated than the Hilbert series of that same algebra. The second is the partial ordering of the elements of the fundamental parallelepiped associated to the simplex. We conclude with a proof-of-concept for using machine learning techniques in algebraic combinatorics. Specifically, we attempt to model the integer decomposition property of a family of lattice simplices using a neural network.