In the event that you do not have a 20 percent down payment, lenders will allow a smaller down paymentâ as low as 3 percent in some cases. With the smaller down payment loans, however, borrowers are usually required to carry private mortgage insurance. Private mortgage insurance will usually require an initial premium payment and may require an additional monthly fee depending on your loan's structure.