I finally put the effort into finding sources for pH up that aren't from the hydroponics store, and it turns out I can get both, easily, in my small town.
calcium hydroxide is known in the masonry world as hydrated lime or masons lime. It's cheap (8$CDN for 25kg) and you can get it at any home building supply store.
potassium hydroxide is sometimes also known as lye, however, take note that lye can also be sodium hydroxide so double check the ingredient when you buy it. It is used in soap making, brewing, making biodiesel, and apparently plumbers use it to clean pipe fittings. It can also be bought at a higher price at soap making supply stores and at most home supply stores in the plumbing section (8$CDN for a water-bottle size).
Remember that these are caustic alkalies and can burn your skin and eyes so use caution and appropriate protective gear. And store them both in airtight containers to keep them from absorbing moisture from the air and turning into weird piles of goo.