refactor: part 1 technical improvements - logging, response standards, caching, soft delete

refactor: major security, performance, and API quality improvements

Initial commit