One year after ChatGPT took the world by storm, the adoption of Large Language Models (AI) in enterprises is still low, as numerous studies and interviews pointed out. The reasons concern data privacy, accuracy, regulatory compliance, costs, and 3rd party dependency. As alternative solutions appear, it is worthwhile to dive deep into the challenges of AI LLMs adoption in the Enterprise and how to address them.