Large Language Models (LLMs) have become a transformative force in artificial intelligence, showcasing remarkable abilities in natural language processing and generation. Their capacity to understand, interpret, and produce human-like text has unlocked new possibilities across various sectors, including healthcare, finance, customer service, and entertainment. According to McKinsey, generative AI technologies like LLMs are expected to contribute trillions to the global economy. Despite their immense potential, building sophisticated LLMs necessitates a confluence of factors, including substantial computational power.