AWS and TII collaborate for advanced AI training
Amazon Web Services (AWS) announced at AWS Summit in London that Technology Innovation Institute (TII), a leading global scientific research centre in Abu Dhabi is training its top-performing, open source Falcon 40B model on AWS.
AWS has shared details on how it is helping customers across a range of industries and how they can benefit from generative AI. To drive better performance and cost efficiencies throughout the development process, customers including Stability AI, AI 21 Labs, Hugging Face, and LG AI rely on Amazon SageMaker, AWS’s end-to-end machine ML service, to build, train, and deploy their LLMs.
Falcon 40B model uses AWS to suit specific customer needs
TII’s Falcon 40B model is now available to customers via Amazon SageMaker Jumpstart, which is a machine learning (ML) hub that offers pre-trained models. As a result, it makes it easier to build cutting-edge generative AI applications using the top performing open source model.
In addition, TII has trained Falcon 40B, a 40 billion parameter LLM, on Amazon SageMaker. It is currently ranked number one on Hugging Face’s Open LLM Leaderboards, as of June 2023.
Customers can deploy Falcon 40B on Amazon SageMaker JumpStart, which provides access to Falcon 40B’s accuracy and industry-leading performance without having to build their own model from scratch.
Open source: aims to enable widespread access to advanced tech capabilities
Throughout the training process, AWS also worked closely with TII to enhance resiliency using SageMaker, ensuring that training ran smoothly and reducing interruptions that required developer attention.
TII released its Falcon 40B model in May 2023 under the Apache 2.0 licence. Since then, Falcon 40B has outperformed similar contemporary models across various benchmarks, demonstrating exceptional performance without specialised fine-tuning.
“Falcon 40Bs open source release empowers organisations to harness its exceptional capabilities and drive advancements in AI-driven solutions. It represents a significant milestone in our commitment to fostering AI innovation and exemplifies the profound scientific contributions of the UAE,” said Dr. Ebtesam Almazrouei, executive director of AI-Cross Center Unit and Project Lead for LLM Projects at TII.
“By making Falcon LLM open-source, we aim to enable widespread access to its advanced tech capabilities and empower researchers and organisations worldwide. Next steps include contributing to further advancements in the field of AI and advanced technologies, with new models on the horizon, and promoting the utilisation of advanced AI tech within UAE organisations and businesses.”
Persistent Systems adopts CodeWhisperer to deliver applications faster
In another announcement, AWS said Persistent Systems would use Amazon CodeWhisperer to help it build and deliver industry applications faster and more securely for enterprise clients.
Trained on billions of lines of code, Amazon CodeWhisperer allows Persistent Systems engineers to generate code based on natural language comments or existing codes. This will help them bypass time-consuming development tasks and as a result, accelerate the creation of new solutions.
“As a pioneer in Digital Engineering, we have always believed in staying ahead of the disruptive technology curve, such as Generative AI," commented Sandeep Kalra, CEO and Executive Director at Persistent. "Our proactive approach and deep collaboration with AWS have enabled us to provide game-changing engineering solutions that have accelerated time to value for our clients across industries.
"With the adoption of CodeWhisperer by our engineering teams, we are witnessing valuable productivity gains across the software engineering lifecycle and expect these to improve significantly over time. With this alliance, we will work closely with AWS in onboarding our Enterprise and ISV clients to CodeWhisperer and provide them the necessary training and support to accelerate their digital transformation journeys.”