Integrating LLM Ops in RunML
Integrating LLM Ops in RunML
(An ML Ops product)
My Role
Product Designer
Tools
Figma
Timeline
3 weeks
MEMEBRS
2 Backend Dev, 2 Front End Dev, 3 Data Scientists
Description
Implemented LLM features within RunML, an MLOps platform, to enhance model performance through comprehensive metrics, comparison, evaluation, and embeddings. This seamless integration augments the platform's capabilities, providing deeper insights and enabling users to refine and deploy ML models more effectively. RunML now empowers users with enhanced functionality, leveraging LLM to optimize workflows and achieve superior model performance.
"As a result, model accuracy improved by 12x, driving a 60% increase in financial outcomes. The integration of LLM features enhanced model evaluation, empowering users to make more informed decisions. This optimization led to higher ROI, and as a result, RunML secured projects from major companies, increasing platform adoption by 40%. These improvements have solidified RunML’s position as a top-tier MLOps platform."
Highlights
Comparing metrics of each version inside a model
Comparing LLM Prompts of each version inside a model
Process
What’s the problem?
RunML's top performance was held back
RunML's top performance was held back
Model Management & optimization Concerns
Users question RunML's ability to effectively handle models, raising doubts about reliability and suitability for diverse use cases.
Users seek clarity on RunML's model accuracy and potential enhancements for optimizing performance.
Users inquire about the ease of integrating RunML into existing workflows and systems, seeking seamless implementation for their projects.
Opportunities
Enhancing RunML’s performance
In our initial discussion, we identified key LLM design features to integrate into the RunML Product. Collaborating with backend devs, data scientists, our team lead, and product owner, we outlined enhancements to streamline model deployment, optimize performance, and ensure seamless scalability. These features aim to provide users and clients with clearer insights into model operations, facilitating easier understanding and utilization. By focusing on user-centric design and collaborative development, we're poised to deliver a more intuitive and effective RunML experience.
Those key features are....
LLM Prompt Comparison
Facilitates easy identification of superior model versions, streamlining decision-making for optimal performance.
LLM Ops Deployment
Facilitates easy identification of superior model versions, streamlining decision-making for optimal performance.
LLM Metrics Comparison
Facilitates easy identification of superior model versions, streamlining decision-making for optimal performance.
Wow, That’s awesome.....but without a design?????????
Never
So, As I’m the only designer working on these features, I need to figure out how these things works, So, I planned to create a process for myself. It was little challenging for me as I need to complete this in very short period.
Understand
Understanding the process
Gathering requirements
Understanding stakeholder’s needs
Audit
(when we have designs)
Sometimes my lead or clients provides designs
Auditing them to provide better design
Auditing them to provide better design
Ideate
Brainstorming to generate ideas
Sketching and wireframing to visualize
Gathering references that suits our ideas
Design
Abstracting ideas into solutions
Creating mockups and prototypes
Iterating design for better solutions
Review
Evaluating the design
Getting feedbacks and validations
Handing off designs to Development Team
Designs
LLM Prompt comparison
So, I had no idea about LLM Prompts and the way it works, So, i had to sit with product lead, data scientists and developers to understand it’s workflow. I learned it in a simple way, That this feature helps to bring out the best version of each model through prompts with some metrics. For example. Model A could give better results for a prompt whereas Model B migh not, which is understood through certain metrics.
After understanding, I’ve received a sample design and asked to design like this. But, after analyzing this design, I felt it needed some changes. Let’s see what’s the constraints here with this design
Try scrolling the prompt comparison in the prototype below…
Auditing the design
What if there are multiple models to compare?
Users want to keep an eye on their inputs....
The user desires to closely monitor the inputs as they observe the outputs, which are linked to the article and questions provided by them. They find it convenient if these inputs remain static, facilitating their observation process. This approach allows for a clearer understanding and analysis of the information being processed.
Huge data’s shown here is not helping them.....
Users getting confused.....
The user aims to compare multiple prompts simultaneously but is concerned that displaying too much data at once could be overwhelming and distracting. They recognize the potential for hierarchical issues to arise and worry that excessive information might strain their ability to effectively process and comprehend the content. Thus, they seek a solution that optimizes the presentation of data, ensuring clarity and ease of comparison without overwhelming their cognitive load.
So, Ideally the users wants to keep eye on one comparison at a time but it’s not possible here
Users wants to keep eye on one comparison at a time.
User’s wants to see the input everytime while viewing the output
So, How do we do that?
Cool, Let’s Ideate
Ideate
I took a pen and paper.....
I took pen and paper and Idealized all the solutions. I was clear with what I need to do, So I started to try to out multiple solutions and but I wasn't sure if could actually help me to bring the best solution possible. Also, did some brainstorming sessions with my lead, and data scientists. In the end, After multiple tries, I came up with this final solution which was liked by our lead and clients.
Was trying to better the table
I was trying make the same table but keeping the inputs static, But still I felt there’s a lot of info
Tried grouping them into different
Here, I tried to group them with all the contents, but it won’t work if there’s multiple models
Finally, I came up with this
Finally, We decided to group them seperate and hide other outputs, and it looked better.
Great, Now that we ideated the solution,
Let’s transform this into design
Design
I took pen and paper and Idealized all the solutions. I was clear with what I need to do, So I started to try to out multiple solutions and but I wasn't sure if could actually help me to bring the best solution possible. In the end, After multiple tries, I came up with this final solution which was liked by our lead and clients.
Randomtrees
RunML
Main
Overview
Services
Monitor
Project
Version
Models
Summarization
Settings
Notification
Settings
Comparison between different Registered models, select for A/B testing and proceed for deployment
Model Comparison
Model Registry > BioBrief > summarizer
Listing out model Metrics from the connected model source
Create AT
Model List
Model Registry
Label text or value
Below you can see the registered models information
Export
Project Name
Bike-Sharing
Bike-Sharing
Bike-Sharing
Parameters
View
View
View
Type
LLM
LLM
LLM
Staging
Prod
UAT
QA
Version
Version 01
Version 02
Version 03
Tags
BioBrief
BioBrief
BioBrief
Deployment
Ready to deploy
Test Model
Test Model
Compare
Metric Comparison
Prompt Comparison
Article
Sehwag holds multiple records including the highest score made by an Indian in Test cricket (319 against South Africa at M. A. Chidambaram Stadium in Chennai), which was also the fastest triple century in the history of international cricket (reached 300 off only 278 balls) as well as the fastest 250 by any batsman (in 207 balls against Sri Lanka on 3 December 2009 at the Brabourne Stadium in Mumbai). Sehwag also holds the distinction of being one of four batsmen in the world to have ever surpassed 300 twice in Test cricket.[5] Sehwag has the highest strike rate in test matches among batsmen with 2000 or more test runs. Sehwag's career strike rate in test matches is 82.23.[6] In March 2009, Sehwag smashed what was until then the fastest century ever scored by an Indian in ODI cricket, from 60 balls.[7] On 8 December 2011, he hit his maiden double century in ODI cricket, against West Indies, becoming the second batsman after Sachin Tendulkar to reach the landmark.[8] His score became the highest individual score in ODI cricket—219 off 149 balls which was later bettered by Rohit Sharma—264 off 173 balls on 13 November 2014. He is one of only two players in the world to score a double hundred in ODI and a triple hundred in Test Cricket, the other being Chris Gayle",
Article
"Tendulkar took up cricket at the age of eleven, made his Test match debut on 15 November 1989 against Pakistan in Karachi at the age of sixteen, and went on to represent Mumbai domestically and India internationally for over 24 years. In 2002, halfway through his career, Wisden ranked him the second-greatest Test batsman of all time, behind Don Bradman, and the second-greatest ODI batsman of all time, behind Viv Richards. The same year, Tendulkar was a part of the team that was one of the joint-winners of the 2002 ICC Champions Trophy. Later in his career, Tendulkar was part of the Indian team that won the 2011 Cricket World Cup, his first win in six World Cup appearances for India. He had previously been named \"Player of the Tournament\" at the 2003 World Cup.", "Version_3": "The article provides a brief summary of Sachin Tendulkar's cricket career. Tendulkar started playing cricket at the age of eleven and made his Test match debut at sixteen against Pakistan in Karachi. He represented Mumbai domestically and India internationally for over 24 years. In 2002, Wisden ranked him as the second-greatest Test batsman of all time, after Don Bradman, and the second-greatest ODI batsman of all time, after Viv Richards. Tend",
Article
Sehwag holds multiple records including the highest score made by an Indian in Test cricket (319 against South Africa at M. A. Chidambaram Stadium in Chennai), which was also the fastest triple century in the history of international cricket (reached 300 off only 278 balls) as well as the fastest 250 by any batsman (in 207 balls against Sri Lanka on 3 December 2009 at the Brabourne Stadium in Mumbai). Sehwag also holds the distinction of being one of four batsmen in the world to have ever surpassed 300 twice in Test cricket.[5] Sehwag has the highest strike rate in test matches among batsmen with 2000 or more test runs. Sehwag's career strike rate in test matches is 82.23.[6] In March 2009, Sehwag smashed what was until then the fastest century ever scored by an Indian in ODI cricket, from 60 balls.[7] On 8 December 2011, he hit his maiden double century in ODI cricket, against West Indies, becoming the second batsman after Sachin Tendulkar to reach the landmark.[8] His score became the highest individual score in ODI cricket—219 off 149 balls which was later bettered by Rohit Sharma—264 off 173 balls on 13 November 2014. He is one of only two players in the world to score a double hundred in ODI and a triple hundred in Test Cricket, the other being Chris Gayle",
Article
"Tendulkar took up cricket at the age of eleven, made his Test match debut on 15 November 1989 against Pakistan in Karachi at the age of sixteen, and went on to represent Mumbai domestically and India internationally for over 24 years. In 2002, halfway through his career, Wisden ranked him the second-greatest Test batsman of all time, behind Don Bradman, and the second-greatest ODI batsman of all time, behind Viv Richards. The same year, Tendulkar was a part of the team that was one of the joint-winners of the 2002 ICC Champions Trophy. Later in his career, Tendulkar was part of the Indian team that won the 2011 Cricket World Cup, his first win in six World Cup appearances for India. He had previously been named \"Player of the Tournament\" at the 2003 World Cup.", "Version_3": "The article provides a brief summary of Sachin Tendulkar's cricket career. Tendulkar started playing cricket at the age of eleven and made his Test match debut at sixteen against Pakistan in Karachi. He represented Mumbai domestically and India internationally for over 24 years. In 2002, Wisden ranked him as the second-greatest Test batsman of all time, after Don Bradman, and the second-greatest ODI batsman of all time, after Viv Richards. Tend",
Article
Sehwag holds multiple records including the highest score made by an Indian in Test cricket (319 against South Africa at M. A. Chidambaram Stadium in Chennai), which was also the fastest triple century in the history of international cricket (reached 300 off only 278 balls) as well as the fastest 250 by any batsman (in 207 balls against Sri Lanka on 3 December 2009 at the Brabourne Stadium in Mumbai). Sehwag also holds the distinction of being one of four batsmen in the world to have ever surpassed 300 twice in Test cricket.[5] Sehwag has the highest strike rate in test matches among batsmen with 2000 or more test runs. Sehwag's career strike rate in test matches is 82.23.[6] In March 2009, Sehwag smashed what was until then the fastest century ever scored by an Indian in ODI cricket, from 60 balls.[7] On 8 December 2011, he hit his maiden double century in ODI cricket, against West Indies, becoming the second batsman after Sachin Tendulkar to reach the landmark.[8] His score became the highest individual score in ODI cricket—219 off 149 balls which was later bettered by Rohit Sharma—264 off 173 balls on 13 November 2014. He is one of only two players in the world to score a double hundred in ODI and a triple hundred in Test Cricket, the other being Chris Gayle",
Article
"Tendulkar took up cricket at the age of eleven, made his Test match debut on 15 November 1989 against Pakistan in Karachi at the age of sixteen, and went on to represent Mumbai domestically and India internationally for over 24 years. In 2002, halfway through his career, Wisden ranked him the second-greatest Test batsman of all time, behind Don Bradman, and the second-greatest ODI batsman of all time, behind Viv Richards. The same year, Tendulkar was a part of the team that was one of the joint-winners of the 2002 ICC Champions Trophy. Later in his career, Tendulkar was part of the Indian team that won the 2011 Cricket World Cup, his first win in six World Cup appearances for India. He had previously been named \"Player of the Tournament\" at the 2003 World Cup.", "Version_3": "The article provides a brief summary of Sachin Tendulkar's cricket career. Tendulkar started playing cricket at the age of eleven and made his Test match debut at sixteen against Pakistan in Karachi. He represented Mumbai domestically and India internationally for over 24 years. In 2002, Wisden ranked him as the second-greatest Test batsman of all time, after Don Bradman, and the second-greatest ODI batsman of all time, after Viv Richards. Tend",
LLM Prompt Comparison - summarizer Model
Below you can see the metcis scores from the registered model that user selected to compare
Search queries
Let’s understand how this solution helps
Main area, This area is now static which gives idea for the users on what they are looking for, they easily compare the models with
Comparison Area, This is were the output is viewed. Now User can easily compare each model’s outputs with given inputs. In this way, User won’t distracted with other prompt inputs.
Article
Sehwag holds multiple records including the highest score made by an Indian in Test cricket (319 against South Africa at M. A. Chidambaram Stadium in Chennai), which was also the fastest triple century in the history of international cricket (reached 300 off only 278 balls) as well as the fastest 250 by any batsman (in 207 balls against Sri Lanka on 3 December 2009 at the Brabourne Stadium in Mumbai). Sehwag also holds the distinction of being one of four batsmen in the world to have ever surpassed 300 twice in Test cricket.[5] Sehwag has the highest strike rate in test matches among batsmen with 2000 or more test runs. Sehwag's career strike rate in test matches is 82.23.[6] In March 2009, Sehwag smashed what was until then the fastest century ever scored by an Indian in ODI cricket, from 60 balls.[7] On 8 December 2011, he hit his maiden double century in ODI cricket, against West Indies, becoming the second batsman after Sachin Tendulkar to reach the landmark.[8] His score became the highest individual score in ODI cricket—219 off 149 balls which was later bettered by Rohit Sharma—264 off 173 balls on 13 November 2014. He is one of only two players in the world to score a double hundred in ODI and a triple hundred in Test Cricket, the other being Chris Gayle",
Version 1
GPT 3.5 - Turbo
Parameters
temperature=1.0
max_tokens=100
model_route=Chat
Metrics
Rogue1: 0.18
Rogue2: 0.04
roguel:0.14
roguelsum: 0.17
Prompt template
Summarize the text {{ article }}
Answer
The text discusses the multiple records held by Indian cricketer Virender Sehwag. He has the highest test cricket scorer record of 319 runs in a match against South Africa, which is also the fastest out of all rapid triple all international cricket.AlÜ SeiticketIdentifierCookiesFcnIn creamtriggerUIDSeoboxCurrentmid486 Cummingsfungustime til »\n\n698 AssocfmtetectionsargcifarOKilentits_InitStructurePreValor tentaccess(asyncColumnsMode *StrLnInputI Cos LatestgamepcionesltaddEventListenerść" }
809ms, 883 total tokens
Version 2
GPT 3.5 - Turbo
Parameters
temperature=0.5
max_tokens=100
model_route=Chat
Metrics
Rogue1: 0.30
Rogue2: 0.10
roguel:0.22
roguelsum: 0.28
Prompt template
Read through the provided article and summarize the it. {{ article }}.
Answer
The article discusses the achievements and records held by Indian cricketer Virender Sehwag. Sehwag holds multiple records, including the highest score made by an Indian in Test cricket, with a score of 319 against South Africa. This innings was also the fastest triple century in the history of international cricket, reached off only 278 balls. Sehwag also holds the record for the fastest 250 by any batsman, achieved in 207 balls against Sri Lanka. He is one",
809ms, 883 total tokens
Version 3
GPT 3.5 - Turbo
Parameters
temperature=0.01
max_tokens=100
model_route=Chat
Metrics
Rogue1: 0.32
Rogue2: 0.13
roguel:0.23
roguelsum: 0.30
Prompt template
Read the attached article and summarize it. {{ article }}. Do not hallucinate and do not include any information absent in the article
Answer
The article discusses the various records held by Indian cricketer Virender Sehwag. Sehwag holds the highest score made by an Indian in Test cricket, scoring 319 against South Africa. This was also the fastest triple century in the history of international cricket, reaching 300 off only 278 balls. He also holds the record for the fastest 250 by any batsman, achieved in 207 balls against Sri Lanka. Sehwag is one of only four batsmen in the",
809ms, 883 total tokens
Now user can focus each prompt inputs....
Article
Sehwag holds multiple records including the highest score made by an Indian in Test cricket (319 against South Africa at M. A. Chidambaram Stadium in Chennai), which was also the fastest triple century in the history of international cricket (reached 300 off only 278 balls) as well as the fastest 250 by any batsman (in 207 balls against Sri Lanka on 3 December 2009 at the Brabourne Stadium in Mumbai). Sehwag also holds the distinction of being one of four batsmen in the world to have ever surpassed 300 twice in Test cricket.[5] Sehwag has the highest strike rate in test matches among batsmen with 2000 or more test runs. Sehwag's career strike rate in test matches is 82.23.[6] In March 2009, Sehwag smashed what was until then the fastest century ever scored by an Indian in ODI cricket, from 60 balls.[7] On 8 December 2011, he hit his maiden double century in ODI cricket, against West Indies, becoming the second batsman after Sachin Tendulkar to reach the landmark.[8] His score became the highest individual score in ODI cricket—219 off 149 balls which was later bettered by Rohit Sharma—264 off 173 balls on 13 November 2014. He is one of only two players in the world to score a double hundred in ODI and a triple hundred in Test Cricket, the other being Chris Gayle",
Article
"Tendulkar took up cricket at the age of eleven, made his Test match debut on 15 November 1989 against Pakistan in Karachi at the age of sixteen, and went on to represent Mumbai domestically and India internationally for over 24 years. In 2002, halfway through his career, Wisden ranked him the second-greatest Test batsman of all time, behind Don Bradman, and the second-greatest ODI batsman of all time, behind Viv Richards. The same year, Tendulkar was a part of the team that was one of the joint-winners of the 2002 ICC Champions Trophy. Later in his career, Tendulkar was part of the Indian team that won the 2011 Cricket World Cup, his first win in six World Cup appearances for India. He had previously been named \"Player of the Tournament\" at the 2003 World Cup.", "Version_3": "The article provides a brief summary of Sachin Tendulkar's cricket career. Tendulkar started playing cricket at the age of eleven and made his Test match debut at sixteen against Pakistan in Karachi. He represented Mumbai domestically and India internationally for over 24 years. In 2002, Wisden ranked him as the second-greatest Test batsman of all time, after Don Bradman, and the second-greatest ODI batsman of all time, after Viv Richards. Tend",
Article
Sehwag holds multiple records including the highest score made by an Indian in Test cricket (319 against South Africa at M. A. Chidambaram Stadium in Chennai), which was also the fastest triple century in the history of international cricket (reached 300 off only 278 balls) as well as the fastest 250 by any batsman (in 207 balls against Sri Lanka on 3 December 2009 at the Brabourne Stadium in Mumbai). Sehwag also holds the distinction of being one of four batsmen in the world to have ever surpassed 300 twice in Test cricket.[5] Sehwag has the highest strike rate in test matches among batsmen with 2000 or more test runs. Sehwag's career strike rate in test matches is 82.23.[6] In March 2009, Sehwag smashed what was until then the fastest century ever scored by an Indian in ODI cricket, from 60 balls.[7] On 8 December 2011, he hit his maiden double century in ODI cricket, against West Indies, becoming the second batsman after Sachin Tendulkar to reach the landmark.[8] His score became the highest individual score in ODI cricket—219 off 149 balls which was later bettered by Rohit Sharma—264 off 173 balls on 13 November 2014. He is one of only two players in the world to score a double hundred in ODI and a triple hundred in Test Cricket, the other being Chris Gayle",
Article
Sehwag holds multiple records including the highest score made by an Indian in Test cricket (319 against South Africa at M. A. Chidambaram Stadium in Chennai), which was also the fastest triple century in the history of international cricket (reached 300 off only 278 balls) as well as the fastest 250 by any batsman (in 207 balls against Sri Lanka on 3 December 2009 at the Brabourne Stadium in Mumbai). Sehwag also holds the distinction of being one of four batsmen in the world to have ever surpassed 300 twice in Test cricket.[5] Sehwag has the highest strike rate in test matches among batsmen with 2000 or more test runs. Sehwag's career strike rate in test matches is 82.23.[6] In March 2009, Sehwag smashed what was until then the fastest century ever scored by an Indian in ODI cricket, from 60 balls.[7] On 8 December 2011, he hit his maiden double century in ODI cricket, against West Indies, becoming the second batsman after Sachin Tendulkar to reach the landmark.[8] His score became the highest individual score in ODI cricket—219 off 149 balls which was later bettered by Rohit Sharma—264 off 173 balls on 13 November 2014. He is one of only two players in the world to score a double hundred in ODI and a triple hundred in Test Cricket, the other being Chris Gayle",
Version 1
GPT 3.5 - Turbo
Parameters
temperature=1.0
max_tokens=100
model_route=Chat
Metrics
Rogue1: 0.18
Rogue2: 0.04
roguel:0.14
roguelsum: 0.17
Prompt template
Summarize the text {{ article }}
Answer
The text discusses the multiple records held by Indian cricketer Virender Sehwag. He has the highest test cricket scorer record of 319 runs in a match against South Africa, which is also the fastest out of all rapid triple all international cricket.AlÜ SeiticketIdentifierCookiesFcnIn creamtriggerUIDSeoboxCurrentmid486 Cummingsfungustime til »\n\n698 AssocfmtetectionsargcifarOKilentits_InitStructurePreValor tentaccess(asyncColumnsMode *StrLnInputI Cos LatestgamepcionesltaddEventListenerść" }
809ms, 883 total tokens
Version 2
GPT 3.5 - Turbo
Parameters
temperature=0.5
max_tokens=100
model_route=Chat
Metrics
Rogue1: 0.30
Rogue2: 0.10
roguel:0.22
roguelsum: 0.28
Prompt template
Read through the provided article and summarize the it. {{ article }}.
Answer
The article discusses the achievements and records held by Indian cricketer Virender Sehwag. Sehwag holds multiple records, including the highest score made by an Indian in Test cricket, with a score of 319 against South Africa. This innings was also the fastest triple century in the history of international cricket, reached off only 278 balls. Sehwag also holds the record for the fastest 250 by any batsman, achieved in 207 balls against Sri Lanka. He is one",
809ms, 883 total tokens
Version 3
GPT 3.5 - Turbo
Parameters
temperature=0.01
max_tokens=100
model_route=Chat
Metrics
Rogue1: 0.32
Rogue2: 0.13
roguel:0.23
roguelsum: 0.30
Prompt template
Read the attached article and summarize it. {{ article }}. Do not hallucinate and do not include any information absent in the article
Answer
The article discusses the various records held by Indian cricketer Virender Sehwag. Sehwag holds the highest score made by an Indian in Test cricket, scoring 319 against South Africa. This was also the fastest triple century in the history of international cricket, reaching 300 off only 278 balls. He also holds the record for the fastest 250 by any batsman, achieved in 207 balls against Sri Lanka. Sehwag is one of only four batsmen in the",
809ms, 883 total tokens
Now, when they want to look into a prompt comparison, they will open that particular input which will showcase those outputs, No more distractions and too much datas.
LLM Metric comparison
To create an improved visualization for comparing models based on their performance metrics, let's focus on enhancing the clarity and visual appeal. We'll prioritize highlighting Rogue's metrics as they are crucial in determining the best model. Depending on specific requirements, users can select the model that best aligns with their priorities, be it precision, recall, or overall Rogue Score.
This visualization offers a comprehensive comparison of models, emphasizing the importance of Rogue's metrics while also providing insights into precision, recall, and F1-Score.
LLM Deployment
It’s great that we created these LLM features in ML Ops product. Now, It’s very important that we need a way to implement these features. So, we have deployment for LLM. Let’s see how we built that
Connecting with DevOps team.....
Engage with the DevOps team to align on the infrastructure and deployment requirements for hosting and managing the LLM.
Discuss factors such as hardware specifications, cloud provider options, and automation tools to streamline deployment processes.
Collaborate with the DevOps team to establish CI/CD pipelines for automating the build, testing, and deployment of LLM updates.
By establishing clear communication and collaboration channels with the DevOps team, I created the LLM Deployment screens for the RunML Product.
Learnings & Outcomes
RunML turning tables in Demo’s
RunML turning tables in Demo’s
It got everyone excited - it brought our PM's vision to life, got solid support from our engineers, and marked a crucial milestone for RunML's future. It ignited widespread interest among clients, bolstering our business growth and positioning RunML as a go-to choice in the industry.
Outcomes
Incorporating LLM significantly enhanced model accuracy across our product spectrum, making a substantial impact for clients by delivering heightened performance and reliability in various use cases.
The integration of LLM not only empowered users to identify optimal models tailored to their specific needs but also amplified our business reach, driving growth and expanding profitability margins for the organization.
This strategic implementation not only elevated our offerings to newer heights but also fostered a more competitive edge, solidifying our position as a leader in the market and fueling business expansion opportunities.
Learnings
Happy that I’m able to contribute f this product which excelled in client demo’s and got great appreciation. Things I’ve learned:
How LLM works in a MLOps model, as this is my first time getting hands on AI/ML Industry.
As a sole designer, collaborating with backend developers, front-end developers and data scientists and getting knowledge from them.
