Discover ways to use the Template design sample to boost your code
Introduction
Just lately I’ve been engaged on the domain-specific fine-tuning of a number of LLMs. The primary and perhaps crucial a part of this process is to gather, scrape, and clear textual knowledge to feed the LLM. I seen that my code was turning into messy with many repetitions, as a result of for each recognized supply I used to be writing a script from scratch which had a variety of issues in frequent with different scripts in my codebase. I used to be not following the “Don’t repeat your self” (DRY) precept in any respect. This is the reason I made a decision to implement the Template Design Sample and make my code base extra elegant and environment friendly.
The Template Design Sample
I gained’t repeat right here what a design sample is and the way we classify design patterns based mostly on their functionalities, since I’ve written many articles on the topic. If you’re taken with studying my earlier articles on this matter I’ll go away some references on the finish.
On this article, I’ll present you an instance associated to knowledge processing. Let’s say that in our venture we’ve got to deal with totally different varieties of knowledge that we wish to analyze. A few of these knowledge are…