You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
<!-- Add a background color and large text to the whole page -->
56
-
<divclass="w3-grayscale w3-large">
57
-
58
-
<!-- About Container -->
59
-
<divclass="w3-container" id="about">
60
-
<divclass="w3-content" style="max-width:1000px">
61
-
<h5class="w3-center w3-padding-64"><spanclass="w3-tag w3-wide">ARCHITECTURE OF MACHINE LEARNING PIPELINE</span></h5>
62
-
<p>The Cafe was founded in blabla by Mr. Smith in lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam, quis nostrud exercitation ullamco laboris nisi ut aliquip ex ea commodo consequat.</p>
63
-
<p>In addition to our full espresso and brew bar menu, we serve fresh made-to-order breakfast and lunch sandwiches, as well as a selection of sides and salads and other good stuff.</p>
64
-
<divclass="w3-panel w3-leftbar w3-light-grey">
65
-
<p><i>"Use products from nature for what it's worth - but never too early, nor too late." Fresh is the new sweet.</i></p>
<!-- Add a background color and large text to the whole page -->
51
+
<divclass="w3-grayscale w3-large">
52
+
<!-- About Container -->
53
+
<divclass="w3-container" id="about">
54
+
<pclass="w3-content" style="max-width:800px">
55
+
<h5class="w3-center w3-padding-64"><spanclass="w3-tag w3-wide">ARCHITECTURE OF MACHINE LEARNING PIPELINE</span></h5>
56
+
<p>Writing a working machine learning code does not guarantee a production ready system. This blog is about designing a machine learning prototype through the engineering road map. What you need is a team of professional Software Engineers by your side to take your (disposable) proof of concept and turn it into a performant, reliable, loosely coupled and scalable system!</p>
57
+
<p>Given below is the roster of objectives that we need to build a production ready system:
58
+
<ulstyle="list-style-type:circle;">
59
+
<li>Reduces latency;</li>
60
+
<li>Is integrated but loosely coupled with the other parts of the system, e.g. data stores, reporting, graphical user interface;</li>
61
+
<li>Can scale both horizontally and vertically;</li>
62
+
<li>Is message driven i.e. the system communicates via asynchronous, non-blocking message passing;</li>
63
+
<li>Provides efficient computation with regards to workload management;</li>
64
+
<li>Is fault-tolerant and self healing i.e. breakdown management;</li>
<p>I will start-off by writing some of the most commonly used design architectures:
69
+
<ul>
70
+
<li>
71
+
<b>Reactive Style:</b>
72
+
<p>Properties of a reactive system: <br>
73
+
<ul>
74
+
<li><i>Responsive:</i> A responsive system provides rapid and consistent response times, establishing reliable upper bounds so they deliver reliable quality product.</li>
75
+
<li><i>Resilient:</i> The system stays responsive in case of failure. Resilience is achieved by replication, containment, isolation and delegation. Failures are contained within each component, isolating components from each other and thereby ensuring that parts of the system can fail and recover without compromising the system as a whole. Recovery of each component is delegated to another (external) component and high-availability is ensured by replication where necessary. The client of a component is not burdened with handling its failures.</li>
76
+
<li><i>Elastic:</i> The system stays responsive under varying workload. </li>
77
+
<li><i>Message Driven:</i> Reactive Systems rely on asynchronous message-passing to establish a boundary between components that ensures loose coupling, isolation and location transparency. This boundary also provides the means to delegate failures as messages. Employing explicit message-passing enables load management, elasticity, and flow control by shaping and monitoring the message queues in the system and applying back-pressure when necessary. Location transparent messaging as a means of communication makes it possible for the management of failure to work with the same constructs and semantics across a cluster or within a single host. Non-blocking communication allows recipients to only consume resources while active, leading to less system overhead.</li>
78
+
</ul>
79
+
</p>
80
+
</li>
81
+
<li>
82
+
<b>Service Oriented Architecture (SOA):</b>
83
+
<p>SOA centres around the concept of decomposing business problems into services. The services share information via the network and they also share code (i.e. common components) to maintain consistency and reduce development effort. <br>
84
+
</li>
85
+
<li>
86
+
<b>Streaming Architecture: </b>
87
+
</li>
88
+
</ul>
89
+
</p>
90
+
<divclass="w3-panel w3-leftbar w3-light-grey">
91
+
<p><i>"Use products from nature for what it's worth - but never too early, nor too late." Fresh is the new sweet.</i></p>
0 commit comments