Posts

From Value Functions to Policy Search: How Modern AI Systems Learn to Act Under Uncertainty

-
Image
From Value Functions to Policy Search: Rethinking Decision-Making in Modern AI Systems In most traditional AI systems, decision-making is indirect. A model predicts an outcome, another layer interprets that prediction, and finally, a rule or heuristic decides what to do. This pipeline introduces complexity and latency. A different paradigm is emerging: What if systems could learn how to act directly—without first learning how to evaluate every possible state? This is the core idea behind policy search . The Shift: From Evaluating States to Learning Actions Classical decision-making follows a sequential dependency: State \(\rightarrow\) Value Function (\(V\)) \(\rightarrow\) Action (\(a\)) Policy search simplifies the runtime architecture by mapping observations directly to behavior: State \(\rightarrow\) Policy (\(\pi\)) \(\rightarrow\) Action (\(a\)) Instead of estimating value, we optimize a function that dictates b...
Post a Comment
Read more

Quran Page 44: Faith, Resurrection, and the Multiplication of Sincere Charity

-
Image
📖 About Surah Al-Baqarah (Page 44) Page 44 continues with a powerful demonstration of faith and certainty through the story of Prophet Ibrahim (Abraham), who seeks reassurance about resurrection. It then transitions into profound parables about charity, illustrating how sincere spending in the way of Allah multiplies rewards, while insincere actions or reminders of charity nullify its value. The imagery used conveys spiritual growth, sincerity, and accountability. 🕌 Arabic Text (Page 44)   🌍 English Translation (Sahih International) Verse 260: And [mention] when Abraham said, "My Lord, show me how You give life to the dead." [Allah] said, "Have you not believed?" He said, "Yes, but [I ask] only that my heart may be satisfied." [Allah] said, "Take four birds and commit them to yourself. Then [after slaughtering them] put on each hill a portion of them; then call them - they will come [flying] to you in haste. A...
Post a Comment
Read more

The $0 AI Agent That Runs My Investment Portfolio — What It Taught Me About Enterprise AI ROI

-
Image
Enterprise AI · Strategy The $0 AI Agent That Runs My Investment Portfolio — What It Taught Me About Enterprise AI ROI Technology Leadership ~900 words 5 min read I built an AI agent for $0 a month. Not as a side project. As a deliberate experiment to understand something every technology leader should understand before signing another seven-figure AI contract. It runs on a Raspberry Pi 5 sitting on my desk, powered by Home Assistant OS, connected to Telegram, and backed by a private GitHub repository. Every trading day at 2:30 PM it sends me a live portfolio snapshot — current value, capital P&L, dividend-adjusted total return, and which positions moved more than 3% with their technical signals. When I want signals on what to consider buying or selling, I type two words. The analysis comes back in under 90 seconds. I didn't build this because I couldn't afford a commercial alternative. I built it because I wa...
Post a Comment
Read more

Quran Page 43: From Darkness to Light—Divine Sovereignty over Life and Death

-
Image
📖 About Surah Al-Baqarah (Page 43) Page 43 continues the profound message following Ayat al-Kursi, emphasizing the contrast between belief and disbelief. It highlights Allah as the protector of the believers, bringing them from darkness into light, while disbelief leads to the opposite. The page also presents powerful examples: the debate of Prophet Ibrahim (Abraham) with a king, and the story of a man witnessing resurrection after death—both reinforcing Allah’s absolute power over life and death. 🕌 Arabic Text (Page 43)   🌍 English Translation (Sahih International) Verse 257: Allah is the ally of those who believe. He brings them out from darknesses into the light. And those who disbelieve - their allies are Taghut. They take them out of the light into darknesses. Those are the companions of the Fire; they will abide eternally therein. Verse 258: Have you not considered the one who argued with Abraham about his Lord [merely] be...
Post a Comment
Read more

How AI Systems Plan Under Uncertainty: From Lookahead to MCTS

-
Image
How AI Systems Plan Under Uncertainty: From Lookahead to MCTS In real-world AI systems, decisions are rarely made with complete information. Whether it’s an autonomous system navigating uncertain terrain, a fraud detection engine evaluating risk, or a robotics system reacting to sensor noise—decisions must be made before the future is known . Instead of asking “What will happen?”, these systems ask: “What should I do, given what might happen?” Mathematically, we aim to find the Optimal Action (\(a^*\)) that maximizes expected utility (\(U\)) over future states: \[ a^* = \arg \max_{a \in A} \sum_{s' \in S} T(s, a, s') [R(s, a, s') + \gamma V(s')] \] The Architecture of Choice: Navigating the Search Space As an AI Enterprise Architect, I view planning not just as an algorithm, but as a runtime architecture decision . The challenge is balancing the "Curse of Dimensionality" with the need for ...
Post a Comment
Read more

Quran Page 42: The Majesty of Ayat al-Kursi and the Principle of No Compulsion (Surah Al-Baqarah 253-256)

-
Image
📖 About Surah Al-Baqarah (Page 42) Page 42 begins by acknowledging the different ranks of the Messengers and the role of divine will in human history. It then transitions into the monumental Ayat al-Kursi (The Throne Verse) , a comprehensive declaration of Allah's attributes. This page also features the famous declaration "La ikraha fid-deen" (There is no compulsion in religion), emphasizing that the path of righteousness is distinct and clear for those who choose to believe and hold onto the "trustworthy handhold" of faith. 🕌 Arabic Text (Page 42)   🌍 English Translation (Sahih International) Verse 253: Those messengers - some of them We caused to exceed others. Among them were those to whom Allah spoke, and He raised some of them in degree. And We gave Jesus, the Son of Mary, clear proofs and We supported him with the Pure Spirit. If Allah had willed, those [generations] after them would not have fought each other aft...
Post a Comment
Read more

Quran Page 41: The Test of the River and the Victory of David (Surah Al-Baqarah 249-252)

-
Image
📖 About Surah Al-Baqarah (Page 41) Page 41 details the final trials of Saul's army. It begins with the test at the river , where the soldiers' discipline was measured by their restraint. Despite their small numbers, the believers' reliance on Allah led to the defeat of the formidable army of Goliath (Jalut) . This page famously introduces David (Dawud) , who slew Goliath and was subsequently granted kingship and wisdom by Allah. It concludes by affirming that these stories are true signs and revelations from Allah. 🕌 Arabic Text (Page 41)   🌍 English Translation (Sahih International) Verse 249: And when Saul went forth with the soldiers, he said, "Indeed, Allah will be testing you with a river. So whoever drinks from it is not of me, and whoever does not taste it is indeed of me, except one who takes [from it] in the hollow of his hand." But they drank from it, except a [very] few of them. Then when he had crossed it along...
Post a Comment
Read more