Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
3 changes: 1 addition & 2 deletions docs/2025/atarashi-enhancement/updates/2025-07-16.md
Original file line number Diff line number Diff line change
Expand Up @@ -23,8 +23,7 @@ This week was largely focused on **recovery**, as I was still recovering from th

*(July 16, 2025)*

### Attendees

## Attendees
* [Rajul Jha](https://github.com/rajuljha)
* [Sushant](https://github.com/its-sushant)
* [Kaushlendra](https://github.com/Kaushl2208)
Expand Down
61 changes: 61 additions & 0 deletions docs/2025/atarashi-enhancement/updates/2025-08-13.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,61 @@
---
title: Week 11
author: Rajul Jha
tags: [gsoc25, Atarashi]
---

<!--
SPDX-License-Identifier: CC-BY-SA-4.0
SPDX-FileCopyrightText: 2025 Rajul Jha <rajuljha49@gmail.com>
-->

# Week 11

*(August 07, 2025 - August 13, 2025)*

## Overview

This week focused on completing the **UI integration of Atarashi** within FOSSology and refining its configuration workflow. The agent is now being **triggered seamlessly from the UI using the scheduler**, ensuring that users can run Atarashi directly from the FOSSology interface.

---

## Development Progress

* Completed the **Atarashi UI integration** with FOSSology.
* Finalized the **configuration setup** in `atarashi.conf`.
* Verified that the agent can be triggered **end-to-end from the UI via scheduler**.
* Conducted extensive testing on different file types.
* Identified **two performance bottlenecks**:
1. **Database transactions** were expensive and slowed down processing.
2. The **algorithms themselves are inherently computationally heavy**, requiring exploration of faster alternatives such as **Locality-Sensitive Hashing (LSH)**.

---

## Attendees

* [Rajul Jha](https://github.com/rajuljha)
* [Sushant](https://github.com/its-sushant)
* [Kaushlendra](https://github.com/Kaushl2208)


## Meeting

* Reviewed testing results with mentors.
* Discussed **short-term optimizations** (DB-level improvements) vs. **long-term solutions** (rethinking algorithmic complexity).
* Consensus: address DB transaction overhead first, while keeping algorithmic improvements as a future direction.

---

## Status

* UI integration completed.
* Agent fully schedulable and triggerable from FOSSology UI.
* Performance issues identified and documented.

---

## Next Steps

* Optimize **DB transactions** via bulk operations.
* Introduce caching to reduce redundant writes.
* Investigate feasibility of **LSH-based optimizations** for longer-term improvements.
63 changes: 63 additions & 0 deletions docs/2025/atarashi-enhancement/updates/2025-08-20.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,63 @@
---
title: Week 12
author: Rajul Jha
tags: [gsoc25, Atarashi]
---

<!--
SPDX-License-Identifier: CC-BY-SA-4.0
SPDX-FileCopyrightText: 2025 Rajul Jha <rajuljha49@gmail.com>
-->

# Week 12

*(August 14, 2025 - August 20, 2025)*

## Overview

This week was dedicated to **optimizing Atarashi’s performance**, particularly addressing the **database transaction bottlenecks** identified earlier. The improvements led to significant efficiency gains during execution.

---

## Development Progress

* Implemented **bulk insertion of license results** into the database. DB transactions could be
improved by doing bulk insertion into the database using query aggregation. Previously, it was one
trasaction for one row in the license table, but now, the agent first scans and identifies multiple
rows that need to be inserted and then does a bulk insertion step to insert them in a single
transaction. This saves valuable time during DB trasactions.

* Added **license caching** inside DB tables.
* Before inserting, the agent now checks if the license entry already exists.
* If yes → skip insertion.
* Prevents duplicate writes and improves efficiency.

* Noted that algorithmic complexity (second issue from Week 11) still needs further research (e.g., LSH), but DB-level optimizations already provide noticeable improvements.

---

## Attendees

* [Rajul Jha](https://github.com/rajuljha)
* [Sushant](https://github.com/its-sushant)

## Meeting

* Demonstrated bulk insertion and caching results to mentors.
* Received positive feedback on optimizations.
* Discussed roadmap for tackling algorithmic performance in future iterations.

---

## Status

* **Database bottleneck resolved** with bulk insertions and caching.
* Significant runtime improvements observed.
* Algorithmic optimization still pending.

---

## Next Steps

* Continue exploring **faster algorithmic approaches** such as LSH.
* Prepare groundwork for **final project report and evaluation**.
53 changes: 53 additions & 0 deletions docs/2025/atarashi-enhancement/updates/2025-08-27.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,53 @@
---
title: Week 13
author: Rajul Jha
tags: [gsoc25, Atarashi]
---

<!--
SPDX-License-Identifier: CC-BY-SA-4.0
SPDX-FileCopyrightText: 2025 Rajul Jha <rajuljha49@gmail.com>
-->

# Week 13

*(August 21, 2025 - August 27, 2025)*

## Overview

This week was primarily focused on wrapping up the project and completing the **final project report** for GSoC 2025.

---

## Development Progress

* Dedicated time to documenting the project thoroughly.
* Wrote and finalized the **GSoC Final Project Report**, covering:
* Development journey of Atarashi’s integration into FOSSology.
* Key technical challenges and solutions.
* Future improvements and roadmap.

* Published the final report on my blog.

📄 **Final Report Link:** [GSoC 2025 Project Report](https://rajuljha.github.io/posts/gsoc-25-project-report/)

---
## Attendees

* [Rajul Jha](https://github.com/rajuljha)
* [Sushant](https://github.com/its-sushant)


## Status

* Project milestones completed.
* Final report submitted and published.

---

## Next Steps

* Wrap up final evaluation process.
* Continue refining Atarashi beyond GSoC as part of ongoing contributions to FOSSology.

---