Filecoin Community Roadmap - 2022Q1 Project Contributions

[kaitlin-beegle]

There are many exciting enhancements, improvements, and tools that will be introduced by the Filecoin community in 2022.

In an effort to better communicate about and collaborate on this work, we will be assembling a community roadmap! Help contribute to this effort (and publicize your team's hard work) by contributing your projects!

What?

The Filecoin Community Roadmap is an open-source reference document compiled and managed by the Filecoin community.

The current roadmap manager is Kaitlin Beegle ([email protected]).

The roadmap will be updated on a quarterly basis. Prior to the start of each quarter, the roadmap manager will open up and publicize a Call for Contributions in the Filecoin Community Discussion Forum. Teams will have a designated window of time during which they can submit new milestones and/or update existing milestone timelines.

Once the Call for Contributions period has expired, a new iteration of the roadmap will categorize projects by type and be organized visually according to project milestones.

How?

To contribute your project, simply copy+paste the below template into a new comment on this thread.

Project Name:
Project Description (2-3 sentences):
Key Contributors: 
Team/Organization: 
Milestone(s):
    Milestone x:
    How this improves Filecoin:
    Est Milestone Date:
Relevant Links:

Worked example:

Project Name: Filecoin Virtual Machine (FVM)
Project Description (2-3 sentences): Add user programmable smart contracts ("actors") to Filecoin.
Contributors: @raulk, @stebalien
Team/Organization: Protocol Labs EngRes - FVM
    Milestone 1: Upgrade the Filecoin Mainnet & all Filecoin implementations to validate the chain via the WASM-based Filecoin Virtual Machine, hosting no user-deployed contracts, only the system built-in actors based on the canonical implementation (forked from Rust actors).
    How this improves Filecoin (1-2 sentences): This intermediary milestone builds towards adding user-defined smart contracts natively on top of the WASM FVM.
    Est Milestone Date: March 2021 for WASM-based FVM deployment + gas schedule rebalancing
    Milestone 2: Add support for user-programmability to the FVM, supporting both native and the foreign EVM actors
    How this improves Filecoin (1-2 sentences): Users can now deploy custom smart contracts, either native or EVM-based, natively on top of the WASM FVM (including creating and deploying new actors like storage provider DeFi loans, auto-renewing storage deals, etc)
    Est Milestone Date: June 2021 for native/foreign actors integration
Relevant Links: https://github.com/filecoin-project/fvm-project, https://www.youtube.com/watch?v=Vw9syGiG31c

A Note on Projects
This roadmap is for tracking projects that will open up new Filecoin use cases, network capacity, or tooling. If you believe your project accomplishes this, please submit it! However, projects that refine, incrementally improve, or compete with existing tools/projects built solely on top of Filecoin, should instead be submitted to the ecosystem project dashboard.

The purpose of this roadmap is to chart projects that expand the scope of the Filecoin ecosystem, not those that deepen existing utilities.

A Note on Milestones
The roadmap organizes projects of various types, scopes, and levels of complexity along a single timeline. Although your project may be tracking multiple 'milestones' or development benchmarks, we are focused on plotting high-level milestones that represent community-facing achievements.

Most projects will record a single milestone; perhaps a launch date, or an alpha release. However, really large projects may record multiple milestones if each milestone represents a significant change in the public-facing functionality of a tool.

If you're unsure what level of detail to include for your project, feel free to reach out to the roadmap manager. You are also welcome to include additional project details, but know that not all of this information may be included in the final roadmap.

---

Lastly, be sure to fill out all sections of the template in order to be included in the final roadmap.

Please note that this roadmap should only capture projects that are currently in development. 'Wish list items', or other projects that you'd like to see completed, should be suggested in the FIPs Discussion Forum.

[kaitlin-beegle]

Contributions to the first -ever roadmap will be accepted through January 7, 2022!

Be sure to add your project before then, and don't hesitate to reach out with any questions or ideas that you may have :)

[Please note: deadline extended from 12/31/21 to 1/7/22]

[molekilla]

Ancon Protocol has Wasm Edge VM integrated with go-ipld-prime with graphql

https://github.com/anconprotocol/contracts

[BlocksOnAChain]

Project Name: SnapDeals

Project Description:
Since 90+% of sectors in the Filecoin Network are CC sectors, having a protocol that allows for updating CC sectors to store real data without incurring a full re-sealing would massively improve our network in terms of the amount of real data stored through it.

Key Contributors: @Kubuxu, @nicola, @cryptonemo, @DrPeterVanNostrand, @lucaniz, @arajasek, @ZenGround0, @BlocksOnAChain, @momack2, @jennijuju, @dignifiedquire, @magik6k
Team/Organization: Protocol Labs team

Milestone(s):

• Update Circuits to unlock proofs potential for SnapDeals implementation
  How this improves Filecoin: We will get new and updated proofs circuits that will unlock the SnapDeals feature on the entire Filecoin network

• Make changes to Lotus and Actors to support SnapDeals development path
  How this improves Filecoin: It will enable us to see the full potential of the SnapDeal implementation path, which includes utilization of existing committed capacity and makes it cheaper for Storage providers

• Multiple audits from the Theory and Implementation side
  How this improves Filecoin: it gives us reassurance that all the implementation steps we took are done in the correct way + our code quality and specification for the changes we made is up to date and ready to be used by end-users.

• Run Trusted setup with multiple network users in order to generate Groth16 parameters
  How this improves Filecoin: We will generate new parameters for the Zero-Knowledge Proving System that will unlock usability for the new circuit that we developed to support SnapDeals in Filecoin

• Perform multiple testing and validation rounds in order to validate the entire implementation flow on our testnets
  How this improves Filecoin: We would get a well-tested and validated release, so we know we have a stable network upgrade that can be shipped when we are ready.

Overall implementation benefits for the Filecoin network:

• It allows decoupling sealing latency from deal-making speed - offering storage clients an improved experience for how quickly their data can land in on-chain deals
• It will unlock the 8EiB of storage already committed to the Filecoin network to be quickly used for deals - enabling a 100PiB+ client to make deals for their entire dataset with a single miner like f0127595 which already has 120PiB of committed capacity.
• It enables utilizing existing committed capacity much cheaper for miners (since they’ve already invested the sealing cost), increasing the chances they pay clients to add FIL+ data to these sectors.

Est Milestone Date: We plan to ship it by the end of February 2022

Relevant Links:

• SnapDeals Development board - https://github.com/orgs/filecoin-project/projects/17
• SnapDeals FIP - FIP Discussion: Snap Deals FIPs#145

[andrewxhill]

Here are some!

• Powergate V3 - the original powergates (v1 and v2) have been mainly replaced now by overlapping efforts. For example, Estuary is tackling the linking of the fil and ipfs networks head-on. The reputation and miner selection challenges are something we've been tackling in our auctions network. We will launch a Powergate v3 effort that will trim away all those overlapping features from the old versions and focus on a client toolkit that will help users leverage deal-making apis (glif, auctions, estuary), manage deal logs, and some other nice features. We are still scoping the project but hope to kick it off early next year.

• Auctions - the bidbot+auctions network saw unprecedented throughput and accuracy in the past few weeks. E.g., https://blog.textile.io/announcing-the-winners-of-the-2021-filecoin-auction-challenge/. We are now helping large clients use that network to do new things such as target a set of pre-vetted miners and quickly onboard/distribute data. We'll post our learnings from these efforts early next year too.

• Auctions API - we have an undocumented API that we'll publish where other projects can review all the data from within auctions for review. This includes bids, wins, prices, errors, etc.

• Secret project - we are back in the kitchen cooking up something exciting for the broader community. We'll be sharing this Q1 next year, I can't wait for all of your feedback.

• Wishlist - There are some things we'd love to see others build too!

  • Renewal service - It would-be killer to have someone run a renewal service where a client could drop a csv of deals with proper metadata and have the service manage renewals for them. Perhaps a week before renewal, an email would be sent with a summary. The service could be built using its own wallet to start, but later, even support utilizing a client's wallet and signatures.
  • Provider profiles - I've seen a couple starts to this but no clear winner. It would be great if there was a public website with an index of storage providers. It is similar to what we already see on filfox, but even with videos of providers showing their hardward/spaces. Volunteered information about their location. Are they a small, medium, or large provider? Could it list what ways they accept deals (auctions, estuary, default)? Contact info? I could imagine it pulling stats and recent work that each provider has been doing on estuary or bidbot using those public apis.

[kaitlin-beegle]

Hey @andrewxhill! I'm drafting the roadmap, which should be available next week!

Now that it's 2022Q1, is there any update on the secret project that you're able to share?! Curious minds are dying to know ;)

Also, do you a rough estimation (month) when you plan to release the auctions API?

[flyworker]

Project Name: Multi Chain Payment (MCP)
Project Description:
Enabled the users pay IPFS/Filecoin storage by tokens on different blockchain. User can pay filecoin storage base on the price feed from the DEX, so they do not need to buy FIl and pay storage deals by them self. User will get the payment transaction info and the IPFS cid with FIlecoin deal id for future reference.

Key Contributors: @flyworker @liushmh
Team/Organization: FilSwan
Milestone(s):
Milestone 1:

• Pay stable coin for Filecoin with Polygon network
• Payment throught metamask
• Price feed from Sushi exchanges
• Testnet Faucet for matic and other tokens
• Service Avaliable on Calibration network
  Est Milestone Date: December 15th 2021

Milestone 2:

• Support eth, bsc and other evm blockchains
• Filecoin Mainet support
  Est Milestone Date: March 15th 2022

MIlestone3:

• Support FVM once it is ready

How this improves Filecoin:
Filecoin as a storage solution leading in decentralized storage market is used by lots of famous blockchain projects. e.g. Near, Polygon. It is also used by projects in NFT, deep learning. However, Filecoin blockchain currently only support FIL as the payment token,with MCP integration it will greatly increased the adaption by other blockchains storage data on Filecoin network, it will also benefit Filecoin network storage provider get income from other blockchains.

Relevant Links:
GitHub Repo: https://github.com/filswan/multi-chain-payment
Testnet: https://calibration-mcp.filswan.com

[dchoi27]

Project Name: NFT.Storage + Web3.Storage
Project Description (2-3 sentences): NFT.Storage provides free storage for off-chain NFT data on IPFS and Filecoin. Web3.Storage provides general content-addressed storage on IPFS and Filecoin.
Key Contributors: @alanshaw @vasco-santos @hugomrdias @Gozala @yusefnapora @mikeal and many others!
Team/Organization: Protocol Labs

Milestone: Launch of gateway.nft.storage
How this improves Filecoin: Will collect a ton of data to help public gateways be better optimized for NFT use cases, and switch over to retrieving from Filecoin once more performant
Est Milestone Date: Q1

Milestone: niftysave Ethereum
How this improves Filecoin: Storing all retrievable off-chain data from NFTs on Ethereum onto NFT.Storage, and therefore Filecoin
Est Milestone Date: Q1

Milestone: Staking FIL for expanded storage on Web3.Storage
How this improves Filecoin: Lets users stake FIL to expand their allowed storage capacity on Web3.Storage beyond the 1TiB limit per account, both decreasing FIL token velocity and allowing more users to store more data on Filecoin.
Est Milestone Date: Q2

Milestone: niftysave Solana
How this improves Filecoin: Storing all retrievable off-chain data from NFTs on Solana onto NFT.Storage, and therefore Filecoin
Est Milestone Date: Q2-3

Milestone: nft.storage perpetual renewal + data DAO
How this improves Filecoin: Early use case of FVM once released that can show how the funding of public goods can work on Filecoin (auto renewal of storage deals funded by a data DAO, both powered by FVM)
Est Milestone Date: ~Q4

Relevant Links: https://nft.storage/ https://web3.storage/

[kaitlin-beegle]

Hey @dchoi27! Thanks for submitting this project! :)

I'm currently finalizing the roadmap and plan to have a copy released next week. In the meantime, would you mind providing an update on gateway.nft.storage? Do you know a bit more about when this tool will be made available? Thank you!

[dchoi27]

Should be by early Feb!

[dchoi27]

Added some more detail on our FIL-relevant roadmap for 2022

[flyworker]

Project Name: FS3
Project Description：
FS3 (a.k.a. Filecoin Simple Storage Service), a Filecoin and S3 compatible storage gateway, makes it possible for industry users to migrate large-scale data from AWS, Azure to the Filecoin network without redesigning the system. FS3 provides services including S3 compatible storage, Filecoin payment, and multiple-storage- provider backup. FS3 backup can automatically retain backups for resources according to users' backup plan.

Key Contributors: @flyworker @GuohaoMa
Team/Organization: FilSwan
Milestone:
- Schedule file Backup to Filecoin with online deal
- Volume backup to Filecoin Network with offline deal
- Hosted version for multi tenants
- Payment and billing system

How this improves Filecoin:

With FS3, we can easily migrate existing web2 users to Filecoin network, it give the best user experience for industry users.

Est Milestone Date: Q1 2022

Relevant Links:
Single User demo instance:

https://calibration-fs3.filswan.com

[kaitlin-beegle]

Hey @flyworker! I'm finalizing the roadmap now...you'll be able to see it late next week!

Now that it's 2022Q1, do you have an update on the the FS3 release schedule? I'm looking to know which month it will be released in, if you happen to know :)

[TimGuo7]

Project Name: Filscan
Project Description: Filscan(https://filscan.io/) is the first data browser in the Filecoin ecosystem and is dedicated to building the Filecoin network data analysis center, providing the Filecoin ecosystem data services, visualization and other one-stop data analysis for the whole network, and building a data intelligence platform for 3rd party ecosystem applications.
Contributors: @TimGuo7 @steven004
Team/Organization: IPFSForce Team
Milestone: Provide API for 3rd party and other public chains to integrate with Filecoin ecosystem, continue the efforts of providing 1 stop data analysis center for Filecoin ecosystem participants.
How this improves Filecoin: This will help to expand the integration of Filecoin ecosystem with other chain, and support Dapps built with IPFS/Filecoin.
Est Milestone Date: June 2022, fully managed and dedicated hosting with Full API Access.

Relevant Links:
Web: https://filscan.io
Github Repo: https://github.com/Filscan-Team

[icodeface]

Project Name: FoxWallet

Project Description: FoxWallet is a decentralized Filecoin(ETH also supported) mobile wallet, which supports multi seed phase and multi accounts based on BIP44 standard. FoxWallet provides useful information and tools for the Filecoin network, makes it easy for users to manage their assets and collaborate within the Filecoin ecosystem. Audited by certik: https://www.certik.org/projects/fox-wallet .

Key Contributors: @icodeface、@filfox

Team/Organization: Filfox、6Block

Milestone(s):

• Milestone 1:
  How this improves Filecoin: send/receive FIL, support bls/spec256k1 signature type, show network information, show miner information.
  Est Milestone Date: 2021 Q4 (implemented already)

• Milestone 2:
  How this improves Filecoin: support multi-sig wallet、transaction speed up、better gas premium prediction
  Est Milestone Date: 2022 Q1

• Milestone 3:
  How this improves Filecoin: monitor miner status, push notification when detect faulty sectors or control-account balance not enough
  Est Milestone Date: 2022 Q1-Q2

• Milestone 4:
  How this improves Filecoin: miner management(change owner、control address, withdraw rewards)
  Est Milestone Date: 2022 Q2

• Milestone 5:
  How this improves Filecoin: FVM integration, support cross-chain bridge/swap
  Est Milestone Date: 2022 Q3

Relevant Links: https://foxwallet.com/

[luckyceline]

Project Name: FiveToken
Project Description: FiveToken（Fivetoken.io）offer a professional encrypted multi-sig wallet with services including asset management tools for miner node creation, owner alteration, and FIL transaction and cluster status monitoring tool. The user can also protect his private key and mnemonic words via offline signature and offline wallet.

Contributors: @speakshare, @ss1991zh

Team/Organization: FiveToken Team

Milestone: Provide multi-chain mode/protocol that can support FIlecoin to link to other blockchains to build seamless interoperability from Filecoin network to the web 3 metaverse; Enforce the capability of information management via all individual identity accounts and data communication across varied blockchains;

How this improves Filecoin: Provide professional transaction service for Filecoin storage providers and bridge Filecoin ecosystem to Web 3 metaverse with reliable ID management.

Est Milestone Date: Q2 2022, connect polkadot and dfinity to promote multi-chain asset storage

Relevant Links: https://github.com/FiveToken; https://fivetoken.io/

[laurarenpanda]

Project Name:

FileDrive Datasets

Project Description:

FileDrive Datasets is a platform to effectively connect the huge storage market that Filecoin has built with owners or publishers of data. It has integrated IPFS protocol and a group of FileDrive tools to provide storage service, with both Cloud Storage and Object-base Storage compatibility and a better user experience to attract more users. All data will store on the Filecoin network with storage providers in different locations.

Key Contributors:

@beeleelee @qianhh @laurarenpanda @abu0306

Team/Organization:

FileDrive Labs

Milestone(s):

• User system: audit invitation mechanism for both data owners/managers and storage providers
• Data management system: support to manage data in iterative management style, and backup storage by version
• Configuration panel: support storage providers to set verified deal parameters, which will automatically synchronize to FileDrive Dealbot
• Client authorization mechanism: support verified clients to upload/manage/store data through FileDrive Datasets and send verified deals to storage providers, who have registered in this platform

How this improves Filecoin:

FileDrive Datasets can build a bridge between data and IPFS/Filecoin by a complete service system, without complex technical barriers.

Est Milestone Date:

Q2 2022

Relevant Links:

https://datasets.filedrive.io/

[davidd8]

Project Name: Indexing for Filecoin
Project Description: Enable Storage Providers to index stored content, over gossipsub, to an indexer system that maps CIDs to the providers that host the content.
Key Contributors: @gammazero, @masih , @MarcoPolo, @willscott
Team/Organization: Protocol Labs
Milestone 1: Lotus nodes can index content to an Indexer node.
How this improves Filecoin: Makes Filecoin content discoverable. Clients can now query an Indexer for specific content, and determine which Storage Provider(s) to make retrieval deals.
Est Milestone Date: Q1 2022
Relevant Links: https://github.com/filecoin-project/storetheindex, https://github.com/filecoin-project/index-provider

[kaitlin-beegle]

Hey @davidd8, thanks for including this project! I'm creating the final roadmap now and am wondering if you have an update on the milestone? Do you know when in Q1 Filecoin data indexing will become available?

[davidd8]

Hi @kaitlin-beegle, Filecoin indexing should be available alongside the lotus 1.15.1 release, sometime in March 2022.

[davidd8]

Project Name: Lightning
Project Description: Improve performance and reliability of the data transfer stack for storage and retrieval deals.
Key Contributors: @hannahhoward, @rvagg, @mvdan
Team/Organization: Protocol Labs
Milestone(s):
Milestone 1: Improve performance for Estuary
Est Milestone Date: Q1 2022
Relevant Links: Project Overview in Notion
Repos - https://github.com/ipfs/go-graphsync, https://github.com/filecoin-project/go-data-transfer

[PluskitOfficial]

@momack2 Sorry for mistake. I have made it seperately.

[momack2]

Hey @davidd8 - can you clarify what "success" looks like for lightning? How are the improvements going to show up for users of Filecoin (any specific metrics you're tracking?)

[cryptoquick]

Lightning is a terrible name for this if it has nothing to do with the Lightning Network, especially if there were projects in the future seeking to pay for Filecoin storage with Lightning sats.

[kaitlin-beegle]

@davidd8 hey there! Would you mind providing an update on the above comments, as well as any updates you may have about the timeline?

[davidd8]

Hi @kaitlin-beegle and @momack2, in terms of success metrics we're looking overall throughput and completion rates for Estuary deals - the specifics are linked in https://www.notion.so/pl-strflt/Project-Overview-c0536310297841d5b82ed0fb7fa82bcb. While the project is focused on Estuary, the performance improvements to Graphsync should apply to all clients that upgrade to the updated version, which translates to faster transfers and higher success rates. There's also the benefit of making the graphsync codebase simpler to understand for more developers to make contributions. We expect the first major graphsync update to land in the lotus 1.15 release in March 2022.

As for the name, @cryptoquick , agree it has nothing to do with the "Lightning Network" and may be confusing. The backstory is that this initially started out as an internal code name and it stuck before it became more public. We'll be more careful moving forward on naming collisions, especially within the web3 space.

[cryptonemo]

Project Name: Halo2

Project Description:

Currently, an artificial “bandwidth” limit exists on the Filecoin network due to the number of Groth16 proofs which need to be validated per block. An example of this “bandwidth” limit is that miners cannot onboard storage as fast as they want. Halo2 is a new proof system which can replace Filecoin’s current proof system (Groth16).

Filecoin currently uses Groth16 proof aggregation (SnarkPack) which allows miner’s to aggregate a limited number of Groth16 proofs into a single Groth16 proof, thus reducing proof congestion.

Unlike Groth16, Halo2 proofs are recursive, i.e. a single Halo2 proof can prove the validity of other Halo2 proofs, theoretically this recursion is unbounded, i.e. we are not limited in the number of Halo2 proofs which can be proved by a single Halo2 proof. Also, unlike Groth16, Halo2 proofs do not require an expensive trusted-setup, thus making it easier for the network to update the proofs it uses.

Key Contributors: @DrPeterVanNostrand, @cryptonemo, @BlocksOnAChain, @vmx, possibly @dignifiedquire

Team/Organization: FilecoinCrypto

Milestone(s):

• Milestone 1: Prepare the proofs codebase(s) for a new proving system

  • How this improves Filecoin: We need to integrate Pasta fields throughout our hashing repos and adding support for them in our Merkle trees and graphs. In addition, we need to create new Vanilla replication, PoRep and PoSt methods/processes and APIs using the Pasta fields.
  • Est Milestone Date: End of Q1 2022

• Milestone 2: Add Halo2 gadgets and circuits

  • How this improves Filecoin: This will allow us to wire in Halo2 circuit proving end to end via SDR-PoRep, Winning and Window PoSt and EmptySectorUpdate and provide APIs. Proof recursion may be ready for our use/integration around this time, but that is still TBD.
  • Est Milestone Date: End of Q2 2022

Relevant Links:

https://zcash.github.io/halo2/index.html
https://github.com/filecoin-project/rust-fil-proofs

[ColinSchwarz]

Project Name: ChainSafe Storage

Project Description:
A dynamic developer tool and pinning service, ChainSafe Storage offers a set of API keys that provide easy access to IPFS and Filecoin. Storage provides an S3 compatible API so that web2 applications can migrate their storage layer to use IPFS and Filecoin in just a few seconds. Comprehensive file service APIs can be plugged in as the storage layer for any web2 or web3 application in just a few clicks.

Key Contributors: @kalambet, @dhyaniarun1993, @sadiq1971, @ohmpatel1997, @ColinSchwarz

Team/Organization: ChainSafe

Milestone(s):

Milestone 1: Performance enhancements
How this improves Filecoin: Will improve upload/download speed for applications connecting to Filecoin through ChainSafe Storage
Est Milestone Date: Q1 2022

Milestone 2: NFT Module
How this improves Filecoin: Will create intuitive flow for storing NFT off-chain data to Filecoin
Est Milestone Date: Q1 2022

Milestone 3: ChainSafe gaming SDK integration
How this improves Filecoin: create easy and integrated storage solution for video game data and in-game NFT data to Filecoin
Est Milestone Date: Q1 2021

Relevant Links: https://storage.chainsafe.io/

[kaitlin-beegle]

Hey @ColinSchwarz, thanks for submitting this project! I'm currently finalizing the roadmap, and you'll be able to see a copy next week :)

In the meantime, since it's currently 2022Q1, I wanted to see if you had an update for the above timelines? Specifically, do you know in which month the SDK integration will be released? Thanks!

[ColinSchwarz]

Project Name: ChainSafe Files

Project Description:
An intuitive, private and secure cloud storage service that provides easy access to Filecoin and IPFS for non-technical users. Files offers all the convenience of web2 cloud storage apps but preserves the user's data ownership and privacy. Files is the perfect on-ramp for web2 users to web3 storage.

Key Contributors: @FSM1, @Tbaut, @RyRy79261, @tanmoyAtb, @asnaith, @sweetpea22, @serenaho, @ColinSchwarz

Team/Organization: ChainSafe

Milestone(s):

Milestone 1: Enhanced collaboration features
How this improves Filecoin: Will allow users to collaborate more easily within the app so that entire organizations can easily access Filecoin, driving more usage and adding additional functionality.
Est Milestone Date: Q2 2022

Relevant Links: https://files.chainsafe.io/

[Joss-Hua]

Project Name:
Venus

Short description: Venus is an implementation of the Filecoin Distributed Storage Network.
Long description: Venus is an implementation of the Filecoin in Go. Venus is committed to continuous improvement on the security of the Filecoin network and the applicability of distributed clusters.

Key Contributors:
@diwufeiwen @hunjixin @zl03jsj @simlecode @Joss-Hua

Team/Organization:
IPFSForce Team

Software type: Filecoin Implementation

Milestone(s):

Milestone 1: venus-market V2

• Launch venus-market V2 as a chain service module;
• Service tools of venus-market V2;
• Implementation of the automatic market trading scheme;

How this improves Filecoin: increase the diversity of use methods to meet different use scenarios; Provide more support for the service platform of real orders, as stated in the roadmap.

Milestone 2: chain service V2

• Common types and API integration;
• RPC API maintains the same API as Lotus;
• Automatic monitoring of API changes;
• The chain service modules code is reconstructed and integrated to reduce code redundancy and manage the common code uniformly;
• Dev tool, automatic generation of relevant code based on the template;
• CI / CD upgrade;
• Generate a help group library for random objects with increased test coverage;

How this improves Filecoin: streamline repo management, improve more automation, test coverage, program compatibility, and ease of use of storage providers.

Milestone 3: venus-cluster V1

• Release version V1 through the test of the whole process of sector seal;
• Optimize user experience: simplify operation commands, readability of execution results, and improve documents;
• Optimize worker scheduling and write task allocation rule template;
• Controllability, visualization, and monitoring of resource occupation;
• Improve the efficiency of sector sealing and realize the dynamic loading of filecoin-ffi;
  • Provide a convenient ffi loading mechanism, such as the community's own optimized ffi to generate a dynamic library and load dynamically when calling
  • compatible with different implementation (such as lotus-provider, venus-market, etc.)

How this improves Filecoin: Improve the efficiency of sector sealing, provide a convenient ffi loading mechanism, and provide more selectivity and convenience for storage providers.

Est Milestone Date:
Q1 2022
Q1-Q2 2022

Relevant Links
Website: https://venus.filecoin.io
Repo(s): https://github.com/filecoin-project/venus
Slack: https://filecoinproject.slack.com/archives/CEHHJNJS3

[anorth]

Project Name: FIL+ Subsidy
Project Description (2-3 sentences): Decouple storage market from storage-powered consensus by replacing the notion of quality-adjusted power with an explicit reward to subsidise FIL+ deals.
Key Contributors: @anorth @Kubuxu @zixuanzh
Team/Organization: Protocol Labs EngRes - Protocol Opportunities
Milestone(s):
Milestone 1: FIL+ subsidy protocol upgrade
How this improves Filecoin: Decouples FIL+ incentive mechanism from storage power. This enables more scalable designs for accounting for network storage power as well as more flexibility for deal markets. This is a step towards complete decoupling of storage markets from chain security and consensus which will allow multiple storage markets to exist and evolve without network-wide upgrades.
Est Milestone Date: Q2 2022
Relevant Links: filecoin-project/FIPs#121

[anorth]

Project Name: Storage market decoupling
Project Description (2-3 sentences): Remove coupling between the storage miner actor and the on-chain storage market in order to enable markets to innovate independently
Key Contributors: @anorth @Kubuxu
Team/Organization: Protocol Labs EngRes - Protocol Opportunities
Milestone(s):
Milestone 1: Break miner<->market actor coupling (miner actor never invokes market actor)
How this improves Filecoin: Speed up development iterations on both mining and markets. Enables development of alternative storage markets. Removes storage market from consensus-critical risk surface. Removes risk of market dominating blockchain tx capacity.
Est Milestone Date: Q3 2022
Milestone 2: Break deal<->sector coupling (deals can move between sectors)
How this improves Filecoin: Enables deal extension and much more flexible policies regarding faults, termination, etc. Moves sector->deal mapping out of miner state, enabling efficient on-chain accounting through sector aggregates
Est Milestone Date: Q3 2022
Milestone 3: Storage market as an upgradeable contract
How this improves Filecoin: After FVM, allows the storage market to be upgraded on-chain as a contract upgrade rather than consensus-breaking network upgrade. Greatly increase potential for storage market development iteration speed. Allows efficient implementation of a giant wish list of market features.
Est Milestone Date: Q4 2022

Relevant Links: None yet

[anorth]

Project Name: Programmable storage market
Project Description (2-3 sentences): A storage market with composable primitives to expose storage deal functionality to smart contract programmers in the FVM
Key Contributors: @anorth and many more
Team/Organization: Protocol Labs EngRes - Protocol Opportunities
Milestone(s):
Milestone 1: Deals as NFTs
How this improves Filecoin: Provide standard interfaces for storage deals enabling the construction of many on-chain applications such as brokers, aggregators, repair-providers, derivatives, insurance, etc.
Est Milestone Date: Q4 2022
Relevant Links: None yet

[Destore2023]

Project Name: ByteBase Privacy Storage Platform
Project Description：
ByteBase Privacy Storage Platform provides easy-to-use SaaS services and OpenAPI services. We connect both Data Providers and Storage Providers. Data Providers enjoy stable and reliable decentralized storage services based on IPFS networks and Storage Providers enjoy the benefits from data storage and retrieval.
Key Contributors: @swatchliu
Team/Organization: ByteBase
Milestone:
-Support for MetaMask Wallet login
-Public IPFS remote pin service
-Build Public IPFS node to support data retrieval
-PowerDealer：a kind of data distribution solution system
How this improves Filecoin:
With these improvements, users can more easily use the Filecoin network for storage.
Est Milestone Date: Q2 2022
Relevant Links:
https://www.bytebase.cn

[dev-ddid]

Project Name:
DDID（DECENTRALIZED DIGITAL IDENTITY）

Project Description:
DDID is to unify the login entrance of Dapp, help web3 users regain control of data sovereignty, and provide users with reliable data transaction protocols to help users digitize their data in exchange for benefits.

Different from other products (more DID products focus on identity authentication), the protocol designed by DDID will focus on the data collection, classification and transaction matching after the data digitized by the user interacts with the Dapp. Through the establishment of a good digital identity, reputation, transaction agreement to maximize the protection of users' privacy is not violated. "Guaranteeing user privacy and exchanging data benefits for users" can bring us more community support, and we will also vigorously promote the implementation of Web3 to contribute to it.

DDID will mainly solve 4 problems:

1. Data ownership: Let the data generated by the interaction between the user and the platform return to the user.
2. Data insecurity: privacy leakage is a very headache for users in all countries. We will ensure the security of user data through mature and open source encryption algorithms on the market.
3. Data digitization: After data is digitized, value can be generated, and it can generate income for users according to the value in line with the market.
4. The issue of trust in data transactions: We have begun in-depth cooperation with a Chinese algorithm company. The algorithm can determine the legitimacy of the data under the ciphertext of the data to provide security for both buyers and sellers.

Key Contributors:
@dev-ddid

Team/Organization:
DDID team

Milestone(s):
• Milestone 1: Access metaverse with linked real or virtual identities
• Milestone 2: Data Exchange Platform for monetization
• Milestone 3: Reputation Score to fend off witch attacks

Est Milestone Date:
August 2022 for beta release

Relevant Links:
Website: https://ddid.io/
Twitter: https://twitter.com/ddid_io
Youtube: https://www.youtube.com/watch?v=XoO9Bi8FM6g&t=24s

[kaitlin-beegle]

Hi @dev-ddid, thanks for submitting your project! I'm currently in the process of incorporating all submitted projects into the roadmap, which should be released next week.

In order to include your project, can you please explain how the DDID tool integrates with the Filecoin network? Is DDID's plan to use Filecoin network data to confirm user identities, or does the tool use Filecoin for data storage?

[dev-ddid]

Ok thanks @kaitlin-beegle , DDID data is divided into 2 categories in total:
One category is sensitive information, it will only be stored locally on the user's mobile phone
The second type of data belongs to the data generated by the interaction between users and DApps. These data are stored in web3.storage after homomorphic encryption.

[alexander-camuto]

Project Name: Retrieval Market

Project Description: We're building a retrieval market which allows for the fast retrieval of files that are stored on the Filecoin network. We do so by creating a new type of provider node called a ‘pop’ which caches popular files in hot storage. Because of the similarities between retrieval market dynamics and content delivery networks, our broader aim is to build a resilient and decentralized content delivery network (CDN) that dApps can use to performantly serve content to their end users.

Key Contributors: @alexander-camuto @tchardin

Team/Organization: Myel team

Milestone 1:

• JS GraphSync implementation.
• Allows for browsers to fetch and deliver content. Improves adoption and usage of the retrieval market as clients don’t need to install and run a full node.
• Delivery by Spring 2022.

Milestone 2:

• Cache missing to Filecoin and IPFS.
• Users storing content on IPFS and Filecoin won’t have to pre-emptively cache on our network to get fast content retrieval.
• Delivery by Summer 2022.

Milestone 3:

• Stable payments in production leveraging nitro payment channels (Magmo team project).
• Payments are a critical piece of the retrieval market and should be performant enough that they don’t slow down data transfers.
• Delivery by Summer 2022.

Relevant Links:

• Website: https://myel.network
• Twitter: https://twitter.com/myelnet
• Discord: http://discord.link/myel

[liyunzhi-666]

Project Name:
DappOnline

Project Description (2-3 sentences):
The world's leading decentralized application ecosystem and has become China's largest decentralized application store. A platform related to blockchain content that most users think highly of. Also a one-stop community where nearly 5,000 decentralized projects and mainstream blockchains have settled in, such as ETH, EOS, TRON, IOST, BSC, Polygon, Filecoin, Solana and etc.

Key Contributors:
@jmy520

Team/Organization:
@tengeek

Milestone(s):
Milestone 1:
Connect to the IPFS network for DappOnline, and store massive information of nearly 5,000 decentralized projects in the community on IPFS nodes
How this improves Filecoin:
To verify the storage performance and reliability of IPFS nodes, increase storage of trusted data in IPFS/Fileocin network, and create IPFS/Filecoin community content
Est Milestone Date:
2nd quarter of 2021

Milestone 2:
Deepen the technical application of IPFS/Filecoin, and store original creations like articles and videos on the platform in the trusted network node of IPFS/Fileocin
How this improves Filecoin:
Increase storage of trusted data in IPFS/Fileocin network and create IPFS/Filecoin community content
Est Milestone Date:
3rd quarter of 2021

Milestone 3:
Support projects in Filecoin blockchain ecology
How this improves Filecoin:
Blockchain projects in IPFS/Fileocin ecology can be directly published to the DappOnline community to gain more opportunities of exposure and display. All users in the community can also enjoy ecological application of Filecoin at the same time
Est Milestone Date:
3rd quarter of 2021

Relevant Links:
https://dapponline.io
https://twitter.com/DappOnline

[kaitlin-beegle]

Hi @liyunzhi-666, thanks for submitting! However, I'm not sure this is the correct space for showcasing your work! It sounds like you're planning to store information on Filecoin/IPFS, which is great.

This roadmap, however, is for highlighting key projects built to support the Filecoin ecosystem, not new clients onboarding data.

Please let me know ASAP if I am misunderstanding!

[liyunzhi-666]

here are some additions, please check. @kaitlin-beegle

Project Name:
DappOnline

ProjectDescription (2-3 sentences):
The world's leading and China's largest decentralized application ecosystem, a blockchain content platform that more users like. A one-stop community for nearly 5,000 decentralized projects from mainstream blockchains such as ETH, EOS, TRON, IOST, BSC, Polygon, Filecoin, and Solana.

Key Contributors:
@dapponline
Team/Organization:
@tengeek

Milestone(s):
Milestone 1:
DappOnline will develop a set of full-process storage APIs to support the project development of the Filecoin blockchain
How this improves Filecoin:
Filecoin blockchain ecological partners use IPFS for storage when developing chain games or NFT projects, increase trusted data storage in the IPFS/Fileocin network, and build IPFS/Filecoin community content
Est Milestone Date:
Q2 2022

Milestone 2:
Deepen the technical application of IPFS/Filecoin, the later planning of DappOnline, and display the data stored by NFT on the IPFS network on the project details page
How this improves Filecoin:
Increase trusted data storage in IPFS/Fileocin network and build IPFS/Filecoin community content
Est Milestone Date:
Q3 or Q4 2022
Relevant Links:
https://dapponline.io
https://twitter.com/DappOnline

[liyunzhi-666]

Project Name:
TJWallet

Project Description (2-3 sentences):
@TJ_Wallet, a crypto wallet exclusively developed by @tengeek, provides a one-stop cryptocurrency asset management solution, using dual mode of software wallet & hardware wallet. A safe and easy-to-use blockchain wallet act as a better digital tool in the Filecoin ecosystem.

Key Contributors:
@eggacher

Team/Organization:
@tengeek

Milestone(s):
Milestone 1:
A software wallet on the Filecoin blockchain that supports the creation, import, query, transfer, and withdrawal of FIL tokens
How this improves Filecoin:
Users in Filecoin community can join the Filecoin ecosystem more conveniently, follow and utilize Filecoin projects, and share the ecological dividend of FIL. The product is widely used by Helmsman, one of the Filecoin ecological projects, and has accumulated more than 50K real users so far.
Est Milestone Date:
3rd quarter of 2021

Milestone 2:
To create IPFS/Filecoin content nodes for flashnews, news and other content in the TJWallet mobile application
How this improves Filecoin:
Increase storage of trusted data in IPFS/Fileocin network and create IPFS/Filecoin community content
Est Milestone Date:
4th quarter of 2021

Milestone 3:
To develop a hardware wallet that supports the creation, import, query, transfer, and withdrawal of FIL accounts, and provide a safe and reliable FIL token management financial solution. At present, hardware wallets have been mass-produced and are widely used by various partners of Filecoin ecosystem. At the same time, retail versions have been put on sale in some regions.
How this improves Filecoin:
Users of Filecoin community can easily join the Filecoin ecosystem using a more secure hardware wallet, follow and utilize Filecoin projects, and share the ecological dividend of FIL
Est Milestone Date:
4th quarter of 2021

Milestone 4:
To reach in-depth cooperation with @IPFS-grandhelmsman a high-quality project in Filecoin ecology, to develop a big data system of FIL blockchain for the Filecoin ecosystem
How this improves Filecoin:
All the users in Filecoin community can use the FIL big data system to query FIL ecological nodes and data of user and developer, and also more conveniently participate in the Filecoin ecological community construction
Est Milestone Date:
4th quarter of 2021

Milestone 5:
The development of "Galileo", the miner monitoring system of Filecoin crypto ecology, can realize the status monitoring of all nodes, including but not limited to:
-Monitor lotus node, miner node, P1P2C1C2 and other packaging status of process operation;
-Monitor the real-time status of machine hardware;
-Monitor the status of miner's winningpost and windowpost;
-Real-time alarm of abnormal status;
-Log statistics and analysis;
How this improves Filecoin:
It is convenient for Filecoin ecological miners to pay attention to the node status and better serve the Filecoin ecological cluster. "Galileo" has been purchased by the Helmsman as an official utility tool at present
Est Milestone Date:
4th quarter of 2021

Milestone 6:
Reached in-depth cooperation with Helmsman and developed a FIL token financial dispersal system for Filecoin ecological miners. And the scheme has been adopted by the Helmsman
How this improves Filecoin:
All the mining pool developers of FIL blockchain can manage ecological users more conveniently, and realize the functions of batch issuance, batch settlement and batch management of FIL tokens
Est Milestone Date:
4th quarter of 2021

Milestone 7:
Develop the query entrance of FIL blockchain transaction record for the Filecoin ecosystem and disclose related API entrances
How this improves Filecoin:
Users of FIL ecology can use the open API entrance to conveniently query the direction information, source address and summary account information of FIL users, wallets and tokens
Est Milestone Date:
1st quarter of 2022 (Beta)
Relevant Links:
https://tjwallet.net/
https://twitter.com/TJ_Wallet
https://k.youshop10.com/BcJFDScV

[kaitlin-beegle]

Hi @liyunzhi-666, it looks like all of these milestones have already occured. Is this correct?

As a reminder, this roadmap only tracks future projects, not ones which have already launched. Thanks!

[liyunzhi-666]

here are some additions, please check. @kaitlin-beegle

Project Name:
TJWallet
Project Description (2-3 sentences):
The digital wallet @TJ_Wallet exclusively developed by @tengeek provides a one-stop digital asset management solution. "Software wallet + hardware wallet" dual mode, a blockchain wallet with both security and ease of use, a digital tool for the Filecoin ecosystem.
Key Contributors:
@TJ_Wallet
Team/Organization:
@tengeek
Milestone(s):

Milestone 1:

Provide bank-level security wallet: encrypted multi-signature hardware wallet
How this improves Filecoin:
The previous TJWallet products allow Filecoin community users to join the Filecoin ecosystem more easily, pay attention to and use Filecoin projects, and share the ecological dividends of FIL. The previous products have been widely used by Filecoin ecological projects and have accumulated more than 50K real users. On this basis, we will continue to deepen the security plan and launch a digital multi-signature wallet with bank security level
Est Milestone Date:
Q2 2022

Milestone 2:

On the basis of in-depth cooperation with the Filecoin ecological high-quality project party, the FIL blockchain big data system is deeply developed for the Filecoin ecology: provide more information query API (detailed cost calculation, including gas, mortgage, timeout penalty for each stage) , linear release of rewards earned, etc.)
How this improves Filecoin:
All Filecoin community users can use the FIL big data system to query the data of FIL ecological nodes, users, DApps and developers, and more easily participate in the construction of the Filecoin ecological community
Est Milestone Date:
Q3 2022

Milestone 3:

The development of the Filecoin digital ecological miner monitoring system "Galileo" can monitor the status of all nodes, including but not limited to:

• Monitor the package status of the lotus node, miner node, P1P2C1C2 and other processes;
• Monitor the real-time status of machine hardware;
• Monitor the status of miner's winningpost and windowpost;
• Real-time state abnormal alarm;
• Log statistics and analysis;
• Provide rpc public node cluster.
  How this improves Filecoin:
  It is convenient for Filecoin ecological miners to pay attention to the node status, and as a Filecoin ecological tool to better serve the Filecoin ecological cluster
  Est Milestone Date:
  Q2 2022

Milestone 4:
Deepen the technical application of IPFS/Filecoin, modularize the storage and calculation of filecoin, minimize the level of storage and calculation, and use small family computing boxes for distributed storage and computing
How this improves Filecoin:
Increase trusted data storage in IPFS/Fileocin network and build IPFS/Filecoin community content
Est Milestone Date:
Q3 2022

Milestone 5:
Develop a FIL blockchain transaction record query interface for the Filecoin ecosystem and expose related API interfaces
How this improves Filecoin:
FIL ecological users can use the open API interface to conveniently query the destination information, source address and aggregated account information of FIL users, wallets and tokens
Est Milestone Date:
Q1 2022 (Beta)
Relevant Links:
https://tjwallet.net/
https://twitter.com/TJ_Wallet

[lanzafame]

Project Name: Collateral Control Actor
Project Description (2-3 sentences): Actor based lending that is friendly to Storage Provider operations, i.e. allows the SP to retain ownership of the miner actor whilst providing on-chain guarantees to the lender that their investment is secure.
Contributors: @lanzafame, @whyrusleeping
Team/Organization: ARG
Milestone 1: Publish FIP proposal
Relevant Links: Coming soon.

[1ane-1]

Project Name:Genesis browser
Project Description (2-3 sentences):Genesis browser is a data browser based on filecoin network, which can perform statistics / analysis / monitoring / traceability of data on all chains of filecoin network, and is committed to creating an indispensable diversified browser in the filecoin ecology.
Key Contributors: 1ane-1
Team/Organization: Genesis browser
Milestone(s):1. Enhance traceability
Milestone x: 2. Try to embed multiple types of tools such as storage interfaces
How this improves Filecoin:
Est Milestone Date:2022 Q1
Relevant Links:http://www.ipfs6.com/

[kaitlin-beegle]

Hi @1ane-1, thank you for submitting this project! From the looks of the website, the dashboard has already launched. Is this correct?

[1ane-1]

yes, the Genesis Browser is launched.

[1ane-1]

Project Name:Shangding Cloud system
Project Description (2-3 sentences):Shangding Cloud system is a distributed storage system based on interstellar file system IPFS and backed up by filecoin network. With the mission of perpetuating human data, Shangding Cloud is committed to creating a distributed storage system with low cost / high security and privacy, so as to contribute to the ecologically effective data of filecoin.
Key Contributors: @zoe
Team/Organization: SD Group
Milestone(s):1. Provide cool storage experience.
How this improves Filecoin:
Milestone x:2. Explore the original universe Portal track
Est Milestone Date:2022Q1
Relevant Links:https://www.sdcloud.top/

[kaitlin-beegle]

Hi @1ane-1, much like the above, this looks to have already launched. Can you confirm please?

[1ane-1]

Hi @1ane-1, much like the above, this looks to have already launched. Can you confirm please?

The Shangding Cloud is going to be lunched in Q1.

[kaitlin-beegle]

Thanks, everyone, for your contributions! The submission period for this quarter's roadmap is now closed; the discussion has been locked.

Be on the lookout for the community roadmap, landing in the next few weeks!

And, if you missed this opportunity to contribute your work, fret not: the roadmap will be updated quarterly. Be on the lookout, as the next update cycle will begin mid-March.

[momack2]

(locking the discussion locked comment replies too! I think there might also be a few late-breaking updates. that folks should still be able to add. AFAIK this is a 2022 roadmap, and we can just do progressive updates to visualizations over time =]

[kaitlin-beegle]

Oh, thanks for the heads up! I thought it only locked new comments on the thread.

But yes! This will be updated quarterly, but I'll kick of a new thread each quarter, and follow up 1:1 with previous projects. Don't want this thread to become unwieldy, and don't want to bias projects that are already accounted for!