Please describe your proposed solution.

Problem:

Modern applications, especially the ones involving ML and AI need access to massive amounts of big data. Hosting databases on a cloud is expensive and makes data storage centralized to big data providers, hindering access to data sources directly from decentralized networks.

Unique solution:

The proposed solution is to enable consumers to deploy an Elasticsearch cluster with custom configuration on decentralized hardware available via NuNet.

NuNet will enable anyone with eligible devices to host Elasticsearch nodes, configure them into clusters and be rewarded via Cardano Smart Contracts. For these purposes a number of new features will be added to the platform.

More info on the many application areas of Elasticsearch can be found here:

<https://www.elastic.co/>

All these application areas could be enabled to run on NuNet as an alternative to big cloud service providers.

Detailed approach:

This solution will add new features on the existing NuNet platform. The solution can be seen from three perspectives: 1) consumer, 2) provider and the 3) NuNet platform.

Consumers:

A consumer will be able to request the deployment of Elasticsearch cluster with custom configuration via the NuNet network. When this solution is done, a consumer will either select nodes to create a cluster or they will be automatically assigned machines based on cluster configuration and available machines. The consumer will be able to access, monitor and manage the cluster.

Providers:

Currently device providers on NuNet can onboard their device and provide compute resources for running machine learning workflows. This use-case solution and new platform features will enable providers to host Elasticsearch nodes as they will.

NuNet platform:

New features will be added on the NuNet platform so that Elasticsearch clusters can be formed dynamically as per consumer requests and hosted for the predefined time or indefinitely. Under the hood, NuNet platform will treat Elasticsearch nodes as a single continuously running job. So, the existing design and components of NuNet are suitable to manage the Elasticsearch cluster.

Benefits for the Cardano ecosystem:

This solution is important to Cardano in two ways:

First, projects which need data hosting and indexing solutions, like NuNet’s partner IAMX, which retrieve data from the Cardano nodes and store it on the cloud providers, will have a better alternative to store their data on decentralized hardware. Elasticsearch provides many other application areas where it could be deployed.

Second, the payment for these services will be in NTX (a Cardano native token), where each transaction will be executed as a Smart Contract on the Cardano blockchain which will directly increase the volume of tx, volume of CNT as well as provide unique use cases to be built on top of it for the Cardano ecosystem. This will provide flexible data hosting pricing and use-case monetization options for Web3 application developers.

How does your proposed solution address the challenge and what benefits will this bring to the Cardano ecosystem?

The proposal addresses the following directions of the challenge:

• Data oracles, indexers & explorers

This project helps solutions that store and consume blockchain data, along with any other data that needs to be efficiently indexed and queried. Cardano blockchain explorers can deploy Elasticsearch clusters on NuNet and configure them in order to perform fast custom queries for internal use or providing services for the community. This encourages more blockchain exploration and data storage / indexing solutions to be implemented and monetized via the Cardano ecosystem.

Also, other startups building novel solutions in the ecosystem that need a database for their application logic will get an advantage and a head start.

IAMX partnership

One of the direct project benefits is the deployment of Elasticsearch clusters on NuNet, specifically configured for project partner’s IAMX use-case, which will serve for the first real-world usage and reference implementation. IAMX currently has a workflow where they have the need for an Elasticsearch cluster, which is in turn deployed on their cloud/bare metal systems.

IAMX is developing their own KYC/KYC solution on the Cardano blockchain and uses a Cardano native token IAMX for their processes.

This partnership between two Cardano native projects will be a direct benefit for the Cardano ecosystem. In addition, when live, this feature will enable Elasticsearch use cases to be used by the wider Cardano community as well as anybody willing to deploy it on decentralized systems - NuNet.

More about IAMX: <https://iamx.id/>

How do you intend to measure the success of your project?

This proposal is an implementation and can be measured with the total number of consumers, providers and Elasticsearch cluster deployments.

NuNet will be monitoring the adoption of the solution and reporting direct interest and users during the project milestones. We anticipate at least 1 partner to be onboarded.

Some of the direct benefits to the Cardano ecosystem are:

• Computing resources used in the processes will be compensated in NTX, which is a Cardano Native Token
• Each exchange of value will be done as a Smart Contract on Cardano
• Currently over 2000+ people are in NuNet Discord testing the various builds of the NuNet platform

The indirect benefits to the Cardano ecosystem is:

• Other solutions in the Cardano ecosystem will be able to deploy Elasticsearch cluster on NuNet and provide a decentralized hardware provision for data storage and exploration needs;
• Moreover, implementation of platform features, needed to deploy Elasticsearch clusters via NuNet will enable further development of data hosting solutions via NuNet using mainstream databases

Please describe your plans to share the outputs and results of your project?

Spreading Outputs Over a Timescale

Our project plan includes clear milestones and deliverables, which will be shared publicly as they are completed. This incremental release of outputs will ensure a continuous stream of updates for the community.

This approach lets us provide updates on a regular basis, and offers users the chance to provide feedback that we can use to guide subsequent development.

Sharing Outputs, Impacts, and Opportunities

We intend to leverage various communication channels to share our project's outputs, impacts, and opportunities:

1. GitLab: The primary hub for our technical work, hosting our codebase, documentation, and issue tracking. This will be the main point of reference for the details of our project.
2. Social Platforms: We plan to regularly post updates on our progress on platforms like Twitter, LinkedIn, and Reddit. This will include major milestones, bug fixes, and insights from our development work.
3. Technical Discussions: We will continue to hold weekly technical discussion where we discuss the technical aspects of our work. This provides a forum for live Q&A and discussion with our community.
4. Blogs: A regular blogs to summarize the progress we have made, highlighting key achievements and outlining the next steps in our project.

Testing and further research

As an open-source project, our outputs will be freely accessible for further research and development. We encourage the community's involvement in testing our solutions to enhance their real-world performance.

Community Testing: We'll invite our users to participate in alpha and beta testing phases, where they can help identify bugs and suggest improvements. We'll use GitLab's issue tracking for managing feedback and provide guidelines for issue reporting and feature suggestions.

Internally, we'll use project insights and community feedback to guide our future work, optimize performance, and prioritize new features. Our aim is to foster a collaborative development ecosystem that is robust, relevant, and of high quality.

What is your capability to deliver your project with high levels of trust and accountability?

Illustration of Capacity:

Our organization comes with a history of successfully bringing intricate technology projects to fruition. The pillars of our success lie in our deep-rooted technical understanding, stringent project management practices, and an unwavering focus on transparency and responsibility.

Our team is populated with seasoned software engineers with excellent skills to leverage containerization (Docker), Elastic Stack , Blockchain and peer-to-peer networking (Go libp2p). NuNet past work includes the implementation of projects in some sense similar to the one proposed here, showcasing our readiness to tackle the unique challenges this project poses.

NuNet is committed to Open Source Software development from the inception. Therefore, all our development and progress is available for public scrutiny at all times as well as open collaboration with the community. We actively invite and work with the community in regards to contribution, usage, work and testing of the platform codebase.

Link: <https://gitlab.com/nunet>

NuNet licencing policy:

<https://docs.nunet.io/nunet-licensing-policy/>

Openness and Responsibility:

We have established a robust framework to ensure openness and responsibility in the execution of the project and the management of finances:

1. Elaborate Budgeting: We present an exhaustive budget layout at the start of the project that details the fund allocation across various tasks. This leaves no room for ambiguity regarding the utilization of funds.

2. Periodic Reporting: Regular updates regarding the project and financial statements will be shared, offering complete transparency into the progression of the project and the use of funds.

3. External Auditing: We are open to audits conducted by independent third parties at regular intervals. This ensures responsibility and openness in our financial management.

4. Escrow Mechanisms: To further reassure proper use of funds, we can utilize an escrow service. This arrangement ensures that the project funds are held by a third party and released according to pre-set milestones. This provides an extra layer of assurance for the funds.

5. Payment Based on Milestones: Our payment structure is built around specific, agreed-upon milestones. This ensures that funds are released as we achieve these milestones. The completion of each milestone can be verified, ensuring you pay only for verifiable progress.

These measures reflect our commitment to openness, responsibility, and proper management of funds. We believe that these factors, along with our technical capabilities, make us an ideal choice to successfully execute this project.

We understand that not all steps we have implemented are valid for the Catalyst proposal but it demonstrates the internal working procedures we have in place.

Catalyst Experience

NuNet also has received the funding for proposals in Fund7 and Fund8. One proposal is successfully closed and the other is close to completion with one technical obstacle left to be solved. Overall, the funds were spent as intended on the development which can be monitored on Gitlab with daily commits since the award.

<https://gitlab.com/groups/nunet/-/milestones/19#tab-issues>

<https://gitlab.com/groups/nunet/-/milestones/20#tab-issues>

Financial Stability

As a 28+ strong team, we have independent funding to develop the core platform with a cash runway for at least 1-1.5 years. Cardano Catalyst proposals are used to extend the functionality and add features to the platform in order to enrich the possible use cases.

The financial report is publicly available and can be reviewed here:

<https://medium.com/nunet/nunet-financial-report-2022-and-outlook-for-2023-405d38397629>

What are the main goals for the project and how will you validate if your approach is feasible?

Main goals:

1. Enable consumers to deploy Elasticsearch clusters on NuNet

This project enables a consumer to deploy an Elasticsearch cluster with a fair price. On the other hand, a computer device provider can host an Elasticsearch node and can get paid for that.

2. Decentralize Elasticsearch cluster

The existing approach of deploying databases on cloud providers leads data to be centrally hosted by few big tech companies. By allowing databases to be deployed and monetized on decentralized hardware, this project opens up an unlimited number of use cases and further development of decentralized data storage and granular monetization leveraging mainstream database solutions.

3. An alternative data hosting for NuNet partners including IAMX

Use case partners or third party developers leveraging the NuNet network (like IAMX) will be able to deploy Elasticsearch services on NuNet. These companies will have a decentralized, more dynamic and potentially cheaper alternative to current solutions.

4. NuNet will use it for the system observability purposes

Currently NuNet is running its observability infrastructure that involves Elasticsearch cluster deployed on a cloud server. This solution will allow NuNet to run its own infrastructure on its own network and enable this for other software development companies.

Please provide a detailed breakdown of your project’s milestones and each of the main tasks or activities to reach the milestone plus the expected timeline for the delivery.

Milestone 1: Project Commencement and detailed architecture design

• Main Tasks / Activities:
• Forming the squad, building communication platforms, conducting weekly brainstorming sessions for comprehensive understanding of the Cardano universe and its latest computational offerings, identifying the prerequisites for a distributed database hosting, drafting a comprehensive project blueprint and architecture design, and conducting a practicability study based on the specified prerequisites and available resources.
• Expected Delivery Time: 5-8 Weeks

Milestone 2: Implementation of detailed architecture

• Main Tasks / Activities:
• Implement ability for compute providers to broadcast their availability to run Elasticsearch nodes and network topology to the network;
• Implement functionality to create Elasticsearch cluster configuration and propagate it to the network;
• Implement functionality to correctly receive deployment request on a selected compute provider;
• Implement functionality to deploy Elasticsearch node container and connect to the cluster;
• Expected Delivery Time: 4-12 Weeks

Milestone 3: Internal, community testing and resolving additional issues

• Main Tasks / Activities:
• Internal testing on closed testing network;
• Testing in cooperation with partner IAMX by deploying the service and their specific processes;
• Large scale community testing on testnet/preprod;
• Resolving bug reports and implement identified additional features;
• Expected Delivery Time: 4-12 Weeks

Milestone 4: Production release

• Main Tasks / Activities:
• Release of the tested solution and features on the Cardano mainnet;
• Expected Delivery Time: 3-8 Weeks

Milestone 5: Technical documentation and result dissemination;

• Main Tasks / Activities:
• Writing documentation
• Dissemination of results in the community
• Expected Delivery Time: 2.5-4 Weeks

Please describe the deliverables, outputs and intended outcomes of each milestone.

Milestone 1: Project Commencement and detailed architecture design

• Deliverables: Project blueprint, general architecture and applied research, practicability analysis, project roadmap, defining risk management strategy and resource allocation plan.
• Outcomes: Detailed documents of all strategies, including a timeline, resource distribution, and dependencies.

Milestone 2: Implementation of detailed architecture

• Deliverables: Updated platform components (DMS) with modified data format, advertising willingness to host Elasticsearch nodes, functionality of required hardware and network capacity properties, matching and searching for required nodes for the specified Elasticsearch cluster functionality, connecting nodes into the cluster inside NuNet’s peer-to-peer network;
• Outcomes: New device and job metadata format and related functionality, option for data hosting availability advertising on the platform, increased number of applications using NuNet network with requirement of data access.

Milestone 3: Internal, community testing and resolving additional issues

• Deliverables: Extensive testing of the system under different conditions and gathering feedback to make improvements to the system specified in a documented format; fixes based on the community testing
• Outcomes: A reliable and robust system that meets the defined requirements and delivers the desired functionality.

Milestone 4: Production release

• Deliverables: Deployment of the finalized and tested system on the Cardano mainnet.
• Outcomes: A live, functioning system on the Cardano mainnet enabling customers to request Elasticsearch clusters and compute providers to deploy their nodes and get rewarded for actual compute resources used for that.

Milestone 5: Technical documentation and result dissemination;

• Deliverables: Prepared comprehensive technical and usage documentation for users and community developers;
• Outcomes: Users are trained and informed on how to effectively use the system and deploy Elasticsearch clusters, improved ability to develop full applications involving data access and storage on mainstream databases on decentralized hardware, increased number of NTX settlement transactions on Cardano blockchain and in general.

Please provide a detailed budget breakdown of the proposed work and resources.

Each project is examined in great detail which can be seen in the proposed budgeting sheet. This results in pre-feasibility and feasibility studies which minimize the risk of budget overruns.

Project management in NuNet is on a high level with employed techniques such as Agile, Scrum, CCPM and others resulting in a good daily overview of the project progress.

The project is complex and involves research and development uncertainties however, NuNet is a well funded deep tech startup and in case of budget overruns will continue to develop until delivered due to this being a critical part of the overall NuNet development plan. This is evidenced by the funding received in Cardano Catalyst Fund 7 and 8 where NuNet has continued the work despite the substantial unexpected technical roadblocks and time impact.

Who is in the project team and what are their roles?

NuNet is a deep tech startup that is developing cutting edge solutions in the decentralized open source space. Currently, there are 28+ people in NuNet working on delivering use cases, primarily for Cardano. On top of that,

As a SingularyNET spin-off, NuNet has access to 100+ AI and software engineers for support. Main team members responsible for this proposal are presented below.

The NuNet Team working on this project:

Name: Kabir Veitas, PhD AI, MBA

Location: Brussels, Belgium

LinkedIn: <https://www.linkedin.com/in/vveitas/>

Position: Co-Founder & CEO

Bio:

Working in the computer software, research and management consulting industries with demonstrated experience. Skilled in Artificial Intelligence, cognitive and computer sciences, systems thinking, technology strategy, strategic business planning, management and social science research. Strong operations professional with a Doctor of Philosophy - PhD focused in Multi/Interdisciplinary Studies from Vrije Universiteit Brussel.

Name: Janaina Senna, MSc CS, MBA

Location: Belo Horizonte, Brasil

LinkedIn: <https://www.linkedin.com/in/janaina-farnese-senna/>

Position: Product Owner

Bio:

Master's degree in computer science and played different roles over the past 20 years, such as development manager, tech lead, and system architect, helping organizations launch new software and hardware products in the telecommunication and energy areas. As a product owner, she has shaped the product vision into manageable tasks and constructed the bridge between developers and stakeholders. She enjoys seeing products coming to life!

Name: Dagim Sisay Anbessie, BSc CS

Location: Addis Ababa, Ethiopia

LinkedIn: <https://www.linkedin.com/in/dagim-sisay-7b4b05b8/>

Position: Tech Lead

Bio:

Experience in projects in the areas of Robotics, Machine Learning, System Software Development and Server Application Deployment and Administration for several international clients. At SingularityNET he worked on AI and misc. software development. Main responsibilities lay in researching the development path, technology to be used and directing specific tasks to the dev team. Additionally, he has been involved in system development when circumstances demand it.

Name: Yitbarek Yohannes, MSc CS

Location: Pisa, Italy

LinkedIn: https://www.linkedin.com/in/yitbarek-yohannes-7b044714b/

Position: Developer

Bio:

Has experience in Fullstack development, ELK stack , Blockchain and AI projects. He has been engaged with SingularityNet projects since 2018.

Name: Sam Lake

Location: Phuket, Thailand

LinkedIn: https://www.linkedin.com/in/sam-lake-a04698127/

Position: Dev Rel / Community testing

Bio:

30 Years Experience in delivering projects in the areas of IT Infrastructure / Cloud / Networking/ IOT Sam's responsibilities at NuNet are working alongside the development team to test and provide input into solutions being developed as well as handling communications with and input from the community.

Name: Jennifer Bourke, BA, MSc

Location: Dublin, Ireland

LinkedIn: https://www.linkedin.com/in/jennifer-bourke-1bb286158/

Position: Marketing and Community Lead

Bio:

A data-driven marketing expert with a postgraduate degree in digital marketing and data analytics. Currently pursuing a postgraduate degree in global leadership, she combines her strategic marketing skills with a global perspective. With over 6 years of experience, Jennifer has a proven track record of driving successful marketing campaigns.

Name: Ilija Radeljic, MSc CE

Location: Oslo, Norway

LinkedIn: <https://www.linkedin.com/in/ilija-radelji%C4%87-2108ab14/>

Position: Director of Operations and Business Development

Bio:

Corporate industry veteran and AI&Blockchain enthusiast. This combination brings a wealth of 15 years of experience managing major infrastructure, power and manufacturing projects to the emerging blockchain world and its applications.

15+ years of experience in business negotiation, partnerships, leads, market entry, project management, promotion and presentations worldwide.

Formal engineering education, MSc Civil Engineering + MIT Sloan Executive Management and Leadership certified.

Cardano Catalyst Community Advisor and Cardano Catalyst Veteran Community Advisor since the beginning (Fund2) and consulted several funded proposals in Cardano Catalyst.

External auditors:

NuNet is also collaborating with the external auditing company Obsidian (<https://obsidian.systems/>) which has been contracted to audit the core platform development as well as specific use case integrations such as this one.

We intend to extend their contract (or hire another suitable 3rd party auditor) for auditing the implementation of this research work as well.

External support:

NuNet has a capable team (28+) to tackle the project but sometimes some extra resources or skills might be needed outside of the available pool. This will be sourced either as additional employees or subcontracted depending on the size and length of the development.

How does the cost of the project represent value for money for the Cardano ecosystem?

The costs of the project are based on the average salary levels of engineers currently employed by NuNet. Since the team is fully distributed and remote, it is challenging to have a suitable median cost that covers the range of countries (India, Pakistan, Ethiopia, Brasil, Egypt, UAE, UK, Italy and others).

We believe that the costs are reasonable and reflect the seniority and knowledge of various positions involved in the delivering of the proposal.

In line of full openness, in the budget table can be seen the very granular distribution of costs, all the way to the hours of each position for each milestone.

In addition, fully remote workers can compete for jobs in Western countries driving the individual compensation levels much higher than in their native countries.