Solution Highlights
- Implemented software integrations to automate data entry, cutting time from hours to minutes
- Designed ETL/ELT pipelines to process and validate data in real-time
- Improved data accuracy and consistency across Indigo’s systems
- Enhanced user experience, reducing abandonment and boosting sales
About the Project
Customer:
Indigo Ag is a leading agritech company focused on enhancing farmer profitability and environmental sustainability through nature-based and digital technologies. The company’s key offerings include Carbon, Market+, and biotrinsic, which work together to optimize the production, sourcing, and distribution of crops.
As a promising environmentally friendly solution, Indigo’s Carbon program pioneers agricultural carbon credits, encouraging farmers to adopt sustainable practices while generating registry-issued credits for their efforts.
Challenges & Project Goals:
Indigo initially approached us to reduce manual data entry. The company wanted to develop software integrations with third-party data providers to automate manual input of extensive data, such as seed types, field locations, watering schedules, and fertilization practices.
“The data entry which could take up to 8 hours. This was inconvenient for users and led to the loss of clients who abandoned the process midway. So, the primary goal was to reduce data entry time and, consequently, boost sales success.”
Solution:
Intelliarts implemented software integrations that enabled Indigo to automatically transfer data from external sources and fill in the needed fields in advance.
By designing ETL/ELT pipelines with a medallion architecture, we ensured high data quality and streamlined data governance across Indigo’s platform. Additionally, we integrated a finite-state machine (FSM) for managing complex data workflows, further enhancing accuracy and efficiency.
As planned, this streamlined approach reduced the data entry time but also enhanced data accuracy across their carbon credit system.
Technology Consulting, Software Engineering, R&D, Data Engineering
Data Analysis, Cloud Services, Big Data, Business Intelligence & Analytics
Technology Solution
Project kickoff and establishing data partnerships
In the beginning, Intelliarts engaged in thorough discussions with Indigo Ag to understand their business needs, challenges, and existing processes. Indigo’s vision was clear: they wanted to eliminate time-consuming manual data entry and automate processes by developing software integrations with third-party data providers.
After these initial meetings with Indigo, the Intelliarts team focused on establishing partnerships with third-party data providers. We looked for companies that gather and aggregate relevant agricultural data, which we then planned to convert into the right format and transfer directly to Indigo’s system.
Designing advanced ETL/ELT pipelines
Our next step was to develop a range of software integrations, enabling automated data transfers from these external sources and filling in the needed fields in advance, significantly reducing manual data entry.
The cornerstone of our solution was designing a robust set of ETL (Extract, Transform, Load) and ELT (Extract, Load, Transform) pipelines. These pipelines were designed to process and validate data in real time, ensuring that only accurate and relevant information reached Indigo’s system. Our ETL/ELT architecture allowed us to capture data as it arrived, standardize it into the correct formats, and transform it into structured fields, ready for use. This careful orchestration of data flow was essential in reducing data entry time, enhancing data consistency, and making the entire system more resilient to errors.
Finite-state machine (FSM) for workflow management
The complexities of aggregating, validating, and processing diverse data from multiple external sources demanded a strong workflow management framework. To support complex integrations with external data providers, we implemented an FSM model, which allowed us to manage different states and transitions within the integration processes. This ensured smooth data flows and robust workflow management across various inputs.
Structured data processing with medallion architecture
For ETL/ELT pipelines, we applied a medallion architecture. This layered approach organizes data into bronze, silver, and gold stages, ensuring a clear progression from raw data to refined, high-quality insights. The bronze layer stored raw data as it arrived from third-party sources, while the silver layer transformed and cleaned this data to make it usable for Indigo’s operations. The gold layer then held fully refined, high-quality data for in-depth analysis and actionable insights. This approach did not only enhance data quality but provided better data governance across the entire pipeline.
Business Outcomes
The implementation of software integrations by Intelliarts delivered substantial improvements to Indigo Ag’s operational efficiency and user experience, directly benefiting their Carbon program and sales success. Among the key benefits:
- Data entry time was reduced from up to 8 hours to several minutes, minimizing user frustration and improving client retention.
- The automated processes minimized errors in data entry, ensuring consistent and reliable data across Indigo’s Carbon program.
- With a streamlined user experience, Indigo saw fewer abandoned processes, making the system easier and faster.
- Indigo also improved user satisfaction, boosting overall sales, thanks to smoother workflows and better data reliability.
