Increasing Velocity to Answers
Increasing Velocity to AnswersWhy we built qsv pro
Why we built qsv pro
Without exception, DATA QUALITY, or the lack of it has been a universal problem across all our implementations since we started deploying data portals in 2011.
And the problem is just getting worse as the five V‘s of Big Data – Volume, Velocity, Variety, Veracity, and Value are ever-increasing, and doing so on a logarithmic scale.
Ironically, our largest customers – even with their dedicated data science staff and access to enterprise solutions, actually have it worse! As every organization is now a digital organization – we all produce and consume data.
And the data-wrangling “duct tape” we often see at the edges – bespoke, slow Python scripts and hand-curated Excel macros, are just ill-suited for the “last-mile” curation required to maintain an authoritative enterprise data catalog.
To date, data-wrangling is still an error-prone task requiring specialized tools and skills – taking an inordinate amount of time even if you have access to qualified resources.
Excel is the go-to solution for most people. But its hard limit of 1 million rows is small by today’s standards.
We need something that is blazing fast, can handle millions of rows of data, has a familiar Excel-like interface, with ready access to common “data-wrangling” tasks and recipes that ANYONE can use without specialized training. It needs to be able to tap into the raw power of today’s hardware; automatically derive and infer metadata; normalize, enrich and link your data with data from authoritative sources; and leverage the latest technologies; all while being able to work with your existing data-wrangling investments.
All towards increasing our Velocity to Answers.
That’s why we built qsv pro.
qsv pro is datHere’s spreadsheet data wrangling desktop app available for compatible Windows, macOS, and Linux systems. Explore your spreadsheet data (including Excel, CSV, ODS, and more), interact with your CKAN instances, and much more with qsv pro’s modern data wrangling, analytics, and engineering suite.
qsv pro’s 6 core features
qsv pro presents 6 core features at varying stages of progress and more features are planned as described below.
The following features are displayed and described based on a paid plan of qsv pro.
qsv pro Workflow
Drag and drop your spreadsheet data into the qsv pro Workflow. Once imported successfully, you may browse statistics, frequency, and metadata about your file. Run Polars SQL queries, run recipes, view your file with csvlens on Windows, search your file (optionally by regex), export to multiple file formats, download and upload from/to compatible CKAN instances, and more.
qsv pro Toolbox
Run tools in qsv pro’s Toolbox, where tools are straightforward scripts including “Copy CSV to clipboard”, “Sort CSV rows”, “Get CSV row count”, and more.
qsv pro Flow
Engineer data pipelines using an interactive node-based UI. Access multiple qsv commands and pipe them together along with custom nodes to architect data pipelines. Share or import your pipelines with other qsv pro users. More qsv commands are planned for inclusion in qsv pro Flow.
qsv pro Configurator (Experimental)
Run qsv commands in a graphical user interface and explore its stdout and stderr as raw output. The command’s elapsed time is also provided. Not all commands are supported and this feature may be broken/outdated.
qsv pro API
Interact with the local qsv pro API server from other apps and services such as importing a file path into the qsv pro Workflow or on Windows launching an Alacritty terminal running csvlens on a provided file path. Explore the API’s capabilities through locally served API documentation or through the qsv pro command available on the qsv command-line tool. qsv pro closes to the system tray so that you may continue to use the API with the window closed (some endpoints may have conditions to work properly such as having the Workflow open for the Workflow endpoint).
qsv pro command
Use the qsv pro command available on the qsv command-line tool to import local files by their file path into the qsv pro Workflow. On Windows, launch an Alacritty terminal running csvlens on the file.
What does qsv pro v1 have to offer?
qsv pro is built with Tauri and uses the qsv command-line tool (built with Rust) for various data wrangling operations primarily with spreadsheet data. To bridge the gap between the terminal experience with qsv and an audience that may be unfamiliar with command-line usage along with the convenience of a modern data wrangling suite, qsv pro offers a new way to explore, analyze, transform, and download/upload spreadsheet data.
Conclusion
You may download qsv pro and try its free plan or purchase license keys for unlocking features from qsvpro.dathere.com. Also, your company may receive qsv pro licenses by connecting with us as part of datHere’s CKAN DMS framework.
If you find any issues or need any further assistance, you may reach out at support.dathere.com.
Open Datanaut, Open Source contributor, SemTechie, Urbanist, Civic Hacker, Futurist, Humanist, Dad, Hubby & Social Entrepreneur on a 3BL mission.
I oversee the design, development, and implementation of innovative data solutions for clients. My expertise in data management, data quality, and data integration has been integral to driving data-driven decision-making. I am passionate about creating a culture of data-driven innovation that enables organizations to stay ahead of the competition.
Software engineer who enjoys building projects & sharing what I learn.
I'm interested in various technologies including Python, Rust, Tauri, Next.js, React, TypeScript, SQL, & much more.
Leave a Reply
You must be logged in to post a comment.