diff --git a/docs/blog/0.19.md b/docs/blog/0.19.md new file mode 100644 index 00000000000..1407ec0ca8b --- /dev/null +++ b/docs/blog/0.19.md @@ -0,0 +1,29 @@ +--- + +date: 2023-01-18 +image: https://user-images.githubusercontent.com/5587788/213252791-17125a21-52c9-4821-9005-981c9b1e94ca.png + +--- + +# Rill 0.19 – Embed data sources in models + +:::note +⚡ Rill Developer is a tool that makes it effortless to transform your datasets with SQL and create powerful, opinionated dashboards. + +To [try out Rill Developer, check out these instructions](/#pick-an-install-option) and [let us know over on Discord](https://bit.ly/3bbcSl9) if you encounter any problems or have ideas about how to improve Rill Developer! +::: + +![embed-source](https://user-images.githubusercontent.com/5587788/213253704-497451bb-bc13-46a0-890f-59c935c95c1f.gif "790508438") + + +This release of Rill Developer introduces a new way to start your analysis by directly embedding sources into model `FROM` statements. This means you can jump directly into your data project without fiddling with the inputs and tabs needed to manually create a source reference through our modal. With embedded sources, we check for valid URIs to ingest and cache the source in Rill Developer to keep things incredibly fast as you elaborate upon your query. The result is a magical, fast, frictionless querying experience from the moment you identify an interesting data set. + +- **Embed sources directly into models —** *Fast and simple* are core value here at Rill. To this end, we are introducing an experimental feature where you can define your source directly in the model. The ability to embed sources in models eliminates the navigation complexity of sources and makes it easy to jumpstart modeling with a simple `FROM` statement and a `uri`: + + ```bash + FROM "s3://bucket/partition.parquet" + ``` + + — check it out and let us know what you think on [Discord](https://bit.ly/3bbcSl9)! *Note that embedded sources do not have total feature parity with parameters explicitly defined sources in the modal.* + +- **Create dashboards without timeseries data —** Data comes in all shapes and sizes, however historically our dashboard had hard requirements around the types needed to create an interactive dashboard - primarily a timeseries column to generate temporal line charts. Though the dashboard was designed with time series line charts in mind, digging into catalogs and lookup table metrics can be incredibly useful for for understanding what is available and how to refine dimension value labels for consumption by people. To support this workflow, we have relaxed timeseries constraints and it is now possible to present leaderboards and big-numbers without charts. diff --git a/docs/docs/using-rill/import-data.md b/docs/docs/using-rill/import-data.md index 16687ef7c3a..f4e5648c985 100644 --- a/docs/docs/using-rill/import-data.md +++ b/docs/docs/using-rill/import-data.md @@ -13,6 +13,12 @@ Rill supports several connectors for importing data: local files, download from To import a file using the UI, click "+" by Sources in the left hand navigation pane, select "Local File", and navigate to the specific file. Alternately, try dragging and dropping the file directly onto the Rill interface. +*Experimental: Alternatively, you can directly query sources from within the [model](https://docs.rilldata.com/using-rill/sql-models) itself using a `FROM` statment and `path` with double quotes around it.* + +``` +FROM "/path/to/data.csv" +``` + ### Using the CLI You can also add a local file directly using the Rill CLI. To do so, `cd` into your Rill project and run: @@ -41,6 +47,12 @@ Note that if you provide a relative path, the path should be relative to your Ri ### Using the UI To add a remote source using the UI, click "+" by Sources in the left hand navigation pane and select the location where your remote files are stored ("Google Cloud Storage", "Amazon S3", or "http(s)"). Enter your file's URI and click "Add Source". +*Experimental: Alternatively, you can directly query sources from within the [model](https://docs.rilldata.com/using-rill/sql-models) itself using a `FROM` statment and `uri` with double quotes around it. If you need to parameterize your URI for region authentication, we recommend using the modal.* + +``` +FROM "https://data.example.org/path/to/file.parquet" +``` + After import, you can reimport your data whenever you want by clicking the "refresh source" button in the Rill UI. ### Using the CLI